Test Center of Excellence (CoE) face a dilemma today. Testing processes haven’t kept up with Agile and continuous software delivery trends. Instead of facilitating speed, testing has become a real bottleneck – forcing a tough tradeoff between speed and quality. Software test automation has never been more important. We recently discussed CA’s vision of a Center of Developer Excellence (CoDE), which addresses the current disconnect between continuous software delivery trends and testing practices. In today’s blog, we show you how adopting a quality assurance (QA) framework that can extend test coverage for your Test CoE, and accelerate test automation that help launch better software faster.
Elevate and broaden the role of Test Automation in the Test CoE.
It’s time to decentralize testing to make app teams accountable for code development, testing and deployment. But that doesn’t mean your Test CoE gets relegated to the sidelines. On the contrary, it’s time to recognize that to make decentralized testing a success, you will need to take on a broader leadership role when it comes to test automation – in establishing and enforcing standards, identifying best practices, mentoring functional teams, and brokering the tools and resources needed to produce top-quality software at speed.
An important first step is to set the stage and establish a flexible, cross-functional QA test automation framework that will integrate and support all types of testing. From on-demand functional tests at the desktop to cloud-based performance tests run at load and in parallel across varying networks.
While any QA framework you establish should reflect the unique needs of your business, several important characteristics will be fundamental to success:
- Open-source compatible. Your framework should support scripting and test creation using the open-source tools developers are already using in their IDE – from JMeter and Taurus to Selenium and Appium. Leveraging contributions of a large open-source community, define and orchestrate test scripts from your local machine, to scale and re-use test scripts when ready.
- Multiple provisioning options. Team members should be able to run tests on-demand at the desktop or from multiple geographical locations within a public or private cloud. Be able to scale up to millions of virtual users in an instance – and to do so across distributed project teams in the business.
- Automation. You’ll want to automate static code analysis, unit tests, functional tests and performance tests so they can be launched from simple API calls, including multiple tests run in parallel in different environments. And you want to be able to do this all from a single integrated toolchain that minimizes management complexity.
- Configurability. You should be able to combine and reuse various test modules as part of a single configuration so you can evaluate software build, release and production snapshots. Be able to performance engineer for quality and accelerate test automation across a continuous integration/continuous delivery (CI/CD) application pipeline.
- Reporting. For a continuous feedback loop, you’ll want to integrate the reporting solutions your teams use (e.g. Jenkins Performance Trend and others). You’ll also want to be able to group tests by builds, create pass/fail trend reports, and produce “deep dive” diagnostics by dedicated workspaces that offer a centralized view for the Test CoE
Automate Testing Early and Often with BlazeMeter
In the age of the modern software development lifecycle (SDLC), if your Test CoE relies on a proprietary test platform, it can become a real challenge to establish a test automation framework that will meet the application QA needs for ten/hundreds of distributed Agile teams across your business. One that helps deliver quality applications rapidly to market. That’s why we’ve built our BlazeMeter platform to help the Test CoE extend test coverage for the Agile teams. Accelerate test automation for quality application release across the CI/CD pipeline while making use of legacy IT investments made.
Designed to be open source, BlazeMeter embraces the benefits of rich community based contributions for continuous improvements. We do so while avoiding the heavy costs of vendor lock-ins and the pain/hassle of feature upgrades. With continued developer investments to the open source community (e.g. JMeter), BlazeMeter is well placed to help organizations that wish to continue their QA test automation journey into open source. In transforming the Test CoE to adapt to the proliferation and complexity that Agile development and DevOps delivery brings.
A SaaS based platform that offers ease of adoption, BlazeMeter bridges legacy test platforms today. Providing the agility for on-demand application performance testing and a high service level availability to meet the needs of your Agile teams. With cost efficiencies from an enterprise grade toolchain that is 100% compatible with industry leading open source testing tools. At the while, Agile teams can do so without leaving their favorite application development tool. With Taurus, Agile teams are able to test early and often on their own, without overwhelming the already limited resources of the Test CoE. They can write and run tests right off their local machines the moment that code is written. Developers can perform frequent small finite scoped tests on their code in a self-contained IDE environment of their choice. Once ready, teams can then push their code into commit, re-use the test scrips as they scale for performance testing within the Test CoE. This is an area where BlazeMeter helps developers code more, wait less – in helping the Test CoE draw up best practices of adapting to the needs of Agile developer teams.
With BlazeMeter, everything is drag and drop, to load and go with no proprietary language to learn. Testing can become decentralized and multifunctional, with the Test CoE brokering for automated tools and test resources consumed by Agile teams in their designated workspaces. As Test CoEs see the democratization of test services to the Agile teams, they do so with visibility of usage by teams through use of drill down reports, for chargeback purposes. From a single integrated test toolchain, development and DevOps teams across your business can now write and run massively scalable performance and functional tests against microservices, APIs and apps, including web and mobile. Scale up to 10M+ virtual users for any project instantly, and also scale out across multiple geographically dispersed projects in that same instant. In doing so, be able to emulate the networks of connected devices which these applications are expected to be used on.
BlazeMeter offer extensive integrations with OOTB plug-ins to support yourDevOps practice today. Accelerate your test automation continuously across the CI/CD pipeline, without throwing out your existing legacy test platforms and processes. Take for example the way we Performance Test and Monitor applications today. As your developer teams performance test applications, your operations teams can leverage tests that monitor the health of an application. Enjoy prescriptive performance testing without having to reverse engineer, create a script and adapt to every change. They can establish a comprehensive set of monitoring tests that run 24/7 and trigger automated failure alerts. All of this can be encapsulated in a CI/CD process flow using the BlazeMeter plug-in with Jenkins CI server. Automate your regression tests with peace of mind for any code changes made to a specific release.
Learn more about Test Automation
These are just examples that BlazeMeter makes it simple for your test CoE to take on a broader role for test automation either in the Cloud or behind the firewall. You get tools that let you stage and manage infrastructure and consolidate test results into rich reports and interactive graphs. Ultimately, BlazeMeter helps you streamline your entire testing process for immediate feedback – helping you produce quality software at speed. Stand up a QA test automation framework to banish testing bottlenecks and improve the quality and performance of your applications. Visit our website to explore the features of BlazeMeter and learn more about setting up your own QA test automation framework. Also, stay tuned to this place. We’ve got an exciting BlazeMeter update coming shortly that you don’t want to miss. Meanwhile, remember to request for your free CA BlazeMeter demo!
Collin enjoys helping traditional Central IT and Agile development teams Plan-Build-Test-Run for speed in quality application release. Taking on grassroots engagements with practitioners in application test automation for the Agile software development lifecycle and DevOps delivery, Collin has broken new grounds in next generation programs like predictive insights for Dev-QA teams, and hybrid cloud management solutions for Ops teams in the software defined datacenter.