CONTINUOUS TESTINGNEWS10 takeaways from the 2019 Forrester TEI Study on Continuous Testing

Findings from the recent Forrester Total Economic Impact (TEI) study on Continuous Testing demonstrate how several enterprise companies, could potentially save over $19M in net present value by adopting continuous testing over a three-year period.
Collin Chau Collin ChauApril 17, 20194 min

Findings from the recent Forrester Total Economic Impact (TEI) study on Continuous Testing demonstrates how customers enjoy enormous value ($19M in Net Present Value) with quick payback (in under 8 months) when using Broadcom’s Continuous Testing portfolio.

Forrester examined several companies across different industries over a three year period, to better understand their progress and challenges with Continuous Testing.

The development teams interviewed mentioned several challenges. These include how to integrate tests with back-end services without incurring significant costs, and ways for provisioning data sets for testing workflows in a timely manner. The report also notes that the teams interviewed had not implemented code checks at all stages in the software delivery cycle.

The top 10 takeaways from the report are:

  1. Continuous Testing Improves Productivity. Prior to implementing continuous testing, developer productivity was hampered by bottlenecks. By switching to continuous testing, development team productivity saw over $7M in improvement.
  2. QA Teams Can Minimize Test Case Design Costs. QA teams were designing a significant number of unnecessary tests.  Upon implementation of continuous testing, QA teams switched to a requirements-based testing approach that reduced test case design costs by nearly $9M.  
  3. Reduction in Test Automation can Reduce Execution Costs. Continuous testing helps minimize the number of test cases while also ensuring comprehensive coverage. This meant an 80% reduction of effort and over $4M cost savings in test case execution.
  4. Improved Requirements Design Equalled Increased Productivity. Improved efficiency in the requirements design process meant less unnecessary work, and more time freed up through a reduced number of meetings. Efficiency in collecting application requirements valued at $1.4M.
  5. Continuous Performance Testing Saves Money. Continuous testing reduces reliance on high-cost performance testing solutions. By running frequent performance tests you can potentially avoid at least $2M in downtime costs.
  6. Mitigating Compliance and Regulatory Risks Results in Significant Savings. Companies need to reduce the heavy cost of compliance violations and compliance reviews from GDPR regulations. Continuous testing helps mitigate compliance risks through de-sensitization of PII data and provisioning synthetic test data sets for development teams.
  7. Updating Testing Environment Infrastructure Reduces Maintenance Costs. Significant amounts of time and resources were spent to support services for testing in the past. Continuous testing avoided significant infrastructure and maintenance costs worth over $3M.
  8. Virtual Services Increase Productivity and Reduce Costs. Prior to adopting continuous testing, outside contractors were used to build simulators for testing. Upon adopting continuous testing in house, this resulted in significant cost savings over $1M.
  9. Updating Release Management Systems Results in More Code, More Quickly. Eliminate inefficient release management workflows by using continuous testing, with release managers being 40% more productive by monitoring and managing code throughout the pipeline.
  10. Release Coordination Activity Saves Time and Money. Remove time consuming cut-over calls each time code is pushed into production. With continuous testing, companies can shift efforts towards overseeing critical code deployments with a minimal resources to reduce costs by over r $1M


Build Better Applications, Faster with Broadcom Continuous Testing


The Forrester TEI Report with help you understand how customers have successfully tested earlier and more often in the software development lifecycle, by using Broadcom Continuous Testing solutions to:


  • Test the business with requirements-based models, in establishing a model-based approach to test case design, that help minimize the number of test cases while maximizing coverage.


  • Test early in development and at scale with Open Source, where teams shift left for in-sprint test automation and execute to frequent performance tests to ensure application and environment stability.


  • Test “as code” to eliminate wait times in developer workflows for test environments. From virtualizing back-end services from the IDE to provisioning data sets in testing workflows that reduce reliance on costly infrastructure.


  • Test at production and shift right because Agile development testing does not stop at production, as in-sprint teams continuously validation code across development and production for early visibility in API problems.


  • Test for continuous improvement and actionable insights through intelligent test cycles that help prioritize what needs to be tested and where. Leaning into machine learning and artificial intelligence to uncover gaps in test plans and promote backlog grooming

Download the report here:

Collin Chau

Collin Chau

Collin enjoys helping traditional Central IT and Agile development teams Plan-Build-Test-Run for speed in quality application release. Taking on grassroots engagements with practitioners in application test automation for the Agile software development lifecycle and DevOps delivery, Collin has broken new grounds in next generation programs like predictive insights for Dev-QA teams, and hybrid cloud management solutions for Ops teams in the software defined datacenter.