Performance Test Strategy Best Practices: Continuous (Early) vs System level Performance tests

Presentation will highlight the Performance Test strategy best practices & do/don’ts for continuous (CI/CD based) performance tests versus system level performance tests

With the popularity of DevOps culture, increasingly continuous performance testing is adopted by most of the organizations. Though this move has lead to tremendous improvement in proactive performance measurement possibilities, many a time, performance testing team have challenges to adapt to the new needs of the DevOps environment. The struggle to bring in smart performance testing strategies to test & certify the system performance which adheres to standards & agility expected in DevOps environment is very high.

The Performance testing strategy includes best practices & techniques around NFR identification & verification, type of tests, test objectives, use cases identification, infrastructure requirements, key focus areas of analysis during tests, KPIs for test results comparison, use of shift-level or shift-right strategies rightly, where & when to use ML/AI, etc.

There is a paradigm shift in the above activities in DevOps environment for early performance tests(with CI/CD platform) versus system level performance tests. The session will highlight the differences & best practices by doing a deep dive on practical case studies & clearly dictating the need for 2 key things for Performance Engineers: 1) the need for understanding the ‘Big Picture’ of the system under test & 2) the need to learn the art of connecting the dots to proactively assess system performance…scalability…and application capacity.

The session would help the audience to appreciate the real benefits & Do/Don’ts in DevOps performance tests & understand how to adapt to the upcoming challenges.


About Ramya

Ramya R Moorthy is a passionate performance analyst with about 15+ years of experience in performance testing, performance modeling & application capacity planning. She is a computer science engineering graduate with her Masters in Software Systems (MS) from BITS PILANI, India.

She does technical consulting on Performance & Security space and also conducts trainings through her Indian & US start up. She also runs an online academy (https://elearning.qaelitesouls.com) for Performance Engineers. She is a prestigious award winner of Computer Measurement Group’s Bill Mullen award 2017 for her paper on anomaly detection.

She is a proud mother of two adorable daughters, so no time for hobbies anymore.