Test Intelligence - Elmar Jürgens 

 September 26 2023

You are currently viewing a placeholder content from Podigee. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.

More Information

"We did a study ourselves once to see whether we as developers really manage to cover the functionality in the developer tests" - Elmar Jürgens

We take a trip into the world of test intelligence, coverage profiling and test gap analysis. How do you analyze development and test artifacts to efficiently identify defects? How do you evaluate the discrepancy between expected and actual results? And how do you build it all into the pipeline? Analysis tools promise continuous improvements in test quality and efficiency. But what's behind them?

Dr. Elmar Jürgens received his doctorate on static code analysis and was awarded the Software Engineering Prize of the Ernst Denert Foundation for his doctoral thesis. He is co-founder of CQSE GmbH and has been helping teams improve their quality assurance and testing processes for ten years. Elmar speaks regularly at research and industry conferences and has received several awards for his presentations. In 2015, he was named a Junior Fellow of the Gesellschaft für Informatik.

Highlights in this episode:

  • Elmar Jürgens and I talk about Test Intelligence and how it helps to find errors more efficiently
  • We discuss the importance of test gap analysis and coverage profiling
  • Elmar explains how manual tests can be included in the analysis
  • It discusses how test intelligence can improve development processes and what future trends there are
  • We talk about the challenges and benefits of introducing test intelligence in teams
  • Elmar provides insights into the importance of change management when implementing analytics tools
  • We will discuss how test intelligence can help to save resources and work more efficiently
  • Elmar shares how Test Intelligence is used in practice and what it holds for the future


Contact Elmar:

More links:

  • CQSE Homepage
  • Our free online lectures, often with participation from customers who talk about their experiences with test intelligence analysis


From test gap analysis to test suite minimization: Test Intelligence

TLDR: In this episode, I share my insights from an insightful conversation with Elmar Jürgens about Test Intelligence. We uncover the importance and application of analysis techniques in the development and testing process to find bugs more efficiently and improve the quality of software development.

Test Intelligence

Today I had the pleasure of welcoming Elmar Jürgens to the podcast. We talked about the topic of test intelligence. This term may seem abstract at first, but it encompasses a range of analysis techniques that aim to find bugs in less time and thereby significantly improve the software development process. From static analysis to coverage profiling, our conversation covered a wide range of topics that are all brought together under the umbrella of Test Intelligence.

The test gap analysis

One of the most prominent topics of our conversation was undoubtedly test gap analysis. This technology enables teams to uncover untested changes before the release. By merging data from the version control system and coverage profilers, a complete documentation of all test steps is created - a significant step towards improving quality assurance. It is particularly impressive that not only automated tests are taken into account, but also manual ones - a decisive extension of the conventional understanding of test coverage.

Coverage beyond automated tests

Elmar emphasized that coverage profilers have been used primarily for automated tests for years. The fact that we can now successfully use these technologies for manual testing marks a significant step forward. This development clearly shows that the boundaries between manual and automated testing are blurring and we are moving towards a more comprehensive view of testing.

First-hand experience: surprises from the field

Elmar's experience with various projects revealed some surprising insights: In one case, particularly low test coverage even led to the termination of a project. Such moments highlight the importance of thoroughly analyzing and monitoring test coverage. It also shows that even in technically skilled teams, not all changes are always adequately tested - another argument for the use of test intelligence.

A look into the future

Our conversation also provided an exciting outlook on what we can expect in the future in the field of test intelligence. From using the same technologies in production to introducing new analytics such as test smells or requirement smells, the possibilities seem endless. This continuous progress promises not only more efficient error detection and correction, but also an overall increase in quality in the software development process.

Static and dynamic analyses combined

One particularly interesting aspect is the combination of static and dynamic analyses. By merging both approaches, we can get a more precise picture of where our code stands and what needs to be improved. These hybrid analyses represent an innovative approach to better support both developers and testers and ultimately develop better software.