Results of the 2024 software testing survey

A quarter of respondents do not automate load and performance tests - while AI is already used in almost half of all development projects. The Software Test Survey 2024 with over 800 participants shows that, despite decades of professionalization, there is a massive lack of basics such as test techniques and security testing. At the same time, test automation has stagnated since 2020, and “agile” is just a new label for old structures in many companies.

Podcast Episode: Results of the 2024 software testing survey

In this episode, I talk to Karin Vosseberg and Frank Simon about the results of the Software Testing Survey 2024. We discuss findings such as the use of AI in testing and developments in test automation. Despite technical advances, many testers do not automate basic procedures such as regression testing. We also discuss the influence of agile working methods and the trend towards hybrid models. And what about certifications? Are they still up to date?

“In coding, you actually have the largest number of AIs in automation. But then when it comes to design decisions, project management or test management, the more human factors, then the numbers of AI decrease significantly.” - Frank Simon

Prof. Dr.-Ing. Karin Vosseberg has been a university lecturer at Bremerhaven University of Applied Sciences since 2009, specializing in IT system integration and software engineering. She is committed to the integration of software quality assurance, sustainability in software development and digital sovereignty in curricula. She is a strong advocate for gender equality in STEM degree programs and is a member of specialist groups of the German Informatics Society and the Forum Computer Scientists for Peace and Social Responsibility. She has also been a member of the ASQF Executive Committee since 2015.

Dr. Frank Simon, born in 1969, studied computer science and completed his doctorate in the field of large architectures. After 15 years in management consulting, he built up the IT security division of a large insurance company. He then spent 3 years as CIO at a large financial services provider in Cologne. He is currently CIO at the State Development Bank of Bavaria, which supports start-ups, companies and municipalities with almost 2 billion with over 400 employees. At the ISTQB, he heads the Security Testing Working Group, which published the new Syllabus Security Test Engineer last year and is currently working on the new Syllabus Security Test Analyst.

Highlights der Episode

• Test automation has been stagnating for years: 12% do not automate regression testing at all.
• Only 60% are familiar with basic test techniques such as equivalence partitions - despite 20 years of ISTQB.
• AI is already used by 50% of developers, but hardly for test design.
• A quarter carry out load and performance tests manually - almost unimaginable.
• “Hybrid-agile” often means: managers dictate, teams are allowed to do daily standup.

Software Test Survey 2024

Introduction

The Software Test Survey 2024 offers a fascinating insight into the world of software testing and provides valuable insights for the industry. This article discusses the key aspects of the survey:

• Overview of the Software Testing Survey 2024: Dive into the results of this comprehensive survey that provides insights into current trends and challenges in software testing.
• Significance of the survey results for the software testing industry: Learn what impact the findings of this survey could have on future development and innovation in software testing.
• Summary of key findings from the survey: Discover the key points discussed by experts in the field of software testing and what conclusions can be drawn from them.

Immerse yourself in the world of software testing and be inspired by the findings of the Software Test Survey 2024.

Background of the software testing survey

The Software Testing Survey has been conducted regularly since 2011 and is an initiative of the German Testing Board. The aim is to comprehensively record and scientifically evaluate relevant trends and developments in the field of software testing.

Four surveys have been conducted so far:

• 2011: First survey with a very high number of participants, as the topic was still comparatively new.
• 2016: Continuous further development of the methodology and evaluation.
• 2020: Stronger focus on automation and agile processes.
• 2024: Over 800 participants, which represents a slight decrease compared to previous years. This can be explained by the increased number of surveys in the industry and changed participation dynamics.

The survey is scientifically supported and offers various reporting options:

• A compact Management Abstract for quick reference.
• A comprehensive test brochure with around 50 to 60 pages for detailed analysis.
• A technical report that provides more in-depth data and statistical evaluations.

This structure ensures that both managers and operational test experts receive suitable information. The results form an important basis for decision-making for companies and software testing professionals.

Participation from a wide range of industries and company sizes ensures a broadly diversified picture of the current testing landscape.

Results and further details can be found at https://www.softwaretest-umfrage.de