Published: October 14, 2019
Author(s)
Bestoun Ahmed (Karlstad University), Amador Pahim (Red Hat Czech), Cleber Rosa Junior (Red Hat), Richard Kuhn (NIST), Miroslav Bures (Czech Technical University)
Conference
Name: Evaluation and Assessment in Software Engineering (EASE)
Dates: 10/14/2019 - 10/17/2019
Location: Copenhagen, Denmark
Citation: EASE '19: Proceedings of the Evaluation and Assessment on Software Engineering, pp. 252-258
Combinatorial interaction testing (CIT) is a well-known technique, but industrial experience is needed to determine its effectiveness in different application domains. We present a case study introducing a unified framework for generating, executing and verifying CIT test suites, based on the open-source Avocado test framework. In addition, we present a new industrial case study to demonstrate the effectiveness of the framework. This evaluation showed that the new framework can generate, execute, and verify effective combinatorial interaction test suites for detecting configuration failures (invalid configurations) in a virtualization system.
Combinatorial interaction testing (CIT) is a well-known technique, but industrial experience is needed to determine its effectiveness in different application domains. We present a case study introducing a unified framework for generating, executing and verifying CIT test suites, based on the...
See full abstract
Combinatorial interaction testing (CIT) is a well-known technique, but industrial experience is needed to determine its effectiveness in different application domains. We present a case study introducing a unified framework for generating, executing and verifying CIT test suites, based on the open-source Avocado test framework. In addition, we present a new industrial case study to demonstrate the effectiveness of the framework. This evaluation showed that the new framework can generate, execute, and verify effective combinatorial interaction test suites for detecting configuration failures (invalid configurations) in a virtualization system.
Hide full abstract
Keywords
automated testing framework; software testing; combinatorial testing applications; software quality assurance; test automation
Control Families
None selected
