Towards an Automated Unified Framework to Run Applications for Combinatorial Interaction Testing

Ahmed, Bestoun; Pahim, Amador; Rosa Junior, Cleber; Kuhn, Richard; Bures, Miroslav

doi:https://doi.org/10.1145/3319008.3319348

Conference Proceedings

Towards an Automated Unified Framework to Run Applications for Combinatorial Interaction Testing

Documentation Topics

Published: October 14, 2019

Author(s)

Bestoun Ahmed (Karlstad University), Amador Pahim (Red Hat Czech), Cleber Rosa Junior (Red Hat), Richard Kuhn (NIST), Miroslav Bures (Czech Technical University)

Conference

Name: Evaluation and Assessment in Software Engineering (EASE)
Dates: October 14-17, 2019
Location: Copenhagen, Denmark
Citation: EASE '19: Proceedings of the Evaluation and Assessment on Software Engineering, pp. 252-258

Abstract

Combinatorial interaction testing (CIT) is a well-known technique, but industrial experience is needed to determine its effectiveness in different application domains. We present a case study introducing a unified framework for generating, executing and verifying CIT test suites, based on the open-source Avocado test framework. In addition, we present a new industrial case study to demonstrate the effectiveness of the framework. This evaluation showed that the new framework can generate, execute, and verify effective combinatorial interaction test suites for detecting configuration failures (invalid configurations) in a virtualization system.

Keywords

automated testing framework; software testing; combinatorial testing applications; software quality assurance; test automation

Control Families

None selected

Documentation

Publication:
Conference Proceedings (DOI)

Supplemental Material:
Preprint (pdf)

Document History:
10/14/19: Conference Proceedings (Final)

Topics

Security and Privacy
assurance; security automation; testing & validation

Technologies
combinatorial testing; software & firmware