Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing

Tahvili, Sahar and Bohlin, Markus and Saadatmand, Mehrdad and Larsson, Stig and Afzal, Wasif and Sundmark, Daniel (2016) Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing. In: THE 17TH INTERNATIONAL CONFERENCE ON PRODUCT-FOCUSED SOFTWARE PROCESS IMPROVEMENT(PROFES 2016), 22 – 24 November 2016, TRONDHEIM, NORWAY.

This is the latest version of this item.

PDF - Published Version


In software system development, testing can take considerable time and resources, and there are numerous examples in the literature of how to improve the testing process. In particular, methods for selection and prioritization of test cases can play a critical role in efficient use of testing resources. This paper focuses on the problem of selection and ordering of integration-level test cases. Integration testing is performed to evaluate the correctness of several units in composition. Further, for reasons of both effectiveness and safety, many embedded systems are still tested manually. To this end, we propose a process, supported by an online decision support system, for ordering and selection of test cases based on the test result of previously executed test cases. To analyze the economic efficiency of such a system, a customized return on investment (ROI) metric tailored for system integration testing is introduced. Using data collected from the development process of a large-scale safety-critical embedded system, we perform Monte Carlo simulations to evaluate the expected ROI of three variants of the proposed new process. The results show that our proposed decision support system is beneficial in terms of ROI at system integration testing and thus qualifies as an important element in improving the integration testing process.

Item Type:Conference or Workshop Item (Paper)
ID Code:6081
Deposited By:Sahar Tahvili
Deposited On:08 Dec 2016 16:08
Last Modified:08 Dec 2016 16:08

Available Versions of this Item

Repository Staff Only: item control page