Loading...
An analysis of the suitability of test-based patch acceptance criteria
Zemín, Luciano Gutiérrez Brida, Simón Godio, Ariel Cornejo, César Degiovanni, Renzo Regis, Germán Aguirre, Nazareno Frías, Marcelo
Zemín, Luciano
Gutiérrez Brida, Simón
Godio, Ariel
Cornejo, César
Degiovanni, Renzo
Regis, Germán
Aguirre, Nazareno
Frías, Marcelo
Type
Ponencia en congreso
Citations
Altmetric:
Abstract
"Program repair techniques attempt to fix programs by looking for patches within a search space of fix candidates. These techniques require a specification of the program to be repaired, used as an acceptance criterion for fix candidates, that often also plays an important role in guiding some search processes. Most tools use tests as specifications, which constitutes a risk, since the incompleteness of tests as specifications may lead one to obtain spurious repairs, that pass all tests but are in fact incorrect. This problem has been identified by various researchers, raising concerns about the validity of program fixes. More thorough studies have been proposed using different sets of tests for fix validation, and resorting to manual inspection, showing that while tools reduce their program fixing rate, they are still able to repair a significant number of cases. In this paper, we perform a different analysis of the suitability of tests as acceptance criteria for automated program fixes, by checking patches produced by automated repair tools using a bug-finding tool, as opposed to previous works that used tests or manual inspections. We develop a number of experiments in which faulty programs from a known benchmark are fed to the program repair tools GenProg, Angelix, AutoFix and Nopol, using test suites of varying quality and extension, including those accompanying the benchmark. We then check the produced patches against formal specifications using a bug-finding tool. Our results show that, in general, automated program repair tools are significantly more likely to accept a spurious program fix than producing an actual one, in the studied scenarios. "
Description
Date
2017-07
Journal Title
Journal ISSN
Volume Title
Publisher
Collections
Files
Loading...
Ponencia_Zemín
Adobe PDF, 207.13 KB
Research Projects
Organizational Units
Journal Issue
Keywords
BENCHMARKING, DEPURACION DE PROGRAMAS, VERIFICACION DE SOFTWARE