Identifying patch correctness in test-based program repair

Author email: xiongyf@pku.edu.cn
Tool name: Defact
Description: Test-based automatic program repair has attracted a lot of attention in recent years. However, the test suites in practice are often too weak to guarantee correctness and existing approaches often generate a large number of incorrect patches. To reduce the number of incorrect patches generated, we propose a novel approach that heuristically determines the correctness of the generated patches. The core idea is to exploit the behavior similarity of test case executions. The passing tests on original and patched programs are likely to behave similarly while the failing tests on original and patched programs are likely to behave differently. Also, if two tests exhibit similar runtime behavior, the two tests are likely to have the same test results. Based on these observations, we generate new test inputs to enhance the test suites and use their behavior similarity to determine patch correctness. Our approach is evaluated on a dataset consisting of 139 patches generated from existing program repair systems including jGen-Prog, Nopol, jKali, ACS and HDRepair. Our approach successfully prevented 56.3% of the incorrect patches to be generated, without blocking any correct patches.
Bibtex: @inproceedings{10.1145/3180155.3180182, author = {Xiong, Yingfei and Liu, Xinyuan and Zeng, Muhan and Zhang, Lu and Huang, Gang}, title = {Identifying Patch Correctness in Test-Based Program Repair}, year = {2018}, isbn = {9781450356381}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3180155.3180182}, doi = {10.1145/3180155.3180182}, booktitle = {Proceedings of the 40th International Conference on Software Engineering}, pages = {789–799}, numpages = {11}, location = {Gothenburg, Sweden}, series = {ICSE ’18} }
Link to public pdf: https://dl.acm.org/doi/10.1145/3180155.3180182
Link to tool webpage: https://github.com/Ultimanecat/DefectRepairing
Link to demo: Not provided by authors
Category: None
Year and Conference: 2018, ICSE
Terms of use