Extraction of Bug Localization Benchmarks from History – ASE 2007

by Valentin Dallmeier, Thomas Zimmermann

Researchers have proposed a number of tools for automatic bug localization. Given a program and a description of the failure, such tools pinpoint a set of statements that are most likely to contain the bug. Evaluating bug localization tools is a difficult task because existing benchmarks are limited in size of subjects and number of bugs. In this paper we present iBUGS, an approach that semi-automatically extracts benchmarks for bug localization from the history of a project. For ASPECTJ, we extracted 369 bugs, 223 out of these had associated test cases. We demonstrate the relevance of our dataset with a case study on the bug localization tool AMPLE.

Download as PDF.
See also: http://www.ibugs.org/

Reference

Valentin Dallmeier, Thomas Zimmermann. Extraction of Bug Localization Benchmarks from History. In Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007), Atlanta, Georgia, USA, November 2007.

BibTeX Entry

@inproceedings{dallmeier-ase-2007,
    title = "Extraction of Bug Localization Benchmarks from History",
    author = "Valentin Dallmeier and Thomas Zimmermann",
    year = "2007",
    month = "November",
    booktitle = "Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering",
    location = "Atlanta, Georgia, USA",
}