Revisiting common bug prediction findings using effort-aware models

Yasutaka Kamei, Shinsuke Matsumoto, Akito Monden, Ken Ichi Matsumoto, Bram Adams, Ahmed E. Hassan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

87 Citations (Scopus)

Abstract

Bug prediction models are often used to help allocate software quality assurance efforts (e.g. testing and code reviews). Mende and Koschke have recently proposed bug prediction models that are effort-aware. These models factor in the effort needed to review or test code when evaluating the effectiveness of prediction models, leading to more realistic performance evaluations. In this paper, we revisit two common findings in the bug prediction literature: 1) Process metrics (e.g., change history) outperform product metrics (e.g., LOC), 2) Packagelevel predictions outperform file-level predictions. Through a case study on three projects from the Eclipse Foundation, we find that the first finding holds when effort is considered, while the second finding does not hold. These findings validate the practical significance of prior findings in the bug prediction literature and encourage their adoption in practice.

Original languageEnglish
Title of host publicationIEEE International Conference on Software Maintenance, ICSM
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event2010 IEEE International Conference on Software Maintenance, ICSM 2010 - Timisoara
Duration: Sep 12 2010Sep 18 2010

Other

Other2010 IEEE International Conference on Software Maintenance, ICSM 2010
CityTimisoara
Period9/12/109/18/10

Fingerprint

Codes (standards)
Quality assurance
Testing

ASJC Scopus subject areas

  • Software

Cite this

Kamei, Y., Matsumoto, S., Monden, A., Matsumoto, K. I., Adams, B., & Hassan, A. E. (2010). Revisiting common bug prediction findings using effort-aware models. In IEEE International Conference on Software Maintenance, ICSM [5609530] https://doi.org/10.1109/ICSM.2010.5609530

Revisiting common bug prediction findings using effort-aware models. / Kamei, Yasutaka; Matsumoto, Shinsuke; Monden, Akito; Matsumoto, Ken Ichi; Adams, Bram; Hassan, Ahmed E.

IEEE International Conference on Software Maintenance, ICSM. 2010. 5609530.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kamei, Y, Matsumoto, S, Monden, A, Matsumoto, KI, Adams, B & Hassan, AE 2010, Revisiting common bug prediction findings using effort-aware models. in IEEE International Conference on Software Maintenance, ICSM., 5609530, 2010 IEEE International Conference on Software Maintenance, ICSM 2010, Timisoara, 9/12/10. https://doi.org/10.1109/ICSM.2010.5609530
Kamei Y, Matsumoto S, Monden A, Matsumoto KI, Adams B, Hassan AE. Revisiting common bug prediction findings using effort-aware models. In IEEE International Conference on Software Maintenance, ICSM. 2010. 5609530 https://doi.org/10.1109/ICSM.2010.5609530
Kamei, Yasutaka ; Matsumoto, Shinsuke ; Monden, Akito ; Matsumoto, Ken Ichi ; Adams, Bram ; Hassan, Ahmed E. / Revisiting common bug prediction findings using effort-aware models. IEEE International Conference on Software Maintenance, ICSM. 2010.
@inproceedings{ca979d1d969145dc887bf39746fccfb1,
title = "Revisiting common bug prediction findings using effort-aware models",
abstract = "Bug prediction models are often used to help allocate software quality assurance efforts (e.g. testing and code reviews). Mende and Koschke have recently proposed bug prediction models that are effort-aware. These models factor in the effort needed to review or test code when evaluating the effectiveness of prediction models, leading to more realistic performance evaluations. In this paper, we revisit two common findings in the bug prediction literature: 1) Process metrics (e.g., change history) outperform product metrics (e.g., LOC), 2) Packagelevel predictions outperform file-level predictions. Through a case study on three projects from the Eclipse Foundation, we find that the first finding holds when effort is considered, while the second finding does not hold. These findings validate the practical significance of prior findings in the bug prediction literature and encourage their adoption in practice.",
author = "Yasutaka Kamei and Shinsuke Matsumoto and Akito Monden and Matsumoto, {Ken Ichi} and Bram Adams and Hassan, {Ahmed E.}",
year = "2010",
doi = "10.1109/ICSM.2010.5609530",
language = "English",
isbn = "9781424486298",
booktitle = "IEEE International Conference on Software Maintenance, ICSM",

}

TY - GEN

T1 - Revisiting common bug prediction findings using effort-aware models

AU - Kamei, Yasutaka

AU - Matsumoto, Shinsuke

AU - Monden, Akito

AU - Matsumoto, Ken Ichi

AU - Adams, Bram

AU - Hassan, Ahmed E.

PY - 2010

Y1 - 2010

N2 - Bug prediction models are often used to help allocate software quality assurance efforts (e.g. testing and code reviews). Mende and Koschke have recently proposed bug prediction models that are effort-aware. These models factor in the effort needed to review or test code when evaluating the effectiveness of prediction models, leading to more realistic performance evaluations. In this paper, we revisit two common findings in the bug prediction literature: 1) Process metrics (e.g., change history) outperform product metrics (e.g., LOC), 2) Packagelevel predictions outperform file-level predictions. Through a case study on three projects from the Eclipse Foundation, we find that the first finding holds when effort is considered, while the second finding does not hold. These findings validate the practical significance of prior findings in the bug prediction literature and encourage their adoption in practice.

AB - Bug prediction models are often used to help allocate software quality assurance efforts (e.g. testing and code reviews). Mende and Koschke have recently proposed bug prediction models that are effort-aware. These models factor in the effort needed to review or test code when evaluating the effectiveness of prediction models, leading to more realistic performance evaluations. In this paper, we revisit two common findings in the bug prediction literature: 1) Process metrics (e.g., change history) outperform product metrics (e.g., LOC), 2) Packagelevel predictions outperform file-level predictions. Through a case study on three projects from the Eclipse Foundation, we find that the first finding holds when effort is considered, while the second finding does not hold. These findings validate the practical significance of prior findings in the bug prediction literature and encourage their adoption in practice.

UR - http://www.scopus.com/inward/record.url?scp=78650145923&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78650145923&partnerID=8YFLogxK

U2 - 10.1109/ICSM.2010.5609530

DO - 10.1109/ICSM.2010.5609530

M3 - Conference contribution

AN - SCOPUS:78650145923

SN - 9781424486298

BT - IEEE International Conference on Software Maintenance, ICSM

ER -