Filter-INC: Handling effort-inconsistency in software effort estimation datasets

Passakorn Phannachitta, Jacky Keung, Kwabena Ebo Bennin, Akito Monden, Kenichi Matsumoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Effort-inconsistency is a situation where historical software project data used for software effort estimation (SEE) are contaminated by many project cases with similar characteristics but are completed with significantly different amount of effort. Using these data for SEE generally produces inaccurate results; however, an effective technique for its handling is yet made to be available. This study approaches the problem differently from common solutions, where available techniques typically attempt to remove every project case they have detected as outliers. Instead, we hypothesize that data inconsistency is caused by only a few deviant project cases and any attempt to remove those other cases will result in reduced accuracy, largely due to loss of useful information and data diversity. Filter-INC (short for Filtering technique for handling effort-INConsistency in SEE datasets) implements the hypothesis to decide whether a project case being detected by any existing technique should be subject to removal. The evaluation is carried out by comparing the performance of 2 filtering techniques between before and after having Filter-INC applied. The results produced from 8 real-world datasets together with 3 machine-learning models, and evaluated by 4 performance measures show a significant accuracy improvement at the confident interval of 95%. Based on the results, we recommend our proposed hypothesis as an important instrument to design a data preprocessing technique for handling effort-inconsistency in SEE datasets, definitely an important step forward in preprocessing data for a more accurate SEE model.

Original languageEnglish
Title of host publicationProceedings - 23rd Asia-Pacific Software Engineering Conference, APSEC 2016
EditorsAlex Potanin, Gail C. Murphy, Steve Reeves, Jens Dietrich
PublisherIEEE Computer Society
Pages185-192
Number of pages8
ISBN (Electronic)9781509055753
DOIs
Publication statusPublished - Jul 2 2016
Event23rd Asia-Pacific Software Engineering Conference, APSEC 2016 - Hamilton, New Zealand
Duration: Dec 6 2016Dec 9 2016

Publication series

NameProceedings - Asia-Pacific Software Engineering Conference, APSEC
Volume0
ISSN (Print)1530-1362

Other

Other23rd Asia-Pacific Software Engineering Conference, APSEC 2016
CountryNew Zealand
CityHamilton
Period12/6/1612/9/16

Keywords

  • Data preprocessing
  • Effort-inconsistency
  • Empirical software engineering
  • Software effort estimation

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Filter-INC: Handling effort-inconsistency in software effort estimation datasets'. Together they form a unique fingerprint.

  • Cite this

    Phannachitta, P., Keung, J., Bennin, K. E., Monden, A., & Matsumoto, K. (2016). Filter-INC: Handling effort-inconsistency in software effort estimation datasets. In A. Potanin, G. C. Murphy, S. Reeves, & J. Dietrich (Eds.), Proceedings - 23rd Asia-Pacific Software Engineering Conference, APSEC 2016 (pp. 185-192). [7890587] (Proceedings - Asia-Pacific Software Engineering Conference, APSEC; Vol. 0). IEEE Computer Society. https://doi.org/10.1109/APSEC.2016.035