Empirical evaluation of mimic software project data sets for software effort estimation

Maohua Gan, Zeynep Yücel, Akito Monden, Kentaro Sasaki

Research output: Contribution to journalArticlepeer-review

Abstract

To conduct empirical research on industry software development, it is necessary to obtain data of real software projects from industry. However, only few such industry data sets are publicly available; and unfortunately, most of them are very old. In addition, most of today’s software companies cannot make their data open, because software development involves many stakeholders, and thus, its data confidentiality must be strongly preserved. To that end, this study proposes a method for artificially generating a “mimic” software project data set, whose characteristics (such as average, standard deviation and correlation coefficients) are very similar to a given confidential data set. Instead of using the original (confidential) data set, researchers are expected to use the mimic data set to produce similar results as the original data set. The proposed method uses the Box-Muller transform for generating normally distributed random numbers; and exponential transformation and number reordering for data mimicry. To evaluate the efficacy of the proposed method, effort estimation is considered as potential application domain for employing mimic data. Estimation models are built from 8 reference data sets and their concerning mimic data. Our experiments confirmed that models built from mimic data sets show similar effort estimation performance as the models built from original data sets, which indicate the capability of the proposed method in generating representative samples.

Original languageEnglish
Pages (from-to)2094-2103
Number of pages10
JournalIEICE Transactions on Information and Systems
VolumeE103D
Issue number10
DOIs
Publication statusPublished - Oct 1 2020

Keywords

  • Data confidentiality
  • Data mining
  • Empirical software engineering

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Empirical evaluation of mimic software project data sets for software effort estimation'. Together they form a unique fingerprint.

Cite this