Improvement and Evaluation of Data Consistency Metric CIL for Software Engineering Data sets

Research output: Contribution to journalArticlepeer-review


Software data sets derived from actual software products and their development processes are widely used for project planning, management, quality assurance and process improvement, etc. Although it is demonstrated that certain data sets are not fit for these purposes, the data quality of data sets is often not assessed before using them. The principal reason for this is that there are not many metrics quantifying fitness of software development data. In that respect, this study makes an effort to fill in the void in literature by devising a new and efficient assessment method of data quality. To that end, we start as a reference from Case Inconsistency Level (CIL), which counts the number of inconsistent project pairs in a data set to evaluate its consistency. Based on a follow-up evaluation with a large sample set, we depict that CIL is not effective in evaluating the quality of certain data sets. By studying the problems associated with CIL and eliminating them, we propose an improved metric called Similar Case Inconsistency Level (SCIL). Our empirical evaluation with 54 data samples derived from six large project data sets show that SCIL can distinguish between consistent and inconsistent data sets, and that prediction models for software development effort and productivity built from consistent data sets achieve indeed a relatively higher accuracy.

Original languageEnglish
Pages (from-to)1
Number of pages1
JournalIEEE Access
Publication statusAccepted/In press - 2022


  • data inconsistency
  • Data integrity
  • Data models
  • Data quality metric
  • Estimation
  • Measurement
  • Redundancy
  • Software
  • software effort estimation
  • Software engineering
  • software productivity estimation
  • software project data analysis

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)
  • Electrical and Electronic Engineering


Dive into the research topics of 'Improvement and Evaluation of Data Consistency Metric CIL for Software Engineering Data sets'. Together they form a unique fingerprint.

Cite this