Exploiting eye movements for evaluating reviewer's performance in software review

Uwano Hidetake, Nakamura Masahide, Monden Akito, Matsumoto Ken-Ichi

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

This paper proposes to use eye movements to characterize the performance of individuals in reviewing software documents. We design and implement a system called DRESREM, which measures and records eye movements of document reviewers. Based on the eye movements captured by eye tracking device, the system computes the line number of the document that the reviewer is currently looking at. The system can also record and play back how the eyes moved during the review process. To evaluate the effectiveness of the system we conducted an experiment to analyze 30 processes of source code review (6 programs, 5 subjects) using the system. As a result, we have identified a particular pattern, called scan, in the subject's eye movements. Quantitative analysis showed that reviewers who did not spend enough time on the scan took more time to find defects on average.

Original languageEnglish
Pages (from-to)2290-2300
Number of pages11
JournalIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
VolumeE90-A
Issue number10
DOIs
Publication statusPublished - Oct 2007

Keywords

  • Experimental evaluation
  • Eye movement
  • Human factor
  • Software review
  • System development

ASJC Scopus subject areas

  • Signal Processing
  • Computer Graphics and Computer-Aided Design
  • Electrical and Electronic Engineering
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Exploiting eye movements for evaluating reviewer's performance in software review'. Together they form a unique fingerprint.

  • Cite this