TY - GEN
T1 - Resolution of focus of attention using gaze direction estimation and saliency computation
AU - Yücel, Zeynep
AU - Salah, Albert Ali
PY - 2009/12/1
Y1 - 2009/12/1
N2 - Modeling the user's attention is useful for responsive and interactive systems. This paper proposes a method for establishing joint visual attention between an experimenter and an intelligent agent. A rapid procedure is described to track the 3D head pose of the experimenter, which is used to approximate the gaze direction. The head is modeled with a sparse grid of points sampled from the surface of a cylinder. We then propose to employ a bottom-up saliency model to single out interesting objects in the neighborhood of the estimated focus of attention. We report results on a series of experiments, where a human experimenter looks at objects placed at different locations of the visual field, and the proposed algorithm is used to locate target objects automatically. Our results indicate that the proposed approach achieves high localization accuracy and thus constitutes a useful tool for the construction of natural human-computer interfaces.
AB - Modeling the user's attention is useful for responsive and interactive systems. This paper proposes a method for establishing joint visual attention between an experimenter and an intelligent agent. A rapid procedure is described to track the 3D head pose of the experimenter, which is used to approximate the gaze direction. The head is modeled with a sparse grid of points sampled from the surface of a cylinder. We then propose to employ a bottom-up saliency model to single out interesting objects in the neighborhood of the estimated focus of attention. We report results on a series of experiments, where a human experimenter looks at objects placed at different locations of the visual field, and the proposed algorithm is used to locate target objects automatically. Our results indicate that the proposed approach achieves high localization accuracy and thus constitutes a useful tool for the construction of natural human-computer interfaces.
KW - Gaze estimation
KW - Head pose estimation
KW - Intelligent interaction
KW - Joint attention modeling
KW - Saliency
UR - http://www.scopus.com/inward/record.url?scp=77949408954&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77949408954&partnerID=8YFLogxK
U2 - 10.1109/ACII.2009.5349547
DO - 10.1109/ACII.2009.5349547
M3 - Conference contribution
AN - SCOPUS:77949408954
SN - 9781424447992
T3 - Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
BT - Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
T2 - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
Y2 - 10 September 2009 through 12 September 2009
ER -