Bionic tracking method by hand & eye-vergence visual servoing

Wei Song, Mamoru Minami, Lin Yong Shen, Ya Nan Zhang

Research output: Contribution to journalArticle

Abstract

Animals rotate their eyes to gaze at the target prey, enhancing the ability of measuring the distance to the target precisely for catching it. These animals, visual tracking includes the triangular eye-vergence control and their body’s motion control by visual servoing. The research aims to realize a bionic robot tracking performance, in which the body links moves together with eyes’ view orientation. This paper proposed a hand & eye-vergence dual control system which included two feedback loops: an outer loop for conventional visual servoing to direct a manipulator toward a target object and an inner loop for active motion control of binocular cameras to change the viewpoint along with the moving object to give an accurate and broad observation. This research also foused on how to compensate a fictional motion of the target seen by camera images in an eye-in-hand system, where the camera was fixed on the end-effector and moved together with the hand motion. A robust motion-feedforward (MFF) recognition method is proposed to compensate the fictional motion of the target based on the manipulator’s joint velocity, then the real motion of the target seen by camera images is extracted, which can improve the feedback image sensing unit to make the whole servoing system dynamically stable. The effectiveness of the proposed hand & eye-vergence visual servoing method is shown by tracking experiments using a 6-DoF robot manipulator and a 3-DoF binocular vision system.

Original languageEnglish
Pages (from-to)157-166
Number of pages10
JournalAdvances in Manufacturing
Volume4
Issue number2
DOIs
Publication statusPublished - Jun 1 2016

Fingerprint

Visual servoing
Bionics
End effectors
Cameras
Manipulators
Motion control
Animals
Robots
Binocular vision
Feedback
Binoculars
Control systems
Experiments

Keywords

  • Binocular vision
  • Bionic tracking
  • Eye-vergence
  • Visual servoing

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering
  • Mechanical Engineering
  • Mechanics of Materials
  • Polymers and Plastics

Cite this

Bionic tracking method by hand & eye-vergence visual servoing. / Song, Wei; Minami, Mamoru; Shen, Lin Yong; Zhang, Ya Nan.

In: Advances in Manufacturing, Vol. 4, No. 2, 01.06.2016, p. 157-166.

Research output: Contribution to journalArticle

Song, Wei ; Minami, Mamoru ; Shen, Lin Yong ; Zhang, Ya Nan. / Bionic tracking method by hand & eye-vergence visual servoing. In: Advances in Manufacturing. 2016 ; Vol. 4, No. 2. pp. 157-166.
@article{b7bf830cc0ae437786ccb4384bb9a188,
title = "Bionic tracking method by hand & eye-vergence visual servoing",
abstract = "Animals rotate their eyes to gaze at the target prey, enhancing the ability of measuring the distance to the target precisely for catching it. These animals, visual tracking includes the triangular eye-vergence control and their body’s motion control by visual servoing. The research aims to realize a bionic robot tracking performance, in which the body links moves together with eyes’ view orientation. This paper proposed a hand & eye-vergence dual control system which included two feedback loops: an outer loop for conventional visual servoing to direct a manipulator toward a target object and an inner loop for active motion control of binocular cameras to change the viewpoint along with the moving object to give an accurate and broad observation. This research also foused on how to compensate a fictional motion of the target seen by camera images in an eye-in-hand system, where the camera was fixed on the end-effector and moved together with the hand motion. A robust motion-feedforward (MFF) recognition method is proposed to compensate the fictional motion of the target based on the manipulator’s joint velocity, then the real motion of the target seen by camera images is extracted, which can improve the feedback image sensing unit to make the whole servoing system dynamically stable. The effectiveness of the proposed hand & eye-vergence visual servoing method is shown by tracking experiments using a 6-DoF robot manipulator and a 3-DoF binocular vision system.",
keywords = "Binocular vision, Bionic tracking, Eye-vergence, Visual servoing",
author = "Wei Song and Mamoru Minami and Shen, {Lin Yong} and Zhang, {Ya Nan}",
year = "2016",
month = "6",
day = "1",
doi = "10.1007/s40436-016-0143-8",
language = "English",
volume = "4",
pages = "157--166",
journal = "Advances in Manufacturing",
issn = "2095-3127",
publisher = "Springer Science + Business Media",
number = "2",

}

TY - JOUR

T1 - Bionic tracking method by hand & eye-vergence visual servoing

AU - Song, Wei

AU - Minami, Mamoru

AU - Shen, Lin Yong

AU - Zhang, Ya Nan

PY - 2016/6/1

Y1 - 2016/6/1

N2 - Animals rotate their eyes to gaze at the target prey, enhancing the ability of measuring the distance to the target precisely for catching it. These animals, visual tracking includes the triangular eye-vergence control and their body’s motion control by visual servoing. The research aims to realize a bionic robot tracking performance, in which the body links moves together with eyes’ view orientation. This paper proposed a hand & eye-vergence dual control system which included two feedback loops: an outer loop for conventional visual servoing to direct a manipulator toward a target object and an inner loop for active motion control of binocular cameras to change the viewpoint along with the moving object to give an accurate and broad observation. This research also foused on how to compensate a fictional motion of the target seen by camera images in an eye-in-hand system, where the camera was fixed on the end-effector and moved together with the hand motion. A robust motion-feedforward (MFF) recognition method is proposed to compensate the fictional motion of the target based on the manipulator’s joint velocity, then the real motion of the target seen by camera images is extracted, which can improve the feedback image sensing unit to make the whole servoing system dynamically stable. The effectiveness of the proposed hand & eye-vergence visual servoing method is shown by tracking experiments using a 6-DoF robot manipulator and a 3-DoF binocular vision system.

AB - Animals rotate their eyes to gaze at the target prey, enhancing the ability of measuring the distance to the target precisely for catching it. These animals, visual tracking includes the triangular eye-vergence control and their body’s motion control by visual servoing. The research aims to realize a bionic robot tracking performance, in which the body links moves together with eyes’ view orientation. This paper proposed a hand & eye-vergence dual control system which included two feedback loops: an outer loop for conventional visual servoing to direct a manipulator toward a target object and an inner loop for active motion control of binocular cameras to change the viewpoint along with the moving object to give an accurate and broad observation. This research also foused on how to compensate a fictional motion of the target seen by camera images in an eye-in-hand system, where the camera was fixed on the end-effector and moved together with the hand motion. A robust motion-feedforward (MFF) recognition method is proposed to compensate the fictional motion of the target based on the manipulator’s joint velocity, then the real motion of the target seen by camera images is extracted, which can improve the feedback image sensing unit to make the whole servoing system dynamically stable. The effectiveness of the proposed hand & eye-vergence visual servoing method is shown by tracking experiments using a 6-DoF robot manipulator and a 3-DoF binocular vision system.

KW - Binocular vision

KW - Bionic tracking

KW - Eye-vergence

KW - Visual servoing

UR - http://www.scopus.com/inward/record.url?scp=84976578079&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84976578079&partnerID=8YFLogxK

U2 - 10.1007/s40436-016-0143-8

DO - 10.1007/s40436-016-0143-8

M3 - Article

VL - 4

SP - 157

EP - 166

JO - Advances in Manufacturing

JF - Advances in Manufacturing

SN - 2095-3127

IS - 2

ER -