Design of kinematic controller for real-time vision guided robot manipulators

Cong Wang, Chung Yen Lin, Masayoshi Tomizuka

Research output: Contribution to journalConference articlepeer-review

6 Scopus citations


This paper discusses the control strategies for robot manipulators to track moving targets based on realtime vision guidance. The work is motivated by some new demands of vision guided robot manipulators in which the workpieces being manipulated are in complex motion and the widely adopted look-then-move control strategy cannot give satisfactory performance. In order to serve industrial applications, the limited sensing and actuation capabilities have to be considered properly. In our work, a cascade control structure is introduced. The sensor and actuator limits are dealt with by consecutive modules in the controller respectively. In particular, the kinematic visual servoing (KVS) module is discussed in detail. It is a kinematic controller that generates reference trajectory in real-time. Sliding control is used to give a basic Jacobian-based design. Constrained optimal control is applied to address the actuator limits. validation is conducted through simulation and experiment.

Original languageEnglish (US)
Article number6907461
Pages (from-to)4141-4146
Number of pages6
JournalProceedings - IEEE International Conference on Robotics and Automation
StatePublished - Sep 22 2014
Externally publishedYes
Event2014 IEEE International Conference on Robotics and Automation, ICRA 2014 - Hong Kong, China
Duration: May 31 2014Jun 7 2014

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering


Dive into the research topics of 'Design of kinematic controller for real-time vision guided robot manipulators'. Together they form a unique fingerprint.

Cite this