Handling crowdsourced data using state space discretization for robot learning and synthesizing physical skills

Leidi Zhao, Lu Lu, Cong Wang

Research output: Contribution to journalArticlepeer-review

2 Scopus citations


Intelligent physical skills are a fundamental element needed by robots to interact with the real world. Instead of learning from individual sources in single cases, continuous robot learning from crowdsourced mentors over long terms provides a practical path towards realizing ubiquitous robot physical intelligence. The mentors can be human drivers that teleoperate robots when their intelligence is not yet enough for acting autonomously. A large amount of sensorimotor data can be obtained constantly from a group of teleoperators, and processed by machine learning to continuously generate and improve the autonomous physical skills of robots. This paper presents a learning method that utilizes state space discretization to sustainably manage constantly collected data and synthesize autonomous robot skills. Two types of state space discretization have been proposed. Their advantages and limits are examined and compared. Simulation and physical tests of two object manipulation challenges are conducted to examine the proposed learning method. The capability of handling system uncertainty, sustainably managing high-dimensional state spaces, as well as synthesizing new skills or ones that have only been partly demonstrated are validated. The work is expected to provide a long-term and big-scale measure to produce advanced robot physical intelligence.

Original languageEnglish (US)
Pages (from-to)390-402
Number of pages13
JournalInternational Journal of Intelligent Robotics and Applications
Issue number4
StatePublished - Dec 2020

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications


  • Crowdsourcing
  • Physical intelligence
  • Robot learning
  • Robotic manipulation


Dive into the research topics of 'Handling crowdsourced data using state space discretization for robot learning and synthesizing physical skills'. Together they form a unique fingerprint.

Cite this