AN AUTONOMOUS EYE-IN-HAND ROBOTIC SYSTEM FOR PICKING OBJECTS IN A SUPERMARKET ENVIRONMENT WITH NON-HOLONOMIC CONSTRAINT

Lyu，Erli1; Yang，Xing1; Liu，Wei2; Wang，Jiaole1; Song，Shuang1; Meng，Max Q.H.3,4,5

2022

10.2316/J.2022.206-0685

INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION   Impact Factor & Quartile

0826-8185

Designing a robot that can autonomously find and pick objects in a supermarket is the core requirement of an unmanned supermarket. The difficulties of this task include building a robot with both high payload and big workspace and designing a robot system that incorporates the navigation and grasping system. In this paper, we present our robot which includes a high payload chassis, an UR5 manipulator and a suction system. To deal with the non-holonomic constraint and to incorporate the navigation and grasping system, we designed a pipeline called navigation, observation and grasping (NOG). Furthermore, we propose a new grasping pose generation algorithm which utilizes a heuristic cost function to get rid of the effect of the noise points in the point cloud. Jingdong held a competition named Jingdong robotics challenge (JRC) to simulate an unmanned supermarket environment. This competition required the robot to autonomously find and pick 10 different objects among 20 categories of objects and place them into a collection box. We tested our robot in this competition, and the designed robot system grasped 8/10 objects in the first round, 7/10 object in the second round and finally achieved third and first place in two rounds.

Autonomous robotics system object picking supermarket environment

SCI ; EI

English

Others

WOS:000792022500005

20222612274836

Cost functions ; Manipulators ; Retail stores ; Robots

Robotics:731.5 ; Optimization Techniques:921.5

2-s2.0-85132728195

Scopus

1.School of Mechanical Engineering and Automation,Harbin Institute of Technology (Shenzhen),Shenzhen,518055,China
2.Department of Mechanical and Energy Engineering,Southern University of Science and Technology,Shenzhen,518055,China
3.Department of Electronic and Electrical Engineering,The Southern University of Science and Technology,Shenzhen,518055,China
4.Department of Electronic Engineering,Chinese University of Hong Kong,Hong Kong,Hong Kong
5.Shenzhen Research Institute,Chinese University of Hong Kong,Shenzhen,China

Lyu，Erli,Yang，Xing,Liu，Wei,et al. AN AUTONOMOUS EYE-IN-HAND ROBOTIC SYSTEM FOR PICKING OBJECTS IN A SUPERMARKET ENVIRONMENT WITH NON-HOLONOMIC CONSTRAINT[J]. INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION,2022,37(4):352-361.

Lyu，Erli,Yang，Xing,Liu，Wei,Wang，Jiaole,Song，Shuang,&Meng，Max Q.H..(2022).AN AUTONOMOUS EYE-IN-HAND ROBOTIC SYSTEM FOR PICKING OBJECTS IN A SUPERMARKET ENVIRONMENT WITH NON-HOLONOMIC CONSTRAINT.INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION,37(4),352-361.

Lyu，Erli,et al."AN AUTONOMOUS EYE-IN-HAND ROBOTIC SYSTEM FOR PICKING OBJECTS IN A SUPERMARKET ENVIRONMENT WITH NON-HOLONOMIC CONSTRAINT".INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION 37.4(2022):352-361.