<abstract xmlns="http://www.w3.org/1999/xhtml"><p>This paper describes the results of experiments on detection and recognition of 3D objects in RGB-D images provided by the Microsoft Kinect sensor. While the studies focus on single image use, sequences of frames are also considered and evaluated. Observed objects are categorized based on both geometrical and visual cues, but the emphasis is laid on the performance of the point cloud matching method. To this end, a rarely used approach consisting of independent VFH and CRH descriptors matching, followed by ICP and HV algorithms from the Point Cloud Library is applied. Successfully recognized objects are then subjected to a classical 2D analysis based on color histogram comparison exclusively with objects in the same geometrical category. The proposed two-stage approach allows to distinguish objects of similar geometry and different visual appearance, like soda cans of various brands. By separating geometry and color identification phases, the applied system is still able to categorize objects based on their geometry, even if there is no color match. The recognized objects are then localized in the three-dimensional space and autonomously grasped by a manipulator. To evaluate this approach, a special validation set was created, and additionally a selected scene from the Washington RGB-D Object Dataset was used.</p></abstract>

This paper describes the results of experiments on detection and recognition of 3D objects in RGB-D images provided by the Microsoft Kinect sensor. While the studies focus on single image use, sequences of frames are also considered and evaluated. Observed objects are categorized based on both geometrical and visual cues, but the emphasis is laid on the performance of the point cloud matching method. To this end, a rarely used approach consisting of independent VFH and CRH descriptors matching, followed by ICP and HV algorithms from the Point Cloud Library is applied. Successfully recognized objects are then subjected to a classical 2D analysis based on color histogram comparison exclusively with objects in the same geometrical category. The proposed two-stage approach allows to distinguish objects of similar geometry and different visual appearance, like soda cans of various brands. By separating geometry and color identification phases, the applied system is still able to categorize objects based on their geometry, even if there is no color match. The recognized objects are then localized in the three-dimensional space and autonomously grasped by a manipulator. To evaluate this approach, a special validation set was created, and additionally a selected scene from the Washington RGB-D Object Dataset was used.

3D Object Detection and Recognition for Robotic Grasping Based on RGB-D Images and Global Features

Instytut Sterowania i Elektroniki Przemysłowej

Foundations of Computing and Decision Sciences

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

This paper describes the results of experiments on detection and recognition of 3D objects in RGB-D images provided by the Microsoft Kinect sensor. While the...

3D Object Detection and Recognition for Robotic Grasping Based on RGB-D Images and Global Features

Published Online: Sep 09, 2017

Page range: 219 - 237

DOI: https://doi.org/10.1515/fcds-2017-0011

Keywords
3D object detection and recognition, Kinect, point cloud analysis, RGB-D images, VFH, CRH, ICP

© 2017 Witold Czajewski et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

3D Object Detection and Recognition for Robotic Grasping Based on RGB-D Images and Global Features

Published Online: Sep 09, 2017

Page range: 219 - 237

DOI: https://doi.org/10.1515/fcds-2017-0011

Keywords3D object detection and recognition, Kinect, point cloud analysis, RGB-D images, VFH, CRH, ICP

© 2017 Witold Czajewski et al., published by De Gruyter Open

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
3D object detection and recognition, Kinect, point cloud analysis, RGB-D images, VFH, CRH, ICP