RESEARCH PAPER
Pick-and-Place Task Implementation Using Visual Open-Loop Control
1
Faculty of Mechanical Engineering, Bialystok University of Technology, ul. Wiejska 45C, Białystok , 15-351, Poland
2
Faculty of Electrical Engineering, Bialystok University of Technology, ul. Wiejska 45D, Białystok , 15-351, Poland
Submission date: 2019-07-10
Acceptance date: 2019-10-31
Online publication date: 2019-11-05
Publication date: 2019-09-01
Acta Mechanica et Automatica 2019;13(3):211-216
KEYWORDS
ABSTRACT
In the ever increasing number of robotic system applications in the industry, the robust and fast visual recognition and pose estimation of workpieces are of utmost importance. One of the ubiquitous tasks in industrial settings is the pick-and-place task where the object recognition is often important. In this paper, we present a new implementation of a work-piece sorting system using a template matching method for recognizing and estimating the position of planar workpieces with sparse visual features. The proposed framework is able to distinguish between the types of objects presented by the user and control a serial manipulator equipped with parallel finger gripper to grasp and sort them automatically. The system is furthermore enhanced with a feature that optimizes the visual processing time by automatically adjusting the template scales. We test the proposed system in a real-world setup equipped with a UR5 manipulator and provide experimental results documenting the performance of our approach.
REFERENCES (24)
1.
Amagai A., Takase K. (2001), Implementation of dynamic manipulation with visual feedback and its application to pick and place task, Proceedings of the 2001 IEEE International Symposium on Assembly and Task Planning Assembly and Disassembly in the Twenty-first Century, 344–350.
2.
Amini A., Banitsas K. (2019), Using Kinect v2 to Control a Laser Visual Cue System to Improve the Mobility during Freezing of Gait in Parkinson’s Disease, Journal of Healthcare Engineering, art. no. 3845462.
3.
Bay H., Tuytelaars T., Gool L.V. (2008), Speeded-up robust features (SURF), Computer Vision and Image Understanding, 110, 346–359.
5.
Cabre T.P., Cairol M.T., Calafell D.F., Ribes M.T., Roca J.P. (2013), Project-Based Learning Example: Controlling an Educational Robotic Arm with Computer Vision, Tecnologias del Aprendizaje, IEEE Revista Iberoamericana de, 8, 135–142.
6.
Chaumette F., Hutchinson S. (2007), Visual Servo Control, Part II: Advanced Approaches, IEEE Robotics and Automation Magazine, 14(1), 109–118.
7.
Collet A., Martinez M., Srinivasa S.S. (2011), The MOPED framework: object recognition and pose estimation for manipulation, The International Journal of Robotics Research, 30, 1–23.
8.
Corke P. (2001), Robotics, Vision and Control: Fundamental Algorithms in MATLAB, Springer.
9.
Ellekilde L.-P., Jorgensen J. A. (2010), Robwork: A flexible toolbox for robotics research and education, Proceedings of the 41st International Symposium on Robotics and 6th German Conference, 1–7.
11.
Flandin G., Chaumette F., Marchand E. (2000), Eye-in-hand/eyeto-hand co-operation for visual servoing, Proceedings of the IEEE International Conference on Robotics and Automation, 3, 2741–2746.
12.
Grimson W. (1990), Object recognition by computer: the role of geometric constraints, MIT Press.
13.
Hagelskjær F., Krüger N., Buch A.G. (2016), Does Vision Work Well Enough for Industry?, Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications.
14.
Huang W., Xu H. (2018), Development of six-DOF welding robot with machine vision, Modern Physics Letters B, 32, 34–36.
15.
Krivic J., Solina F. (2004), Part-level object recognition using superquadrics, Computer Vision and Image Understanding, 95, 105–126.
16.
Kumar R., Kumar S., Lal S., Chand P. (2014), Object detection and recognition for a pick and place robot, Computer Science and Engineering 2014 Asia-Pacific World Congress, 1–7.
17.
Lowe D.G. (2004), Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision, 60, 91–110.
18.
Nalini K.M., Gondkar R.R. (2017), Robotic recognition for unstructured 2-D parts to pick and place objects, 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology, 1478–1482.
19.
Nieuwenhuisen M., Stückler J., Berner A., Klein R., Behnke S. (2012), Shape-primitive based object recognition and grasping, Proceedings of the 7th German Conference on Robotics.
20.
Pessoa R., Barbosa W., McLoughlin J., Kokaram A. (2018), Visual Servo Control of a Micro Quad-copter as a Teaching Platform for Engineering, 29th Irish Signals and Systems Conference, art. no. 8585355.
21.
Saxena A., Driemeyer J., Ng A.Y. (2007), Robotic Grasping of novel Objects using Vision, The International Journal of Robotics Research, 27(2), 157–173.
22.
Sibiryakov A. (2008), Statistical template matching under geometric transformations, Discrete Geometry for Computer Imaginary, Proceedings of the 14th IAPR International Conference, 225–237.
23.
Steger C., Ulrich M., Wiedmann C. (2017), Machine Vision Algorithms and Applications, Wiley-VCH.
24.
Willaume P., Parrend P., Gancel E., Deruyver A. (2016), The graph matching optimization methodology for thin object recognition in pick and place tasks, 2016 IEEE Symposium Series on Computational Intelligence, 1–8.
| eISSN: | 2300-5319 |
| ISSN: | 1898-4088 |
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
