Computer Vision Based Industrial Robotic Arm for Sorting Objects by Color and Height

Abu Salman Shaikat; Suraiya Akter; Umme  Salma

doi:10.38032/jea.2020.04.002

Authors

Abu Salman Shaikat Department of Mechatronics Engineering, World University of Bangladesh, Dhaka - 1205, Bangladesh
Suraiya Akter Department of Mechatronics Engineering, World University of Bangladesh, Dhaka - 1205, Bangladesh
Umme Salma Department of Mechatronics Engineering, World University of Bangladesh, Dhaka - 1205, Bangladesh

DOI:

https://doi.org/10.38032/jea.2020.04.002

Keywords:

Color and Height Detection, Sorting, Computer Vision, Degree of Freedom, Robotic Arm, Efficiency

Abstract

In industrial production systems, manufacturers often face difficulties in sorting different types of objects. Color and height-based sorting which is done manually by human is quite a tedious task and its needs countless time as well. For manual sorting, many workers are required, which can be quite expensive. Moreover, robots that can sort only color or height can’t be effective when there is a need of products with same color with different heights and vice versa. In this paper, a computer vision based robotic sorter is proposed, which is capable of detecting and sorting objects by their colors and heights at the same time. This work isn’t done before as height sorting of same shapes is a new technique, which is done with color sorting techniques by computer vision. It is equipped with a robotic arm having 6 degree of freedom (DOF), by which it picks up and then place objects according to its color and height, to a predetermined place as per the production system requirement. A camera with the computer vision software detects various colors and heights. Haar Cascade algorithm has been used to sort the products. This multi-DOF robotic sorter can be a remarkably useful tool for automating the production process completely, where multiple conveyor belts are used, which can reduce time complexity as well. In the proposed system, the efficiency of color and height sorting is around 99%, which proves the efficiency of our system. The overall improvement in the efficiency of the production process can be significantly enhanced by using this system.

References

Dhayalini, K. and Mukesh, R., 2018, January. Deterioration & non-deterioration wastes separation using pick & place robot. In 2018 2nd International Conference on Inventive Systems and Control (ICISC) (pp. 96-99). IEEE.

Hu, C.Y., Chen, C.R., Tseng, C.H., Yudha, A.P. and Kuo, C.H., 2016, March. Visual servoing spanner picking and placement with a SCARA manipulator. In 2016 IEEE International Conference on Industrial Technology (ICIT) (pp. 1632-1637). IEEE.

Gecks, T. and Henrich, D., 2005, August. Human-robot cooperation: safe pick-and-place operations. In ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005. (pp. 549-554). IEEE.

Kato, G., Onchi, D. and Abarca, M., 2013. Low cost flexible robot manipulator for pick and place tasks. In 2013 10th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) (pp. 677-680). IEEE.

Andhare, P. and Rawat, S., 2016, August. Pick and place industrial robot controller with computer vision. In 2016 International Conference on Computing Communication Control and automation (ICCUBEA) (pp. 1-4). IEEE.

Li, W., Xiao, Y., Bi, S. and Du, G., 2013, September. Automatic elliptical trajectory planning algorithm for pick and place operation. In 2013 International Conference on Advanced Mechatronic Systems (pp. 36-39). IEEE.

Lin, H.I., Chen, Y.Y. and Chen, Y.Y., 2015, May. Robot vision to recognize both object and rotation for robot pick-and-place operation. In 2015 International Conference on Advanced Robotics and Intelligent Systems (ARIS) (pp. 1-6). IEEE.

Lukač, D., 2018, May. Simulation of a pick-and-place cube robot by means of the simulation software KUKA Sim Pro. In 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (pp. 0846-0849). IEEE.

Rahman, M.J., Das, D.P., Islam, O. and Zaman, H.U., 2018, February. A Novel Design of a Robotic Object Sorter Based on Color Differences using Image Processing Techniques. In 2018 International Conference on Computer, Communication, Chemical, Material and Electronic Engineering (IC4ME2) (pp. 1-4). IEEE.

Viola, P. and Jones, M., 2001, December. Rapid object detection using a boosted cascade of simple features. In 2001 IEEE computer society conference on computer vision and pattern recognition (CVPR) (Vol. 1, pp. I-I). IEEE.

Roshni, N. and Kumar, T.S., 2017, March. Pick and place robot using the centre of gravity value of the moving object. In 2017 IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing (INCOS) (pp. 1-5). IEEE.

Rahmad, C., Asmara, R.A., Putra, D.R.H., Dharma, I., Darmono, H. and Muhiqqin, I., 2020, January. Comparison of Viola-Jones Haar Cascade Classifier and Histogram of Oriented Gradients (HOG) for face detection. In IOP Conference Series: Materials Science and Engineering (Vol. 732, No. 1, p. 012038). IOP Publishing.

Craig, J.J., 2009. Introduction to robotics: mechanics and control, 3/E. Pearson Education India.