Detection of Objects and Trajectories in Real-time using Deep Learning by a Controlled Robot

Research output: Contribution to conferencePaper

24 Downloads (Pure)

Abstract

Nowadays, there are many different approaches to detect objects as well as to determine the trajectory of an object. Each of these approaches has its advantages and disadvantages in terms of real-time use for various applications. In this study, we propose an approach to detect objects in real-time using the YOLOv3 deep learning algorithm and plot the trajectory of an object using 2D LIDAR and depth cameras on a robot. The laser rangefinder allows us to find distances to objects from a certain angle, but does not provide accurate object detection of the object class. In order to detect the object in real-time and discover the class to which the object belongs, we formed YOLOv3 deep learning model using transfer learning on several classes from data sets of publicly accessible images. We also measured the distance to an object using a depth camera with LIDAR together to determine and estimate the trajectory of objects. In addition, these detected trajectories are smoothed by polynomial regression. Our experiments in a laboratory environment show that YOLOv3 with 2D LIDAR and depth camera on a controlled robot can be used fairly accurately and efficiently in real-time situations for the detection of objects and trajectories necessary for various applications.
Original languageEnglish
Pages131-140
Number of pages10
Publication statusPublished - Nov 6 2020
EventInternational Conference on Robotics, Computer Vision and Intelligent Systems, ROBOVIS 2020 - , Spain
Duration: Nov 4 2020Nov 6 2020
http://www.robovis.org/

Conference

ConferenceInternational Conference on Robotics, Computer Vision and Intelligent Systems, ROBOVIS 2020
CountrySpain
Period11/4/2011/6/20
Internet address

Keywords

  • Deep Learning, Object Detection, Trajectory, Depth Camera, LIDAR.

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Detection of Objects and Trajectories in Real-time using Deep Learning by a Controlled Robot'. Together they form a unique fingerprint.

Cite this