Object Tracking for Safety - Team SafeBots

[EECS 504] Final Project - Saptadeep Debnath, Preeti Kannapan, Malvika Shetty

The aim of our project is to implement object tracking in videos using bounded boxes for safety applications. With more and more autonomous robots and vehicles being deployed in the world, it is becoming increasingly important to ensure the safety of everyone in the robot’s environment. There are many contexts in which this is applicable:

Specifically, we would like to use object tracking to detect and draw conclusions about the distance of the moving object from the camera, and additionally issue a warning based on the proximity of the object to the camera. Such a warning would be useful for a robot, vehicle, or even human, to react appropriately when the camera is mounted on them. This will be done with a depth estimator method that makes use of the variation in scale of the bounding box with depth of the object. Therefore, we propose to implement object tracking as well as a proximity warning system for safety purposes.

Goals

The video submission includes;

Running the code

  1. First, clone or download this GitHub repository. Install requirements and download pretrained weights:
pip install -r ./requirements.txt
wget -P model_data https://pjreddie.com/media/files/yolov3.weights
  1. Start with using pretrained weights to test predictions on both image and video:

Results

Download the Princeton tracking benchmark dataset and run the Final_SafetyWarningSystem.ipynb

Check the proposal, final report and video presentation for more details on implementation.

Team Members