DL & CV-based indicator toolset for the vehicle drivers via live dash-cam footage.

Overview

Vehicle Indicator Toolset

Deep Learning and Computer Vision based indicator toolset for vehicle drivers using live dash-cam footages.

Tracking of vehicles
The tracking of the vehicles with a track ID can be seen below.

|


Detection of the lanes.
Whenever the driver gets out of the lane, he will be displayed a warning to stay inside the lane.

|


Tail light detection
Detect all the tail lights of the vehicles applying brakes at night.

|


Traffic signal recognition
Warning is shown when to stop and resume again using traffic lights.

|



Vehicle collision estimation
Incase, a collision is estimated, driver is warned.

|



Pedestrian stepping
Whenever, pedestrian comes in our view, a warning is displayed.

|


Dependencies required:

  • Python 3.0
  • TensorFlow 2.0
  • openCV

Project Structure:

  • lanes:This folder contains files related to lane detection only.
  • tf-color: This folder contains files related to traffic light detection and detect the colour and accordingly give instructions to the driver.
  • tracked: This folder contains detection and tracking algorithm for the vehicles.
  • untracked: Detection and visualization only
  • utils: contains various functions that are used continuously again and again for different frames.
  • estimations: Detect pedestrians and vehicles too close to us that may cause collision.
  • cropping: Cropping frames using drag and drop or clicking points.
  • display: All the gifs shown above are stored here.

Requisities:

Download the tensorflow model from here.

  • Provide the path to the labels txt file using variable named PATH_TO_LABELS.
  • Provide the path to the tensorflow model using variable named model_name.
  • Make sure all the files are imported properly from the utils folder. If you get an error, add the location of the utils folder using sys module.
  • Tensorflow version 2.0 is must or else you may come across various error.

Working:

Run python integrate3.py or python intyolo.py after following the above mentioned requisities.
Now select the dash area for the car by clicking on multiple points as shown below. This is done to
remove detection of our own vehicle in some cases which may generate false results.

In the second step, select the area where searching of the lanes should be made. This may differ due to
the placement of dash-cams in the vehicle. The area above the horizon where road ends should not be selected.

Now, you can visualize the working and see the warnings/suggestions displayed to the driver.
All the works that are implemented individually are present in their respective folders, which are integrated together.
Old models may have some bugs now, as many files inside utils are changed.
Visit honors branch of models repository forked from tf/models to see more work on this project,
that I have done in google colab.

Drawbacks:

  • At night, searching for tail light should be made in the dark. If sufficient light is present, false cases can get introduced.
  • Tracking works good for bigger objects, while smaller may loose their track ID at places.
  • Threshold values used in lane detection needs to be altered depending on the roads and the quality of the videos.
  • Object detection needs to work properly for better results throughout. The model with higher accuracy should be downloaded from the link given above.
Owner
Alex Xu
Alex Xu
A python software that can help blind people find things like laptops, phones, etc the same way a guide dog guides a blind person in finding his way.

GuidEye A python software that can help blind people find things like laptops, phones, etc the same way a guide dog guides a blind person in finding h

Munal Jain 0 Aug 09, 2022
The repository forked from NVlabs uses our data. (Differentiable rasterization applied to 3D model simplification tasks)

nvdiffmodeling [origin_code] Differentiable rasterization applied to 3D model simplification tasks, as described in the paper: Appearance-Driven Autom

Qiujie (Jay) Dong 2 Oct 31, 2022
Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)

This repository contains code to reproduce results for submission NeurIPS 2021, "Momentum Centering and Asynchronous Update for Adaptive Gradient Meth

Juntang Zhuang 15 Jun 11, 2022
WatermarkRemoval-WDNet-WACV2021

WatermarkRemoval-WDNet-WACV2021 Thank you for your attention. Citation Please cite the related works in your publications if it helps your research: @

LUYI 63 Dec 05, 2022
PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

A ready-to-use framework of latest models for structured (tabular) data learning with PyTorch. Applications include recommendation, CRT prediction, healthcare analytics, and etc.

48 Nov 30, 2022
Weakly Supervised End-to-End Learning (NeurIPS 2021)

WeaSEL: Weakly Supervised End-to-end Learning This is a PyTorch-Lightning-based framework, based on our End-to-End Weak Supervision paper (NeurIPS 202

Auton Lab, Carnegie Mellon University 131 Jan 06, 2023
Code of the paper "Multi-Task Meta-Learning Modification with Stochastic Approximation".

Multi-Task Meta-Learning Modification with Stochastic Approximation This repository contains the code for the paper "Multi-Task Meta-Learning Modifica

Andrew 3 Jan 05, 2022
The Official Repository for "Generalized OOD Detection: A Survey"

Generalized Out-of-Distribution Detection: A Survey 1. Overview This repository is with our survey paper: Title: Generalized Out-of-Distribution Detec

Jingkang Yang 338 Jan 03, 2023
GE2340 project source code without credentials.

GE2340-Project-Public GE2340 project source code without credentials. Run the bot.py to start the bot Telegram: @jasperwong_ge2340_bot If the bot does

0 Feb 10, 2022
Code for Transformer Hawkes Process, ICML 2020.

Transformer Hawkes Process Source code for Transformer Hawkes Process (ICML 2020). Run the code Dependencies Python 3.7. Anaconda contains all the req

Simiao Zuo 111 Dec 26, 2022
This repository provides an unified frameworks to train and test the state-of-the-art few-shot font generation (FFG) models.

FFG-benchmarks This repository provides an unified frameworks to train and test the state-of-the-art few-shot font generation (FFG) models. What is Fe

Clova AI Research 101 Dec 27, 2022
Fast and scalable uncertainty quantification for neural molecular property prediction, accelerated optimization, and guided virtual screening.

Evidential Deep Learning for Guided Molecular Property Prediction and Discovery Ava Soleimany*, Alexander Amini*, Samuel Goldman*, Daniela Rus, Sangee

Alexander Amini 75 Dec 15, 2022
Repo for "Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions" https://arxiv.org/abs/2201.12296

Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions This repo contains the dataset and code for the paper Benchmarking Ro

Jiachen Sun 168 Dec 29, 2022
ROS support for Velodyne 3D LIDARs

Overview Velodyne1 is a collection of ROS2 packages supporting Velodyne high definition 3D LIDARs3. Warning: The master branch normally contains code

ROS device drivers 543 Dec 30, 2022
This is the official PyTorch implementation of our paper: "Artistic Style Transfer with Internal-external Learning and Contrastive Learning".

Artistic Style Transfer with Internal-external Learning and Contrastive Learning This is the official PyTorch implementation of our paper: "Artistic S

51 Dec 20, 2022
A python library to artfully visualize Factorio Blueprints and an interactive web demo for using it.

Factorio Blueprint Visualizer I love the game Factorio and I really like the look of factories after growing for many hours or blueprints after tweaki

Piet Brömmel 124 Jan 07, 2023
Bib-parser - Convenient script to parse .bib files with the ACM Digital Library like metadata

Bib Parser Convenient script to parse .bib files with the ACM Digital Library li

Mehtab Iqbal (Shahan) 1 Jan 26, 2022
A Python package for generating concise, high-quality summaries of a probability distribution

GoodPoints A Python package for generating concise, high-quality summaries of a probability distribution GoodPoints is a collection of tools for compr

Microsoft 28 Oct 10, 2022
A Pytorch Implementation of [Source data‐free domain adaptation of object detector through domain

A Pytorch Implementation of Source data‐free domain adaptation of object detector through domain‐specific perturbation Please follow Faster R-CNN and

1 Dec 25, 2021
AugLiChem - The augmentation library for chemical systems.

AugLiChem Welcome to AugLiChem! The augmentation library for chemical systems. This package supports augmentation for both crystaline and molecular sy

BaratiLab 17 Jan 08, 2023