This is the official implementation of the paper "Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation".

Last update: May 03, 2022

Related tags

Deep Learning ObjProp

Overview

ObjProp

Introduction

This is the official implementation of the paper "Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation".

Installation

This repo is built using mmdetection. To install the dependencies, first clone the repository locally:

git clone https://github.com/anirudh-chakravarthy/objprop.git

Then, install PyTorch 1.1.0, torchvision 0.3.0, mmcv 0.2.12:

conda install pytorch==1.1.0 torchvision==0.3.0 -c pytorch
pip install mmcv==0.2.12

Then, install the CocoAPI for YouTube-VIS

conda install cython scipy
pip install git+https://github.com/youtubevos/cocoapi.git#"egg=pycocotools&subdirectory=PythonAPI"

Training

First, download and prepare the YouTube-VIS dataset using the following instructions.

To train ObjProp, run the following command:

python3 tools/train.py configs/masktrack_rcnn_r50_fpn_1x_youtubevos_objprop.py

In order to change the arguments such as dataset directory, learning rate, number of GPUs, etc, refer to the following configuration file configs/masktrack_rcnn_r50_fpn_1x_youtubevos_objprop.py.

Inference

To perform inference using ObjProp, run the following command:

python3 tools/test_video.py configs/masktrack_rcnn_r50_fpn_1x_youtubevos_objprop.py [MODEL_PATH] --out [OUTPUT_PATH.json] --eval segm

A JSON file with the inference results will be saved at OUTPUT_PATH.json. To evaluate the performance, submit the result file to the evaluation server.

License

ObjProp is released under the Apache 2.0 license.

Citation

@article{Chakravarthy2021ObjProp,
  author = {Anirudh S Chakravarthy and Won-Dong Jang and Zudi Lin and Donglai Wei and Song Bai and Hanspeter Pfister},  
  title = {Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation},
  journal = {CoRR},
  volume = {abs/2111.07529},
  year = {2021},
  url = {https://arxiv.org/abs/2111.07529}
}

This is the official implementation of the paper "Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation".

Related tags

Overview

ObjProp

Introduction

Installation

Training

Inference

License

Citation

Owner

Anirudh S Chakravarthy

Hands-On Machine Learning for Algorithmic Trading, published by Packt

Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition

Western-3DSlicer-Modules - Point-Set Registrations for Ultrasound Probe Calibrations

Projects for AI/ML and IoT integration for games and other presented at re:Invent 2021.

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

[CVPR 2021] Forecasting the panoptic segmentation of future video frames

:boar: :bear: Deep Learning based Python Library for Stock Market Prediction and Modelling

A robust pointcloud registration pipeline based on correlation.

This project hosts the code for implementing the ISAL algorithm for object detection and image classification

(AAAI 2021) Progressive One-shot Human Parsing

Count GitHub Stars ⭐

Unofficial PyTorch implementation of "RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving" (ECCV 2020)

Fully convolutional deep neural network to remove transparent overlays from images

Code & Data for Enhancing Photorealism Enhancement

A clean and robust Pytorch implementation of PPO on continuous action space.

The source code for Adaptive Kernel Graph Neural Network at AAAI2022

Hough Transform and Hough Line Transform Using OpenCV

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Pytorch implementation of the popular Improv RNN model originally proposed by the Magenta team.

Project dự đoán giá cổ phiếu bằng thuật toán LSTM gồm: code train và code demo