Self-Supervised depth kalilia

Overview

Self-Supervised-depth

by kalilia.

Contents

0-depth-estimation-overview

Conference Tittle code Author mark note
Single Image Depth Estimation: An Overview Istanbul Technical University πŸ™‰

*-datasets

Tittle yaer mark note
Vision meets Robotics: The KITTI Dataset 2012 Karlsruhe Institute of Technology
nuScenes: A multimodal dataset for autonomous driving 2018 nuTonomy: an APTIV company

1-Monocular-depth with Cost Volume

Conference Tittle code Author mark note
NIPS2020 Forget About the LiDAR: Self-Supervised Depth Estimators with MED Probability Volumes Korea Advanced Institute of Science and Technology πŸ™‰ link
CVPR2021 DRO: Deep Recurrent Optimizer for Structure-from-Motion Alibaba A.I. Labs πŸ™ˆ link
CVPR2021 The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depth link Niantic πŸ™ˆ
CVPR2020 Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volume link Australian Institute for Machine Learning πŸ™ˆ
ECCV2020 Feature-metric Loss for Self-supervised Learning of Depth and Egomotion link πŸ™ˆ

2-Mono-SfM

2017

Conference Tittle code Author mark note
CVPR2017 Semi-Supervised Deep Learning for Monocular Depth Map Prediction RWTH Aachen University πŸ™ˆ
CVPR2017 SfMLearner: Unsupervised Learning of Depth and Ego-Motion from Video link UC Berkeley ⭐ link

2018

Conference Tittle code Author mark note
CVPR2018 DVO: Learning Depth from Monocular Videos using Direct Methods Carnegie Mellon University πŸ™ˆ
CVPR2018 GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose link SenseTime Research πŸ™ˆ
ECCV2018 DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistency ) Virginia Tech πŸ™ˆ
ECCV2018 Supervising the new with the old: learning SFM from SFM ) University of Oxford πŸ™ˆ

2019

Conference Tittle code Author mark note
2019 Self-Supervised 3D Keypoint Learning for Ego-motion Estimation Toyota Research Institute (TRI) πŸ™ˆ
ICRA2019 SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimation Toyota Research Institute (TRI) πŸ™ˆ
AAAI2019 Depth prediction without the sensors: Leveraging structure for unsupervised learning from monocular videos Harvard University/Google Brain πŸ™ˆ
ICCV2019 Unsupervised High-Resolution Depth Learning From Videos With Dual Networks Tsinghua University πŸ™ˆ
ICCV2019 Self-Supervised Monocular Depth Hints link Niantic πŸ™ˆ
ICCV2019 Monodepth2: Digging into self-supervised monocular depth estimation link UCL/niantic 🌟
NIPS2019 SC-SfMLearner: Unsupervised scale-consistent depth and ego-motion learning from monocular video University of Adelaide, Australia πŸ™ˆ
CVPR2019 Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation Max Planck Institute for Intelligent Systems πŸ™ˆ
CoRL2019 Robust Semi-Supervised Monocular Depth Estimation with Reprojected Distances Toyota Research Institute (TRI) πŸ™ˆ

2020

Conference Tittle code Author mark note
ECCV2020 DeepSFM: Structure From Motion Via Deep Bundle Adjustment Fudan University πŸ™ˆ
CoRL2020 Unsupervised Monocular Depth Learning in Dynamic Scenes Google Research πŸ™ˆ
CoRL2020 Attentional Separation-and-Aggregation Network for Self-supervised Depth-Pose Learning in Dynamic Scenes Tsinghua University πŸ™‰
3DV2020 Neural Ray Surfaces for Self-Supervised Learning of Depth and Ego-motion Toyota Research Institute (TRI)
ICLR2020 Semantically-Guided Representation Learning for Self-Supervised Monocular Depth Toyota Research Institute (TRI)
CVPR2020 On the uncertainty of self-supervised monocular depth estimation link University of Bologna, Italy πŸ™ˆ
CVPR2020 Towards Better Generalization: Joint Depth-Pose Learning without PoseNet link Tsinghua University πŸ™ˆ link
CVPR2020 3D Packing for Self-Supervised Monocular Depth Estimation Toyota Research Institute (TRI) 🌟 link
CVPR2020 Self-supervised monocular trained depth estimation using self-attention and discrete disparity volume University of Adelaide πŸ™ˆ
2020 SAFENet: Self-Supervised Monocular Depth Estimation with Semantic-Aware Feature Extraction link Toyota Research Institute (TRI) πŸ™ˆ
2020 Self-Supervised Monocular Depth Estimation : Solving the Dynamic Object Problem by Semantic Guidance Technische UniversitΒ¨at Braunschweig, Germany πŸ™ˆ
IROS2020 Toward Hierarchical Self-Supervised Monocular Absolute Depth Estimation for Autonomous Driving Applications link Tongji University πŸ™ˆ

2021

Conference Tittle code Author mark note
AAAI2021 HR-Depth : High Resolution Self-Supervised Monocular Depth Estimation link Zhejiang University ⭐ link
AAAI2021 Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistency KAIST ⭐ link
CVPR2021 Manydepth:The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depth link Niantic πŸ™ˆ
CVPR2021 MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Camera link TUM πŸ™ˆ
IROS2021 Self-Supervised Scale Recovery for Monocular Depth and Egomotion Estimation University of Toronto πŸ™ˆ
2021 Self-supervised Depth Estimation Leveraging Global Perception and Geometric Smoothness Using On-board Videos Hong Kong Polytechnic University πŸ™ˆ
2021 Self-Supervised Structure-from-Motion through Tightly-Coupled Depth and Egomotion Networks University of Toronto πŸ™ˆ
2021 Moving SLAM: Fully Unsupervised Deep Learning in Non-Rigid Scenes HKUST πŸ™ˆ
2021 Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video Tongji University πŸ™ˆ
2021 Monocular Depth Estimation through Virtual-world Supervision and Real-world SfM Self-Supervision πŸ™ˆ
2021 Self-Supervised Learning of Depth and Ego- Motion from Video by Alternative Training and Geometric Constraints from 3D to 2D πŸ™ˆ
-update-time-09-13-2021-
ICCV2021 Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimation Seoul National University πŸ™ˆ
ICCV2021 Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Dark Nanjing University of Science and Technology πŸ™ˆ
ICCV2021 Self-supervised Monocular Depth Estimation for All Day Images using Domain Separation Zhejiang University πŸ™ˆ
ICCV2021 StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimation Shanghai Jiao Tong University πŸ™ˆ
ICCV2021 MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environments OPPO US Research Center πŸ™ˆ
Sensors Journal 2021 Unsupervised Monocular Depth Perception: Focusing on Moving Objects Chinese University of Hong Kong πŸ™ˆ
2021 R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenes TUM ⭐
2021 Unsupervised Monocular Depth Estimation in Highly Complex Environments East China University of Science and Technology πŸ™ˆ

3-Multi-view-stereo

Conference Tittle code Author mark
PAMI2008 SGM:Stereo processing by Semi-Global matching and Mutual Information German Aerospace Cente πŸ™ˆ
ECCV2016 Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue University of Adelaide πŸ™ˆ
CVPR2017 DispNet: Unsupervised Monocular Depth Estimation with Left-Right Consistency University College London πŸ™ˆ
Cost Volume Pyramid Based Depth Inference for Multi-View Stereo Jiayu link Northwestern Polytechnical University πŸ™ˆ
CVPR2020 Semi-Supervised Deep Learning for Monocular Depth Map Prediction Australian National University πŸ™ˆ
AAAI2021 Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentation South China University of Technology πŸ™ˆ
CVPR2021 Differentiable Diffusion for Dense Depth Estimation from Multi-view Images Brown University πŸ™ˆ
ICCV2021 NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo Australian National University ⭐

4-SLAM-Visual-Odometry

Conference Tittle code Author mark
ECCV2014 LSD-SLAM: Large-Scale Direct Monocular SLAM TUM πŸ™ˆ
TR2015 ORB-SLAM: A Versatile and Accurate Monocular SLAM System Universidad de Zaragoza πŸ™ˆ
2016 Direct Visual Odometry using Bit-Planes Carnegie Mellon University πŸ™ˆ
TR2017 ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras Universidad de Zaragoza πŸ™ˆ
2016 A Photometrically Calibrated Benchmark For Monocular Visual Odometry TUM πŸ™ˆ

2018

Conference Tittle code Author mark
PAMI2018 DSO: Direct Sparse Odometry TUM πŸ™ˆ
IROS2018 LDSO: Direct Sparse Odometry with Loop Closure TUM πŸ™ˆ
ECCV2018 Deep Virtual Stereo Odometry:Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry TUM πŸ™ˆ
2018 Self-improving visual odometry Magic Leap, Inc. πŸ™ˆ

2019

Conference Tittle code Author mark
ICLR2019 BA-NET: DENSE BUNDLE ADJUSTMENT NETWORKS Simon Fraser University πŸ™ˆ
TartanVO: A Generalizable Learning-based VO link Carnegie Mellon University πŸ™ˆ
IROS D2VO: Monocular Deep Direct Visual Odometry πŸ™ˆ

2020

Conference Tittle code Author mark
ECCV2020 Pseudo RGB-D for Self-Improving Monocular SLAM and Depth Prediction IIIT-Delhi πŸ™ˆ
CVPR2020 VOLDOR: Visual Odometry from Log-logistic Dense Optical flow Residuals Stevens Institute of Technology πŸ™ˆ
2021 Generalizing to the Open World: Deep Visual Odometry with Online Adaptation Peking University πŸ™ˆ
ICRA2021 SA-LOAM: Semantic-aided LiDAR SLAM with Loop Closure Zhejiang University πŸ™ˆ

Light-Filed-based-depth

Conference Tittle code Author mark
TPAMI2021 Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network Northeastern University πŸ™ˆ
CVPR2021 Differentiable Diffusion for Dense Depth Estimation from Multi-view Images Brown University πŸ™ˆ
IROS2021 Unsupervised Learning of Depth Estimation and Visual Odometry for Sparse Light Field Cameras Brown University πŸ™ˆ
2021 Occlusion-aware Unsupervised Learning of Depth from 4-D Light Fields University of Sydney πŸ™ˆ

6-depth-estimation-and-complementation

Conference Tittle code Author mark
Sparse Auxiliary Networks for Unified Monocular Depth Prediction and Completion Vitor Toyota Research Institute (TRI) πŸ™ˆ
3DV2019 Enhancing self-supervised monocular depth estimation with traditional visual odometry Univrses AB πŸ™ˆ
ECCV2020 S3Net: Semantic-aware self-supervised depth estimation with monocular videos and synthetic data UCSD πŸ™ˆ
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators

Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators This is our Pytorch implementation for t

RUCAIBox 12 Jul 22, 2022
πŸ’ƒ VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena

πŸ’ƒ VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena.

Heidelberg-NLP 17 Nov 07, 2022
Dynamic Slimmable Network (CVPR 2021, Oral)

Dynamic Slimmable Network (DS-Net) This repository contains PyTorch code of our paper: Dynamic Slimmable Network (CVPR 2021 Oral). Architecture of DS-

Changlin Li 197 Dec 09, 2022
PyTorch implementation of Super SloMo by Jiang et al.

Super-SloMo PyTorch implementation of "Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation" by Jiang H., Sun

Avinash Paliwal 2.9k Jan 03, 2023
Pytorch version of SfmLearner from Tinghui Zhou et al.

SfMLearner Pytorch version This codebase implements the system described in the paper: Unsupervised Learning of Depth and Ego-Motion from Video Tinghu

ClΓ©ment Pinard 909 Dec 22, 2022
LaneAF: Robust Multi-Lane Detection with Affinity Fields

LaneAF: Robust Multi-Lane Detection with Affinity Fields This repository contains Pytorch code for training and testing LaneAF lane detection models i

155 Dec 17, 2022
CVPR 2021: "The Spatially-Correlative Loss for Various Image Translation Tasks"

Spatially-Correlative Loss arXiv | website We provide the Pytorch implementation of "The Spatially-Correlative Loss for Various Image Translation Task

Chuanxia Zheng 89 Jan 04, 2023
Code for "Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans" CVPR 2021 best paper candidate

News 05/17/2021 To make the comparison on ZJU-MoCap easier, we save quantitative and qualitative results of other methods at here, including Neural Vo

ZJU3DV 748 Jan 07, 2023
PyTorch implementation of the R2Plus1D convolution based ResNet architecture described in the paper "A Closer Look at Spatiotemporal Convolutions for Action Recognition"

R2Plus1D-PyTorch PyTorch implementation of the R2Plus1D convolution based ResNet architecture described in the paper "A Closer Look at Spatiotemporal

Irhum Shafkat 342 Dec 16, 2022
DeepFaceLive - Live Deep Fake in python, Real-time face swap for PC streaming or video calls

DeepFaceLive - Live Deep Fake in python, Real-time face swap for PC streaming or video calls

8.3k Dec 31, 2022
Snscrape-jsonl-urls-extractor - Extracts urls from jsonl produced by snscrape

snscrape-jsonl-urls-extractor extracts urls from jsonl produced by snscrape Usag

1 Feb 26, 2022
Elegy is a framework-agnostic Trainer interface for the Jax ecosystem.

Elegy Elegy is a framework-agnostic Trainer interface for the Jax ecosystem. Main Features Easy-to-use: Elegy provides a Keras-like high-level API tha

435 Dec 30, 2022
Naszilla is a Python library for neural architecture search (NAS)

A repository to compare many popular NAS algorithms seamlessly across three popular benchmarks (NASBench 101, 201, and 301). You can implement your ow

270 Jan 03, 2023
Tool for live presentations using manim

manim-presentation Tool for live presentations using manim Install pip install manim-presentation opencv-python Usage Use the class Slide as your sce

Federico Galatolo 146 Jan 06, 2023
Reimplementation of the paper `Human Attention Maps for Text Classification: Do Humans and Neural Networks Focus on the Same Words? (ACL2020)`

Human Attention for Text Classification Re-implementation of the paper Human Attention Maps for Text Classification: Do Humans and Neural Networks Foc

Shunsuke KITADA 15 Dec 13, 2021
This repository accompanies the ACM TOIS paper "What can I cook with these ingredients?" - Understanding cooking-related information needs in conversational search

In this repository you find data that has been gathered when conducting in-situ experiments in a conversational cooking setting. These data include tr

6 Sep 22, 2022
Laplacian Score-regularized Concrete Autoencoders

Laplacian Score-regularized Concrete Autoencoders Requirements: torch = 1.9 scikit-learn = 0.24 omegaconf = 2.0.6 scipy = 1.6.0 matplotlib How to

JS 6 Dec 07, 2022
Differential Privacy for Heterogeneous Federated Learning : Utility & Privacy tradeoffs

Differential Privacy for Heterogeneous Federated Learning : Utility & Privacy tradeoffs In this work, we propose an algorithm DP-SCAFFOLD(-warm), whic

19 Nov 10, 2022
DiAne is a smart fuzzer for IoT devices

Diane Diane is a fuzzer for IoT devices. Diane works by identifying fuzzing triggers in the IoT companion apps to produce valid yet under-constrained

seclab 28 Jan 04, 2023
Code for paper "Learning to Reweight Examples for Robust Deep Learning"

learning-to-reweight-examples Code for paper Learning to Reweight Examples for Robust Deep Learning. [arxiv] Environment We tested the code on tensorf

Uber Research 261 Jan 01, 2023