Office source code of paper UniFuse: Unidirectional Fusion for 360$^\circ$ Panorama Depth Estimation

Last update: Dec 26, 2022

Overview

UniFuse (RAL+ICRA2021)

Office source code of paper UniFuse: Unidirectional Fusion for 360$^\circ$ Panorama Depth Estimation, arXiv, Demo

Preparation

Installation

Environments

python 3.6
Pytorch >= 1.0.0
CUDA >= 9.0

Install requirements

pip install -r requirements.txt

Datasets

Please download the preferred datasets, i.e., Matterport3D, Stanford2D3D, 3D60 and PanoSUNCG. For Matterport3D, please preprocess it following M3D-README.md.

Training

UniFuse on Matterport3D

python train.py --data_path $DATA_PATH \
-dataset matterport3d \
--model_name Matterport3D_UniFuse \
--batch_size 6 \
--num_epochs 100 \
--height 512 \
--width 1024 \
--imagenet_pretrained \
--net UniFuse

Equirectangular baseline on Matterport3D

python train.py --data_path $DATA_PATH \
-dataset matterport3d \
--model_name Matterport3D_Equi \
--batch_size 6 \
--num_epochs 100 \
--height 512 \
--width 1024 \
--imagenet_pretrained \
--net Equi

It is similar for other datasets.

Evaluation

Pre-trained models

The pre-trained models of UniFuse for 4 datasets are available, Matterport3D, Stanford2D3D, 3D60 and PanoSUNCG.

Test on a pre-trained model

python evaluate.py  --data_path $DATA_PATH --dataset matterport3d --load_weights_folder $MODEL_PATH

Citation

Please cite our paper if you find our work useful in your research.

@article{jiang2021unifuse,
      title={UniFuse: Unidirectional Fusion for 360$^{\circ}$ Panorama Depth Estimation}, 
      author={Hualie Jiang and Zhe Sheng and Siyu Zhu and Zilong Dong and Rui Huang},
	  journal={IEEE Robotics and Automation Letters},
	  year={2021},
	  publisher={IEEE}
}

Office source code of paper UniFuse: Unidirectional Fusion for 360$^\circ$ Panorama Depth Estimation

Related tags

Overview

UniFuse (RAL+ICRA2021)

Preparation

Installation

Datasets

Training

UniFuse on Matterport3D

Equirectangular baseline on Matterport3D

Evaluation

Pre-trained models

Test on a pre-trained model

Citation

Owner

Alibaba

A Python package for faster, safer, and simpler ML processes

Official implementation of the paper: "LDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speech"

Artificial Neural network regression model to predict the energy output in a combined cycle power plant.

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

PyTorch implementation of paper "Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes", CVPR 2021

Official pytorch implementation of "DSPoint: Dual-scale Point Cloud Recognition with High-frequency Fusion"

Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers [CVPR 2021]

Code for the published paper : Learning to recognize rare traffic sign

A annotation of yolov5-5.0

Sign Language is detected in realtime using video sequences. Our approach involves MediaPipe Holistic for keypoints extraction and LSTM Model for prediction.

Implementation of the pix2pix model on satellite images

Exploration & Research into cross-domain MEV. Initial focus on ETH/POLYGON.

Open source person re-identification library in python

Bling's Object detection tool

Interpretable and Generalizable Person Re-Identification with Query-Adaptive Convolution and Temporal Lifting

A library for preparing, training, and evaluating scalable deep learning hybrid recommender systems using PyTorch.

Practical Blind Denoising via Swin-Conv-UNet and Data Synthesis

PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "

This is a deep learning-based method to segment deep brain structures and a brain mask from T1 weighted MRI.

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable.