Office source code of paper UniFuse: Unidirectional Fusion for 360$^\circ$ Panorama Depth Estimation

Last update: Dec 26, 2022

Overview

UniFuse (RAL+ICRA2021)

Office source code of paper UniFuse: Unidirectional Fusion for 360$^\circ$ Panorama Depth Estimation, arXiv, Demo

Preparation

Installation

Environments

python 3.6
Pytorch >= 1.0.0
CUDA >= 9.0

Install requirements

pip install -r requirements.txt

Datasets

Please download the preferred datasets, i.e., Matterport3D, Stanford2D3D, 3D60 and PanoSUNCG. For Matterport3D, please preprocess it following M3D-README.md.

Training

UniFuse on Matterport3D

python train.py --data_path $DATA_PATH \
-dataset matterport3d \
--model_name Matterport3D_UniFuse \
--batch_size 6 \
--num_epochs 100 \
--height 512 \
--width 1024 \
--imagenet_pretrained \
--net UniFuse

Equirectangular baseline on Matterport3D

python train.py --data_path $DATA_PATH \
-dataset matterport3d \
--model_name Matterport3D_Equi \
--batch_size 6 \
--num_epochs 100 \
--height 512 \
--width 1024 \
--imagenet_pretrained \
--net Equi

It is similar for other datasets.

Evaluation

Pre-trained models

The pre-trained models of UniFuse for 4 datasets are available, Matterport3D, Stanford2D3D, 3D60 and PanoSUNCG.

Test on a pre-trained model

python evaluate.py  --data_path $DATA_PATH --dataset matterport3d --load_weights_folder $MODEL_PATH

Citation

Please cite our paper if you find our work useful in your research.

@article{jiang2021unifuse,
      title={UniFuse: Unidirectional Fusion for 360$^{\circ}$ Panorama Depth Estimation}, 
      author={Hualie Jiang and Zhe Sheng and Siyu Zhu and Zilong Dong and Rui Huang},
	  journal={IEEE Robotics and Automation Letters},
	  year={2021},
	  publisher={IEEE}
}

Office source code of paper UniFuse: Unidirectional Fusion for 360$^\circ$ Panorama Depth Estimation

Related tags

Overview

UniFuse (RAL+ICRA2021)

Preparation

Installation

Datasets

Training

UniFuse on Matterport3D

Equirectangular baseline on Matterport3D

Evaluation

Pre-trained models

Test on a pre-trained model

Citation

Owner

Alibaba

Code for the paper "How Attentive are Graph Attention Networks?"

This repository contains a pytorch implementation of "StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision".

Iowa Project - My second project done at General Assembly, focused on feature engineering and understanding Linear Regression as a concept

OpenDelta - An Open-Source Framework for Paramter Efficient Tuning.

Pointer-generator - Code for the ACL 2017 paper Get To The Point: Summarization with Pointer-Generator Networks

The self-supervised goal reaching benchmark introduced in Discovering and Achieving Goals via World Models

A very tiny, very simple, and very secure file encryption tool.

Code for EMNLP2021 paper "Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training"

End-to-end speech secognition toolkit

TeST: Temporal-Stable Thresholding for Semi-supervised Learning

learning and feeling SLAM together with hands-on-experiments

Research on Tabular Deep Learning (Python package & papers)

A library for preparing, training, and evaluating scalable deep learning hybrid recommender systems using PyTorch.

Training PSPNet in Tensorflow. Reproduce the performance from the paper.

⚓ Eurybia monitor model drift over time and securize model deployment with data validation

Algorithmic trading using machine learning.

A foreign language learning aid using a neural network to predict probability of translating foreign words

This repository contains the code for designing risk bounded motion plans for car-like robot using Carla Simulator.

Regression Metrics Calculation Made easy for tensorflow2 and scikit-learn

Method for facial emotion recognition compitition of Xunfei and Datawhale .