A curated list of neural rendering resources.

Overview

Awesome-of-Neural-Rendering Awesome

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

Type of Neural-Rendering

Type View `` `` `` `` `` Other
Explanation View Synthesis other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title Venue Type Code Star
ICCV Other PyTorch(Author) ``
Self-Calibrating Neural Radiance Fields ICCV Other PyTorch(Author) 72
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering ICLR-Oral Other PyTorch(Author) ``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields ICCV-Oral Other PyTorch(Author) ``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering ICCV Other PyTorch(Author) 128
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting CVPR Other PyTorch(Author) 33
IBRNet: Learning Multi-View Image-Based Rendering CVPR View PyTorch(Author) 126
NeX: Real-time View Synthesis with Neural Basis Expansion CVPR-Oral View PyTorch(Author) 320
Neural Lumigraph Rendering CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) 80
pixelNeRF: Neural Radiance Fields from One or Few Images CVPR View PyTorch(Author) 456
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes CVPR View PyTorch(Author) 32
D-NeRF: Neural Radiance Fields for Dynamic Scenes CVPR Other PyTorch(Author) 61
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) ``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields CVPR-BestPaper Other PyTorch(Author) 609
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination SIGGRAPH Asia Other PyTorch(Author) 104

2020

Title Venue Type Code Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material NeurIPS Other PyTorch(Author) 223
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis NeurIPS Other PyTorch(Author) 183
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision CVPR Other PyTorch(Author) 471
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis ECCV-Oral View TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd) 3.6k/1.1k/429/19.2k

2019

Title Venue Type Code Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines SIGGRAPH View PyTorch(Author) 691
Deferred Neural Rendering: Image Synthesis using Neural Textures SIGGRAPH Other PyTorch(Author) 123
Geometry-Aware Neural Rendering NeurIPS Other PyTorch(Author) ``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations NeurIPS-Oral Other PyTorch(Author) 287
Monocular Neural Image Based Rendering with Continuous View Control ICCV Other PyTorch(Author) 43
CVPR Other PyTorch(Author) ``

2018

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2017

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2016

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

Previous Venues

Title Venue Type Code Star
Ray-casting Point-in-polyhedron Test 2012-CESCG Other -

Arxiv

Title Date Type Code Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field 2021.08.04 View -
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs 2021.08.02 Other PyTorch(Author) 169
Neural Rays for Occlusion-aware Image-based Rendering 2021.07.28 Other PyTorch(Author) 13
Fast and Explicit Neural View Synthesis 2021.07.12 View -
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields 2021.06.24 Other PyTorch(Author) ``
Volume Rendering of Neural Implicit Surfaces 2021.06.22 Other -
Learning to Stylize Novel Views 2021.05.27 `` -
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis 2021.04.28 Other PyTorch(Author) 7
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling 2021.04.17 `` PyTorch(Author) ``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation 2021.04.02 Other PyTorch(Author) ``
Inverting Neural Radiance Fields for Pose Estimation 2021.04.01 Other -
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination 2021.01.04 Other PyTorch(Author) 115
2021.08.10 `` PyTorch(Author) ``
2021.08.10 `` PyTorch(Author) ``

Awesome Surveys

Awesome Blogs

Videos

Datasets

Tools

Owner
Zhiwei ZHANG
Zhiwei ZHANG
An end-to-end implementation of intent prediction with Metaflow and other cool tools

You Don't Need a Bigger Boat An end-to-end (Metaflow-based) implementation of an intent prediction flow for kids who can't MLOps good and wanna learn

Jacopo Tagliabue 614 Dec 31, 2022
Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

T-Zero This repository serves primarily as codebase and instructions for training, evaluation and inference of T0. T0 is the model developed in Multit

BigScience Workshop 253 Dec 27, 2022
MolRep: A Deep Representation Learning Library for Molecular Property Prediction

MolRep: A Deep Representation Learning Library for Molecular Property Prediction Summary MolRep is a Python package for fairly measuring algorithmic p

AI-Health @NSCC-gz 83 Dec 24, 2022
Source code for "Interactive All-Hex Meshing via Cuboid Decomposition [SIGGRAPH Asia 2021]".

Interactive All-Hex Meshing via Cuboid Decomposition Video demonstration This repository contains an interactive software to the PolyCube-based hex-me

Lingxiao Li 131 Dec 05, 2022
Code for our CVPR 2022 Paper "GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detection"

GEN-VLKT Code for our CVPR 2022 paper "GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detection". Contributed by Yue Lia

Yue Liao 47 Dec 04, 2022
Efficient Lottery Ticket Finding: Less Data is More

The lottery ticket hypothesis (LTH) reveals the existence of winning tickets (sparse but critical subnetworks) for dense networks, that can be trained in isolation from random initialization to match

VITA 20 Sep 04, 2022
[ICLR2021] Unlearnable Examples: Making Personal Data Unexploitable

Unlearnable Examples Code for ICLR2021 Spotlight Paper "Unlearnable Examples: Making Personal Data Unexploitable " by Hanxun Huang, Xingjun Ma, Sarah

Hanxun Huang 98 Dec 07, 2022
Rendering color and depth images for ShapeNet models.

Color & Depth Renderer for ShapeNet This library includes the tools for rendering multi-view color and depth images of ShapeNet models. Physically bas

Yinyu Nie 41 Dec 19, 2022
LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT

LightHuBERT LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT | Github | Huggingface | SUPER

WangRui 46 Dec 29, 2022
PyTorch implementation of the Value Iteration Networks (VIN) (NIPS '16 best paper)

Value Iteration Networks in PyTorch Tamar, A., Wu, Y., Thomas, G., Levine, S., and Abbeel, P. Value Iteration Networks. Neural Information Processing

LEI TAI 75 Nov 24, 2022
Official project repository for 'Normality-Calibrated Autoencoder for Unsupervised Anomaly Detection on Data Contamination'

NCAE_UAD Official project repository of 'Normality-Calibrated Autoencoder for Unsupervised Anomaly Detection on Data Contamination' Abstract In this p

Jongmin Andrew Yu 2 Feb 10, 2022
Demonstration of transfer of knowledge and generalization with distillation

Distilling-the-Knowledge-in-a-Neural-Network This is an implementation of a part of the paper "Distilling the Knowledge in a Neural Network" (https://

26 Nov 25, 2022
Cobalt Strike teamserver detection.

Cobalt-Strike-det Cobalt Strike teamserver detection. usage: cobaltstrike_verify.py [-l TARGETS] [-t THREADS] optional arguments: -h, --help show this

TimWhite 17 Sep 27, 2022
[Preprint] "Bag of Tricks for Training Deeper Graph Neural Networks A Comprehensive Benchmark Study" by Tianlong Chen*, Kaixiong Zhou*, Keyu Duan, Wenqing Zheng, Peihao Wang, Xia Hu, Zhangyang Wang

Bag of Tricks for Training Deeper Graph Neural Networks: A Comprehensive Benchmark Study Codes for [Preprint] Bag of Tricks for Training Deeper Graph

VITA 101 Dec 29, 2022
Official PyTorch implementation of the paper "Self-Supervised Relational Reasoning for Representation Learning", NeurIPS 2020 Spotlight.

Official PyTorch implementation of the paper: "Self-Supervised Relational Reasoning for Representation Learning" (2020), Patacchiola, M., and Storkey,

Massimiliano Patacchiola 135 Jan 03, 2023
Learning based AI for playing multi-round Koi-Koi hanafuda card games. Have fun.

Koi-Koi AI Learning based AI for playing multi-round Koi-Koi hanafuda card games. Platform Python PyTorch PySimpleGUI (for the interface playing vs AI

Sanghai Guan 10 Nov 20, 2022
Probabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking

Probabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking (CVPR 2021) Pytorch implementation of the ArTIST motion model. In this repo

Fatemeh 38 Dec 12, 2022
a simple, efficient, and intuitive text editor

Oxygen beta a simple, efficient, and intuitive text editor Overview oxygen is a simple, efficient, and intuitive text editor designed as more featured

Aarush Gupta 1 Feb 23, 2022
Official PyTorch implementation of the ICRA 2021 paper: Adversarial Differentiable Data Augmentation for Autonomous Systems.

Adversarial Differentiable Data Augmentation This repository provides the official PyTorch implementation of the ICRA 2021 paper: Adversarial Differen

Manli 3 Oct 15, 2022
Learning Representations that Support Robust Transfer of Predictors

Transfer Risk Minimization (TRM) Code for Learning Representations that Support Robust Transfer of Predictors Prepare the Datasets Preprocess the Scen

Yilun Xu 15 Dec 07, 2022