A curated list of neural rendering resources.

Last update: Dec 09, 2022

Related tags

Deep Learning Awesome-of-Neural-Rendering

Overview

Awesome-of-Neural-Rendering

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

Type of Neural-Rendering
Neural-Rendering
Awesome Surveys
Awesome Blogs
Videos
Datasets
Tools

Type of Neural-Rendering

Type	`View`	``	``	``	``	``	`Other`
Explanation	View Synthesis						other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title	Venue	Type	Code	Star
	ICCV	`Other`	PyTorch(Author)	``
Self-Calibrating Neural Radiance Fields	ICCV	`Other`	PyTorch(Author)	`72`
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering	ICLR-Oral	`Other`	PyTorch(Author)	``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields	ICCV-Oral	`Other`	PyTorch(Author)	``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering	ICCV	`Other`	PyTorch(Author)	`128`
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting	CVPR	`Other`	PyTorch(Author)	`33`
IBRNet: Learning Multi-View Image-Based Rendering	CVPR	`View`	PyTorch(Author)	`126`
NeX: Real-time View Synthesis with Neural Basis Expansion	CVPR-Oral	`View`	PyTorch(Author)	`320`
Neural Lumigraph Rendering	CVPR	`Other`	PyTorch(Author)	``
AutoInt: Automatic Integration for Fast Neural Volume Rendering	CVPR	`Other`	PyTorch(Author)	`80`
pixelNeRF: Neural Radiance Fields from One or Few Images	CVPR	`View`	PyTorch(Author)	`456`
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes	CVPR	`View`	PyTorch(Author)	`32`
D-NeRF: Neural Radiance Fields for Dynamic Scenes	CVPR	`Other`	PyTorch(Author)	`61`
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis	CVPR	`Other`	PyTorch(Author)	``
AutoInt: Automatic Integration for Fast Neural Volume Rendering	CVPR	`Other`	PyTorch(Author)	``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields	CVPR-BestPaper	`Other`	PyTorch(Author)	`609`
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	SIGGRAPH Asia	`Other`	PyTorch(Author)	`104`

2020

Title	Venue	Type	Code	Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material	NeurIPS	`Other`	PyTorch(Author)	`223`
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis	NeurIPS	`Other`	PyTorch(Author)	`183`
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision	CVPR	`Other`	PyTorch(Author)	`471`
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
	CVPR	``	PyTorch(Author)	``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis	ECCV-Oral	`View`	TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd)	`3.6k/1.1k/429/19.2k`

2019

Title	Venue	Type	Code	Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines	SIGGRAPH	`View`	PyTorch(Author)	`691`
Deferred Neural Rendering: Image Synthesis using Neural Textures	SIGGRAPH	`Other`	PyTorch(Author)	`123`
Geometry-Aware Neural Rendering	NeurIPS	`Other`	PyTorch(Author)	``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations	NeurIPS-Oral	`Other`	PyTorch(Author)	`287`
Monocular Neural Image Based Rendering with Continuous View Control	ICCV	`Other`	PyTorch(Author)	`43`
	CVPR	`Other`	PyTorch(Author)	``

2018

Title	Venue	Type	Code	Star
	CVPR	`Other`	PyTorch(Author)	``

2017

Title	Venue	Type	Code	Star
	CVPR	`Other`	PyTorch(Author)	``

2016

Title	Venue	Type	Code	Star
	CVPR	`Other`	PyTorch(Author)	``

Previous Venues

Title	Venue	Type	Code	Star
Ray-casting Point-in-polyhedron Test	2012-CESCG	`Other`	-

Arxiv

Title	Date	Type	Code	Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field	2021.08.04	`View`	-
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs	2021.08.02	`Other`	PyTorch(Author)	`169`
Neural Rays for Occlusion-aware Image-based Rendering	2021.07.28	`Other`	PyTorch(Author)	`13`
Fast and Explicit Neural View Synthesis	2021.07.12	`View`	-
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields	2021.06.24	`Other`	PyTorch(Author)	``
Volume Rendering of Neural Implicit Surfaces	2021.06.22	`Other`	-
Learning to Stylize Novel Views	2021.05.27	``	-
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis	2021.04.28	`Other`	PyTorch(Author)	`7`
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling	2021.04.17	``	PyTorch(Author)	``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation	2021.04.02	`Other`	PyTorch(Author)	``
Inverting Neural Radiance Fields for Pose Estimation	2021.04.01	`Other`	-
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination	2021.01.04	`Other`	PyTorch(Author)	`115`
	2021.08.10	``	PyTorch(Author)	``
	2021.08.10	``	PyTorch(Author)	``

Awesome Surveys

Awesome Blogs

Videos

Datasets

Tools

Owner

Zhiwei ZHANG

Zhiwei ZHANG

GitHub Repository

alfred-py: A deep learning utility library for human

Alfred Alfred is command line tool for deep-learning usage. if you want split an video into image frames or combine frames into a single video, then a

800 Jan 03, 2023

Annotated notes and summaries of the TensorFlow white paper, along with SVG figures and links to documentation

TensorFlow White Paper Notes Features Notes broken down section by section, as well as subsection by subsection Relevant links to documentation, resou

437 Oct 09, 2022

Official PyTorch implementation for paper Context Matters: Graph-based Self-supervised Representation Learning for Medical Images

Context Matters: Graph-based Self-supervised Representation Learning for Medical Images Official PyTorch implementation for paper Context Matters: Gra

49 Nov 23, 2022

Official implementation of paper "Query2Label: A Simple Transformer Way to Multi-Label Classification".

Introdunction This is the official implementation of the paper "Query2Label: A Simple Transformer Way to Multi-Label Classification". Abstract This pa

274 Dec 28, 2022

CTRL-C: Camera calibration TRansformer with Line-Classification

CTRL-C: Camera calibration TRansformer with Line-Classification This repository contains the official code and pretrained models for CTRL-C (Camera ca

57 Nov 14, 2022

Code for Reciprocal Adversarial Learning for Brain Tumor Segmentation: A Solution to BraTS Challenge 2021 Segmentation Task

BRATS 2021 Solution For Segmentation Task This repo contains the supported pytorch code and configuration files to reproduce 3D medical image segmenta

6 Sep 15, 2022

Help you understand Manual and w/ Clutch point while driving.

简体中文 forza_auto_gear forza_auto_gear is a tool for Forza Horizon 5. It will help us understand the best gear shift point using Manual or w/ Clutch in

15 Oct 08, 2022

Python Multi-Agent Reinforcement Learning framework

- Please pay attention to the version of SC2 you are using for your experiments. - Performance is *not* always comparable between versions. - The re

1.3k Jan 05, 2023

python 93% acc. CNN Dogs Vs Cats ( Pytorch )

English | 简体中文（测试中...敬请期待） Cnn-Classification-Dog-Vs-Cat 猫狗辨别 (pytorch版本) CNN Resnet18 的猫狗分类器，基于ResNet及其变体网路系列，对于一般的图像识别任务表现优异，模型精准度高达93%（小型样本）。项目制作于

1 May 22, 2022

Repo for my Tensorflow/Keras CV experiments. Mostly revolving around the Danbooru20xx dataset

SW-CV-ModelZoo Repo for my Tensorflow/Keras CV experiments. Mostly revolving around the Danbooru20xx dataset Framework: TF/Keras 2.7 Training SQLite D

20 Dec 27, 2022

Implementation for our AAAI2021 paper (Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction).

SSAN Introduction This is the pytorch implementation of the SSAN model (see our AAAI2021 paper: Entity Structure Within and Throughout: Modeling Menti

69 Nov 15, 2022

The code for replicating the experiments from the LFI in SSMs with Unknown Dynamics paper.

Likelihood-Free Inference in State-Space Models with Unknown Dynamics This package contains the codes required to run the experiments in the paper. Th

0 Dec 27, 2021

"Domain Adaptive Semantic Segmentation without Source Data" (ACM MM 2021)

LDBE Pytorch implementation for two papers (the paper will be released soon): "Domain Adaptive Semantic Segmentation without Source Data", ACM MM2021.

16 Sep 28, 2022

Single-Stage 6D Object Pose Estimation, CVPR 2020

Overview This repository contains the code for the paper Single-Stage 6D Object Pose Estimation. Yinlin Hu, Pascal Fua, Wei Wang and Mathieu Salzmann.

89 Dec 26, 2022

Pacman-AI - AI project designed by UC Berkeley. Designed reflex and minimax agents for the game Pacman.

Pacman AI Jussi Doherty CAP 4601 - Introduction to Artificial Intelligence - Fall 2020 Python version 3.0+ Source of this project This repo contains a

1 Jan 03, 2022

Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning

Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning This repository is the official implementation of CARE.

89 Dec 02, 2022

Code for the paper "Functional Regularization for Reinforcement Learning via Learned Fourier Features"

Reinforcement Learning with Learned Fourier Features State-space Soft Actor-Critic Experiments Move to the state-SAC-LFF repository. cd state-SAC-LFF

10 Nov 11, 2022

Learning to Simulate Dynamic Environments with GameGAN (CVPR 2020)

Learning to Simulate Dynamic Environments with GameGAN PyTorch code for GameGAN Learning to Simulate Dynamic Environments with GameGAN Seung Wook Kim,

199 Dec 26, 2022

基于YoloX目标检测+DeepSort算法实现多目标追踪Baseline

项目简介：使用YOLOX+Deepsort实现车辆行人追踪和计数，代码封装成一个Detector类，更容易嵌入到自己的项目中。代码地址（欢迎star）： https://github.com/Sharpiless/yolox-deepsort/ 最终效果：运行demo： python demo

114 Dec 30, 2022

Train a deep learning net with OpenStreetMap features and satellite imagery.

DeepOSM Classify roads and features in satellite imagery, by training neural networks with OpenStreetMap (OSM) data. DeepOSM can: Download a chunk of

1.3k Nov 24, 2022