A unified 3D Transformer Pipeline for visual synthesis

Last update: Jan 03, 2023

Related tags

Overview

This is the official repo for the paper: "NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion".

NÜWA is a unified multimodal pre-trained model that can generate new or manipulate existing visual data (i.e., images and videos) for 8 visual synthesis tasks (as shown above).

Samples

Text-To-Image (T2I)

SKetch-to-Image (S2I)

Image Completion (I2I)

Text-Guided Image Manipulation (TI2I)

Text-to-Video(T2V)

Video Prediction (V2V)

Sketch-to-Video (S2V)

Text-Guided Video Manipulation (TV2V)

Owner

Microsoft

Open source projects and samples from Microsoft

GitHub Repository

Official pytorch implementation of the paper: "SinGAN: Learning a Generative Model from a Single Natural Image"

SinGAN Project | Arxiv | CVF | Supplementary materials | Talk (ICCV`19) Official pytorch implementation of the paper: "SinGAN: Learning a Generative M

3.2k Dec 25, 2022

Sign Language Translation with Transformers (COLING'2020, ECCV'20 SLRTP Workshop)

transformer-slt This repository gathers data and code supporting the experiments in the paper Better Sign Language Translation with STMC-Transformer.

107 Dec 27, 2022

AI-UPV at IberLEF-2021 EXIST task: Sexism Prediction in Spanish and English Tweets Using Monolingual and Multilingual BERT and Ensemble Models

AI-UPV at IberLEF-2021 EXIST task: Sexism Prediction in Spanish and English Tweets Using Monolingual and Multilingual BERT and Ensemble Models Descrip

1 Jun 08, 2022

TensorFlow implementation for Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How

Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How TensorFlow implementation for Bayesian Modeling and Unce

8 Sep 02, 2022

A unified 3D Transformer Pipeline for visual synthesis

Related tags

Overview

Overview

Samples

Text-To-Image (T2I)

SKetch-to-Image (S2I)

Image Completion (I2I)

Text-Guided Image Manipulation (TI2I)

Text-to-Video(T2V)

Video Prediction (V2V)

Sketch-to-Video (S2V)

Text-Guided Video Manipulation (TV2V)

Owner

Microsoft

Official pytorch implementation of the paper: "SinGAN: Learning a Generative Model from a Single Natural Image"

Sign Language Translation with Transformers (COLING'2020, ECCV'20 SLRTP Workshop)

AI-UPV at IberLEF-2021 EXIST task: Sexism Prediction in Spanish and English Tweets Using Monolingual and Multilingual BERT and Ensemble Models

PSML: A Multi-scale Time-series Dataset for Machine Learning in Decarbonized Energy Grids

This project uses ViT to perform image classification tasks on DATA set CIFAR10.

Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptation

PromptDet: Expand Your Detector Vocabulary with Uncurated Images

StyleGAN2 - Official TensorFlow Implementation

AI Toolkit for Healthcare Imaging

Segmentation vgg16 fcn - cityscapes

piSTAR Lab is a modular platform built to make AI experimentation accessible and fun. (pistar.ai)

Neuralnetwork - Basic Multilayer Perceptron Neural Network for deep learning

这是一个利用facenet和retinaface实现人脸识别的库，可以进行在线的人脸识别。

Codebase for testing whether hidden states of neural networks encode discrete structures.

Artificial intelligence technology inferring issues and logically supporting facts from raw text

Implementation of a Transformer using ReLA (Rectified Linear Attention)

Code release for our paper, "SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereo"

Code for the ICASSP-2021 paper: Continuous Speech Separation with Conformer.

Contrastive Learning with Non-Semantic Negatives

TensorFlow implementation for Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How