A collection of Jupyter notebooks to play with NVIDIA's StyleGAN3 and OpenAI's CLIP for a text-based guided image generation.

Last update: Dec 30, 2022

Overview

StyleGAN3 CLIP-based guidance

StyleGAN3 + CLIP

StyleGAN3 + inversion + CLIP

This repo is a collection of Jupyter notebooks made to easily play with StyleGAN3¹ and CLIP² for a text-based guided image generation.

Both notebooks are heavily based on this notebook, created by nshepperd (thank you!).

Special thanks too to Katherine Crowson for coming up with many improved sampling tricks, as well as some of the code.

Feel free to suggest any changes! If anyone has any idea what license should this repo use, please let me know.

StyleGAN3 was created by NVIDIA. Here is the original repo. ↩
CLIP (Contrastive Language-Image Pre-Training) is a multimodal model made by OpenAI. For more information head over here. ↩

Owner

Eugenio Herrera

Data Scientist, Full-Stack Engineer, and aspiring Researcher.

GitHub Repository

This is a Deep Leaning API for classifying emotions from human face and human audios.

Emotion AI This is a Deep Leaning API for classifying emotions from human face and human audios. Starting the server To start the server first you nee

5 Oct 02, 2022

Official implementation of ACMMM'20 paper 'Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework'

Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework Official code for paper, Self-supervised Video Representation Le

103 Dec 21, 2022

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation, CVPR 2018

Learning Pixel-level Semantic Affinity with Image-level Supervision This code is deprecated. Please see https://github.com/jiwoon-ahn/irn instead. Int

337 Dec 15, 2022

Baseline powergrid model for NY

Baseline-powergrid-model-for-NY Table of Contents About The Project Built With Usage License Contact Acknowledgements About The Project As the urgency

6 Nov 24, 2022

[NeurIPS 2021] "Delayed Propagation Transformer: A Universal Computation Engine towards Practical Control in Cyber-Physical Systems"

Delayed Propagation Transformer: A Universal Computation Engine towards Practical Control in Cyber-Physical Systems Introduction Multi-agent control i

6 May 05, 2022

PyTorch Implementation of ByteDance's Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speech

Cross-Speaker-Emotion-Transfer - PyTorch Implementation PyTorch Implementation of ByteDance's Cross-speaker Emotion Transfer Based on Speaker Conditio

114 Jan 08, 2023

A set of tools for creating and testing machine learning features, with a scikit-learn compatible API

Feature Forge This library provides a set of tools that can be useful in many machine learning applications (classification, clustering, regression, e

380 Nov 05, 2022

Turn based roguelike in python

pyTB Turn based roguelike in python Documentation can be found here: http://mcgillij.github.io/pyTB/index.html Screenshot Dependencies Written in Pyth

4 Sep 29, 2022

Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker

Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker A example FastAPI PyTorch Model deploy with nvidia/cuda base docker. Model

68 Jan 04, 2023

ML model to classify between cats and dogs

Cats-and-dogs-classifier This is my first ML model which can classify between cats and dogs. Here the accuracy is around 75%, however , the accuracy c

4 Aug 20, 2021

In this work, we will implement some basic but important algorithm of machine learning step by step.

WoRkS continued English 中文 Français Probability Density Estimation-Non-Parametric Methods(概率密度估计-非参数方法) 1. Kernel / k-Nearest Neighborhood Density Est

1 Dec 30, 2021

Official implementation of DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representations in TensorFlow 2

DreamerPro Official implementation of DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representations in TensorFl

22 Nov 01, 2022

Implementation of the state of the art beat-detection, downbeat-detection and tempo-estimation model

The ISMIR 2020 Beat Detection, Downbeat Detection and Tempo Estimation Model Implementation. This is an implementation in TensorFlow to implement the

1 Nov 12, 2021

improvement of CLIP features over the traditional resnet features on the visual question answering, image captioning, navigation and visual entailment tasks.

CLIP-ViL In our paper "How Much Can CLIP Benefit Vision-and-Language Tasks?", we show the improvement of CLIP features over the traditional resnet fea

310 Dec 28, 2022

A collection of Jupyter notebooks to play with NVIDIA's StyleGAN3 and OpenAI's CLIP for a text-based guided image generation.

Related tags

Overview

StyleGAN3 CLIP-based guidance

StyleGAN3 + CLIP

StyleGAN3 + inversion + CLIP

Owner

Eugenio Herrera

This is a Deep Leaning API for classifying emotions from human face and human audios.

Official implementation of ACMMM'20 paper 'Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework'

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation, CVPR 2018

Baseline powergrid model for NY

[NeurIPS 2021] "Delayed Propagation Transformer: A Universal Computation Engine towards Practical Control in Cyber-Physical Systems"

PyTorch Implementation of ByteDance's Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speech

A set of tools for creating and testing machine learning features, with a scikit-learn compatible API

Turn based roguelike in python

Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker

ML model to classify between cats and dogs

In this work, we will implement some basic but important algorithm of machine learning step by step.

Official implementation of DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representations in TensorFlow 2

Implementation of the state of the art beat-detection, downbeat-detection and tempo-estimation model

improvement of CLIP features over the traditional resnet features on the visual question answering, image captioning, navigation and visual entailment tasks.

Unsupervised Representation Learning by Invariance Propagation

A PyTorch Lightning solution to training OpenAI's CLIP from scratch.

Little tool in python to watch anime from the terminal (the better way to watch anime)

Qlib is an AI-oriented quantitative investment platform

Python Rapid Artificial Intelligence Ab Initio Molecular Dynamics

🐾 Semantic segmentation of paws from cute pet images (PyTorch)

A collection of Jupyter notebooks to play with NVIDIA's StyleGAN3 and OpenAI's CLIP for a text-based guided image generation.

Related tags

Overview

StyleGAN3 CLIP-based guidance

StyleGAN3 + CLIP

StyleGAN3 + inversion + CLIP

Footnotes

Owner

Eugenio Herrera

This is a Deep Leaning API for classifying emotions from human face and human audios.

Official implementation of ACMMM'20 paper 'Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework'

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation, CVPR 2018

Baseline powergrid model for NY

[NeurIPS 2021] "Delayed Propagation Transformer: A Universal Computation Engine towards Practical Control in Cyber-Physical Systems"

PyTorch Implementation of ByteDance's Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speech

A set of tools for creating and testing machine learning features, with a scikit-learn compatible API

Turn based roguelike in python

Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker

ML model to classify between cats and dogs

In this work, we will implement some basic but important algorithm of machine learning step by step.

Official implementation of DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representations in TensorFlow 2

Implementation of the state of the art beat-detection, downbeat-detection and tempo-estimation model

improvement of CLIP features over the traditional resnet features on the visual question answering, image captioning, navigation and visual entailment tasks.

Unsupervised Representation Learning by Invariance Propagation

A PyTorch Lightning solution to training OpenAI's CLIP from scratch.

Little tool in python to watch anime from the terminal (the better way to watch anime)

Qlib is an AI-oriented quantitative investment platform

Python Rapid Artificial Intelligence Ab Initio Molecular Dynamics

🐾 Semantic segmentation of paws from cute pet images (PyTorch)