ColossalAI-Examples - Examples of training models with hybrid parallelism using ColossalAI

Last update: Jan 09, 2023

Related tags

Deep Learning ColossalAI-Examples

Overview

ColossalAI-Examples

This repository contains examples of training models with ColossalAI. These examples fall under three categories:

Computer Vision
Natural Language Processing
General examples to demonstrate ColossalAI's features

Discussion

Discussion about the Colossal-AI project and examples is always welcomed! We would love to exchange ideas with the community to better help this project grow. If you think there is a need to discuss anything, you may jump to our dicussion forum and create a topic there.

If you encounter any problem while running these examples, you may want to raise an issue in this repository.

Contributing

This project welcomes constructive ideas and implementations from the community. If you wish to add an example for a specific application, please commit your code either in the image or language folders. If you wish to add new examples to explain our features, you can commit your code in the features folder, we may invite you to put up a tutorial or blog in ColossalAI Documentation.

ColossalAI-Examples - Examples of training models with hybrid parallelism using ColossalAI

Related tags

Overview

ColossalAI-Examples

Discussion

Contributing

Owner

HPC-AI Tech

SwinTrack: A Simple and Strong Baseline for Transformer Tracking

Repository for self-supervised landmark discovery

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

Face Recognition plus identification simply and fast | Python

HyperDict - Self linked dictionary in Python

darija <-> english dictionary

implement of SwiftNet:Real-time Video Object Segmentation

Generative Adversarial Text-to-Image Synthesis

Library to enable Bayesian active learning in your research or labeling work.

CSD: Consistency-based Semi-supervised learning for object Detection

code for CVPR paper Zero-shot Instance Segmentation

Finetune SSL models for MOS prediction

A custom DeepStack model for detecting 16 human actions.

Generative vs Discriminative: Rethinking The Meta-Continual Learning (NeurIPS 2021)

Unsupervised Image-to-Image Translation

Official Repo of my work for SREC Nandyal Machine Learning Bootcamp

Meta-TTS: Meta-Learning for Few-shot SpeakerAdaptive Text-to-Speech

Code for "Learning to Regrasp by Learning to Place"

This code uses generative adversarial networks to generate diverse task allocation plans for Multi-agent teams.

Reference implementation of code generation projects from Facebook AI Research. General toolkit to apply machine learning to code, from dataset creation to model training and evaluation. Comes with pretrained models.