This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight)

This is a pytorch implementation of the NeurIPS paper GAN Memory with No Forgetting.

Generative code template for PixelBeasts 10k NFT project.

Bayesian dessert for Lasagne

Details about the wide minima density hypothesis and metrics to compute width of a minima

Pure python implementations of popular ML algorithms.

SwinIR: Image Restoration Using Swin Transformer

Target Propagation via Regularized Inversion

Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)

A Python implementation of active inference for Markov Decision Processes

Learning hidden low dimensional dyanmics using a Generalized Onsager Principle and neural networks

Finding all things on-prem Microsoft for password spraying and enumeration.

Official Implementation for the "An Empirical Investigation of 3D Anomaly Detection and Segmentation" paper.

Code for Blind Image Decomposition (BID) and Blind Image Decomposition network (BIDeN).

Official implementation of our paper "Learning to Bootstrap for Combating Label Noise"

Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs

Simple Python application to transform Serial data into OSC messages

Implement object segmentation on images using HOG algorithm proposed in CVPR 2005

ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction

chainladder - Property and Casualty Loss Reserving in Python