This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

DTCN SMP Challenge - Sequential prediction learning framework and algorithm

CVPR2022 (Oral) - Rethinking Semantic Segmentation: A Prototype View

DSAC* for Visual Camera Re-Localization (RGB or RGB-D)

RL algorithm PPO and IRL algorithm AIRL written with Tensorflow.

A knowledge base construction engine for richly formatted data

ImageNet Adversarial Image Evaluation

robomimic: A Modular Framework for Robot Learning from Demonstration

Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance

A pre-trained language model for social media text in Spanish

Official repository of the paper "GPR1200: A Benchmark for General-PurposeContent-Based Image Retrieval"

BOOKSUM: A Collection of Datasets for Long-form Narrative Summarization

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Ratatoskr: Worcester Tech's conference scheduling system

Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track (SIGIR 2021 Full Paper).

FlowTorch is a PyTorch library for learning and sampling from complex probability distributions using a class of methods called Normalizing Flows

DuBE: Duple-balanced Ensemble Learning from Skewed Data

Animate molecular orbital transitions using Psi4 and Blender

Deeper DCGAN with AE stabilization

This git repo contains the implementation of my ML project on Heart Disease Prediction

A Simulated Optimal Intrusion Response Game