FAIMED 3D

use fastai to quickly train fully three-dimensional models on radiological data

Classification

from faimed3d.all import *

Load data in various medical formats (DICOM, NIfTI, NRRD) or even videos as simple as in fastai.

d = pd.read_csv('../data/radiopaedia_cases.csv')
dls = ImageDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

Faimed3d provides multiple model architectures, pretrained on the UCF101 dataset for action recoginiton, which can be used for transfer learning.

Model	3-fold accuracy	duration/epoch	model size
efficientnet b0	92.5 %	9M:35S	48.8 MB
efficientnet b1	90.1 %	13M:20S	80.5 MB
resnet 18	87.6 %	6M:57S	339.1 MB
resnet 50	94.8 %	12M:16S	561.2 MB
resnet 101	96.0 %	17M:20S	1,030 MB

# slow
learn = cnn_learner_3d(dls, efficientnet_b0)

# slow
learn.lr_find()

SuggestedLRs(lr_min=0.014454397559165954, lr_steep=6.309573450380412e-07)

Click here for a more in-depth classification example.

Segmentation

dls = SegmentationDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

All models in faimed3d can be used as a backbone for U-Nets, even with pre-trained weights.

# slow
learn = unet_learner_3d(dls, efficientnet_b0, n_out = 2)

# slow 
learn.lr_find()

SuggestedLRs(lr_min=0.33113112449646, lr_steep=0.10000000149011612)

Click here for a more in-depth segmentation example.

Extension to fastai for volumetric medical data

Related tags

Overview

FAIMED 3D

Classification

Segmentation

Owner

Keno

MvtecAD unsupervised Anomaly Detection

ChebLieNet, a spectral graph neural network turned equivariant by Riemannian geometry on Lie groups.

Retina blood vessel segmentation with a convolutional neural network

AQP is a modular pipeline built to enable the comparison and testing of different quality metric configurations.

"NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search".

basic tutorial on pytorch

Parameterized Explainer for Graph Neural Network

A minimal solution to hand motion capture from a single color camera at over 100fps. Easy to use, plug to run.

Monocular 3D Object Detection: An Extrinsic Parameter Free Approach (CVPR2021)

TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation

Reading Group @mila-iqia on Computational Optimal Transport for Machine Learning Applications

An official source code for paper Deep Graph Clustering via Dual Correlation Reduction, accepted by AAAI 2022

Tool for installing and updating MiSTer cores and other files

(ICCV 2021) Official code of "Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing."

Deploy optimized transformer based models on Nvidia Triton server

LoFTR:Detector-Free Local Feature Matching with Transformers CVPR 2021

Code release for paper: The Boombox: Visual Reconstruction from Acoustic Vibrations

Code to accompany our paper "Continual Learning Through Synaptic Intelligence" ICML 2017

A simple rest api that classifies pneumonia infection weather it is Normal, Pneumonia Virus or Pneumonia Bacteria from a chest-x-ray image.

The goal of the exercises below is to evaluate the candidate knowledge and problem solving expertise regarding the main development focuses for the iFood ML Platform team: MLOps and Feature Store development.