FAIMED 3D

use fastai to quickly train fully three-dimensional models on radiological data

Classification

from faimed3d.all import *

Load data in various medical formats (DICOM, NIfTI, NRRD) or even videos as simple as in fastai.

d = pd.read_csv('../data/radiopaedia_cases.csv')
dls = ImageDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

Faimed3d provides multiple model architectures, pretrained on the UCF101 dataset for action recoginiton, which can be used for transfer learning.

Model	3-fold accuracy	duration/epoch	model size
efficientnet b0	92.5 %	9M:35S	48.8 MB
efficientnet b1	90.1 %	13M:20S	80.5 MB
resnet 18	87.6 %	6M:57S	339.1 MB
resnet 50	94.8 %	12M:16S	561.2 MB
resnet 101	96.0 %	17M:20S	1,030 MB

# slow
learn = cnn_learner_3d(dls, efficientnet_b0)

# slow
learn.lr_find()

SuggestedLRs(lr_min=0.014454397559165954, lr_steep=6.309573450380412e-07)

Click here for a more in-depth classification example.

Segmentation

dls = SegmentationDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

All models in faimed3d can be used as a backbone for U-Nets, even with pre-trained weights.

# slow
learn = unet_learner_3d(dls, efficientnet_b0, n_out = 2)

# slow 
learn.lr_find()

SuggestedLRs(lr_min=0.33113112449646, lr_steep=0.10000000149011612)

Click here for a more in-depth segmentation example.

Extension to fastai for volumetric medical data

Related tags

Overview

FAIMED 3D

Classification

Segmentation

Owner

Keno

CARMS: Categorical-Antithetic-REINFORCE Multi-Sample Gradient Estimator

PyTorch code for the "Deep Neural Networks with Box Convolutions" paper

PyG (PyTorch Geometric) - A library built upon PyTorch to easily write and train Graph Neural Networks (GNNs)

a baseline to practice

Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]

UniFormer - official implementation of UniFormer

Two-stage CenterNet

a minimal terminal with python 😎😉

Semantic Segmentation Suite in TensorFlow

Unofficial PyTorch implementation of Neural Additive Models (NAM) by Agarwal, et al.

Simple, efficient and flexible vision toolbox for mxnet framework.

Text completion with Hugging Face and TensorFlow.js running on Node.js

meProp: Sparsified Back Propagation for Accelerated Deep Learning

Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian (CVPR 2022)

Point-NeRF: Point-based Neural Radiance Fields

Auto-Encoding Score Distribution Regression for Action Quality Assessment

Non-stationary GP package written from scratch in PyTorch

TakeInfoatNistforICS - Take Information in NIST NVD for ICS

MLP-Like Vision Permutator for Visual Recognition (PyTorch)

Official implementation of "Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks", NeurIPS 2021.