An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Last update: Nov 09, 2021

Related tags

Deep Learning EquivariantSelfAttention

Overview

EquivariantSelfAttention

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

This work extends and builds on previous work:

FR Classification using e2cnn, whose code is here.
Attention for FR Classificaion, whose code is here. This work makes extensive use of the e2cnn package: e2cnn.

Imports for General Use

import os
import torch
import e2cnn
import pandas as pd
import numpy as np
import configparser as ConfigParser

import utils

Loading a network:

To load a network import the network files, read in a config file, and load the network with the config file parameters:

from networks import AGRadGalNet, VanillaLeNet, testNet, DNSteerableLeNet, DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = locals()[config['model']['base']](**config['model']).to(device)

Alternatively, if you know which architecture you want to use, only import that and load in the config parameters (i.e. without using locals()):

from networks import DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = DNSteerableAGRadGalNet(**config['model']).to(device)

Loading a model:

To load the best performing model (according to early stopping) from a given model training session:

path_supliment = config['data']['augment']+'/'
model = utils.utils.load_model(config, load_model='best', device=device, path_supliment=path_supliment)

Testing a model:

Follow the example of evaluation.ipynb for model evaluation.

Defining a model:

To define your own model simply create a new config which follows the examples provided in configs.

Training a model:

To train a model use the train.py using your config file:

python3.8 train.py --config YOUR_CONFIG_NAME.cfg >& logs/YOUR_CONFIG_NAME.log

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Related tags

Overview

EquivariantSelfAttention

Imports for General Use

Loading a network:

Loading a model:

Testing a model:

Defining a model:

Training a model:

Owner

Neural Fixed-Point Acceleration for Convex Optimization

The official implementation of paper "Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks" (IJCV under review).

A curated list of neural network pruning resources.

Code and data for ACL2021 paper Cross-Lingual Abstractive Summarization with Limited Parallel Resources.

DeepFaceEditing: Deep Face Generation and Editing with Disentangled Geometry and Appearance Control

A framework that constructs deep neural networks, autoencoders, logistic regressors, and linear networks

NeurIPS-2021: Neural Auto-Curricula in Two-Player Zero-Sum Games.

A framework to train language models to learn invariant representations.

Simple ray intersection library similar to coldet - succedeed by libacc

Receptive Field Block Net for Accurate and Fast Object Detection, ECCV 2018

AutoDeeplab / auto-deeplab / AutoML for semantic segmentation, implemented in Pytorch

This solves the autonomous driving issue which is supported by deep learning technology. Given a video, it splits into images and predicts the angle of turning for each frame.

Activating More Pixels in Image Super-Resolution Transformer

An implementation of the methods presented in Causal-BALD: Deep Bayesian Active Learning of Outcomes to Infer Treatment-Effects from Observational Data.

Implementation of self-attention mechanisms for general purpose. Focused on computer vision modules. Ongoing repository.

Dataset for the Research2Clinics @ NeurIPS 2021 Paper: What Do You See in this Patient? Behavioral Testing of Clinical NLP Models

Long Expressive Memory (LEM)

Algebraic effect handlers in Python

Machine learning evaluation metrics, implemented in Python, R, Haskell, and MATLAB / Octave

the official code for ICRA 2021 Paper: "Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation"