An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Last update: Nov 09, 2021

Related tags

Deep Learning EquivariantSelfAttention

Overview

EquivariantSelfAttention

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

This work extends and builds on previous work:

FR Classification using e2cnn, whose code is here.
Attention for FR Classificaion, whose code is here. This work makes extensive use of the e2cnn package: e2cnn.

Imports for General Use

import os
import torch
import e2cnn
import pandas as pd
import numpy as np
import configparser as ConfigParser

import utils

Loading a network:

To load a network import the network files, read in a config file, and load the network with the config file parameters:

from networks import AGRadGalNet, VanillaLeNet, testNet, DNSteerableLeNet, DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = locals()[config['model']['base']](**config['model']).to(device)

Alternatively, if you know which architecture you want to use, only import that and load in the config parameters (i.e. without using locals()):

from networks import DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = DNSteerableAGRadGalNet(**config['model']).to(device)

Loading a model:

To load the best performing model (according to early stopping) from a given model training session:

path_supliment = config['data']['augment']+'/'
model = utils.utils.load_model(config, load_model='best', device=device, path_supliment=path_supliment)

Testing a model:

Follow the example of evaluation.ipynb for model evaluation.

Defining a model:

To define your own model simply create a new config which follows the examples provided in configs.

Training a model:

To train a model use the train.py using your config file:

python3.8 train.py --config YOUR_CONFIG_NAME.cfg >& logs/YOUR_CONFIG_NAME.log

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Related tags

Overview

EquivariantSelfAttention

Imports for General Use

Loading a network:

Loading a model:

Testing a model:

Defining a model:

Training a model:

Owner

Turning SymPy expressions into JAX functions

Neural models of common sense. 🤖

Check out the StyleGAN repo and place it in the same directory hierarchy as the present repo

Code for "Intra-hour Photovoltaic Generation Forecasting based on Multi-source Data and Deep Learning Methods."

CPU inference engine that delivers unprecedented performance for sparse models

Deep Semisupervised Multiview Learning With Increasing Views (IEEE TCYB 2021, PyTorch Code)

2021搜狐校园文本匹配算法大赛分比我们低的都是帅哥队

Image-retrieval-baseline - MUGE Multimodal Retrieval Baseline

Official code implementation for "Personalized Federated Learning using Hypernetworks"

Neon: an add-on for Lightbulb making it easier to handle component interactions

The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color

Tensorflow 2.x based implementation of EDSR, WDSR and SRGAN for single image super-resolution

Deep Learning & 3D Convolutional Neural Networks for Speaker Verification

Benchmark for the generalization of 3D machine learning models across different remeshing/samplings of a surface.

Official PyTorch implementation of the paper "TEMOS: Generating diverse human motions from textual descriptions"

Code Release for ICCV 2021 (oral), "AdaFit: Rethinking Learning-based Normal Estimation on Point Clouds"

PyTorch Live is an easy to use library of tools for creating on-device ML demos on Android and iOS.

Cascaded Deep Video Deblurring Using Temporal Sharpness Prior and Non-local Spatial-Temporal Similarity

Definition of a business problem according to Wilson Lower Bound Score and Time Based Average Rating

CMP 414/765 course repository for Spring 2022 semester

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Related tags

Overview

EquivariantSelfAttention

Imports for General Use

Loading a network:

Loading a model:

Testing a model:

Defining a model:

Training a model:

Owner

Turning SymPy expressions into JAX functions

Neural models of common sense. 🤖

Check out the StyleGAN repo and place it in the same directory hierarchy as the present repo

Code for "Intra-hour Photovoltaic Generation Forecasting based on Multi-source Data and Deep Learning Methods."

CPU inference engine that delivers unprecedented performance for sparse models

Deep Semisupervised Multiview Learning With Increasing Views (IEEE TCYB 2021, PyTorch Code)

2021搜狐校园文本匹配算法大赛 分比我们低的都是帅哥队

Image-retrieval-baseline - MUGE Multimodal Retrieval Baseline

Official code implementation for "Personalized Federated Learning using Hypernetworks"

Neon: an add-on for Lightbulb making it easier to handle component interactions

The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color

Tensorflow 2.x based implementation of EDSR, WDSR and SRGAN for single image super-resolution

Deep Learning & 3D Convolutional Neural Networks for Speaker Verification

Benchmark for the generalization of 3D machine learning models across different remeshing/samplings of a surface.

Official PyTorch implementation of the paper "TEMOS: Generating diverse human motions from textual descriptions"

Code Release for ICCV 2021 (oral), "AdaFit: Rethinking Learning-based Normal Estimation on Point Clouds"

PyTorch Live is an easy to use library of tools for creating on-device ML demos on Android and iOS.

Cascaded Deep Video Deblurring Using Temporal Sharpness Prior and Non-local Spatial-Temporal Similarity

Definition of a business problem according to Wilson Lower Bound Score and Time Based Average Rating

CMP 414/765 course repository for Spring 2022 semester

2021搜狐校园文本匹配算法大赛分比我们低的都是帅哥队