An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Last update: Nov 09, 2021

Related tags

Deep Learning EquivariantSelfAttention

Overview

EquivariantSelfAttention

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

This work extends and builds on previous work:

FR Classification using e2cnn, whose code is here.
Attention for FR Classificaion, whose code is here. This work makes extensive use of the e2cnn package: e2cnn.

Imports for General Use

import os
import torch
import e2cnn
import pandas as pd
import numpy as np
import configparser as ConfigParser

import utils

Loading a network:

To load a network import the network files, read in a config file, and load the network with the config file parameters:

from networks import AGRadGalNet, VanillaLeNet, testNet, DNSteerableLeNet, DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = locals()[config['model']['base']](**config['model']).to(device)

Alternatively, if you know which architecture you want to use, only import that and load in the config parameters (i.e. without using locals()):

from networks import DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = DNSteerableAGRadGalNet(**config['model']).to(device)

Loading a model:

To load the best performing model (according to early stopping) from a given model training session:

path_supliment = config['data']['augment']+'/'
model = utils.utils.load_model(config, load_model='best', device=device, path_supliment=path_supliment)

Testing a model:

Follow the example of evaluation.ipynb for model evaluation.

Defining a model:

To define your own model simply create a new config which follows the examples provided in configs.

Training a model:

To train a model use the train.py using your config file:

python3.8 train.py --config YOUR_CONFIG_NAME.cfg >& logs/YOUR_CONFIG_NAME.log

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Related tags

Overview

EquivariantSelfAttention

Imports for General Use

Loading a network:

Loading a model:

Testing a model:

Defining a model:

Training a model:

Owner

A toolkit for Lagrangian-based constrained optimization in Pytorch

SpeechNAS Better Trade off between Latency and Accuracy for Large Scale Speaker Verification

Learning Generative Models of Textured 3D Meshes from Real-World Images, ICCV 2021

🔥 TensorFlow Code for technical report: "YOLOv3: An Incremental Improvement"

Task-based end-to-end model learning in stochastic optimization

Bu repo SAHI uygulamasını mantığını öğreniyoruz.

Learning Open-World Object Proposals without Learning to Classify

Official implementation for the paper "Attentive Prototypes for Source-free Unsupervised Domain Adaptive 3D Object Detection"

The official codes for the ICCV2021 presentation "Uniformity in Heterogeneity: Diving Deep into Count Interval Partition for Crowd Counting"

Annotated notes and summaries of the TensorFlow white paper, along with SVG figures and links to documentation

This repository contains code for the paper "Disentangling Label Distribution for Long-tailed Visual Recognition", published at CVPR' 2021

SlotRefine: A Fast Non-Autoregressive Model forJoint Intent Detection and Slot Filling

AI-UPV at IberLEF-2021 EXIST task: Sexism Prediction in Spanish and English Tweets Using Monolingual and Multilingual BERT and Ensemble Models

Volumetric parameterization of the placenta to a flattened template

Official PyTorch implementation and pretrained models of the paper Self-Supervised Classification Network

Reference implementation for Structured Prediction with Deep Value Networks

EmoTag helps you train emotion detection model for Chinese audios

SafePicking: Learning Safe Object Extraction via Object-Level Mapping, ICRA 2022

Dataset and Code for ICCV 2021 paper "Real-world Video Super-resolution: A Benchmark Dataset and A Decomposition based Learning Scheme"

Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer