Source for the paper "Universal Activation Function for machine learning"

Last update: Dec 03, 2022

Overview

Universal Activation Function

Tensorflow and Pytorch source code for the paper

Yuen, Brosnan, Minh Tu Hoang, Xiaodai Dong, and Tao Lu. "Universal activation function for machine learning." Scientific reports 11, no. 1 (2021): 1-11.

Getting the code

Requires Docker

Use git to pull this repo

git clone https://github.com/SensorOrgNet/Universal_Activation_Function.git

Running the Tensorflow 2 version

Install CUDA 11.2 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.2.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install tensorflow==2.7.0

Run the MLP with UAF for MNIST dataset

cd   Universal_Activation_Function/tensorflow/
python3   ./mnist_UAF.py

Running the Pytorch version

Install CUDA 11.3 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.3.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install torch==1.10.0+cu113 torchvision==0.11.1+cu113 torchaudio==0.10.0+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
pip3 install torch-scatter -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-sparse -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-cluster -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-spline-conv -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-geometric

Run the CNN with UAF for MNIST dataset

cd   Universal_Activation_Function/pytorch/
python3   ./mnist_UAF.py

Run the GCN2 with UAF for CORA dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./gcn2_cora_UAF.py  0

Run the PNA with UAF for ZNC dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./pna_UAF.py  0

Source for the paper "Universal Activation Function for machine learning"

Related tags

Overview

Universal Activation Function

Getting the code

Running the Tensorflow 2 version

Running the Pytorch version

Owner

Code base for reproducing results of I.Schubert, D.Driess, O.Oguz, and M.Toussaint: Learning to Execute: Efficient Learning of Universal Plan-Conditioned Policies in Robotics. NeurIPS (2021)

Implementation for the IJCAI2021 work "Beyond the Spectrum: Detecting Deepfakes via Re-synthesis"

Tackling the Class Imbalance Problem of Deep Learning Based Head and Neck Organ Segmentation

Can we learn gradients by Hamiltonian Neural Networks?

Learning Domain Invariant Representations in Goal-conditioned Block MDPs

Training Very Deep Neural Networks Without Skip-Connections

[CVPR 2022] Back To Reality: Weak-supervised 3D Object Detection with Shape-guided Label Enhancement

lightweight python wrapper for vowpal wabbit

Interpretable and Generalizable Person Re-Identification with Query-Adaptive Convolution and Temporal Lifting

Multi Agent Reinforcement Learning for ROS in 2D Simulation Environments

Meshed-Memory Transformer for Image Captioning. CVPR 2020

CAMoE + Dual SoftMax Loss (DSL): Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss

Official implementation of YOGO for Point-Cloud Processing

A Python framework for developing parallelized Computational Fluid Dynamics software to solve the hyperbolic 2D Euler equations on distributed, multi-block structured grids.

ByteTrack with ReID module following the paradigm of FairMOT, tracking strategy is borrowed from FairMOT/JDE.

🌈 PyTorch Implementation for EMNLP'21 Findings "Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer"

Pytorch implementation of XRD spectral identification from COD database

Official PyTorch implementation of U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation

A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution

Code for the paper "Implicit Representations of Meaning in Neural Language Models"