Source for the paper "Universal Activation Function for machine learning"

Last update: Dec 03, 2022

Overview

Universal Activation Function

Tensorflow and Pytorch source code for the paper

Yuen, Brosnan, Minh Tu Hoang, Xiaodai Dong, and Tao Lu. "Universal activation function for machine learning." Scientific reports 11, no. 1 (2021): 1-11.

Getting the code

Requires Docker

Use git to pull this repo

git clone https://github.com/SensorOrgNet/Universal_Activation_Function.git

Running the Tensorflow 2 version

Install CUDA 11.2 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.2.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install tensorflow==2.7.0

Run the MLP with UAF for MNIST dataset

cd   Universal_Activation_Function/tensorflow/
python3   ./mnist_UAF.py

Running the Pytorch version

Install CUDA 11.3 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.3.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install torch==1.10.0+cu113 torchvision==0.11.1+cu113 torchaudio==0.10.0+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
pip3 install torch-scatter -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-sparse -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-cluster -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-spline-conv -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-geometric

Run the CNN with UAF for MNIST dataset

cd   Universal_Activation_Function/pytorch/
python3   ./mnist_UAF.py

Run the GCN2 with UAF for CORA dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./gcn2_cora_UAF.py  0

Run the PNA with UAF for ZNC dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./pna_UAF.py  0

Source for the paper "Universal Activation Function for machine learning"

Related tags

Overview

Universal Activation Function

Getting the code

Running the Tensorflow 2 version

Running the Pytorch version

Owner

Training data extraction on GPT-2

Reinforcement learning library in JAX.

Codebase for testing whether hidden states of neural networks encode discrete structures.

TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification

Learning to Communicate with Deep Multi-Agent Reinforcement Learning in PyTorch

Real-time Object Detection for Streaming Perception, CVPR 2022

A Pythonic library for Nvidia Codec.

[ICRA 2022] An opensource framework for cooperative detection. Official implementation for OPV2V.

Implementation for "Seamless Manga Inpainting with Semantics Awareness" (SIGGRAPH 2021 issue)

Learning Dense Representations of Phrases at Scale (Lee et al., 2020)

Simulating an AI playing 2048 using the Expectimax algorithm

This repo provides a demo for the CVPR 2021 paper "A Fourier-based Framework for Domain Generalization" on the PACS dataset.

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

PyTorch implementation of "Simple and Deep Graph Convolutional Networks"

CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution

This is the workbook I created while I was studying for the Qiskit Associate Developer exam. I hope this becomes useful to others as it was for me :)

Using a Seq2Seq RNN architecture via TensorFlow to predict future Bitcoin prices

Free course that takes you from zero to Reinforcement Learning PRO 🦸🏻‍🦸🏽

Deep motion generator collections

The Python ensemble sampling toolkit for affine-invariant MCMC