My coursework for Machine Learning (2021 Spring) at National Taiwan University (NTU)

Related tags

Deep Learningmachine-learningdeep-learningpytorch
Overview

Machine Learning 2021

Machine Learning (NTU EE 5184, Spring 2021)

Instructor: Hung-yi Lee

Course Website : (https://speech.ee.ntu.edu.tw/~hylee/ml/2021-spring.html)

Homeworks

# Homework Public score Private Score Score Ranking*
1 Regression 0.87985 0.91099 9 Top 35% (709/2032)
2 Classification 0.76324 0.76319 10.5 Top 5% (59/1522)
3 CNN 0.83094 0.82546 10.5 Top 7% (87/1404)
4 Self-Attention 0.96857 0.96888 10.5 Top 7% (81/1170)
5 Transformer 33.53 32.27 10.5 Top 1% (11/1110)
6 GAN (0.688, 7722.47) NA 10.5 Top 41% (405/1118)
7 BERT 0.85926 0.85157 10.5 Top 4% (39/1263)
8 Anomaly Detection 0.90118 0.89286 10.5 Top 9% (104/1193)
9 Explainable AI NA NA 9.7 NA
10 Attack 0.010 0.010 10.5 Top 14% (154/1162)
11 Adaptation 0.78806 0.78744 10 Top 26% (268/1061)
12 RL 287 NA 10.5 Top 2% (10/766)
13 Compression 0.75686 0.75493 9.5 Top 19% (109/590)
14 Life-Long Learning NA NA 9.2 NA
15 Meta Learning NA NA 10 NA

*Ranking is based on private leaderboard

Viewing Jupyter notebook

Sometimes the error message "Sorry, something went wrong. Reload?" appears when viewing *.ipynb on a GitHub.

We recommend using nbviewer to view the *.ipynb files

Simply copy the URL of this repository to https://nbviewer.jupyter.org/

Download Google Drive files with WGET

Example of a Google Drive download link (HW3 data): https://drive.google.com/file/d/1awF7pZ9Dz7X1jn1_QAiKN-_v56veCEKy/view

The url has the following format https://drive.google.com/file/d/[ID]/view

Copy the ID and run the script wgetgdrive.sh as follows

chmod a+x ./wgetgdrive.sh
./wgetgdrive.sh [ID] [file_name]

For example, to download the data of HW3 and name it as food-11.zip, simply run the following

chmod a+x ./wgetgdrive.sh
./wgetgdrive.sh 1awF7pZ9Dz7X1jn1_QAiKN-_v56veCEKy food-11.zip

Achievement

I finish the 15 assignments with all scores above 9 pts and win a T-shirt as a prize. Only the top 2% (17/1280) students own such an achievement.

shirt

Owner
National Taiwan University. M.S. in Electrical Engineering, 2021
GitHub Repository https://speech.ee.ntu.edu.tw/~hylee/ml/2021-spring.html
This is a collection of our NAS and Vision Transformer work.

AutoML - Neural Architecture Search This is a collection of our AutoML-NAS work iRPE (NEW): Rethinking and Improving Relative Position Encoding for Vi

Microsoft 828 Dec 28, 2022
Türkiye Canlı Mobese Görüntülerinde Profesyonel Nesne Takip Sistemi

Türkiye Mobese Görüntü Takip Türkiye Mobese görüntülerinde OPENCV ve Yolo ile takip sistemi Multiple Object Tracking System in Turkish Mobese with OPE

15 Dec 22, 2022
통일된 DataScience 폴더 구조 제공 및 가상환경 작업의 부담감 해소

Lucas coded by linux shell 목차 Mac버전 CookieCutter (autoenv) 1.How to Install autoenv 2.폴더 진입 시, activate 구현하기 3.폴더 탈출 시, deactivate 구현하기 4.Alias 설정하기 5

ello 3 Feb 21, 2022
A multi-scale unsupervised learning for deformable image registration

A multi-scale unsupervised learning for deformable image registration Shuwei Shao, Zhongcai Pei, Weihai Chen, Wentao Zhu, Xingming Wu and Baochang Zha

ShuweiShao 2 Apr 13, 2022
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

MMF is a modular framework for vision and language multimodal research from Facebook AI Research. MMF contains reference implementations of state-of-t

Facebook Research 5.1k Jan 04, 2023
converts nominal survey data into a numerical value based on a dictionary lookup.

SWAP RATE Converts nominal survey data into a numerical values based on a dictionary lookup. It allows the user to switch nominal scale data from text

Jake Rhodes 1 Jan 18, 2022
NeurIPS 2021 paper 'Representation Learning on Spatial Networks' code

Representation Learning on Spatial Networks This repository is the official implementation of Representation Learning on Spatial Networks. Training Ex

13 Dec 29, 2022
The Pytorch implementation for "Video-Text Pre-training with Learned Regions"

Region_Learner The Pytorch implementation for "Video-Text Pre-training with Learned Regions" (arxiv) We are still cleaning up the code further and pre

Rui Yan 0 Mar 20, 2022
Code base for reproducing results of I.Schubert, D.Driess, O.Oguz, and M.Toussaint: Learning to Execute: Efficient Learning of Universal Plan-Conditioned Policies in Robotics. NeurIPS (2021)

Learning to Execute (L2E) Official code base for completely reproducing all results reported in I.Schubert, D.Driess, O.Oguz, and M.Toussaint: Learnin

3 May 18, 2022
Code repository for the paper "Doubly-Trained Adversarial Data Augmentation for Neural Machine Translation" with instructions to reproduce the results.

Doubly Trained Neural Machine Translation System for Adversarial Attack and Data Augmentation Languages Experimented: Data Overview: Source Target Tra

Steven Tan 1 Aug 18, 2022
[v1 (ISBI'21) + v2] MedMNIST: A Large-Scale Lightweight Benchmark for 2D and 3D Biomedical Image Classification

MedMNIST Project (Website) | Dataset (Zenodo) | Paper (arXiv) | MedMNIST v1 (ISBI'21) Jiancheng Yang, Rui Shi, Donglai Wei, Zequan Liu, Lin Zhao, Bili

683 Dec 28, 2022
Differential Privacy for Heterogeneous Federated Learning : Utility & Privacy tradeoffs

Differential Privacy for Heterogeneous Federated Learning : Utility & Privacy tradeoffs In this work, we propose an algorithm DP-SCAFFOLD(-warm), whic

19 Nov 10, 2022
SwinIR: Image Restoration Using Swin Transformer

SwinIR: Image Restoration Using Swin Transformer This repository is the official PyTorch implementation of SwinIR: Image Restoration Using Shifted Win

Jingyun Liang 2.4k Jan 08, 2023
This is the repo of the manuscript "Dual-branch Attention-In-Attention Transformer for speech enhancement"

DB-AIAT: A Dual-branch attention-in-attention transformer for single-channel SE

Guochen Yu 68 Dec 16, 2022
Code for the paper "Offline Reinforcement Learning as One Big Sequence Modeling Problem"

Trajectory Transformer Code release for Offline Reinforcement Learning as One Big Sequence Modeling Problem. Installation All python dependencies are

Michael Janner 266 Dec 27, 2022
The dynamics of representation learning in shallow, non-linear autoencoders

The dynamics of representation learning in shallow, non-linear autoencoders The package is written in python and uses the pytorch implementation to ML

Maria Refinetti 4 Jun 08, 2022
PyTorch evaluation code for Delving Deep into the Generalization of Vision Transformers under Distribution Shifts.

Out-of-distribution Generalization Investigation on Vision Transformers This repository contains PyTorch evaluation code for Delving Deep into the Gen

Chongzhi Zhang 72 Dec 13, 2022
SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data

SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data Au

14 Nov 28, 2022
Simplified interface for TensorFlow (mimicking Scikit Learn) for Deep Learning

SkFlow has been moved to Tensorflow. SkFlow has been moved to http://github.com/tensorflow/tensorflow into contrib folder specifically located here. T

3.2k Dec 29, 2022
Omnidirectional camera calibration in python

Omnidirectional Camera Calibration Key features pure python initial solution based on A Toolbox for Easily Calibrating Omnidirectional Cameras (Davide

Thomas Pönitz 12 Nov 22, 2022