Repository of continual learning papers

Related tags

Deep Learningmachine-learningdeep-learningneurosciencecontinual-learningcatastrophic-forgetting
Overview

Continual learning paper repository

This repository contains an incomplete (but dynamically updated) list of papers exploring continual learning in machine learning and neuroscience, and accompanies the related paper Towards continual task learning in artificial neural networks: current approaches and insights from neuroscience.

arXiv link

The full paper complementing this repository is available at https://arxiv.org/abs/2112.14146

Machine learning

Reviews, surveys, & tutorials

Title Link Relevance
Continual lifelong learning with neural networks: A review Neural Networks •••
Catastrophic forgetting in connectionist networks TICS •••
Neuroscience-Inspired Artificial Intelligence Neuron ••
How to grow a mind: Statistics, structure, and abstraction Science •
Deep learning Nature •
Universal Intelligence: A Definition of Machine Intelligence arXiv •

Classic papers

Title Link Relevance
Catastrophic forgetting in connectionist networks TICS •••
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem Psychology of Learning & Motivation •••
Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions Psychological Review •

Architectural approaches to continual learning

Title Link Implementation
Progressive Neural Networks arXiv PyTorch TensorFlow
Neurogenesis deep learning: Extending deep networks to accommodate new classes IEEE –
Adaptive structural learning of artificial neural networks ICML TensorFlow

Regularisation

Title Link Implementation
Learning without forgetting arXiv PyTorch
Distilling the knowledge in a neural network arXiv PyTorch TensorFlow
Overcoming catastrophic forgetting in neural networks arXiv PyTorch TensorFlow
Note on the quadratic penalties in elastic weight consolidation PNAS –
Measuring catastrophic forgetting in neural networks arXiv –
Continual learning through synaptic intelligence ICML TensorFlow
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks arXiv Theano

Training regime

Title Link Implementation
How transferable are features in deep neural networks? arXiv Caffe
CHILD: A First Step Towards Continual Learning Machine Learning –
Curriculum learning ICML –
Continual Learning with Deep Generative Replay arXiv PyTorch
Experience Replay for Continual Learning arXiv –
Brain-inspired replay for continual learning with artificial neural networks Nature Communications PyTorch
REMIND Your Neural Network to Prevent Catastrophic Forgetting arXiv PyTorch

Neuroscience

Title Link Relevance
Regulation and function of adult neurogenesis: from genes to cognition Physiological Review •
When and where do we apply what we learn?: A taxonomy for far transfer Psychological Bulletin •
Does the hippocampus map out the future? TICS •
Organizing conceptual knowledge in humans with a gridlike code Science •
Song replay during sleep and computational rules for sensorimotor vocal learning Science •
A theory of the discovery and predication of relational concepts Psychological Review •
Preplay of future place cell sequences by hippocampal cellular assemblies Nature ••
Comparing continual task learning in minds and machines PNAS ••
Cascade models of synaptically stored memories Neuron •
Selective suppression of hippocampal ripples impairs spatial memory Nature Neuroscience ••
The analogical mind MIT Press •
What learning systems do intelligent agents need? Complementary learning systems theory updated TICS •
Human replay spontaneously reorganizes experience Cell •••
Compartmentalized dendritic plasticity and input feature storage in neurons Nature •
Neuroconstructivism: How the brain constructs cognition Oxford University Press •
Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory Psychological Review •••
The Role of Hippocampal Replay in Memory and Planning Current Biology ••
Brain imaging of language plasticity in adopted adults: Can a second language replace the first? Cerebral Cortex •••
Memory formation: Let’s replay Elife •
Strengthening individual memories by reactivating them during sleep Science ••
Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience Science •
Crossmodal spatial attention Annals of the NY Academy of Sciences •
The merging of the senses MIT Press •
Development of multisensory integration from the perspective of the individual neuron Nature Reviews Neuroscience ••
The hippocampal indexing theory and episodic memory: updating the index Hippocampus ••
Stably maintained dendritic spines are associated with lifelong memories Nature •••

Citation

BibTeX

@misc{mccaffary2021continual,
      title={Towards continual task learning in artificial neural networks: current approaches and insights from neuroscience}, 
      author={David McCaffary},
      year={2021},
      eprint={2112.14146},
      archivePrefix={arXiv},
      primaryClass={cs.LG}
}
Owner
🕳️
GitHub Repository
Dense Prediction Transformers

Vision Transformers for Dense Prediction This repository contains code and models for our paper: Vision Transformers for Dense Prediction René Ranftl,

Intel ISL (Intel Intelligent Systems Lab) 1.3k Dec 28, 2022
Towards Implicit Text-Guided 3D Shape Generation (CVPR2022)

Towards Implicit Text-Guided 3D Shape Generation Towards Implicit Text-Guided 3D Shape Generation (CVPR2022) Code for the paper [Towards Implicit Text

55 Dec 16, 2022
Python scripts form performing stereo depth estimation using the high res stereo model in PyTorch .

PyTorch-High-Res-Stereo-Depth-Estimation Python scripts form performing stereo depth estimation using the high res stereo model in PyTorch. Stereo dep

Ibai Gorordo 26 Nov 24, 2022
Efficient training of deep recommenders on cloud.

HybridBackend Introduction HybridBackend is a training framework for deep recommenders which bridges the gap between evolving cloud infrastructure and

Alibaba 111 Dec 23, 2022
Punctuation Restoration using Transformer Models for High-and Low-Resource Languages

Punctuation Restoration using Transformer Models This repository contins official implementation of the paper Punctuation Restoration using Transforme

Tanvirul Alam 142 Jan 01, 2023
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding This repo contains the data and source code for baseline models in the NeurIPS 2

Microsoft 29 Dec 29, 2022
This project is a loose implementation of paper "Algorithmic Financial Trading with Deep Convolutional Neural Networks: Time Series to Image Conversion Approach"

Stock Market Buy/Sell/Hold prediction Using convolutional Neural Network This repo is an attempt to implement the research paper titled "Algorithmic F

Asutosh Nayak 136 Dec 28, 2022
A Machine Teaching Framework for Scalable Recognition

MEMORABLE This repository contains the source code accompanying our ICCV 2021 paper. A Machine Teaching Framework for Scalable Recognition Pei Wang, N

2 Dec 08, 2021
Transfer Reinforcement Learning for Differing Action Spaces via Q-Network Representations

Transfer-Learning-in-Reinforcement-Learning Transfer Reinforcement Learning for Differing Action Spaces via Q-Network Representations Final Report Tra

Trung Hieu Tran 4 Oct 17, 2022
PyTorch implementation of the ACL, 2021 paper Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks.

Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks This repo contains the PyTorch implementation of the ACL, 2021 pa

Rabeeh Karimi Mahabadi 98 Dec 28, 2022
Official Pytorch implementation of "CLIPstyler:Image Style Transfer with a Single Text Condition"

CLIPstyler Official Pytorch implementation of "CLIPstyler:Image Style Transfer with a Single Text Condition" Environment Pytorch 1.7.1, Python 3.6 $ c

203 Dec 30, 2022
OpenMMLab Semantic Segmentation Toolbox and Benchmark.

Documentation: https://mmsegmentation.readthedocs.io/ English | 简体中文 Introduction MMSegmentation is an open source semantic segmentation toolbox based

OpenMMLab 5k Dec 31, 2022
SmartSim Infrastructure Library.

Home Install Documentation Slack Invite Cray Labs SmartSim SmartSim makes it easier to use common Machine Learning (ML) libraries like PyTorch and Ten

Cray Labs 139 Jan 01, 2023
Brain tumor detection using Convolution-Neural Network (CNN)

Detect and Classify Brain Tumor using CNN. A system performing detection and classification by using Deep Learning Algorithms using Convolution-Neural Network (CNN).

assia 1 Feb 07, 2022
Meta-learning for NLP

Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks Code for training the meta-learning models and fine-tuning on downstr

IESL 43 Nov 08, 2022
Deep Latent Force Models

Deep Latent Force Models This repository contains a PyTorch implementation of the deep latent force model (DLFM), presented in the paper, Compositiona

Tom McDonald 5 Oct 26, 2022
A simple and extensible library to create Bayesian Neural Network layers on PyTorch.

Blitz - Bayesian Layers in Torch Zoo BLiTZ is a simple and extensible library to create Bayesian Neural Network Layers (based on whats proposed in Wei

Pi Esposito 722 Jan 08, 2023
MaRS - a recursive filtering framework that allows for truly modular multi-sensor integration

The Modular and Robust State-Estimation Framework, or short, MaRS, is a recursive filtering framework that allows for truly modular multi-sensor integration

Control of Networked Systems - University of Klagenfurt 143 Dec 29, 2022
Torch-based tool for quantizing high-dimensional vectors using additive codebooks

Trainable multi-codebook quantization This repository implements a utility for use with PyTorch, and ideally GPUs, for training an efficient quantizer

Daniel Povey 41 Jan 07, 2023
Official PyTorch implementation of "AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks"

AASIST This repository provides the overall framework for training and evaluating audio anti-spoofing systems proposed in 'AASIST: Audio Anti-Spoofing

Clova AI Research 56 Jan 02, 2023