Repository of continual learning papers

Overview

Continual learning paper repository

This repository contains an incomplete (but dynamically updated) list of papers exploring continual learning in machine learning and neuroscience, and accompanies the related paper Towards continual task learning in artificial neural networks: current approaches and insights from neuroscience.

arXiv link

The full paper complementing this repository is available at https://arxiv.org/abs/2112.14146

Machine learning

Reviews, surveys, & tutorials

Title Link Relevance
Continual lifelong learning with neural networks: A review Neural Networks •••
Catastrophic forgetting in connectionist networks TICS •••
Neuroscience-Inspired Artificial Intelligence Neuron ••
How to grow a mind: Statistics, structure, and abstraction Science
Deep learning Nature
Universal Intelligence: A Definition of Machine Intelligence arXiv

Classic papers

Title Link Relevance
Catastrophic forgetting in connectionist networks TICS •••
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem Psychology of Learning & Motivation •••
Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions Psychological Review

Architectural approaches to continual learning

Title Link Implementation
Progressive Neural Networks arXiv PyTorch TensorFlow
Neurogenesis deep learning: Extending deep networks to accommodate new classes IEEE
Adaptive structural learning of artificial neural networks ICML TensorFlow

Regularisation

Title Link Implementation
Learning without forgetting arXiv PyTorch
Distilling the knowledge in a neural network arXiv PyTorch TensorFlow
Overcoming catastrophic forgetting in neural networks arXiv PyTorch TensorFlow
Note on the quadratic penalties in elastic weight consolidation PNAS
Measuring catastrophic forgetting in neural networks arXiv
Continual learning through synaptic intelligence ICML TensorFlow
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks arXiv Theano

Training regime

Title Link Implementation
How transferable are features in deep neural networks? arXiv Caffe
CHILD: A First Step Towards Continual Learning Machine Learning
Curriculum learning ICML
Continual Learning with Deep Generative Replay arXiv PyTorch
Experience Replay for Continual Learning arXiv
Brain-inspired replay for continual learning with artificial neural networks Nature Communications PyTorch
REMIND Your Neural Network to Prevent Catastrophic Forgetting arXiv PyTorch

Neuroscience

Title Link Relevance
Regulation and function of adult neurogenesis: from genes to cognition Physiological Review
When and where do we apply what we learn?: A taxonomy for far transfer Psychological Bulletin
Does the hippocampus map out the future? TICS
Organizing conceptual knowledge in humans with a gridlike code Science
Song replay during sleep and computational rules for sensorimotor vocal learning Science
A theory of the discovery and predication of relational concepts Psychological Review
Preplay of future place cell sequences by hippocampal cellular assemblies Nature ••
Comparing continual task learning in minds and machines PNAS ••
Cascade models of synaptically stored memories Neuron
Selective suppression of hippocampal ripples impairs spatial memory Nature Neuroscience ••
The analogical mind MIT Press
What learning systems do intelligent agents need? Complementary learning systems theory updated TICS
Human replay spontaneously reorganizes experience Cell •••
Compartmentalized dendritic plasticity and input feature storage in neurons Nature
Neuroconstructivism: How the brain constructs cognition Oxford University Press
Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory Psychological Review •••
The Role of Hippocampal Replay in Memory and Planning Current Biology ••
Brain imaging of language plasticity in adopted adults: Can a second language replace the first? Cerebral Cortex •••
Memory formation: Let’s replay Elife
Strengthening individual memories by reactivating them during sleep Science ••
Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience Science
Crossmodal spatial attention Annals of the NY Academy of Sciences
The merging of the senses MIT Press
Development of multisensory integration from the perspective of the individual neuron Nature Reviews Neuroscience ••
The hippocampal indexing theory and episodic memory: updating the index Hippocampus ••
Stably maintained dendritic spines are associated with lifelong memories Nature •••

Citation

BibTeX

@misc{mccaffary2021continual,
      title={Towards continual task learning in artificial neural networks: current approaches and insights from neuroscience}, 
      author={David McCaffary},
      year={2021},
      eprint={2112.14146},
      archivePrefix={arXiv},
      primaryClass={cs.LG}
}
Owner
🕳️
A PyTorch implementation of a Factorization Machine module in cython.

fmpytorch A library for factorization machines in pytorch. A factorization machine is like a linear model, except multiplicative interaction terms bet

Jack Hessel 167 Jul 06, 2022
DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort

DatasetGAN This is the official code and data release for: DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort Yuxuan Zhang*, Huan Li

302 Jan 05, 2023
Using knowledge-informed machine learning on the PRONOSTIA (FEMTO) and IMS bearing data sets. Predict remaining-useful-life (RUL).

Knowledge Informed Machine Learning using a Weibull-based Loss Function Exploring the concept of knowledge-informed machine learning with the use of a

Tim 43 Dec 14, 2022
PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "

Foley Music: Learning to Generate Music from Videos This repo holds the code for the framework presented on ECCV 2020. Foley Music: Learning to Genera

Chuang Gan 30 Nov 03, 2022
ICLR 2021 i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning

Introduction PyTorch code for the ICLR 2021 paper [i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning]. @inproceedings{lee2021i

Kibok Lee 68 Nov 27, 2022
Sentinel-1 vessel detection model used in the xView3 challenge

sar_vessel_detect Code for the AI2 Skylight team's submission in the xView3 competition (https://iuu.xview.us) for vessel detection in Sentinel-1 SAR

AI2 6 Sep 10, 2022
Simple image captioning model - CLIP prefix captioning.

Simple image captioning model - CLIP prefix captioning.

688 Jan 04, 2023
Safe Bayesian Optimization

SafeOpt - Safe Bayesian Optimization This code implements an adapted version of the safe, Bayesian optimization algorithm, SafeOpt [1], [2]. It also p

Felix Berkenkamp 111 Dec 11, 2022
Keras Image Embeddings using Contrastive Loss

Image to Embedding projection in vector space. Implementation in keras and tensorflow of batch all triplet loss for one-shot/few-shot learning.

Shravan Anand K 5 Mar 21, 2022
Repo for EMNLP 2021 paper "Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression"

beyond-preserved-accuracy Repo for EMNLP 2021 paper "Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression" How to implemen

Kevin Canwen Xu 10 Dec 23, 2022
DeLag: Detecting Latency Degradation Patterns in Service-based Systems

DeLag: Detecting Latency Degradation Patterns in Service-based Systems Replication package of the work "DeLag: Detecting Latency Degradation Patterns

SEALABQualityGroup @ University of L'Aquila 2 Mar 24, 2022
Torchlight2 lan game server tool - A message forwarding tool for Torchlight 2 lan game

Torchlight 2 Lan Game Server Tool A message forwarding tool for Torchlight 2 lan

Huaijun Jiang 3 Nov 01, 2022
A simple code to perform canny edge contrast detection on images.

CECED-Canny-Edge-Contrast-Enhanced-Detection A simple code to perform canny edge contrast detection on images. A simple code to process images using c

Happy N. Monday 3 Feb 15, 2022
Moment-DETR code and QVHighlights dataset

Moment-DETR QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries Jie Lei, Tamara L. Berg, Mohit Bansal For dataset de

Jie Lei 雷杰 133 Dec 22, 2022
Prototype-based Incremental Few-Shot Semantic Segmentation

Prototype-based Incremental Few-Shot Semantic Segmentation Fabio Cermelli, Massimiliano Mancini, Yongqin Xian, Zeynep Akata, Barbara Caputo -- BMVC 20

Fabio Cermelli 21 Dec 29, 2022
NeurIPS'21 Tractable Density Estimation on Learned Manifolds with Conformal Embedding Flows

NeurIPS'21 Tractable Density Estimation on Learned Manifolds with Conformal Embedding Flows This repo contains the code for the paper Tractable Densit

Layer6 Labs 4 Dec 12, 2022
Multi-task Multi-agent Soft Actor Critic for SMAC

Multi-task Multi-agent Soft Actor Critic for SMAC Overview The CARE formulti-task: Multi-Task Reinforcement Learning with Context-based Representation

RuanJingqing 8 Sep 30, 2022
Official Implementation of Few-shot Visual Relationship Co-localization

VRC Official implementation of the Few-shot Visual Relationship Co-localization (ICCV 2021) paper project page | paper Requirements Use python = 3.8.

22 Oct 13, 2022
ReferFormer - Official Implementation of ReferFormer

The official implementation of the paper: Language as Queries for Referring Video Object Segmentation Language as Queries for Referring Video Object S

Jonas Wu 232 Dec 29, 2022
Autonomous Perception: 3D Object Detection with Complex-YOLO

Autonomous Perception: 3D Object Detection with Complex-YOLO LiDAR object detect

Thomas Dunlap 2 Feb 18, 2022