A curated list of awesome Active Learning

Related tags

Deep Learningmachine-learningawesomedeep-learningpapersactive-learning
Overview

Awesome Active Learning Awesome

🤩 A curated list of awesome Active Learning ! 🤩

Background

(image source: Settles, Burr)

What is Active Learning?

Active learning is a special case of machine learning in which a learning algorithm can interactively query a oracle (or some other information source) to label new data points with the desired outputs.

(image source: Settles, Burr)

There are situations in which unlabeled data is abundant but manual labeling is expensive. In such a scenario, learning algorithms can actively query the oracle for labels. This type of iterative supervised learning is called active learning. Since the learner chooses the examples, the number of examples to learn a concept can often be much lower than the number required in normal supervised learning. With this approach, there is a risk that the algorithm is overwhelmed by uninformative examples. Recent developments are dedicated to multi-label active learning, hybrid active learning and active learning in a single-pass (on-line) context, combining concepts from the field of machine learning (e.g. conflict and ignorance) with adaptive, incremental learning policies in the field of online machine learning.

(source: Wikipedia)

Contributing

If you find the awesome paper/code/book/tutorial or have some suggestions, please feel free to pull requests or contact [email protected] to add papers using the following Markdown format:

Year | Paper Name | Conference | [Paper](link) | [Code](link) | Tags | Notes |

Thanks for your valuable contribution to the research community. 😃

Table of Contents

Books

Surveys

Papers

Tags

Sur.: survey | Cri.: critics | Pool.: pool-based sampling | Str.: stream-based sampling | Syn.: membership query synthesize | Meta.: meta learning | SSL.: semi-supervised learning | RL.: reinforcement learning | FS.: few-shot learning | SS.: self-supervised |

Before 2017

Year Title Conf Paper Code Tags Notes
1994 Improving Generalization with Active Learning Machine Learning paper
2007 Discriminative Batch Mode Active Learning NIPS paper
2008 Active Learning with Direct Query Construction KDD paper
2008 An Analysis of Active Learning Strategies for Sequence Labeling Tasks EMNLP paper
2008 Hierarchical Sampling for Active Learning ICML paper
2010 Active Instance Sampling via Matrix Partition NIPS paper
2011 Ask Me Better Questions: Active Learning Queries Based on Rule Induction KDD paper
2011 Active Learning from Crowds ICML paper
2011 Bayesian Active Learning for Classification and Preference Learning CoRR paper
2011 Active Learning Using On-line Algorithms KDD paper
2012 Bayesian Optimal Active Search and Surveying ICML paper
2012 Batch Active Learning via Coordinated Matching ICML paper
2013 Active Learning for Multi-Objective Optimization ICML paper
2013 Active Learning for Probabilistic Hypotheses Usingthe Maximum Gibbs Error Criterion NIPS paper
2014 Active Semi-Supervised Learning Using Sampling Theory for Graph Signals KDD paper
2014 Beyond Disagreement-based Agnostic Active Learning NIPS paper
2016 Cost-Effective Active Learning for Deep Image Classification TCSVT paper
2016 Active Image Segmentation Propagation CVPR paper

2017

Title Conf Paper Code Tags Notes
Active Decision Boundary Annotation with Deep Generative Models ICCV paper
Active One-shot Learning CoRR paper code Str. RL. FS.
A Meta-Learning Approach to One-Step Active-Learning [email protected]/ECML paper Pool. Meta.
Generative Adversarial Active Learning arXiv paper Pool. Syn.
Active Learning from Peers NIPS paper
Learning Active Learning from Data NIPS paper code Pool.
Learning Algorithms for Active Learning ICML paper
Deep Bayesian Active Learning with Image Data ICML paper code Pool.

2018

Title Conf Paper Code Tags Notes
The Power of Ensembles for Active Learning in Image Classification CVPR paper
Adversarial Learning for Semi-Supervised Semantic Segmentation BMVC paper code Pool. SSL.
A Variance Maximization Criterion for Active Learning Pattern Recognition paper
Meta-Learning Transferable Active Learning Policies by Deep Reinforcement Learning ICLR-WS paper Pool. Meta. RL.
Active Learning for Convolutional Neural Networks: A Core-Set Approach ICLR paper
Adversarial Active Learning for Sequence Labeling and Generation IJCAI paper
Meta-Learning for Batch Mode Active Learning ICLR-WS paper

2019

Title Conf Paper Code Tags Notes
ViewAL: Active Learning with Viewpoint Entropy for Semantic Segmentation CVPR paper Pool.
Bayesian Generative Active Deep Learning ICML paper code Pool. Semi.
Variational Adversarial Active Learning ICCV paper code Pool. SSL.
Integrating Bayesian and Discriminative Sparse Kernel Machines for Multi-class Active Learning NeurIPS paper
Active Learning via Membership Query Synthesisfor Semi-supervised Sentence Classification CoNLL paper
Discriminative Active Learning arXiv paper
Semantic Redundancies in Image-Classification Datasets: The 10% You Don’t Need arXiv paper
Bayesian Batch Active Learning as Sparse Subset Approximation NIPS paper
Learning Loss for Active Learning CVPR paper code Pool.
Rapid Performance Gain through Active Model Reuse IJCAI paper
Parting with Illusions about Deep Active Learning arXiv paper Cri.
BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learning NIPS paper

2020

Title Conf Paper Code Tags Notes
Reinforced active learning for image segmentation ICLR paper code Pool. RL.
[BADGE] Batch Active learning by Diverse Gradient Embeddings ICLR paper code Pool.
Adversarial Sampling for Active Learning WACV paper Pool.
Online Active Learning of Reject Option Classifiers AAAI paper
Deep Active Learning for Biased Datasets via Fisher Kernel Self-Supervision CVPR paper
Deep Reinforcement Active Learning for Medical Image Classification MICCAI paper Pool. RL.
State-Relabeling Adversarial Active Learning CVPR paper code Pool.
Towards Robust and Reproducible Active Learning Using Neural Networks arXiv paper Cri.
Consistency-Based Semi-supervised Active Learning: Towards Minimizing Labeling Cost ECCV paper Pool. SSL.

2021

Title Conf Paper Code Tags Notes
MedSelect: Selective Labeling for Medical Image Classification Combining Meta-Learning with Deep Reinforcement Learning arXiv paper Pool. Meta. RL.
Can Active Learning Preemptively Mitigate Fairness Issues ICLR-RAI paper code Pool. Thinking fairness issues
Sequential Graph Convolutional Network for Active Learning CVPR paper code Pool.
Task-Aware Variational Adversarial Active Learning CVPR paper code Pool.
Effective Evaluation of Deep Active Learning on Image Classification Tasks arXiv paper Cri.
Semi-Supervised Active Learning for Semi-Supervised Models: Exploit Adversarial Examples With Graph-Based Virtual Labels ICCV paper Pool. SSL.
Contrastive Coding for Active Learning under Class Distribution Mismatch ICCV paper code Pool. Defines a good question
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering ACL-IJCNLP paper code Pool. Thinking about outliers
LADA: Look-Ahead Data Acquisition via Augmentation for Active Learning NeurIPS paper Pool.
Multi-Anchor Active Domain Adaptation for Semantic Segmentation ICCV paper code Pool.
Active Learning for Lane Detection: A Knowledge Distillation Approach ICCV paper Pool.
Active Contrastive Learning of Audio-Visual Video Representations ICLR paper code Pool.
Multiple instance active learning for object detection CVPR paper code Pool.
SEAL: Self-supervised Embodied Active Learning using Exploration and 3D Consistency NeurIPS paper Robot exploration
Influence Selection for Active Learning ICCV paper code Pool.
Reducing Label Effort: Self-Supervised meets Active Learning arXiv paper Pool. SS. Cri. A meaningful attempt on the combination of SS & AL

Turtorials

Tools

Owner
BAI Fan
Deep Learning, Active Learning, Robotics, Artificial Intelligence.
BAI Fan
GitHub Repository
Improving the robustness and performance of biomedical NLP models through adversarial training

RobustBioNLP Improving the robustness and performance of biomedical NLP models through adversarial training In this repository you can find suppliment

Milad Moradi 3 Sep 20, 2022
This was initially the repo for the project of [email protected] of Asaf Mazar, Millad Kassaie and Georgios Chochlakis named "Powered by the Will? Exploring Lay Theories of Behavior Change through Social Media"

Subreddit Analysis This repo includes tools for Subreddit analysis, originally developed for our class project of PSYC 626 in USC, titled "Powered by

Georgios Chochlakis 1 Dec 17, 2021
This is the implementation of "SELF SUPERVISED REPRESENTATION LEARNING WITH DEEP CLUSTERING FOR ACOUSTIC UNIT DISCOVERY FROM RAW SPEECH" submitted to ICASSP 2022

CPC_DeepCluster This is the implementation of "SELF SUPERVISED REPRESENTATION LEARNING WITH DEEP CLUSTERING FOR ACOUSTIC UNIT DISCOVERY FROM RAW SPEEC

LEAP Lab 2 Sep 15, 2022
ICON: Implicit Clothed humans Obtained from Normals (CVPR 2022)

ICON: Implicit Clothed humans Obtained from Normals Yuliang Xiu · Jinlong Yang · Dimitrios Tzionas · Michael J. Black CVPR 2022 News 🚩 [2022/04/26] H

Yuliang Xiu 1.1k Jan 04, 2023
PyTorch implementation of neural style randomization for data augmentation

README Augment training images for deep neural networks by randomizing their visual style, as described in our paper: https://arxiv.org/abs/1809.05375

84 Nov 23, 2022
A 1.3B text-to-image generation model trained on 14 million image-text pairs

minDALL-E on Conceptual Captions minDALL-E, named after minGPT, is a 1.3B text-to-image generation model trained on 14 million image-text pairs for no

Kakao Brain 604 Dec 14, 2022
This repository implements Douzero's interface to IGCA.

douzero-interface-for-ICGA This repository implements Douzero's interface to ICGA. ./douzero: This directory stores Doudizhu AI projects. ./interface:

zhanggenjin 4 Aug 07, 2022
The all new way to turn your boring vector meshes into the new fad in town; Voxels!

Voxelator The all new way to turn your boring vector meshes into the new fad in town; Voxels! Notes: I have not tested this on a rotated mesh. With fu

6 Feb 03, 2022
DIVeR: Deterministic Integration for Volume Rendering

DIVeR: Deterministic Integration for Volume Rendering This repo contains the training and evaluation code for DIVeR. Setup python 3.8 pytorch 1.9.0 py

64 Dec 27, 2022
Official PyTorch implementation of "Uncertainty-Based Offline Reinforcement Learning with Diversified Q-Ensemble" (NeurIPS'21)

Uncertainty-Based Offline Reinforcement Learning with Diversified Q-Ensemble This is the code for reproducing the results of the paper Uncertainty-Bas

43 Nov 23, 2022
Utility code for use with PyXLL

pyxll-utils There is no need to use this package as of PyXLL 5. All features from this package are now provided by PyXLL. If you were using this packa

PyXLL 10 Dec 18, 2021
Tutorial on scikit-learn and IPython for parallel machine learning

Parallel Machine Learning with scikit-learn and IPython Video recording of this tutorial given at PyCon in 2013. The tutorial material has been rearra

Olivier Grisel 1.6k Dec 26, 2022
Super Pix Adv - Offical implemention of Robust Superpixel-Guided Attentional Adversarial Attack (CVPR2020)

Super_Pix_Adv Offical implemention of Robust Superpixel-Guided Attentional Adver

DLight 8 Oct 26, 2022
This code is part of the reproducibility package for the SANER 2022 paper "Generating Clarifying Questions for Query Refinement in Source Code Search".

Clarifying Questions for Query Refinement in Source Code Search This code is part of the reproducibility package for the SANER 2022 paper "Generating

Zachary Eberhart 0 Dec 04, 2021
PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP. Democratize AI for everyone.

PatrickStar: Parallel Training of Large Language Models via a Chunk-based Memory Management Meeting PatrickStar Pre-Trained Models (PTM) are becoming

Tencent 633 Dec 28, 2022
a project for 3D multi-object tracking

a project for 3D multi-object tracking

155 Jan 04, 2023
Code and models for ICCV2021 paper "Robust Object Detection via Instance-Level Temporal Cycle Confusion".

Robust Object Detection via Instance-Level Temporal Cycle Confusion This repo contains the implementation of the ICCV 2021 paper, Robust Object Detect

Xin Wang 69 Oct 13, 2022
Official repository for Jia, Raghunathan, Göksel, and Liang, "Certified Robustness to Adversarial Word Substitutions" (EMNLP 2019)

Certified Robustness to Adversarial Word Substitutions This is the official GitHub repository for the following paper: Certified Robustness to Adversa

Robin Jia 38 Oct 16, 2022
Phylogeny Partners

Phylogeny-Partners Two states models Instalation You may need to install the cython, networkx, numpy, scipy package: pip install cython, networkx, num

1 Sep 19, 2022
Code accompanying "Learning What To Do by Simulating the Past", ICLR 2021.

Learning What To Do by Simulating the Past This repository contains code that implements the Deep Reward Learning by Simulating the Past (Deep RSLP) a

Center for Human-Compatible AI 24 Aug 07, 2021