Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
Geometry-Aware Gradient Algorithms for Neural Architecture Search Technical Report
2020.
Distributed Evolution of Deep Autoencoders Technical Report
2020.
FBNetV2 - Differentiable Neural Architecture Search for Spatial and Channel Dimensions Proceedings Article
In: pp. 12962-12971, 2020.
ModuleNet - Knowledge-inherited Neural Architecture Search Technical Report
2020.
Evolutionary recurrent neural network for image captioning Journal Article
In: vol. 401, pp. 249-256, 2020.
Neural Architecture Search for Lightweight Non-Local Networks Proceedings Article
In: pp. 10294-10303, 2020.
A Generic Graph-Based Neural Architecture Encoding Scheme for Predictor-Based NAS Proceedings Article
In: pp. 189-204, 2020.
FedNAS - Federated Deep Learning via Neural Architecture Search Technical Report
2020.
AutoRC: Improving BERT Based Relation Classification Models via Architecture Search Technical Report
2020.
An Evolutionary Approach to Variational Autoencoders Proceedings Article
In: pp. 71-77, 2020.
A Scalable System for Neural Architecture Search Proceedings Article
In: pp. 53-60, 2020.
Neural Architecture Generator Optimization Proceedings Article
In: 2020.
Deep-n-Cheap - An Automated Search Framework for Low Complexity Deep Learning Proceedings Article
In: pp. 273-288, 2020.
MTL-NAS - Task-Agnostic Neural Architecture Search Towards General-Purpose Multi-Task Learning Proceedings Article
In: pp. 11540-11549, 2020.
Designing Network Design Spaces Proceedings Article
In: pp. 10425-10433, 2020.
Disturbance-immune Weight Sharing for Neural Architecture Search Technical Report
2020.
NPENAS - Neural Predictor Guided Evolution for Neural Architecture Search Technical Report
2020.
DA-NAS - Data Adapted Pruning for Efficient Neural Architecture Search Proceedings Article
In: pp. 584-600, 2020.
MiLeNAS - Efficient Neural Architecture Search via Mixed-Level Reformulation Proceedings Article
In: pp. 11990-11999, 2020.
Are Labels Necessary for Neural Architecture Search? Proceedings Article
In: pp. 798-813, 2020.
DCNAS - Densely Connected Neural Architecture Search for Semantic Image Segmentation Technical Report
2020.
Hit-Detector - Hierarchical Trinity Architecture Search for Object Detection Proceedings Article
In: pp. 11402-11411, 2020.
Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report
2020.
GreedyNAS - Towards Fast One-Shot NAS With Greedy Supernet Proceedings Article
In: pp. 1996-2005, 2020.
BigNAS - Scaling up Neural Architecture Search with Big Single-Stage Models Proceedings Article
In: pp. 702-717, 2020.
BS-NAS - Broadening-and-Shrinking One-Shot NAS with Searchable Numbers of Channels Technical Report
2020.
Probabilistic Dual Network Architecture Search on Graphs Technical Report
2020.
GAN Compression - Efficient Architectures for Interactive Conditional GANs Proceedings Article
In: pp. 5283-5293, 2020.
ElixirNet - Relation-Aware Network Architecture Adaptation for Medical Lesion Detection Proceedings Article
In: pp. 11093-11100, 2020.
Lifelong Learning with Searchable Extension Units Technical Report
2020.
AutoSTR - Efficient Backbone Search for Scene Text Recognition Proceedings Article
In: pp. 751-767, 2020.
AutoGluon-Tabular - Robust and Accurate AutoML for Structured Data Technical Report
2020.
PONAS - Progressive One-shot Neural Architecture Search for Very Efficient Deployment Technical Report
2020.
Hierarchical Neural Architecture Search for Single Image Super-Resolution Journal Article
In: vol. 27, pp. 1255-1259, 2020.
How to Train Your Super-Net - An Analysis of Training Heuristics in Weight-Sharing NAS Technical Report
2020.
AutoML-Zero - Evolving Machine Learning Algorithms From Scratch Proceedings Article
In: pp. 8007-8019, 2020.
Accelerator-aware Neural Network Design using AutoML Technical Report
2020.
Real-time Federated Evolutionary Neural Architecture Search Technical Report
2020.
BATS - Binary ArchitecTure Search Proceedings Article
In: pp. 309-325, 2020.
ADWPNAS - Architecture-Driven Weight Prediction for Neural Architecture Search Technical Report
2020.
NAS-Count - Counting-by-Density with Neural Architecture Search Proceedings Article
In: pp. 747-766, 2020.
Neural Inheritance Relation Guided One-Shot Layer Assignment Search Proceedings Article
In: pp. 5158-5165, 2020.
Automatically Searching for U-Net Image Translator Architecture Technical Report
2020.
AutoEmb - Automated Embedding Dimensionality Search in Streaming Recommendations Technical Report
2020.
Memory-Efficient Models for Scene Text Recognition via Neural Architecture Search Proceedings Article
In: pp. 183-191, 2020.
Searching for Winograd-aware Quantized Networks Proceedings Article
In: 2020.
Semi-Supervised Neural Architecture Search Proceedings Article
In: 2020.
Neural Architecture Search for compressed sensing Magnetic Resonance image reconstruction Journal Article
In: vol. 85, pp. 101784, 2020.