Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
Search What You Want - Barrier Panelty NAS for Mixed Precision Quantization Proceedings Article
In: pp. 1-16, 2020.
NSGANetV2 - Evolutionary Multi-objective Surrogate-Assisted Neural Architecture Search Proceedings Article
In: pp. 35-51, 2020.
CATCH - Context-Based Meta Reinforcement Learning for Transferrable Architecture Search Proceedings Article
In: pp. 185-202, 2020.
Standing on the Shoulders of Giants - Hardware and Neural Architecture Co-Search With Hot Start Journal Article
In: vol. 39, no. 11, pp. 4154-4165, 2020.
Off-Policy Reinforcement Learning for Efficient and Effective GAN Architecture Search Proceedings Article
In: pp. 175-192, 2020.
Neural Architecture Search for Speech Recognition Technical Report
2020.
BRP-NAS - Prediction-based NAS using GCNs Proceedings Article
In: 2020.
Finding Non-uniform Quantization Schemes Using Multi-task Gaussian Processes Proceedings Article
In: pp. 383-398, 2020.
One-Shot Neural Architecture Search via Novelty Driven Sampling Proceedings Article
In: pp. 3188-3194, 2020.
Neural Architecture Search in A Proxy Validation Loss Landscape Proceedings Article
In: pp. 5853-5862, 2020.
CP-NAS - Child-Parent Neural Architecture Search for 1-bit CNNs Proceedings Article
In: pp. 1033-1039, 2020.
SI-VDNAS - Semi-Implicit Variational Dropout for Hierarchical One-shot Neural Architecture Search Proceedings Article
In: pp. 2088-2095, 2020.
An Empirical Study on the Robustness of NAS based Architectures Technical Report
2020.
MergeNAS - Merge Operations into One for Differentiable Architecture Search Proceedings Article
In: pp. 3065-3072, 2020.
DropNAS - Grouped Operation Dropout for Differentiable Architecture Search Proceedings Article
In: pp. 2326-2332, 2020.
Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article
In: pp. 135-136, 2020.
Architecture Search of Dynamic Cells for Semantic Video Segmentation Proceedings Article
In: pp. 1959-1968, 2020.
Breaking the Curse of Space Explosion - Towards Efficient NAS with Curriculum Search Proceedings Article
In: pp. 3822-3831, 2020.
Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction Proceedings Article
In: pp. 945-955, 2020.
MS-NAS - Multi-scale Neural Architecture Search for Medical Image Segmentation Proceedings Article
In: pp. 388-397, 2020.
VINNAS - Variational Inference-based Neural Network Architecture Search Technical Report
2020.
Multi-modality Information Fusion for Radiomics-Based Neural Architecture Search Proceedings Article
In: pp. 763-771, 2020.
Neural Graph Embedding for Neural Architecture Search Proceedings Article
In: pp. 4707-4714, 2020.
Ensembles of Networks Produced from Neural Architecture Search Proceedings Article
In: pp. 223-234, 2020.
A Study on Encodings for Neural Architecture Search Proceedings Article
In: 2020.
Neural Architecture Search with GBDT Technical Report
2020.
NASGEM - Neural Architecture Search via Graph Embedding Method Technical Report
2020.
Neuro-evolution using game-driven cultural algorithms Proceedings Article
In: pp. 1857-1865, 2020.
An evolution-based approach for efficient differentiable architecture search Proceedings Article
In: pp. 131-132, 2020.
HyperFDA: A Bi-Level Optimization Approach to Neural Architecture Search and Hyperparameters' Optimization via Fractal Decomposition-Based Algorithm Technical Report
Cancún, Mexico, 2020, ISBN: 9781450371278.
Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article
In: pp. 135-136, 2020.
A first step toward incremental evolution of convolutional neural networks Proceedings Article
In: pp. 115-116, 2020.
Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report
2020.
Journey Towards Tiny Perceptual Super-Resolution Proceedings Article
In: pp. 85-102, 2020.
Hyperparameter Optimization in Neural Networks via Structured Sparse Recovery Technical Report
2020.
GOLD-NAS - Gradual, One-Level, Differentiable Technical Report
2020.
Discretization-Aware Architecture Search Technical Report
2020.
Parametric machines - a fresh approach to architecture search Technical Report
2020.
Surrogate-assisted Particle Swarm Optimisation for Evolving Variable-length Transferable Blocks for Image Classification Journal Article
In: IEEE transactions on Neural Networks and Learning Systems, vol. abs/2007.01556, pp. 1-14, 2020.
M-NAS - Meta Neural Architecture Search Proceedings Article
In: pp. 6186-6193, 2020.
RSNet: The Search for Remote Sensing Deep Neural Networks in Recognition Tasks Technical Report
2020.
Theory-Inspired Path-Regularized Differential Network Architecture Search Proceedings Article
In: 2020.
The Heterogeneity Hypothesis - Finding Layer-Wise Dissimilated Network Architecture Technical Report
2020.
Traditional and accelerated gradient descent for neural architecture search Technical Report
2020.
AutoSNAP - Automatically Learning Neural Architectures for Instrument Pose Estimation Proceedings Article
In: pp. 375-384, 2020.
AutoST - Efficient Neural Architecture Search for Spatio-Temporal Prediction Proceedings Article
In: pp. 794-802, 2020.
Neural architecture search for sparse DenseNets with dynamic compression Proceedings Article
In: pp. 386-394, 2020.
Searching towards Class-Aware Generators for Conditional Generative Adversarial Networks Technical Report
2020.