Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2021
BN-NAS: Neural Architecture Search with Batch Normalization Technical Report
2021.
Hardware-Aware Neural Architecture Search: Survey and Taxonomy Proceedings Article
In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 4322–4329, ijcai.org, 2021.
Neural Architecture Dilation for Adversarial Robustness Technical Report
2021.
CONet: Channel Optimization for Convolutional Neural Networks Technical Report
2021.
Automatic Mixed-Precision Quantization Search of BERT Proceedings Article
In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 3427–3433, ijcai.org, 2021.
Probeable DARTS with Application to Computational Pathology Technical Report
2021.
AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System Proceedings Article
In: Zhou, Zhi-Hua (Ed.): Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pp. 2104–2110, ijcai.org, 2021.
Neural Architecture Search for Portrait Parsing Journal Article
In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-10, 2021.
FOX-NAS: Fast, On-device and Explainable Neural Architecture Search Technical Report
2021.
Trends in Neural Architecture Search: Towards the Acceleration of Search Technical Report
2021.
Generative Adversarial Networks Using Neural Architecture Search for Semantic Image Segmentation Proceedings Article
In: 2021 IEEE 4th International Conference on Big Data and Artificial Intelligence (BDAI), pp. 236-241, 2021.
RANK-NOSH: Efficient Predictor-Based Architecture Search via Non-Uniform Successive Halving Proceedings Article
In: ICCV 2021, 2021.
Single-DARTS: Towards Stable Architecture Search Technical Report
2021.
Determining learning direction via multi-controller model for stably searching generative adversarial networks Journal Article
In: Neurocomputing, vol. 464, pp. 37-47, 2021, ISSN: 0925-2312.
Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift Technical Report
2021.
In: Artificial Intelligence in Medicine, vol. 119, pp. 102154, 2021, ISSN: 0933-3657.
Array-Aware Neural Architecture Search Proceedings Article
In: 2021 IEEE 32nd International Conference on Application-specific Systems, Architectures and Processors (ASAP), pp. 125-132, 2021.
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Technical Report
2021.
Pooling Architecture Search for Graph Classification Technical Report
2021.
D-DARTS: Distributed Differentiable Architecture Search Technical Report
2021.
MS-DARTS: Mean-Shift Based Differentiable Architecture Search Technical Report
2021.
Searching Architecture and Precision for U-net based Image Restoration Tasks Proceedings Article
In: 2021 IEEE International Conference on Image Processing (ICIP), pp. 1989-1993, 2021.
Remote Sensing Image Object Detection Based on Angle Classification Journal Article
In: IEEE Access, vol. 9, pp. 118696-118707, 2021.
The Maximum a Posterior Estimation of Darts Proceedings Article
In: 2021 IEEE International Conference on Image Processing (ICIP), pp. 419-423, 2021.
Lightweight Monocular Depth with a Novel Neural Architecture Search Method Technical Report
2021.
iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization Technical Report
2021.
Multiobjective Reinforcement Learning-Based Neural Architecture Search for Efficient Portrait Parsing Journal Article
In: IEEE Transactions on Cybernetics, pp. 1-12, 2021.
Analyzing and Mitigating Interference in Neural Architecture Search Technical Report
2021.
Balanced Neural Architecture Search and Its Application in Specific Emitter Identification Journal Article
In: IEEE Transactions on Signal Processing, vol. 69, pp. 5051-5065, 2021.
StressNAS: Affect State and Stress Detection Using Neural Architecture Search Proceedings Article
In: Doryab, Afsaneh; Lv, Qin; Beigl, Michael (Ed.): UbiComp/ISWC '21: 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2021 ACM International Symposium on Wearable Computers, Virtual Event, September 21-25, 2021, pp. 121–125, ACM, 2021.
Automatic Attention Learning Using Neural Architecture Search for Detection of Cardiac Abnormality in 12-Lead ECG Journal Article
In: IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1-12, 2021.
PVNAS: 3D Neural Architecture Search with Point-Voxel Convolution Journal Article
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2021.
Automated Anomaly Detection via Curiosity-Guided Search and Self-Imitation Learning Journal Article
In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-13, 2021.
Differentiable Convolution Search for Point Cloud Processing Technical Report
2021.
UCB-ENAS based on Reinforcement Learning Proceedings Article
In: 2021 IEEE 16th Conference on Industrial Electronics and Applications (ICIEA), pp. 2008-2013, 2021.
An Analysis of Super-Net Heuristics in Weight-Sharing NAS Journal Article
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2021.
Searching for Two-Stream Models in Multivariate Space for Video Recognition Technical Report
2021.
Bayesian Parametric and Architectural Domain Adaptation of LF-MMI Trained TDNNs for Elderly and Dysarthric Speech Recognition Proceedings Article
In: Proc. Interspeech 2021, pp. 4818–4822, 2021.
NASI: Label- and Data-agnostic Neural Architecture Search at Initialization Technical Report
2021.
In: ICT Express, 2021, ISSN: 2405-9595.
SMoA: Searching a Modality-Oriented Architecture for Infrared and Visible Image Fusion Journal Article
In: IEEE Signal Processing Letters, vol. 28, pp. 1818-1822, 2021.
Searching for Efficient Multi-Stage Vision Transformers Technical Report
2021.
Bayesian Hyperparameter Optimization of Deep Neural Network Algorithms Based on Ant Colony Optimization Proceedings Article
In: Lladós, Josep; Lopresti, Daniel; Uchida, Seiichi (Ed.): Document Analysis and Recognition -- ICDAR 2021, pp. 585–594, Springer International Publishing, Cham, 2021, ISBN: 978-3-030-86334-0.
Edge-featured Graph Neural Architecture Search Technical Report
2021.
Going Beyond Neural Architecture Search with Sampling-based Neural Ensemble Search Technical Report
2021.
NAS-OoD: Neural Architecture Search for Out-of-Distribution Generalization Technical Report
2021.