Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2022
BERTPerf: Inference Latency Predictor for BERT on ARM big.LITTLE Multi-Core Processors Proceedings Article
In: 2022 IEEE Workshop on Signal Processing Systems (SiPS), pp. 1-6, 2022.
A Novel Tran_NAS Method for the Identification of Fe- and Mg-Deficient Pear Leaves from N- and P-Deficient Pear Leaf Data Journal Article
In: ACS Omega, vol. 7, no. 44, pp. 39727-39741, 2022.
Neural Architecture Search via Proxy Validation Journal Article
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-16, 2022.
PredNAS: A Universal and Sample Efficient Neural Architecture Search Framework Technical Report
2022.
Searching for Efficient Neural Architectures for On-Device ML on Edge TPUs Proceedings Article
In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2022) , 2022.
Architecture representations for quantum convolutional neural networks Technical Report
2022.
Efficient Channel Pruning via Architecture-Guided Search Space Shrinking Proceedings Article
In: Yu, Shiqi; Zhang, Zhaoxiang; Yuen, Pong C.; Han, Junwei; Tan, Tieniu; Guo, Yike; Lai, Jianhuang; Zhang, Jianguo (Ed.): Pattern Recognition and Computer Vision, pp. 540–551, Springer International Publishing, Cham, 2022, ISBN: 978-3-031-18907-4.
AutoML and Neural Architecture Search for Gaze Estimation Proceedings Article
In: 16th IEEE International Symposium on Applied Computational Intelligence and Informatics, SACI 2022, Timisoara, Romania, May 25-28, 2022, pp. 143–148, IEEE, 2022.
Search to Pass Messages for Temporal Knowledge Graph Completion Technical Report
2022.
Work-in-Progress: SuperNAS: Fast Multi-Objective SuperNet Architecture Search for Semantic Segmentation Proceedings Article
In: 2022 International Conference on Compilers, Architecture, and Synthesis for Embedded Systems (CASES), pp. 35-36, 2022.
Efficient Backbone Architecture Search for Stereo Depth Estimation in Autonomous Driving Proceedings Article
In: 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC), pp. 355-362, 2022.
Robust Network Architecture Search via Feature Distortion Restraining Proceedings Article
In: Ävidan, Shai; Brostow, Gabriel; Cissé, Moustapha; Farinella, Giovanni Maria; Hassner, Tal" (Ed.): Computer Vision -- ECCV 2022, pp. 122–138, Springer Nature Switzerland, Cham, 2022, ISBN: 978-3-031-20065-6.
Towards Discovering Neural Architectures from Scratch Technical Report
2022.
Speeding up NAS with Adaptive Subset Selection Technical Report
2022.
Speeding up NAS with Adaptive Subset Selection Technical Report
2022.
Optimal Design of Convolutional Neural Network Architectures Using Teaching–Learning-Based Optimization for Image Classification Journal Article
In: Symmetry, vol. 14, no. 11, 2022, ISSN: 2073-8994.
Toward Extremely Lightweight Distracted Driver Recognition With Distillation-Based Neural Architecture Search and Knowledge Transfer Journal Article
In: IEEE Transactions on Intelligent Transportation Systems, pp. 1-14, 2022.
Multi-Objective Evolutionary for Object Detection Mobile Architectures Search Technical Report
2022.
Development of Deep Residual Neural Networks for Gear Pitting Fault Diagnosis Using Bayesian Optimization Journal Article
In: IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-15, 2022.
A Framework for Designing Efficient Deep Learning-Based Genomic Basecallers Technical Report
2022.
GAQ-SNN: A Genetic Algorithm based Quantization Framework for Deep Spiking Neural Networks Proceedings Article
In: 2022 International Conference on IC Design and Technology (ICICDT), pp. 93-96, 2022.
Auto-DenseNet: DenseNet Optimization Method Based on Evolutionary Algorithm Proceedings Article
In: 2022 5th International Conference on Intelligent Autonomous Systems (ICoIAS), pp. 387-393, 2022.
Resource-Aware Heterogeneous Federated Learning using Neural Architecture Search Technical Report
2022.
Äccelerating Evolutionary Neural Architecture Search for Remaining Useful Life Prediction Proceedings Article
In: Mernik, Marjan; Eftimov, Tome; Črepinšek, Matej (Ed.): Bioinspired Optimization Methods and Their Applications, pp. 15–30, Springer International Publishing, Cham, 2022, ISBN: 978-3-031-21094-5.
MO-CNN: Multiobjective Optimization of Convolutional Neural Networks for Hyperspectral Image Classification Journal Article
In: IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-14, 2022.
NAS For efficient mobile eyebrow biometrics Journal Article
In: Pattern Recognition Letters, vol. 164, pp. 276-283, 2022, ISSN: 0167-8655.
CNAS: Constrained Neural Architecture Search Proceedings Article
In: 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 2918-2923, 2022.
Neural Architecture Search Applied to Hybrid Morphological Neural Networks Proceedings Article
In: ao Carlos Xavier-Junior, Jo; Rios, Ricardo Ara'ujo (Ed.): Intelligent Systems, pp. 631–645, Springer International Publishing, Cham, 2022, ISBN: 978-3-031-21689-3.
Work-in-Progress: What to Expect of Early Training Statistics? An Investigation on Hardware-Aware Neural Architecture Search Proceedings Article
In: 2022 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS), pp. 1-2, 2022.
Cross-Model Operator Batching for Neural Network Architecture Search Proceedings Article
In: Wang, Lei; Segal, Michael; Chen, Jenhui; Qiu, Tie (Ed.): Wireless Algorithms, Systems, and Applications, pp. 231–242, Springer Nature Switzerland, Cham, 2022, ISBN: 978-3-031-19214-2.
GNN-EA: Graph Neural Network with Evolutionary Algorithm Proceedings Article
In: 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1476-1481, 2022.
Work-in-Progress: Utilizing latency and accuracy predictors for efficient hardware-aware NAS Proceedings Article
In: 2022 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS), pp. 15-16, 2022.
Revisiting Training-free NAS Metrics: An Efficient Training-based Method Technical Report
2022.
HiveNAS: Neural Architecture Search using Artificial Bee Colony Optimization Technical Report
2022.
M2NAS: Joint Neural Architecture Optimization System with Network Transmission Journal Article
In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2022.
NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension Technical Report
2022.
Accuracy Prediction for NAS Acceleration using Feature Selection and Extrapolation Technical Report
2022.
Ä Data-Driven Framework for Driving Style Classification Proceedings Article
In: Chen, Weitong; Yao, Lina; Cai, Taotao; Pan, Shirui; Shen, Tao; Li, Xue (Ed.): Ädvanced Data Mining and Applications", pp. 253–265, Springer Nature Switzerland, Cham, 2022, ISBN: 978-3-031-22137-8.
MLF-IOSC: Multi-Level Fusion Network with Independent Operation Search Cell for Low-Dose CT Denoising Journal Article
In: IEEE Transactions on Medical Imaging, pp. 1-1, 2022.
3D Object Detection of Cars and Pedestrians by Deep Neural Networks from Unit-Sharing One-Shot NAS Proceedings Article
In: 2022 18th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1-8, 2022.
DistilNAS: Neural Architecture Search With Distilled Data Journal Article
In: IEEE Access, vol. 10, pp. 124990-124998, 2022.
Comparative Analysis of Neural Architecture Search Methods for Classification of Cultural Heritage Sites Proceedings Article
In: Mudenagudi, Uma; Nigam, Aditya; Sarvadevabhatla, Ravi Kiran; Choudhary, Ayesha (Ed.): Proceedings of the Satellite Workshops of ICVGIP 2021, pp. 25–41, Springer Nature Singapore, Singapore, 2022, ISBN: 978-981-19-4136-8.
MPCViT: Searching for MPC-friendly Vision Transformer with Heterogeneous Attention Technical Report
2022.
DAMO-YOLO : A Report on Real-Time Object Detection Design Technical Report
2022.