AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 23 of 64 »

2022

2057.

Huang, Yimin; Li, Yujun; Ye, Hanrong; Li, Zhenguo; Zhang, Zhihua

Improving Model Training with Multi-fidelity Hyperparameter Evaluation Proceedings Article

In: Marculescu, Diana; Chi, Yuejie; Wu, Carole-Jean (Ed.): Proceedings of Machine Learning and Systems 2022, MLSys 2022, Santa Clara, CA, USA, August 29 - September 1, 2022, mlsys.org, 2022.

Links | BibTeX

2056.

Wang, Huanyu; Zhang, Yongshun; Wu, Jianxin

Versatile, full‐spectrum, and swift network sampling for model generation Journal Article

In: Pattern Recognition, vol. 129, pp. 108729, 2022, ISSN: 0031-3203.

Abstract | Links | BibTeX

2055.

Künzel, Steven; Meyer-Nieberg, Silja

ÄNN-EMOA: Evolving Neural Networks Efficiently Proceedings Article

In: Laredo, Juan Luis Jiménez; Hidalgo, J. Ignacio; Babaagba, Kehinde Oluwatoyin (Ed.): Äpplications of Evolutionary Computation", pp. 402–417, Springer International Publishing, Cham, 2022, ISBN: 978-3-031-02462-7.

Abstract | BibTeX

2054.

Saha, Swapnil Sayan; Sandha, Sandeep; Garcia, Luis; Srivastava, Mani

TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation Journal Article

In: Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, vol. 6, pp. 32, 2022.

Links | BibTeX

2053.

Wang, Fuyi; Zhang, Leo Yu; Pan, Lei; Hu, Shengshan; Doss, Robin

Towards Privacy-Preserving Neural Architecture Search Technical Report

2022.

Links | BibTeX

2052.

Li, Chang; Zhang, Zhongzhen; Zhang, Xiaodong; Huang, Guoning; Liu, Yu; Chen, Xun

EEG-based Emotion Recognition via Transformer Neural Architecture Search Journal Article

In: IEEE Transactions on Industrial Informatics, pp. 1-1, 2022.

Links | BibTeX

2051.

Zhang, Xixi; Zhao, Haitao; Zhu, Hongbo; Adebisi, Bamidele; Gui, Guan; Gacanin, Haris; Adachi, Fumiyuki

NAS-AMR: Neural Architecture Search Based Automatic Modulation Recognition for Integrated Sensing and Communication Systems Journal Article

In: IEEE Transactions on Cognitive Communications and Networking, pp. 1-1, 2022.

Links | BibTeX

2050.

Lu, Zexin; Xia, Wenjun; Huang, Yongqiang; Hou, Mingzheng; Chen, Hu; Shan, Hongming; Zhang, Yi

Low-Dose CT Denoising via Neural Architecture Search Proceedings Article

In: 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), pp. 1-5, 2022.

Links | BibTeX

2049.

Cai, Jie; Wang, Xin; Guan, Chaoyu; Tang, Yateng; Xu, Jin; Zhong, Bin; Zhu, Wenwu

Multimodal Continual Graph Learning with Neural Architecture Search Proceedings Article

In: Laforest, Frédérique; Troncy, Raphaël; Simperl, Elena; Agarwal, Deepak; Gionis, Aristides; Herman, Ivan; Médini, Lionel (Ed.): WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25 - 29, 2022, pp. 1292–1300, ACM, 2022.

Links | BibTeX

2048.

Liang, Zixuan; Sun, Yanan

Automating Neural Architecture Design without Search Technical Report

2022.

Links | BibTeX

2047.

Cheng, Mingyue; Liu, Zhiding; Liu, Qi; Ge, Shenyang; Chen, Enhong

Towards Automatic Discovering of Deep Hybrid Network Architecture for Sequential Recommendation Proceedings Article

In: Proceedings of the ACM Web Conference 2022, pp. 1923–1932, Association for Computing Machinery, Virtual Event, Lyon, France, 2022, ISBN: 9781450390965.

Abstract | Links | BibTeX

2046.

Sun, Qigong; Li, Xiufang; Jiao, Licheng; Ren, Yan; Shang, Fanhua; Liu, Fang

Fast and Effective: A Novel Sequential Single-Path Search for Mixed-Precision-Quantized Networks Journal Article

In: IEEE Transactions on Cybernetics, pp. 1-13, 2022.

Links | BibTeX

2045.

Peng, Yameng; Song, Andy; Ciesielski, Vic; Fayek, Haytham M.; Chang, Xiaojun

PRE-NAS: Predictor-assisted Evolutionary Neural Architecture Search Journal Article

In: GECCO, vol. abs/2204.12726, 2022.

Links | BibTeX

2044.

Ji, Junkai; Zhao, Jiajun; Lin, Qiuzhen; Tan, Kay Chen

Competitive Decomposition-Based Multiobjective Architecture Search for the Dendritic Neural Model Journal Article

In: IEEE Transactions on Cybernetics, pp. 1-14, 2022.

Links | BibTeX

2043.

Tang, Cheng; Ji, Junkai; Lin, Qiuzhen; Zhou, Yan

Evolutionary Neural Architecture Design of Liquid State Machine for Image Classification Proceedings Article

In: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 91-95, 2022.

Links | BibTeX

2042.

Nair, Saeejith; Abbasi, Saad; Wong, Alexander; Shafiee, Mohammad Javad

MAPLE-Edge: A Runtime Latency Predictor for Edge Devices Technical Report

2022.

Links | BibTeX

2041.

Wen, Tiancheng; Ding, Zhonggan; Yao, Yongqiang; Wang, Yaxiong; Qian, Xueming

PicassoNet: Searching Adaptive Architecture for Efficient Facial Landmark Localization Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-12, 2022.

Links | BibTeX

2040.

Li, Di; Bai, Yunpeng; Bai, Zongwen; Li, Ying; Shang, Changjing; Shen, Qiang

Decomposed Neural Architecture Search for image denoising Journal Article

In: Applied Soft Computing, vol. 124, pp. 108914, 2022, ISSN: 1568-4946.

Abstract | Links | BibTeX

2039.

Mo, Lingfei; Guan, Xuchen

Neural component search for single image super-resolution Journal Article

In: Signal Processing: Image Communication, vol. 106, pp. 116725, 2022, ISSN: 0923-5965.

Abstract | Links | BibTeX

2038.

Sun, Hanbo; Wang, Chenyu; Zhu, Zhenhua; Ning, Xuefei; Dai, Guohao; Yang, Huazhong; Wang, Yu

Gibbon: Efficient Co-Exploration of NN Model and Processing-In-Memory Architecture Proceedings Article

In: Bolchini, Cristiana; Verbauwhede, Ingrid; Vatajelu, Ioana (Ed.): 2022 Design, Automation & Test in Europe Conference & Exhibition, DATE 2022, Antwerp, Belgium, March 14-23, 2022, pp. 867–872, IEEE, 2022.

Links | BibTeX

2037.

Wang, Aili; Xue, Dong; Wu, Haibin; Gu, Yanfeng

Efficient Convolutional Neural Architecture Search for LiDAR DSM Classification Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-17, 2022.

Links | BibTeX

2036.

Mun, Jiwoo; Ha, Seokhyeon; Lee, Jungwoo

DE-DARTS: Neural architecture search with dynamic exploration Journal Article

In: ICT Express, 2022, ISSN: 2405-9595.

Abstract | Links | BibTeX

2035.

Ingolfsson, Thorir Mar; Vero, Mark; Wang, Xiaying; Lamberti, Lorenzo; Benini, Luca; Spallanzani, Matteo

Reducing neural architecture search spaces with training-free statistics and computational graph clustering Proceedings Article

In: Proceedings of the 19th ACM International Conference on Computing Frontiers, pp. 213–214, 2022.

Links | BibTeX

2034.

Le, Cat P.; Soltani, Mohammadreza; Dong, Juncheng; Tarokh, Vahid

Fisher Task Distance and its Application in Neural Architecture Search Journal Article

In: IEEE Access, vol. 10, pp. 47235-47249, 2022.

Links | BibTeX

2033.

Akin, Berkin; Gupta, Suyog; Long, Yun; Spiridonov, Anton; Wang, Zhuo; White, Marie; Xu, Hao; Zhou, Ping; Zhou, Yanqi

Searching for Efficient Neural Architectures for On-Device ML on Edge TPUs Technical Report

2022.

Links | BibTeX

2032.

Wang, Linnan; Yu, Chenhan; Salian, Satish; Kierat, Slawomir; Migacz, Szymon; Florea, Alex Fit

Searching the Deployable Convolution Neural Networks for GPUs Proceedings Article

In: CVPR 2022, 2022.

Links | BibTeX

2031.

Kawa, Sajad Ahmad; Wani, M Arif

Designing Convolution Neural Network Architecture by utilizing the Complexity Model of the Dataset Proceedings Article

In: 2022 9th International Conference on Computing for Sustainable Global Development (INDIACom), pp. 221-225, 2022.

Links | BibTeX

2030.

Dong, Zhen; Zhou, Kaicheng; Li, Guohao; Zhou, Qiang; Guo, Mingfei; Ghanem, Bernard; Keutzer, Kurt; Zhang, Shanghang

UnrealNAS: Can We Search Neural Architectures with Unreal Data? Technical Report

2022.

Links | BibTeX

2029.

Pourchot, Aloïs; Bailly, Kévin; Ducarouge, Alexis; Sigaud, Olivier

An extensive appraisal of weight-sharing on the NAS-Bench-101 benchmark Journal Article

In: Neurocomputing, vol. 498, pp. 28-42, 2022, ISSN: 0925-2312.

Abstract | Links | BibTeX

2028.

Jin, Charles; Phothilimthana, Phitchaya Mangpo; Roy, Sudip

(alpha)NAS: Neural Architecture Search using Property Guided Synthesis Technical Report

2022.

Links | BibTeX

2027.

Wang, Ting-Ting; Chu, Shu-Chuan; Hu, Chia-Cheng; Jia, Han-Dong; Pan, Jeng-Shyang

Efficient Network Architecture Search Using Hybrid Optimizer Journal Article

In: Entropy, vol. 24, no. 5, 2022, ISSN: 1099-4300.

Abstract | Links | BibTeX

2026.

Li, Boyang; Lu, Qing; Jiang, Weiwen; Jung, Taeho; Shi, Yiyu

A collaboration strategy in the mining pool for proof-of-neural-architecture consensus Journal Article

In: Blockchain: Research and Applications, pp. 100089, 2022, ISSN: 2096-7209.

Abstract | Links | BibTeX

2025.

Zheng, Chenyu; Wang, Junjue; Ma, Ailong; Zhong, Yanfei

AutoLC: Search Lightweight and Top-Performing Architecture for Remote Sensing Image Land-Cover Classification Technical Report

2022.

Links | BibTeX

2024.

Basha, S. H. Shabbeer; Tula, Debapriya; Vinakota, Sravan Kumar; Dubey, Shiv Ram

Target Aware Network Architecture Search and Compression for Efficient Knowledge Transfer Technical Report

2022.

Links | BibTeX

2023.

Ren, Yankun; Li, Longfei; Yang, Xinxing; Zhou, Jun

AutoTransformer: Automatic Transformer Architecture Design For Time Series Classification Proceedings Article

In: Advances in Knowledge Discovery and Data Mining: 26th Pacific-Asia Conference, PAKDD 2022, Chengdu, China, May 16–19, 2022, Proceedings, Part I, pp. 143–155, Springer-Verlag, Chengdu, China, 2022, ISBN: 978-3-031-05932-2.

Abstract | Links | BibTeX

2022.

Deng, Difan; Karl, Florian; Hutter, Frank; Bischl, Bernd; Lindauer, Marius

Efficient Automated Deep Learning for Time Series Forecasting Technical Report

2022.

Links | BibTeX

2021.

Du, Mengge; Chen, Yuntian; Zhang, Dongxiao

AutoKE: An automatic knowledge embedding framework for scientific machine learning Journal Article

In: CoRR, vol. abs/2205.05390, 2022.

Links | BibTeX

2020.

Kim, Do-Guk; Lee, Heung-Chang

Proxyless Neural Architecture Adaptation for Supervised Learning and Self-Supervised Learning Technical Report

2022.

Links | BibTeX

2019.

Sun, Jialiang; Zheng, Xiaohu; Yao, Wen; Zhang, Xiaoya; Zhou, Weien

Heat Source Layout Optimization Using Automatic Deep Learning Surrogate Model and Multimodal Neighborhood Search Algorithm Technical Report

2022.

Links | BibTeX

2018.

Belciug, Smaranda

Learning deep neural networks' architectures using differential evolution. Case study: Medical imaging processing Journal Article

In: Computers in Biology and Medicine, vol. 146, pp. 105623, 2022, ISSN: 0010-4825.

Abstract | Links | BibTeX

2017.

Frey, Nathan; Soklaski, Ryan; Axelrod, Simon; Samsi, Siddharth; Gomez-Bombarelli, Rafael; Coley, Connor; Gadepally, Vijay

Neural Scaling of Deep Chemical Models Journal Article

In: ChemRxiv, 2022.

Links | BibTeX

2016.

Miriyala, Srinivas Soumitri; Pujari, Keerthi NagaSree; Naik, Sakshi; Mitra, Kishalay

Evolutionary neural architecture search for surrogate models to enable optimization of industrial continuous crystallization process Journal Article

In: Powder Technology, vol. 405, pp. 117527, 2022, ISSN: 0032-5910.

Abstract | Links | BibTeX

2015.

Lee, Joo-Hyun; Chang, Joon-Hyuk; Yang, Jae-Mo; Moon, Han-Gil

NAS-TasNet: Neural Architecture Search for Time-Domain Speech Separation Journal Article

In: IEEE Access, vol. 10, pp. 56031-56043, 2022.

Links | BibTeX

2014.

Qian, Qi; Sang, Qingbing

No-reference image quality assessment based on automatic machine learning Journal Article

In: ITM Web Conf., vol. 45, pp. 01034, 2022.

Links | BibTeX

2013.

Ogundokun, Roseline Oluwaseun; Misra, Sanjay; Douglas, Mychal; Damaševičius, Robertas; Maskeliūnas, Rytis

Medical Internet-of-Things Based Breast Cancer Diagnosis Using Hyperparameter-Optimized Neural Networks Journal Article

In: Future Internet, vol. 14, no. 5, 2022, ISSN: 1999-5903.

Abstract | Links | BibTeX

2012.

Xu, Ship Peng; Wang, Ke; Hassan, Md. Rafiul; Hassan, Mohammad Mehedi; Chen, Chien-Ming

An Interpretive Perspective: Adversarial Trojaning Attack on Neural-Architecture-Search Enabled Edge AI Systems Journal Article

In: IEEE Transactions on Industrial Informatics, pp. 1-1, 2022.

Links | BibTeX

2011.

Cummings, Daniel; Sarah, Anthony; Sridhar, Sharath Nittur; Szankin, Maciej; Muñoz, Juan Pablo; Sundaresan, Sairam

A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities Technical Report

2022.

Links | BibTeX

2010.

Li, Yanyu; Zhao, Pu; Yuan, Geng; Lin, Xue; Wang, Yanzhi; Chen, Xin

Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization Technical Report

2022.

Links | BibTeX

2009.

Smith, James Seale; Seymour, Zachary; Chiu, Han-Pang

Incremental Learning with Differentiable Architecture and Forgetting Search Technical Report

2022.

Links | BibTeX

2008.

Tuli, Shikhar; Dedhia, Bhishma; Tuli, Shreshth; Jha, Niraj K.

FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid? Technical Report

2022.

Links | BibTeX

3157 entries « 23 of 64 »