AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4236 entries « 45 of 85 »

2022

2036.

Ren, Yankun; Li, Longfei; Yang, Xinxing; Zhou, Jun

AutoTransformer: Automatic Transformer Architecture Design For Time Series Classification Proceedings Article

In: Advances in Knowledge Discovery and Data Mining: 26th Pacific-Asia Conference, PAKDD 2022, Chengdu, China, May 16–19, 2022, Proceedings, Part I, pp. 143–155, Springer-Verlag, Chengdu, China, 2022, ISBN: 978-3-031-05932-2.

Abstract | Links | BibTeX

2035.

Deng, Difan; Karl, Florian; Hutter, Frank; Bischl, Bernd; Lindauer, Marius

Efficient Automated Deep Learning for Time Series Forecasting Technical Report

2022.

Links | BibTeX

2034.

Du, Mengge; Chen, Yuntian; Zhang, Dongxiao

AutoKE: An automatic knowledge embedding framework for scientific machine learning Journal Article

In: CoRR, vol. abs/2205.05390, 2022.

Links | BibTeX

2033.

Kim, Do-Guk; Lee, Heung-Chang

Proxyless Neural Architecture Adaptation for Supervised Learning and Self-Supervised Learning Technical Report

2022.

Links | BibTeX

2032.

Sun, Jialiang; Zheng, Xiaohu; Yao, Wen; Zhang, Xiaoya; Zhou, Weien

Heat Source Layout Optimization Using Automatic Deep Learning Surrogate Model and Multimodal Neighborhood Search Algorithm Technical Report

2022.

Links | BibTeX

2031.

Belciug, Smaranda

Learning deep neural networks' architectures using differential evolution. Case study: Medical imaging processing Journal Article

In: Computers in Biology and Medicine, vol. 146, pp. 105623, 2022, ISSN: 0010-4825.

Abstract | Links | BibTeX

2030.

Frey, Nathan; Soklaski, Ryan; Axelrod, Simon; Samsi, Siddharth; Gomez-Bombarelli, Rafael; Coley, Connor; Gadepally, Vijay

Neural Scaling of Deep Chemical Models Journal Article

In: ChemRxiv, 2022.

Links | BibTeX

2029.

Miriyala, Srinivas Soumitri; Pujari, Keerthi NagaSree; Naik, Sakshi; Mitra, Kishalay

Evolutionary neural architecture search for surrogate models to enable optimization of industrial continuous crystallization process Journal Article

In: Powder Technology, vol. 405, pp. 117527, 2022, ISSN: 0032-5910.

Abstract | Links | BibTeX

2028.

Lee, Joo-Hyun; Chang, Joon-Hyuk; Yang, Jae-Mo; Moon, Han-Gil

NAS-TasNet: Neural Architecture Search for Time-Domain Speech Separation Journal Article

In: IEEE Access, vol. 10, pp. 56031-56043, 2022.

Links | BibTeX

2027.

Qian, Qi; Sang, Qingbing

No-reference image quality assessment based on automatic machine learning Journal Article

In: ITM Web Conf., vol. 45, pp. 01034, 2022.

Links | BibTeX

2026.

Ogundokun, Roseline Oluwaseun; Misra, Sanjay; Douglas, Mychal; Damaševičius, Robertas; Maskeliūnas, Rytis

Medical Internet-of-Things Based Breast Cancer Diagnosis Using Hyperparameter-Optimized Neural Networks Journal Article

In: Future Internet, vol. 14, no. 5, 2022, ISSN: 1999-5903.

Abstract | Links | BibTeX

2025.

Xu, Ship Peng; Wang, Ke; Hassan, Md. Rafiul; Hassan, Mohammad Mehedi; Chen, Chien-Ming

An Interpretive Perspective: Adversarial Trojaning Attack on Neural-Architecture-Search Enabled Edge AI Systems Journal Article

In: IEEE Transactions on Industrial Informatics, pp. 1-1, 2022.

Links | BibTeX

2024.

Cummings, Daniel; Sarah, Anthony; Sridhar, Sharath Nittur; Szankin, Maciej; Muñoz, Juan Pablo; Sundaresan, Sairam

A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities Technical Report

2022.

Links | BibTeX

2023.

Li, Yanyu; Zhao, Pu; Yuan, Geng; Lin, Xue; Wang, Yanzhi; Chen, Xin

Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization Technical Report

2022.

Links | BibTeX

2022.

Smith, James Seale; Seymour, Zachary; Chiu, Han-Pang

Incremental Learning with Differentiable Architecture and Forgetting Search Technical Report

2022.

Links | BibTeX

2021.

Tuli, Shikhar; Dedhia, Bhishma; Tuli, Shreshth; Jha, Niraj K.

FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid? Technical Report

2022.

Links | BibTeX

2020.

Risso, Matteo; Burrello, Alessio; Conti, Francesco; Lamberti, Lorenzo; Chen, Yukai; Benini, Luca; Macii, Enrico; Poncino, Massimo; Pagliari, Daniele Jahier

Lightweight Neural Architecture Search for Temporal Convolutional Networks at the Edge Journal Article

In: IEEE Transactions on Computers, pp. 1-1, 2022.

Links | BibTeX

2019.

Gao, Yang; Zhang, Peng; Yang, Hong; Zhou, Chuan; Tian, Zhihong; Hu, Yue; Li, Zhao; Zhou, Jingren

GraphNAS++: Distributed Architecture Search for Graph Neural Networks Journal Article

In: IEEE Transactions on Knowledge and Data Engineering, pp. 1-1, 2022.

Links | BibTeX

2018.

Zhang, Zeyang; Chen, Yidong; Zhou, Changle

Self-Growing Binary Activation Network: A Novel Deep Learning Model With Dynamic Architecture Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-10, 2022.

Links | BibTeX

2017.

Abbasi, Saad; Wong, Alexander; Shafiee, Mohammad Javad

MAPLE-X: Latency Prediction with Explicit Microprocessor Prior Knowledge Technical Report

2022.

Links | BibTeX

2016.

Paulo, Maurício; Turnes, Javier Noa; Happ, P.; Ferreira, Matheus; Marques, Haroldo; Feitosa, Raul

HOW FAR SHOULD I LOOK? A NEURAL ARCHITECTURE SEARCH STRATEGY FOR SEMANTIC SEGMENTATION OF REMOTE SENSING IMAGES Journal Article

In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. V-3-2022, pp. 17-23, 2022.

Links | BibTeX

2015.

Lopes, Vasco; Santos, Miguel; Degardin, Bruno; Alexandre, Luís A.

Efficient Guided Evolution for Neural Architecture Search Proceedings Article

In: GECCO2022, 2022.

Links | BibTeX

2014.

Wang, Yicheng; Han, Xiaotian; Chang, Chia-Yuan; Zha, Daochen; Braga-Neto, Ulisses; Hu, Xia

Auto-PINN: Understanding and Optimizing Physics-Informed Neural Architecture Technical Report

2022.

Links | BibTeX

2013.

Li, Yanyu; Zhao, Pu; Yuan, Geng; Lin, Xue; Wang, Yanzhi; Chen, Xin

Pruning-as-Search: Efficient Neural Architecture Search via Channel Pruning and Structural Reparameterization Technical Report

2022.

Links | BibTeX

2012.

Risso, Matteo; Burrello, Alessio; Benini, Luca; Macii, Enrico; Poncino, Massimo; Pagliari, Daniele Jahier

Multi-Complexity-Loss DNAS for Energy-Efficient and Memory-Constrained Deep Neural Networks Technical Report

2022.

Links | BibTeX

2011.

Li, Yanyu; Yuan, Geng; Wen, Yang; Hu, Eric; Evangelidis, Georgios; Tulyakov, Sergey; Wang, Yanzhi; Ren, Jian

EfficientFormer: Vision Transformers at MobileNet Speed Technical Report

2022.

Links | BibTeX

2010.

Zheng, Xiawu; Fei, Xiang; Zhang, Lei; Wu, Chenglin; Chao, Fei; Liu, Jianzhuang; Zeng, Wei; Tian, Yonghong; Ji, Rongrong

Neural Architecture Search With Representation Mutual Information Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11912–11921, 2022.

Links | BibTeX

2009.

Pan, Junyi; Sun, Chong; Zhou, Yizhou; Zhang, Ying; Li, Chen

Distribution Consistent Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10884–10893, 2022.

Links | BibTeX

2008.

Xie, Pengtao; Du, Xuefeng

Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11922–11932, 2022.

Links | BibTeX

2007.

Xu, Kepeng; He, Gang

DNAS: A Decoupled Global Neural Architecture Search Method Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1979–1985, 2022.

Links | BibTeX

2006.

Shang, Ronghua; Zhu, Songling; Ren, Jinhong; Liu, Hangcheng; Jiao, Licheng

Evolutionary neural architecture search based on evaluation correction and functional units Journal Article

In: Knowledge-Based Systems, vol. 251, pp. 109206, 2022, ISSN: 0950-7051.

Abstract | Links | BibTeX

2005.

Liu, Shiqing; Zhang, Haoyu; Jin, Yaochu

A Survey on Surrogate-assisted Efficient Neural Architecture Search Technical Report

2022.

Links | BibTeX

2004.

Kim, Youngkee; Jung, Soyi; Choi, Minseok; Kim, Joongheon

Search Space Adaptation for Differentiable Neural Architecture Search in Image Classification Technical Report

2022.

Links | BibTeX

2003.

Li, Wenshuo; Chen, Xinghao; Bai, Jinyu; Ning, Xuefei; Wang, Yunhe

Searching for Energy-Efficient Hybrid Adder-Convolution Neural Networks Proceedings Article

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1943–1952, 2022.

Links | BibTeX

2002.

Ferjani, Imen; Hidri, Minyar Sassi; Frihida, Ali

SiNoptiC: swarm intelligence optimisation of convolutional neural network architectures for text classification Journal Article

In: International Journal of Computer Applications in Technology, vol. 68, no. 1, pp. 82-100, 2022.

Links | BibTeX

2001.

Liu, Jinyuan; Wu, Yuhui; Wu, Guanyao; Liu, Risheng; Fan, Xin

Learn to Search a Lightweight Architecture for Target-aware Infrared and Visible Image Fusion Journal Article

In: IEEE Signal Processing Letters, pp. 1-5, 2022.

Links | BibTeX

2000.

Li, Zhuowei; Gao, Yibo; Zha, Zhenzhou; Hu, Zhiqiang; Xia, Qing; Zhang, Shaoting; Metaxas, Dimitris N.

Towards Self-supervised and Weight-preserving Neural Architecture Search Technical Report

2022.

Links | BibTeX

1999.

Du, Yipeng; Liu, Jian; Wang, Xiang; Wang, Peng

SSVEP based Emotion Recognition for IoT via Multiobjective Neural Architecture Search Journal Article

In: IEEE Internet of Things Journal, pp. 1-1, 2022.

Links | BibTeX

1998.

Zhang, Yuanhan; Zhou, Kaiyang; Liu, Ziwei

Neural Prompt Search Technical Report

2022.

Links | BibTeX

1997.

Huang, Mingqiang; Liu, Yucen; Man, Changhai; Li, Kai; Cheng, Quan; Mao, Wei; Yu, Hao

A High Performance Multi-Bit-Width Booth Vector Systolic Accelerator for NAS Optimized Deep Learning Neural Networks Journal Article

In: IEEE Transactions on Circuits and Systems I: Regular Papers, pp. 1-13, 2022.

Links | BibTeX

1996.

Xue, Xizhe; Zhang, Haokui; Fang, Bei; Bai, Zongwen; Li, Ying

Grafting Transformer on Automatically Designed Convolutional Neural Network for Hyperspectral Image Classification Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-16, 2022.

Links | BibTeX

1995.

Aradhya, Abhay M. S.; Ashfahani, Andri; Angelina, Fienny; Pratama, Mahardhika; Mello, Rodrigo Fernandes; Sundaram, Suresh

Autonomous CNN (AutoCNN): A data-driven approach to network architecture determination Journal Article

In: Information Sciences, vol. 607, pp. 638-653, 2022, ISSN: 0020-0255.

Abstract | Links | BibTeX

1994.

Shahawy, Mohamed; Benkhelifa, Elhadj; White, David

A Review on Plastic Artificial Neural Networks: Exploring the Intersection between Neural Architecture Search and Continual Learning Technical Report

2022.

Links | BibTeX

1993.

Franken, G. G. H.; Singh, Prabhant; Vanschoren, Joaquin

EmProx: Neural Network Performance Estimation For Neural Architecture Search Technical Report

2022.

Links | BibTeX

1992.

Lu, Qing; Xu, Xiaowei; Dong, Shunjie; Hao, Cong; Yang, Lei; Zhuo, Cheng; Shi, Yiyu

RT-DNAS: Real-time Constrained Differentiable Neural Architecture Search for 3D Cardiac Cine MRI Segmentation Technical Report

2022.

Links | BibTeX

1991.

Liu, Jiawei; Zhang, Kaiyu; Hu, Weitai; Yang, Qing

Improve Ranking Correlation of Super-net through Training Scheme from One-shot NAS to Few-shot NAS Technical Report

2022.

Links | BibTeX

1990.

Eslahi, Samira Vafay; Tao, Jian; Ji, Jim

ERNAS: An Evolutionary Neural Architecture Search for Magnetic Resonance Image Reconstructions Technical Report

2022.

Links | BibTeX

1989.

Yang, Yingguang; Yang, Renyu; Li, Yangyang; Cui, Kai; Yang, Zhiqin; Wang, Yue; Xu, Jie; Xie, Haiyong

RoSGAS: Adaptive Social Bot Detection with Reinforced Self-Supervised GNN Architecture Search Technical Report

2022.

Links | BibTeX

1988.

Ren, Xuhong; Chen, Jianlang; Juefei-Xu, Felix; Xue, Wanli; Guo, Qing; Ma, Lei; Zhao, Jianjun; Chen, Shengyong

DARTSRepair: Core-failure-set guided DARTS for network robustness to common corruptions Journal Article

In: Pattern Recognition, vol. 131, pp. 108864, 2022, ISSN: 0031-3203.

Abstract | Links | BibTeX

1987.

Dervisi, Foteini; Kyriakides, George; Margaritis, Konstantinos

Evaluating Acceleration Techniques for Genetic Neural Architecture Search Proceedings Article

In: Iliadis, Lazaros; Jayne, Chrisina; Tefas, Anastasios; Pimenidis, Elias (Ed.): Engineering Applications of Neural Networks, pp. 3–14, Springer International Publishing, Cham, 2022, ISBN: 978-3-031-08223-8.

Abstract | BibTeX

4236 entries « 45 of 85 »