AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4191 entries « 41 of 84 »

2022

2191.

Ahn, Saehyun; Chang, Jung-Woo; Yoon, Hyeon-Seok; Kang, Suk-Ju

TouchNAS: Efficient Touch Detection Model Design Methodology for Resource-Constrained Devices Journal Article

In: IEEE Sensors Journal, pp. 1-1, 2022.

Links | BibTeX

2190.

Hassantabar, Shayan; Dai, Xiaoliang; Jha, Niraj K.

CURIOUS: Efficient Neural Architecture Search Based on a Performance Predictor and Evolutionary Search Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2022.

Links | BibTeX

2189.

Li, Wei; Wen, Shiping; Shi, Kaibo; Yang, Yin; Huang, Tingwen

Neural Architecture Search with a Lightweight Transformer for Text-to-Image Synthesis Journal Article

In: IEEE Transactions on Network Science and Engineering, pp. 1-1, 2022.

Links | BibTeX

2188.

Pauletto, Loïc; Amini, Massih-Reza; Winckler, Nicolas

Self Semi Supervised Neural Architecture Search for Semantic Segmentation Technical Report

2022.

Links | BibTeX

2187.

Xu, Dongkuan; Mukherjee, Subhabrata; Liu, Xiaodong; Dey, Debadeepta; Wang, Wenhui; Zhang, Xiang; Awadallah, Ahmed Hassan; Gao, Jianfeng

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models Technical Report

2022.

Links | BibTeX

2186.

Wei, Hui; Lee, Feifei; Hu, Chunyan; Chen, Qiu

MOO-DNAS: Efficient Neural Network Design via Differentiable Architecture Search Based on Multi-Objective Optimization Journal Article

In: IEEE Access, vol. 10, pp. 14195-14207, 2022.

Links | BibTeX

2185.

Guo, Bicheng; He, Shibo; Chen, Tao; Chen, Jiming; Ye, Peng

Neural Architecture Ranker Technical Report

2022.

Links | BibTeX

2184.

Na, Byunggook; Mok, Jisoo; Park, Seongsik; Lee, Dongjin; Choe, Hyeokjun; Yoon, Sungroh

AutoSNN: Towards Energy-Efficient Spiking Neural Networks Technical Report

2022.

Links | BibTeX

2183.

Rguibi, Zakaria; Hajami, Abdelmajid; Dya, Zitouni

Äutomatic Searching of Deep Neural Networks for Medical Imaging Diagnostic Proceedings Article

In: Saidi, Rajaa; Bhiri, Brahim El; Maleh, Yassine; Mosallam, Ayman; Essaaidi, Mohammed (Ed.): Ädvanced Technologies for Humanity", pp. 129–140, Springer International Publishing, Cham, 2022, ISBN: 978-3-030-94188-8.

Abstract | BibTeX

2182.

Cardoso, Rui P.; Hart, Emma; Kurka, David Burth; Pitt, Jeremy V.

Augmenting Novelty Search with a Surrogate Model to Engineer Meta-Diversity in Ensembles of Classifiers Technical Report

2022.

Links | BibTeX

2181.

Mehta, Yash; White, Colin; Zela, Arber; Krishnakumar, Arjun; Zabergja, Guri; Moradian, Shakiba; Safari, Mahmoud; Yu, Kaicheng; Hutter, Frank

NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Proceedings Article

In: ICLR 2022, 2022.

Links | BibTeX

2180.

Kang, Ziyang; Wang, Shiying; Wang, Lei; Li, Shiming; Qu, Lianhua; Xu, Weixia

Hardware-aware liquid state machine generation for 2D/3D Network-on-Chip platforms Journal Article

In: Journal of Systems Architecture, vol. 124, pp. 102429, 2022, ISSN: 1383-7621.

Abstract | Links | BibTeX

2179.

Hu, Xing; Liang, Ling; Chen, Xiaobing; Deng, Lei; Ji, Yu; Ding, Yufei; Du, Zidong; Guo, Qi; Sherwood, Tim; Xie, Yuan

A Systematic View of Model Leakage Risks in Deep Neural Network Systems Journal Article

In: IEEE Transactions on Computers, pp. 1-1, 2022.

Links | BibTeX

2178.

Dushatskiy, Arkadiy; Alderliesten, Tanja; Bosman, Peter A. N.

Heed the Noise in Performance Evaluations in Neural Architecture Search Technical Report

2022.

Links | BibTeX

2177.

Cho, Hyunghun; Shin, Jungwook; Rhee, Wonjong

B2EA: An Evolutionary Algorithm Assisted by Two Bayesian Optimization Modules for Neural Architecture Search Technical Report

2022.

Links | BibTeX

2176.

Cho, Minsu; Joshi, Ameya; Garg, Siddharth; Reagen, Brandon; Hegde, Chinmay

Selective Network Linearization for Efficient Private Inference Technical Report

2022.

Links | BibTeX

2175.

Mazumder, Arnab Neelim; Mohsenin, Tinoosh

A Fast Network Exploration Strategy to Profile Low Energy Consumption for Keyword Spotting Technical Report

2022.

Links | BibTeX

2174.

Hassanzadeh, Tahereh; Essam, Daryl; Sarker, Ruhul

EvoDCNN: An Evolutionary Deep Convolutional Neural Network for Image Classification Journal Article

In: Neurocomputing, 2022, ISSN: 0925-2312.

Abstract | Links | BibTeX

2173.

Rabczuk, Timon; Guo, Hongwei; Zhuang, Xiaoying; Chen, Pengwan; Alajlan, Naif

Stochastic deep collocation method based on neural architecture search and transfer learning for heterogeneous porous media Journal Article

In: Engineering with Computers, vol. 2022, pp. 1 – 26, 2022.

Links | BibTeX

2172.

Lee, Jemin; Yu, Misun; Kwon, Yongin; Kim, Taeho

Quantune: Post-training Quantization of Convolutional Neural Networks using Extreme Gradient Boosting for Fast Deployment Technical Report

2022.

Links | BibTeX

2171.

Wang, Duo; Zhao, Yiren; Shumailov, Ilia; Mullins, Robert D.

Model Architecture Adaption for Bayesian Neural Networks Technical Report

2022.

Links | BibTeX

2170.

Elsken, Thomas; Zela, Arber; Metzen, Jan Hendrik; Staffler, Benedikt; Brox, Thomas; Valada, Abhinav; Hutter, Frank

Neural Architecture Search for Dense Prediction Tasks in Computer Vision Technical Report

2022.

Links | BibTeX

2169.

Sun, Junding; Yao, Chong; Liu, Jie; Liu, Weifan; Yu, Zekuan

GNAS-U2Net: A new optic cup and optic disc segmentation architecture with genetic neural architecture search Journal Article

In: IEEE Signal Processing Letters, pp. 1-1, 2022.

Links | BibTeX

2168.

Speckhard, Daniel T.; Misiunas, Karolis; Perel, Sagi; Zhu, Tenghui; Carlile, Simon; Slaney, Malcolm

Neural Architecture Search for Energy Efficient Always-on Audio Models Technical Report

2022.

Links | BibTeX

2167.

Jia, Liang; Tian, Ye; Zhang, Junguo

Domain-Aware Neural Architecture Search for Classifying Animals in Camera Trap Images Journal Article

In: Animals, vol. 12, no. 4, 2022, ISSN: 2076-2615.

Abstract | Links | BibTeX

2166.

Yang, Junhuan; Sheng, Yi; Zhang, Sizhe; Wang, Ruixuan; Foreman, Kenneth; Paige, Mikell; Jiao, Xun; Jiang, Weiwen; Yang, Lei

Automated Architecture Search for Brain-inspired Hyperdimensional Computing Technical Report

2022.

Links | BibTeX

2165.

Huang, Mingqiang; Liu, Yucen; Cheng, Quan; Yang, Shuxin; Li, Kai; Luo, Junyi; Yang, Zhengke; Li, Qiufeng; Yu, Hao; Man, Changhai

A High Throughput Multi-Bit-Width 3D Systolic Accelerator for NAS Optimized Deep Neural Networks on FPGA Proceedings Article

In: Proceedings of the 2022 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, pp. 50, Association for Computing Machinery, Virtual Event, USA, 2022, ISBN: 9781450391498.

Abstract | Links | BibTeX

2164.

Teso-Fz-Betoño, Daniel; Zulueta, Ekaitz; Sanchez-Chica, Ander; Fernandez-Gamiz, Unai; Teso-Fz-Betoño, Adrian; Lopez-Guede, Jose Manuel

Neural architecture search for the estimation of relative positioning of the autonomous mobile robot Journal Article

In: Logic Journal of the IGPL, 2022, ISSN: 1367-0751, (jzac030).

Abstract | Links | BibTeX

2163.

Chen, Jiamin; Gao, Jianliang; Chen, Yibo; Oloulade, Babatounde MOCTARD; Lyu, Tengfei; Li, Zhao

Auto-GNAS: A Parallel Graph Neural Architecture Search Framework Journal Article

In: IEEE Transactions on Parallel and Distributed Systems, pp. 1-1, 2022.

Links | BibTeX

2162.

Kim, Youngkee; Yun, Won Joon; Lee, Youn Kyu; Kim, Joongheon

Two-Stage Architectural Fine-Tuning with Neural Architecture Search using Early-Stopping in Image Classification Technical Report

2022.

Links | BibTeX

2161.

Kim, Jae Kwan; Ahn, Wonbin; Park, Sangin; Lee, Soo-Hong; Kim, Laehyun

Early Prediction of Sepsis Onset Using Neural Architecture Search Based on Genetic Algorithms Journal Article

In: International Journal of Environmental Research and Public Health, vol. 19, no. 4, 2022, ISSN: 1660-4601.

Abstract | Links | BibTeX

2160.

Dai, Liuyao; Cheng, Quan; Wang, Yuhang; Huang, Gengbin; Zhou, Junzhuo; Li, Kai; Mao, Wei; Yu, Hao

An Energy-Efficient Bit-Split-and-Combination Systolic Accelerator for NAS-Based Multi-Precision Convolution Neural Networks Proceedings Article

In: 2022 27th Asia and South Pacific Design Automation Conference (ASP-DAC), pp. 448-453, 2022.

Links | BibTeX

2159.

Lee, Jooyeon; Park, Junsang; Lee, Seunghyun; Kung, Jaeha

Implication of Optimizing NPU Dataflows on Neural Architecture Search for Mobile Devices Journal Article

In: ACM Trans. Des. Autom. Electron. Syst., 2022, ISSN: 1084-4309, (Just Accepted).

Abstract | Links | BibTeX

2158.

Zhang, Chunhui; Yuan, Xiaoming; Zhang, Qianyun; Zhu, Guangxu; Cheng, Lei; Zhang, Ning

Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search Technical Report

2022.

Links | BibTeX

2157.

Bosma, Martijn M. A.; Dushatskiy, Arkadiy; Grewal, Monika; Alderliesten, Tanja; Bosman, Peter A. N.

Mixed-Block Neural Architecture Search for Medical Image Segmentation Technical Report

2022.

Links | BibTeX

2156.

Sheng, Yi; Yang, Junhuan; Wu, Yawen; Mao, Kevin; Shi, Yiyu; Hu, Jingtong; Jiang, Weiwen; Yang, Lei

The Larger The Fairer? Small Neural Networks Can Achieve Fairness for Edge Devices Technical Report

2022.

Links | BibTeX

2155.

Zhao, Shixiong; Li, Fanxin; Chen, Xusheng; Shen, Tianxiang; Chen, Li; Wang, Sen; Zhang, Nicholas; Li, Cheng; Cui, Heming

NASPipe: High Performance and Reproducible Pipeline Parallel Supernet Training via Causal Synchronous Parallelism Proceedings Article

In: Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 374–387, Association for Computing Machinery, Lausanne, Switzerland, 2022, ISBN: 9781450392051.

Abstract | Links | BibTeX

2154.

Zhang, Wentao; Shen, Yu; Lin, Zheyu; Li, Yang; Li, Xiaosen; Ouyang, Wen; Tao, Yangyu; Yang, Zhi; Cui, Bin

PaSca: a Graph Neural Architecture Search System under the Scalable Paradigm Technical Report

2022.

Links | BibTeX

2153.

Zhang, Tianning; Ang, Yee Sin; Li, Erping; Kee, Chun Yun; Ang, L. K.

SUTD-PRCM Dataset and Neural Architecture Search Approach for Complex Metasurface Design Technical Report

2022.

Links | BibTeX

2152.

Huang, Yongdong; Li, Yuanzhan; Cao, Xulong; Zhang, Siyu; Cai, Shen; Lu, Ting; Liu, Yuqi

An Efficient End-to-End 3D Model Reconstruction based on Neural Architecture Search Technical Report

2022.

Links | BibTeX

2151.

Seong, Jaeho; Lee, Chaehyun; Han, Dong Seog

Neural Architecture Search for Real-Time Driver Behavior Recognition Proceedings Article

In: 2022 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), pp. 104-108, 2022.

Links | BibTeX

2150.

Cummings, Daniel; Sridhar, Sharath Nittur; Sarah, Anthony; Szankin, Maciej

Accelerating Neural Architecture Exploration Across Modalities Using Genetic Algorithms Technical Report

2022.

Links | BibTeX

2149.

Zhao, Yaqin; Feng, Liqi; Tang, Jiaxi; Zhao, Wenxuan; Ding, Zhipeng; Li, Ao; Zheng, Zhaoxiang

Automatically recognizing four-legged animal behaviors to enhance welfare using spatial temporal graph convolutional networks Journal Article

In: Applied Animal Behaviour Science, vol. 249, pp. 105594, 2022, ISSN: 0168-1591.

Abstract | Links | BibTeX

2148.

Sarah, Anthony; Cummings, Daniel; Sridhar, Sharath Nittur; Sundaresan, Sairam; Szankin, Maciej; Webb, Tristan; Munoz, J. Pablo

A Hardware-Aware System for Accelerating Deep Neural Network Optimization Technical Report

2022.

Links | BibTeX

2147.

Sinha, Nilotpal; Chen, Kuan-Wen

Neural Architecture Search using Progressive Evolution Technical Report

2022.

Links | BibTeX

2146.

Ye, Peng; Li, Baopu; Li, Yikang; Chen, Tao; Fan, Jiayuan; Ouyang, Wanli

(beta)-DARTS: Beta-Decay Regularization for Differentiable Architecture Search Proceedings Article

In: CVPR2022, 2022.

Links | BibTeX

2145.

Szwarcman, Daniela; Civitarese, Daniel; Vellasco, Marley

Quantum-inspired evolutionary algorithm applied to neural architecture search Journal Article

In: Applied Soft Computing, vol. 120, pp. 108674, 2022, ISSN: 1568-4946.

Abstract | Links | BibTeX

2144.

Huynh, Lam; Rahtu, Esa; Matas, Jiri; Heikkilä, Janne

Fast Neural Architecture Search for Lightweight Dense Prediction Networks Technical Report

2022.

Links | BibTeX

2143.

Lin, Ke; A, Yong; Gan, Zhuoxin; Jiang, Yingying

WPNAS: Neural Architecture Search by jointly using Weight Sharing and Predictor Technical Report

2022.

Links | BibTeX

2142.

Chen, Xuehui; Niu, Xin; Jiang, Jingfei; Pan, Hengyue; Dong, Peijie; Wei, Zimian

Influence of Initialization and Modularization on the Performance of Network Morphism-Based Neural Architecture Search Proceedings Article

In: Yao, Jian; Xiao, Yang; You, Peng; Sun, Guang (Ed.): The International Conference on Image, Vision and Intelligent Systems (ICIVIS 2021), pp. 875–887, Springer Singapore, Singapore, 2022, ISBN: 978-981-16-6963-7.

Abstract | Links | BibTeX

4191 entries « 41 of 84 »