AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4193 entries « 28 of 84 »

2023

2843.

Eisenbach, Markus; Lübberstedt, Jannik; Aganian, Dustin; Gross, Horst-Michael

A Little Bit Attention Is All You Need for Person Re-Identification Technical Report

2023.

Links | BibTeX

2842.

Hasana, Md. Mehedi; Ibrahim, Muhammad; Ali, Md. Sawkat

Speeding Up EfficientNet: Selecting Update Blocks of Convolutional Neural Networks using Genetic Algorithm in Transfer Learning Technical Report

2023.

Links | BibTeX

2841.

Lin, Shih-Ping; Wang, Sheng-De

SGAS-es: Avoiding Performance Collapse by Sequential Greedy Architecture Search with the Early Stopping Indicator Proceedings Article

In: Ärai, Kohei" (Ed.): Ädvances in Information and Communication", pp. 135–154, Springer Nature Switzerland, Cham, 2023, ISBN: 978-3-031-28073-3.

Abstract | Links | BibTeX

2840.

Lu, Shun; Hu, Yu; Yang, Longxing; Sun, Zihao; Mei, Jilin; Tan, Jianchao; Song, Chengru

PA&DA: Jointly Sampling PAth and DAta for Consistent NAS Conference

CVPR2023, vol. abs/2302.14772, 2023.

Links | BibTeX

2839.

Njor, Emil; Madsen, Jan; Fafoutis, Xenofon

Data Aware Neural Architecture Search Proceedings Article

In: Proceedings of tinyML Research Symposium, 2023, (tinyML Research Symposium’23 ; Conference date: 27-03-2023 Through 27-03-2023).

Abstract | Links | BibTeX

2838.

Wang, Kun; Han, Ling; Li, Liangzhi

A decoupled search deep network framework for high-resolution remote sensing image classification Journal Article

In: Remote Sensing Letters, vol. 14, no. 3, pp. 243-253, 2023.

Links | BibTeX

2837.

Xue, Yu; Chen, Chen; Słowik, Adam

Neural Architecture Search Based on A Multi-objective Evolutionary Algorithm With Probability Stack Journal Article

In: IEEE Transactions on Evolutionary Computation, pp. 1-1, 2023.

Links | BibTeX

2836.

Cao, Chunhong; Xiang, Han; Song, Wei; Yi, Hongbo; Xiao, Fen; Gao, Xieping

Lightweight Multiscale Neural Architecture Search With Spectral–Spatial Attention for Hyperspectral Image Classification Journal Article

In: IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1-15, 2023.

Links | BibTeX

2835.

Kus, Zeki; Akkan, Can; Gülcü, Ayla

Novel Surrogate Measures Based on a Similarity Network for Neural Architecture Search Journal Article

In: IEEE Access, vol. 11, pp. 22596–22613, 2023.

Links | BibTeX

2834.

Cereda, Elia; Crupi, Luca; Risso, Matteo; Burrello, Alessio; Benini, Luca; Giusti, Alessandro; Pagliari, Daniele Jahier; Palossi, Daniele

Deep Neural Network Architecture Search for Accurate Visual Pose Estimation aboard Nano-UAVs Proceedings Article

In: IEEE ICRA 2023, 2023.

Links | BibTeX

2833.

Ke, Songyu; Pan, Zheyi; He, Tianfu; Liang, Yuxuan; Zhang, Junbo; Zheng, Yu

AutoSTG+: An automatic framework to discover the optimal network for spatio-temporal graph prediction Journal Article

In: Artificial Intelligence, vol. 318, pp. 103899, 2023, ISSN: 0004-3702.

Abstract | Links | BibTeX

2832.

Brown, Austin; Gupta, Maanak; Abdelsalam, Mahmoud

Automated Machine Learning for Deep Learning based Malware Detection Technical Report

2023.

Links | BibTeX

2831.

Santana, Roberto; Hidalgo-Cenalmor, Ivan; Garciarena, Unai; Mendiburu, Alexander; Lozano, José Antonio

Neuroevolutionary algorithms driven by neuron coverage metrics for semi-supervised classification Technical Report

2023.

Links | BibTeX

2830.

Lee, Jong-Ryul; Moon, Yong-Hyuk

Bespoke: A Block-Level Neural Network Optimization Framework for Low-Cost Deployment Technical Report

2023.

Links | BibTeX

2829.

Shen, Xuan; Wang, Yaohua; Lin, Ming; Huang, Yilun; Tang, Hao; Sun, Xiuyu; Wang, Yanzhi

DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network Technical Report

2023.

Links | BibTeX

2828.

Ali, Mohamed Nabih; Paissan, Francesco; Falavigna, Daniele; Brutti, Alessio

Scaling strategies for on-device low-complexity source separation with Conv-Tasnet Technical Report

2023.

Links | BibTeX

2827.

Chitty-Venkata, Krishna Teja; Emani, Murali; Vishwanath, Venkatram; Somani, Arun K.

Neural Architecture Search Benchmarks: Insights and Survey Journal Article

In: IEEE Access, vol. 11, pp. 25217–25236, 2023.

Links | BibTeX

2826.

Qin, Dalin; Wang, Chenxi; Wen, Qingsong; Chen, Weiqi; Sun, Liang; Wang, Yi

Personalized Federated DARTS for Electricity Load Forecasting of Individual Buildings Journal Article

In: IEEE Transactions on Smart Grid, pp. 1-1, 2023.

Links | BibTeX

2825.

Alaiad, Ahmad; Migdady, Aya; Al-Khatib, Ra’ed M.; Alzoubi, Omar; Zitar, Raed Abu; Abualigah, Laith

Autokeras Approach: A Robust Automated Deep Learning Network for Diagnosis Disease Cases in Medical Images Journal Article

In: Journal of Imaging, vol. 9, no. 3, 2023, ISSN: 2313-433X.

Abstract | Links | BibTeX

2824.

Wang, Zhipeng; Liu, Rengkui; Gao, Yi; Tang, Yuanjie

Metro Track Geometry Defect Identification Model Based on Car-Body Vibration Data and Differentiable Architecture Search Journal Article

In: Applied Sciences, vol. 13, no. 6, 2023, ISSN: 2076-3417.

Abstract | Links | BibTeX

2823.

Mecharbat, Lotfi Abdelkrim; Benmeziane, Hadjer; Ouranoughi, Hamza; Niar, Smaïl

HyT-NAS: Hybrid Transformers Neural Architecture Search for Edge Devices Technical Report

2023.

Links | BibTeX

2822.

Wendlinger, Lorenz; Granitzer, Michael; Fellicious, Christofer

Pooling Graph Convolutional Networks for Structural Performance Prediction Proceedings Article

In: Nicosia, Giuseppe; Ojha, Varun; Malfa, Emanuele La; Malfa, Gabriele La; Pardalos, Panos; Fatta, Giuseppe Di; Giuffrida, Giovanni; Umeton, Renato (Ed.): Machine Learning, Optimization, and Data Science, pp. 1–16, Springer Nature Switzerland, Cham, 2023, ISBN: 978-3-031-25891-6.

Abstract | Links | BibTeX

2821.

Wen, Hao; Li, Yuanchun; Zhang, Zunshuai; Jiang, Shiqi; Ye, Xiaozhou; Ouyang, Ye; Zhang, Ya-Qin; Liu, Yunxin

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments Technical Report

2023.

Links | BibTeX

2820.

Gu, Jianyang; Wang, Kai; Luo, Hao; Chen, Chen; Jiang, Wei; Fang, Yuqiang; Zhang, Shanghang; You, Yang; Zhao, Jian

MSINet: Twins Contrastive Search of Multi-Scale Interaction for Object ReID Technical Report

2023.

Links | BibTeX

2819.

Choi, Wonhyeok; Im, Sunghoon

Dynamic Neural Network for Multi-Task Learning Searching across Diverse Network Topologies Technical Report

2023.

Links | BibTeX

2818.

Zhang, Li Lyna; Wang, Xudong; Xu, Jiahang; Zhang, Quanlu; Wang, Yujing; Yang, Yuqing; Zheng, Ningxin; Cao, Ting; Yang, Mao

SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference Technical Report

2023.

Links | BibTeX

2817.

Yang, Yuguang; Pan, Yu; Yin, Jingjing; Han, Jiangyu; Ma, Lei; Lu, Heng

HYBRIDFORMER: improving SqueezeFormer with hybrid attention and NSR mechanism Technical Report

2023.

Links | BibTeX

2816.

Savadikar, Chinmay; Dai, Michelle; Wu, Tianfu

Learning to Grow Artificial Hippocampi in Vision Transformers for Resilient Lifelong Learning Technical Report

2023.

Links | BibTeX

2815.

Hamid, Saad; Wan, Xingchen; Jørgensen, Martin; Ru, Binxin; Osborne, Michael A.

Bayesian Quadrature for Neural Ensemble Search Technical Report

2023.

Links | BibTeX

2814.

Lyu, Bo; Wen, Shiping; Yang, Yin; Chang, Xiaojun; Sun, Junwei; Chen, Yiran; Huang, Tingwen

Designing Efficient Bit-Level Sparsity-Tolerant Memristive Networks Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-10, 2023.

Links | BibTeX

2813.

Montes, Charles; Morehouse, Todd; Kasilingam, Dayalan; Zhou, Ruolin

Optimized CNN Auto-Generator Using GA With Stopping Criterion: Design and a Use Case Proceedings Article

In: 2023 IEEE 20th Consumer Communications & Networking Conference (CCNC), pp. 1009-1014, 2023.

Links | BibTeX

2812.

Trivedi, Aashka; Udagawa, Takuma; Merler, Michele; Panda, Rameswar; El-Kurdi, Yousef; Bhattacharjee, Bishwaranjan

Neural Architecture Search for Effective Teacher-Student Knowledge Transfer in Language Models Technical Report

2023.

Links | BibTeX

2811.

Li, Chaojian; Chen, Wenwan; Yuan, Jiayi; Lin, Yingyan; Sabharwal, Ashutosh

ERSAM: Neural Architecture Search For Energy-Efficient and Real-Time Social Ambiance Measurement Technical Report

2023.

Links | BibTeX

2810.

Zhang, Li Lyna; Wang, Xudong; Xu, Jiahang; Zhang, Quanlu; Wang, Yujing; Yang, Yuqing; Zheng, Ningxin; Cao, Ting; Yang, Mao

SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference Technical Report

2023.

Links | BibTeX

2809.

Zhou, Ao; Yang, Jianlei; Qi, Yingjie; Shi, Yumeng; Qiao, Tong; Zhao, Weisheng; Hu, Chunming

Hardware-Aware Graph Neural Network Automated Design for Edge Computing Platforms Journal Article

In: CoRR, vol. abs/2303.10875, 2023.

Links | BibTeX

2808.

Lin, Guan-Ting; Tang, Qingming; Kao, Chieh-Chi; Rozgic, Viktor; Wang, Chao

Weight-sharing Supernet for Searching Specialized Acoustic Event Classification Networks Across Device Constraints Technical Report

2023.

Links | BibTeX

2807.

Tang, Chen; Zhang, Li Lyna; Jiang, Huiqiang; Xu, Jiahang; Cao, Ting; Zhang, Quanlu; Yang, Yuqing; Wang, Zhi; Yang, Mao

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices Technical Report

2023.

Links | BibTeX

2806.

Shi, Huihong; You, Haoran; Wang, Zhongfeng; Lin, Yingyan

NASA $+$ : Neural Architecture Search and Acceleration for Multiplication-Reduced Hybrid Networks Journal Article

In: IEEE Transactions on Circuits and Systems I: Regular Papers, pp. 1-14, 2023.

Links | BibTeX

2805.

Li, Sheng; Andersen, Garrett; Chen, Tao; Cheng, Liqun; Grady, Julian; Huang, Da; Le, Quoc V.; Li, Andrew; Li, Xin; Li, Yang; Liang, Chen; Lu, Yifeng; Ni, Yun; Pang, Ruoming; Tan, Mingxing; Wicke, Martin; Wu, Gang; Zhu, Shengqi; Ranganathan, Parthasarathy; Jouppi, Norman P.

Hyperscale Hardware Optimized Neural Architecture Search Proceedings Article

In: Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3, pp. 343–358, Association for Computing Machinery, Vancouver, BC, Canada, 2023, ISBN: 9781450399180.

Abstract | Links | BibTeX

2804.

Yin, Shibai; Hu, Shuhao; Wang, Yibin; Yang, Yee-Hong

High-order Adams Network (HIAN) for image dehazing Journal Article

In: Applied Soft Computing, vol. 139, pp. 110204, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2803.

Zhou, Yuan; Wang, Haiyang; Huo, Shuwei; Wang, Boyu

Hierarchical full-attention neural architecture search based on search space compression Journal Article

In: Knowledge-Based Systems, vol. 269, pp. 110507, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2802.

Huang, Jia-Cheng; Zeng, Guo-Qiang; Geng, Guang-Gang; Weng, Jian; Lu, Kang-Di

SOPA-GA-CNN: Synchronous optimisation of parameters and architectures by genetic algorithms with convolutional neural network blocks for securing Industrial Internet-of-Things Journal Article

In: IET Cyber-Systems and Robotics, vol. 5, no. 1, pp. e12085, 2023.

Abstract | Links | BibTeX

2801.

Sakuma, Yuiko; Ishii, Masato; Narihira, Takuya

DetOFA: Efficient Training of Once-for-All Networks for Object Detection by Using Pre-trained Supernet and Path Filter Technical Report

2023.

Links | BibTeX

2800.

Xu, Ying; Cheng, Long; Cai, Xuyi; Ma, Xiaohan; Chen, Weiwei; Zhang, Lei; Wang, Ying

Efficient Supernet Training Using Path Parallelism Proceedings Article

In: 2023 IEEE International Symposium on High-Performance Computer Architecture (HPCA), pp. 1249-1261, 2023.

Links | BibTeX

2799.

Verma, Monu; Mandal, Murari; Reddy, M. Satish Kumar; Meedimale, Yashwanth Reddy; Vipparthi, Santosh Kumar

Efficient Neural Architecture Search for Emotion Recognition Technical Report

2023.

Links | BibTeX

2798.

Ito, Rafael C.; Zuben, Fernando J. Von

OFA(^mbox2): A Multi-Objective Perspective for the Once-for-All Neural Architecture Search Technical Report

2023.

Links | BibTeX

2797.

Benmeziane, Hadjer; Ounnoughene, Amine Ziad; Hamzaoui, Imane; Bouhadjar, Younes

Skip Connections in Spiking Neural Networks: An Analysis of Their Effect on Network Training Technical Report

2023.

Links | BibTeX

2796.

Xiong, Zhuoran; Amein, Marihan; Therrien, Olivier; Gross, Warren J.; Meyer, Brett H.

FMAS: Fast Multi-Objective SuperNet Architecture Search for Semantic Segmentation Technical Report

2023.

Links | BibTeX

2795.

Dong, Peijie; Li, Lujun; Wei, Zimian

DisWOT: Student Architecture Search for Distillation WithOut Training Technical Report

2023.

Links | BibTeX

2794.

Naumov, A.; Melnikov, Artem; Abronin, V.; Oxanichenko, F.; Izmailov, K.; Pflitsch, Markus; Melnikov, A.; Perelshtein, Michael

Tetra-AML: Automatic Machine Learning via Tensor Networks Technical Report

2023.

Links | BibTeX

4193 entries « 28 of 84 »