AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 36 of 64 »

2021

1407.

-, Julia Guerrero; Hauns, Sven; Izquierdo, Sergio; Miotto, Guilherme; Schrodi, Simon; Biedenkapp, Andre; Elsken, Thomas; Deng, Difan; Lindauer, Marius; Hutter, Frank

Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization Proceedings Article

In: 8th ICML Workshop on Automated Machine Learning, 2021.

Links | BibTeX

1406.

Lv, Jindi; Ye, Qing; Sun, Yanan; Zhao, Juan; Lv, Jiancheng

Heart-Darts: Classification of Heartbeats Using Differentiable Architecture Search Technical Report

2021.

Links | BibTeX

1405.

Mo, Hyunho; Custode, Leonardo Lucio; Iacca, Giovanni

Evolutionary neural architecture search for remaining useful life prediction Journal Article

In: Applied Soft Computing, vol. 108, pp. 107474, 2021, ISSN: 1568-4946.

Abstract | Links | BibTeX

1404.

Chen, Haoze; Zhang, Zhijie; Zhao, Chenyang; Liu, Jiaqi; Yin, Wuliang; Li, Yanfeng; Wang, Fengxiang; Li, Chao; Lin, Zhenyu

Depth Classification of Defects Based on Neural Architecture Search Journal Article

In: IEEE Access, vol. 9, pp. 73424-73432, 2021.

Links | BibTeX

1403.

Wei, Xun; Luo, Wang; Zhang, Xixi; Yang, Jie; Gui, Guan; Ohtsuki, Tomoaki

Differentiable Architecture Search-Based Automatic Modulation Classification Proceedings Article

In: 2021 IEEE Wireless Communications and Networking Conference (WCNC), pp. 1-6, 2021.

Links | BibTeX

1402.

Chen, Shumei; Yu, Jianbo; Wang, Shijin

One-dimensional convolutional neural network-based active feature extraction for fault detection and diagnosis of industrial processes and its understanding via visualization Journal Article

In: ISA Transactions, 2021, ISSN: 0019-0578.

Abstract | Links | BibTeX

1401.

Liu, Mengyu; Yin, Hujun

Efficient pyramid context encoding and feature embedding for semantic segmentation Journal Article

In: Image and Vision Computing, vol. 111, pp. 104195, 2021, ISSN: 0262-8856.

Abstract | Links | BibTeX

1400.

Gao, Yanjie; Zhu, Yonghao; Zhang, Hongyu; Lin, Haoxiang; Yang, Mao

Resource-Guided Configuration Space Reduction for Deep Learning Models Proceedings Article

In: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), pp. 175-187, 2021.

Links | BibTeX

1399.

Fei, Ke; Li, Qi; Cui, Can; chen, Xue; Xu, Xinxin; Xue, Benshan; Cai, Weifeng

Nontechnical Loss Detection using Neural Architecture Search and Outlier Detection Journal Article

In: E3S Web Conf., vol. 256, pp. 01025, 2021.

Links | BibTeX

1398.

Wang, Xiaofang; Cao, Shengcao; Li, Mengtian; Kitani, Kris M

Neighborhood-Aware Neural Architecture Search Technical Report

2021.

Links | BibTeX

1397.

Chatzianastasis, Michail; Dasoulas, George; Siolas, Georgios; Vazirgiannis, Michalis

Operation Embeddings for Neural Architecture Search Technical Report

2021.

Links | BibTeX

1396.

Huang, Han; Shen, Li; He, Chaoyang; Dong, Weisheng; Huang, Haozhi; Shi, Guangming

Lightweight Image Super-Resolution with Hierarchical and Differentiable Neural Architecture Search Technical Report

2021.

Links | BibTeX

1395.

Fard, Farzaneh S; Tomar, Vikrant Singh

Expediting discovery in Neural Architecture Search by Combining Learning with Planning Proceedings Article

In: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8373-8377, 2021.

Links | BibTeX

1394.

Hu, Yiming; Wang, Xingang; Li, Lujun; Gu, Qingyi

Improving One-Shot NAS with Shrinking-and-Expanding Supernet Journal Article

In: Pattern Recognition, vol. 118, pp. 108025, 2021, ISSN: 0031-3203.

Abstract | Links | BibTeX

1393.

Zhou, Yuan; Xie, Xukai; Kung, Sun-Yuan

Exploiting Operation Importance for Differentiable Neural Architecture Search Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-14, 2021.

Links | BibTeX

1392.

Malkova, Aleksandra; ï, Lo; Villien, Christophe; î, Beno; -, Massih

Self-Learning for Received Signal Strength Map Reconstruction with Neural Architecture Search Technical Report

2021.

Links | BibTeX

1391.

Jin, Haifeng

Eficient Neural Architecture Search for Automated Deep Learning PhD Thesis

2021.

Links | BibTeX

1390.

Yasarla, Rajeev; Joze, Hamid Reza Vaezi; Patel, Vishal M

Network Architecture Search for Face Enhancement Technical Report

2021.

Links | BibTeX

1389.

Rezaei, Seyed Saeed Changiz; Han, Fred X; Niu, Di; Salameh, Mohammad; Mills, Keith; Lian, Shuo; Lu, Wei; Jui, Shangling

Generative Adversarial Neural Architecture Search Technical Report

2021.

Links | BibTeX

1388.

Sun, Ming; Dou, Haoxuan; Yan, Junjie

Efficient Transfer Learning via Joint Adaptation of Network Architecture and Weight Technical Report

2021.

Links | BibTeX

1387.

Xu, Lumin; Guan, Yingda; Jin, Sheng; Liu, Wentao; Qian, Chen; Luo, Ping; Ouyang, Wanli; Wang, Xiaogang

ViPNAS: Efficient Video Pose Estimation via Neural Architecture Search Technical Report

2021.

Links | BibTeX

1386.

O’Neill, Damien; Xue, Bing; Zhang, Mengjie

Evolutionary Neural Architecture Search for High-Dimensional Skip-Connection Structures on DenseNet Style Networks Journal Article

In: IEEE Transactions on Evolutionary Computation, pp. 1-1, 2021.

Links | BibTeX

1385.

Meng, Ze; Zhang, Jinnian; Li, Yumeng; Li, Jiancheng; Zhu, Tanchao; Sun, Lifeng

A General Method For Automatic Discovery of Powerful Interactions In Click-Through Rate Prediction Technical Report

2021.

Links | BibTeX

1384.

Duan, Yawen; Chen, Xin; Xu, Hang; Chen, Zewei; Liang, Xiaodan; Zhang, Tong; Li, Zhenguo

TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Search Proceedings Article

In: CVPR2021, 2021.

Links | BibTeX

1383.

Nguyen, Nam; -, Kwang

Quantum Embedding Search for Quantum Machine Learning Technical Report

2021.

Links | BibTeX

1382.

Lin, Yujun; Yang, Mengtian; Han, Song

NAAS: Neural Accelerator Architecture Search Technical Report

2021.

Links | BibTeX

1381.

Maiti, Ritabrata; Agarwal, Priyanka; Kumar, Ragyayee Ravinder; Bhat, Aruna

Detection Of Skin Cancer Using Neural Architecture Search with Model Quantization Proceedings Article

In: 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 1807-1814, 2021.

Links | BibTeX

1380.

Ren, Yudan; Tao, Zeyang; Zhang, Wei; Liu, Tianming

Modeling Hierarchical Spatial and Temporal Patterns of Naturalistic fMRI Volume via Volumetric Deep Belief Network with Neural Architecture Search Proceedings Article

In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 130-134, 2021.

Links | BibTeX

1379.

Li, Shiqian; Li, Wei; Wen, Shiping; Shi, Kaibo; Yang, Yin; Zhou, Pan; Huang, Tingwen

Auto-FERNet: A Facial Expression Recognition Network with Architecture Search Journal Article

In: IEEE Transactions on Network Science and Engineering, pp. 1-1, 2021.

Links | BibTeX

1378.

Philipp, George

The Nonlinearity Coefficient - A Practical Guide to Neural Architecture Design Technical Report

2021.

Links | BibTeX

1377.

Yao, Lewei; Pi, Renjie; Xu, Hang; Zhang, Wei; Li, Zhenguo; Zhang, Tong

Joint-DetNAS: Upgrade Your Detector with NAS, Pruning and Dynamic Distillation Technical Report

2021.

Links | BibTeX

1376.

Zhou, Qinqin; Zhong, Bineng; Liu, Xin; Ji, Rongrong

Attention-Based Neural Architecture Search for Person Re-Identification Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-13, 2021.

Links | BibTeX

1375.

Xu, Jin; Tan, Xu; Luo, Renqian; Song, Kaitao; Li, Jian; Qin, Tao; -, Tie

NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search Technical Report

2021.

Links | BibTeX

1374.

Lin, Haojia; Wu, Shangbin; Chen, Yiping; Li, Wen; Luo, Zhipeng; Guo, Yulan; Wang, Cheng; Li, Jonathan

Semantic segmentation of 3D indoor LiDAR point clouds through feature pyramid architecture search Journal Article

In: ISPRS Journal of Photogrammetry and Remote Sensing, vol. 177, pp. 279-290, 2021, ISSN: 0924-2716.

Abstract | Links | BibTeX

1373.

Zhao, Yuekai; Dong, Li; Shen, Yelong; Zhang, Zhihua; Wei, Furu; Chen, Weizhu

Memory-Efficient Differentiable Transformer Architecture Search Technical Report

2021.

Links | BibTeX

1372.

Nader, Andrew; Azar, Danielle

Evolution of Activation Functions: An Empirical Investigation Technical Report

2021.

Links | BibTeX

1371.

Pan, Zijie; Zeng, Jiajin; Cheng, Riqiang; Yan, Hongyang; Li, Jin

PNAS: A privacy preserving framework for neural architecture search services Journal Article

In: Information Sciences, vol. 573, pp. 370-381, 2021, ISSN: 0020-0255.

Abstract | Links | BibTeX

1370.

Bungert, Leon; Roith, Tim; Tenbrinck, Daniel; Burger, Martin

Neural Architecture Search via Bregman Iterations Technical Report

2021.

Links | BibTeX

1369.

Mo, Tong; Liu, Bang

Encoder-Decoder Neural Architecture Optimization for Keyword Spotting Technical Report

2021.

Links | BibTeX

1368.

Miao, Yingjie; Song, Xingyou; Peng, Daiyi; Yue, Summer; Brevdo, Eugene; Faust, Aleksandra

RL-DARTS: Differentiable Architecture Search for Reinforcement Learning Technical Report

2021.

Links | BibTeX

1367.

Saito, Masahiko; Kishimoto, Tomoe; Kaneta, Yuya; Itoh, Taichi; Umeda, Yoshiaki; Tanaka, Junichi; Iiyama, Yutaro; Sawada, Ryu; Terashi, Koji

Event Classification with Multi-step Machine Learning Technical Report

2021.

Links | BibTeX

1366.

Guo, Xin; Yang, Jianlei; Zhou, Haoyi; Ye, Xucheng; Li, Jianxin

RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models Technical Report

2021.

Links | BibTeX

1365.

Dey, Debadeepta; Shah, Shital; é, S

FEAR: A Simple Lightweight Method to Rank Architectures Technical Report

2021.

Links | BibTeX

1364.

Na, Byunggook; Mok, Jisoo; Choe, Hyeokjun; Yoon, Sungroh

Accelerating Neural Architecture Search via Proxy Data Technical Report

2021.

Links | BibTeX

1363.

Yao, Yuansheng; Liu, Risheng; Zhang, Jiaao; Zhong, Wei; Fan, Xin; Luo, Zhongxuan

Hardware-Aware Low-Light Image Enhancement via One-Shot Neural Architecture Search with Shrinkage Sampling Proceedings Article

In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1-6, 2021.

Links | BibTeX

1362.

Mao, Yuxu; Zhong, Guoqiang; Wang, Yanan; Deng, Zhaoyang

Differentiable Light-Weight Architecture Search Proceedings Article

In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1-6, 2021.

Links | BibTeX

1361.

Yang, Binbin; Liang, Xiaodan; Zhong, Junhao; Peng, Jiefeng; Wang, Guangrun; Lin, Liang

Unifying Dynamic Optimizer Search and Network Architecture Search Proceedings Article

In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1-6, 2021.

Links | BibTeX

1360.

Salinas, David; Perrone, Valerio; Cruchant, Olivier; é, C

A multi-objective perspective on jointly tuning hardware and hyperparameters Technical Report

2021.

Links | BibTeX

1359.

Xue, Xinwei; Meng, Xiangyu; Ma, Long; Wang, Yi; Liu, Risheng; Fan, Xin

Searching Frame-Recurrent Attentive Deformable Network for Real-Time Video Deraining Technical Report

2021.

Links | BibTeX

1358.

Eltotongy, Assem; Awad, Mohammed I; Maged, Shady A; Onsy, Ahmed

Fault Detection and Classification of Machinery Bearing Under Variable Operating Conditions Based on Wavelet Transform and CNN Proceedings Article

In: 2021 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC), pp. 117-123, 2021.

Links | BibTeX

3157 entries « 36 of 64 »