AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4015 entries « 51 of 81 »

2021

1515.

Zhang, Kaiyu; Chen, Jinglong; He, Shuilong; Xu, Enyong; Li, Fudong; Zhou, Zitong

Differentiable neural architecture search augmented with pruning and multi-objective optimization for time-efficient intelligent fault diagnosis of machinery Journal Article

In: Mechanical Systems and Signal Processing, vol. 158, pp. 107773, 2021, ISSN: 0888-3270.

Abstract | Links | BibTeX

1514.

Liang, Tingting; Wang, Yongtao; Tang, Zhi; Hu, Guosheng; Ling, Haibin

OPANAS: One-Shot Path Aggregation Network Architecture Search for Object Detection Technical Report

2021.

Links | BibTeX

1513.

Cao, Shengcao; Wang, Xiaofang; Kitani, Kris

Efficient Model Performance Estimation via Feature Histories Technical Report

2021.

Links | BibTeX

1512.

Zhang, Shi-Xin; Hsieh, Chang-Yu; Zhang, Shengyu; Yao, Hong

Neural Predictor based Quantum Architecture Search Technical Report

2021.

Links | BibTeX

1511.

Liu, Xiaobo; Zhang, Chaochao; Cai, Zhihua; Yang, Jianfeng; Zhou, Zhilang; Gong, Xin

Continuous Particle Swarm Optimization-Based Deep Learning Architecture Search for Hyperspectral Image Classification Journal Article

In: Remote Sensing, vol. 13, no. 6, 2021, ISSN: 2072-4292.

Abstract | Links | BibTeX

1510.

Ban, Hao; Xie, Pengtao

Interleaving Learning, with Application to Neural Architecture Search Technical Report

2021.

Links | BibTeX

1509.

Choi, Kwanghee; Choe, Minyoung; Lee, Hyelee

Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning Technical Report

2021.

Links | BibTeX

1508.

Gracheva, Ekaterina

Trainless Model Performance Estimation for Neural Architecture Search Technical Report

2021.

Links | BibTeX

1507.

Wu, Xuan; Zhang, Xiuyi; Jia, Linhan; Chen, Liang; Liang, Yanchun; Zhou, You; Wu, Chunguo

Neural Architecture Search based on Cartesian Genetic Programming Coding Method Technical Report

2021.

Links | BibTeX

1506.

Luo, Xiangzhong; Liu, Di; Huai, Shuo; Liu, Weichen

HSCoNAS: Hardware-Software Co-Design of Efficient DNNs via Neural Architecture Search Technical Report

2021.

Links | BibTeX

1505.

Wang, Ruochen; Cheng, Minhao; Chen, Xiangning; Tang, Xiaocheng; Hsieh, Cho-Jui

Rethinking Architecture Selection in Differentiable NAS Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1504.

-, Sian; -, Wei

Searching by Generating: Flexible and Efficient One-Shot NAS with Architecture Generator Technical Report

2021.

Links | BibTeX

1503.

Lakhmiri, Dounia; é, S

Use of static surrogates in hyperparameter optimization Technical Report

2021.

Links | BibTeX

1502.

Inkawhich, Matthew; Inkawhich, Nathan; Davis, Eric; Li, Hai; Chen, Yiran

The Untapped Potential of Off-the-Shelf Convolutional Neural Networks Technical Report

2021.

Links | BibTeX

1501.

Chen, Zhiqiang; Xu, Ting-Bing; Liao, Weijian; Li, Zhengcheng; Li, Jinpeng; Liu, Cheng-Lin; He, Huiguang

SNAP: Shaping neural architectures progressively via information density criterion Journal Article

In: Pattern Recognition, vol. 116, pp. 107923, 2021, ISSN: 0031-3203.

Abstract | Links | BibTeX

1500.

Li, Chaojian; Yu, Zhongzhi; Fu, Yonggan; Zhang, Yongan; Zhao, Yang; You, Haoran; Yu, Qixuan; Wang, Yue; Lin, Yingyan

HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark Proceedings Article

In: ICLR 2021, 2021.

Links | BibTeX

1499.

Pyeon, Myeongjang; Moon, Jihwan; Hahn, Taeyoung; Kim, Gunhee

SEDONA: Search for Decoupled Neural Networks toward Greedy Block-wise Learning Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1498.

Zhou, Allan; Knowles, Tom; Finn, Chelsea

Meta-learning Symmetries by Reparameterization Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1497.

Mehrotra, Abhinav; Ramos, Alberto Gil C P; Bhattacharya, Sourav; Ł,; Vipperla, Ravichander; Chau, Thomas; Abdelfattah, Mohamed S; Ishtiaq, Samin; Lane, Nicholas Donald

NAS-Bench-ASR: Reproducible Neural Architecture Search for Speech Recognition Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1496.

Zhou, Daquan; Jin, Xiaojie; Lian, Xiaochen; Yang, Linjie; Xue, Yujing; Hou, Qibin; Feng, Jiashi

AutoSpace: Neural Architecture Search with Less Human Interference Technical Report

2021.

Links | BibTeX

1495.

Li, Changlin; Tang, Tao; Wang, Guangrun; Peng, Jiefeng; Wang, Bing; Liang, Xiaodan; Chang, Xiaojun

BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Technical Report

2021.

Links | BibTeX

1494.

Abed, H; Gyires-Tóth, B

Efficient Neural Architecture Search for Long Short-Term Memory Networks Proceedings Article

In: 2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI), pp. 000287-000292, 2021.

Links | BibTeX

1493.

Ai, Dige; Zhang, Hong

GNAS: A Generalized Neural Network Architecture Search Framework Technical Report

2021.

Links | BibTeX

1492.

Zhang, Haichao; Hao, Kuangrong; Gao, Lei; -, Xue; Wei, Bing

Enhanced Gradient for Differentiable Architecture Search Technical Report

2021.

Links | BibTeX

1491.

Su, Xiu; Huang, Tao; Li, Yanxi; You, Shan; Wang, Fei; Qian, Chen; Zhang, Changshui; Xu, Chang

Prioritized Architecture Sampling with Monto-Carlo Tree Search Technical Report

2021.

Links | BibTeX

1490.

Wang, Hongbo; Pan, Xingyu; Fan, Lingyan; Zhao, Shuofeng

Steganalysis of convolutional neural network based on neural architecture search Journal Article

In: Multimedia Systems, 2021.

Links | BibTeX

1489.

Lu, Zexin; Xia, Wenjun; Huang, Yongqiang; Shan, Hongming; Chen, Hu; Zhou, Jiliu; Zhang, Yi

MANAS: Multi-Scale and Multi-Level Neural Architecture Search for Low-Dose CT Denoising Journal Article

In: CoRR, vol. abs/2103.12995, 2021.

Links | BibTeX

1488.

"Yang Zhao" "Hai Min" "Yan-Xiang Chen Wei Jia" "Wei Xia",

2D and 3D Palmprint and Palm Vein Recognition Based on Neural Architecture Search Journal Article

In: International Journal of Automation and Computing, no. IJAC-2021-01-01, pp. 1, 2021, ISSN: 1476-8186.

Links | BibTeX

1487.

Lin, Yunfeng; Li, Guilin; Zhang, Xing; Zhang, Weinan; Chen, BO; Tang, Ruiming; Li, Zhenguo; Feng, Jiashi; Yu, YOng

ModularNAS: Towards Modularized and Reusable Neural Architecture Search Proceedings Article

In: Proceedings of Machine Learning and Systems 3 pre-proceedings (MLSys 2021), 2021.

Links | BibTeX

1486.

Wang, Rui; Wei, Zhihua; Ji, Shouling; Hong, Zhen

EfficientTDNN: Efficient Architecture Search for Speaker Recognition in the Wild Technical Report

2021.

Links | BibTeX

1485.

Ottelander, Tom Den; Dushatskiy, Arkadiy; Virgolin, Marco; Bosman, Peter A N

Local Search is a Remarkably Strong Baseline for Neural Architecture Search Proceedings Article

In: Ishibuchi, Hisao; Zhang, Qingfu; Cheng, Ran; Li, Ke; Li, Hui; Wang, Handing; Zhou, Aimin (Ed.): Evolutionary Multi-Criterion Optimization - 11th International Conference, EMO 2021, Shenzhen, China, March 28-31, 2021, Proceedings, pp. 465–479, Springer, 2021.

Links | BibTeX

1484.

Ding, Mingyu; Huo, Yuqi; Lu, Haoyu; Yang, Linjie; Wang, Zhe; Lu, Zhiwu; Wang, Jingdong; Luo, Ping

Learning Versatile Neural Architectures by Propagating Network Codes Technical Report

2021.

Links | BibTeX

1483.

Lankford, Séamus

Open-Source Neural Architecture Search with Ensemble and Pre-trained Networks Journal Article

In: International Journal of Modeling and Optimization, vol. 11, no. 2, pp. 33-41, 2021.

Links | BibTeX

1482.

Li, Yanxi; Wen, Zean; Yunhe Wang,; Xu, Chang

One-shot Graph Neural Architecture Search with Dynamic Search Space Proceedings Article

In: AAAI 2021, 2021.

Links | BibTeX

1481.

Cai, Shaofei; Li, Liang; Deng, Jincan; Zhang, Beichen; Zha, Zheng-Jun; Su, Li; Huang, Qingming

Rethinking Graph Neural Network Search from Message-passing Technical Report

2021.

Links | BibTeX

1480.

Roberts, Nicholas; Khodak, Mikhail; Dao, Tri; Li, Liam; é, Christopher R; Talwalkar, Ameet

Rethinking Neural Operations for Diverse Tasks Technical Report

2021.

Links | BibTeX

1479.

He, Yufan; Yang, Dong; Roth, Holger; Zhao, Can; Xu, Daguang

DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentation Technical Report

2021.

Links | BibTeX

1478.

Schmidgall, Samuel

Self-Constructing Neural Networks Through Random Mutation Technical Report

2021.

Links | BibTeX

1477.

Guo, Shaopeng; Wang, Yujie; Yuan, Kun; Li, Quanquan

Differentiable Network Adaption with Elastic Search Space Technical Report

2021.

Links | BibTeX

1476.

Zappella, Giovanni; Salinas, David; Archambeau, Cédric

A resource-efficient method for repeated HPO and NAS problems Technical Report

2021.

Links | BibTeX

1475.

Wang, J; Zhao, J; An, J; Wang, D; Qiu, M

A Linear NAS Service of ConvNets for Fast Deployment in the Edge of 5G Networks Journal Article

In: IEEE Network, vol. 35, no. 2, pp. 46-52, 2021.

Links | BibTeX

1474.

Lee, Hayeon; Hyung, Eunyoung; Hwang, Sung Ju

Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets Proceedings Article

In: International Conference on Learning Representations, 2021.

Links | BibTeX

1473.

Ding, Z; Chen, Y; Li, N; Zhao, D; Sun, Z; Chen, C L P

BNAS: Efficient Neural Architecture Search Using Broad Scalable Architecture Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-15, 2021.

Links | BibTeX

1472.

-, Tien; -, Yi; Sze, Vivienne

NetAdaptV2: Efficient Neural Architecture Search with Fast Super-Network Training and Architecture Optimization Technical Report

2021.

Links | BibTeX

1471.

Hu, Shoukang; Xie, Xurong; Liu, Shansong; Cui, Mingyu; Geng, Mengzhe; Liu, Xunying; Meng, Helen

Neural Architecture Search For LF-MMI Trained Time Delay Neural Networks Proceedings Article

In: ICASSP2021, 2021.

Links | BibTeX

1470.

Wang, X; Wang, X; Jin, L; Lv, R; Dai, B; He, M; Lv, T

Evolutionary Algorithm-Based and Network Architecture Search-Enabled Multiobjective Traffic Classification Journal Article

In: IEEE Access, vol. 9, pp. 52310-52325, 2021.

Links | BibTeX

1469.

Wang, Guangrun; Lin, Liang; Chen, Rongcong; Wang, Guangcong; Zhang, Jiqi

Joint Learning of Neural Transfer and Architecture Adaptation for Image Recognition Journal Article

In: IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021.

Links | BibTeX

1468.

Prabakaran, B S; Akhtar, A; Rehman, S; Hasan, O; Shafique, M

BioNetExplorer: Architecture-Space Exploration of Bio-Signal Processing Deep Neural Networks for Wearables Journal Article

In: IEEE Internet of Things Journal, pp. 1-1, 2021.

Links | BibTeX

1467.

Tan, Mingxing; Le, Quoc V

EfficientNetV2: Smaller Models and Faster Training Technical Report

2021.

Links | BibTeX

1466.

Liang, Y; Lu, L; Jin, Y; Xie, J; Huang, R; Zhang, J; Lin, W

An Efficient Hardware Design for Accelerating Sparse CNNs with NAS-based Models Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2021.

Links | BibTeX

4015 entries « 51 of 81 »