AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4015 entries « 49 of 81 »

2021

1615.

Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Actions for Monte Carlo Tree Search Journal Article

In: IEEE transactions on pattern analysis and machine intelligence, vol. PP, 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX

1614.

Zhang, Zhentong; Shan, Yugang; Yuan, Jie

Multi-Level Cell Progressive Differentiable Architecture Search to Improve Image Classification Accuracy Journal Article

In: Journal of Signal Processing Systems, 2021.

Abstract | Links | BibTeX

1613.

Zheng, X; Ji, R; Chen, Y; Wang, Q; Zhang, B; Ye, Q; Chen, J; Huang, F; Tian, Y

MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search Journal Article

In: IEEE Transactions on Pattern Analysis & Machine Intelligence, no. 01, pp. 1-1, 2021, ISSN: 1939-3539.

Links | BibTeX

1612.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

In: IEEE transactions on pattern analysis and machine intelligence, vol. PP, 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX

1611.

Liu, Lanlan; Zhang, Yuting; Deng, Jia; Soatto, Stefano

Dynamically Grown Generative Adversarial Networks Proceedings Article

In: AAAI 2021, 2021.

Links | BibTeX

1610.

Xu, Y; Xie, L; Dai, W; Zhang, X; Chen, X; Qi, G; Xiong, H; Tian, Q

Partially-Connected Neural Architecture Search for Reduced Computational Redundancy Journal Article

In: IEEE Transactions on Pattern Analysis & Machine Intelligence, no. 01, pp. 1-1, 2021, ISSN: 1939-3539.

Abstract | Links | BibTeX

1609.

Hao, Jie; Zhu, William

Architecture self-attention mechanism: nonlinear optimization for neural architecture search Journal Article

In: Journal of Nonlinear and Variational Analysis, vol. 5, pp. 119-140, 2021.

Links | BibTeX

1608.

Gao, Yanjie; Gu, Xianyu; Zhang, Hongyu; Lin, Haoxiang; Yang, Mao

Runtime Performance Prediction for Deep Learning Models with Graph Neural Network Technical Report

Microsoft no. MSR-TR-2021-3, 2021.

Abstract | Links | BibTeX

1607.

Pham, Hieu; Le, Quoc V

AutoDropout - Learning Dropout Patterns to Regularize Deep Networks Technical Report

2021.

Links | BibTeX

1606.

Huang, Yufang; Axsom, Kelly M; Lee, John; Subramanian, Lakshminarayanan; Zhang, Yiye

DICE: Deep Significance Clustering for Outcome-Aware Stratification Technical Report

2021.

Links | BibTeX

1605.

Ma, Ailong; Wan, Yuting; Zhong, Yanfei; Wang, Junjue; Zhang, Liangpei

SceneNet: Remote sensing scene classification deep learning network using multi-objective neural evolution architecture search Technical Report

2021, ISSN: 0924-2716.

Links | BibTeX

1604.

Yang, Hansi; Yao, Quanming; Kwok, James T

Tensorizing Subgraph Search in the Supernet Technical Report

2021.

Links | BibTeX

1603.

Syed, Muhtadyuzzaman; Srinivasan, Arvind Akpuram

Generalized Latency Performance Estimation for Once-For-All Neural Architecture Search Technical Report

2021.

Links | BibTeX

1602.

Huang, Hanxun; Ma, Xingjun; Erfani, Sarah M; Bailey, James

Neural Architecture Search via Combinatorial Multi-Armed Bandit Technical Report

2021.

Links | BibTeX

1601.

Tang, Tianqi; Yu, Xin; Dong, Xuanyi; Yang, Yi

Auto-Navigator: Decoupled Neural Architecture Search for Visual Navigation Technical Report

2021.

Links | BibTeX

1600.

Zheng, Shuai; Wang, Yabin; Li, Baotong; Li, Xin

A Hardware-adaptive Deep Feature Matching Pipeline for Real-time 3D Reconstruction Journal Article

In: vol. 132, pp. 102984, 2021.

Links | BibTeX

1599.

Hosseini, Ramtin; Yang, Xingyi; Xie, Pengtao

DSRNA - Differentiable Search of Robust Neural Architectures Proceedings Article

In: CVPR 2021, 2021.

Links | BibTeX

1598.

Ruchte, Michael; Zela, Arber; Siems, Julien Niklas; Grabocka, Josif; Hutter, Frank

NASLib: A Modular and Flexible Neural Architecture Search Library Technical Report

2021.

Links | BibTeX

1597.

Shaikh, Azhar; Sinha, Nishant

Learn to Bind and Grow Neural Structures Proceedings Article

In: pp. 119-126, 2021.

Links | BibTeX

1596.

Lu, Hao; Han, Hu

NAS-HR: search of neural architecture for heart-rate estimation from face videos Technical Report

2021.

Links | BibTeX

1595.

Peng, Daiyi; Dong, Xuanyi; Real, Esteban; Tan, Mingxing; Lu, Yifeng; Liu, Hanxiao; Bender, Gabriel; Kraft, Adam; Liang, Chen; Le, Quoc V

PyGlove - Symbolic Programming for Automated Machine Learning Technical Report

2021.

Links | BibTeX

1594.

Liu, Jiaheng; Zhou, Shunfeng; Wu, Yichao; Chen, Ken; Ouyang, Wanli; Xu, Dong

Block Proposal Neural Architecture Search Journal Article

In: vol. 30, pp. 15-25, 2021.

Links | BibTeX

1593.

He, Xin; Wang, Shihao; Ying, Guohao; Zhang, Jiyong; Chu, Xiaowen

Efficient Multi-objective Evolutionary 3D Neural Architecture Search for COVID-19 Detection with Chest CT Scans Technical Report

2021.

Links | BibTeX

1592.

Chu, Xiangxiang; Wang, Xiaoxing; Zhang, Bo; Lu, Shun; Wei, Xiaolin; Yan, Junchi

DARTS-: Robustly Stepping out of Performance Collapse Without Indicators Technical Report

2021.

Links | BibTeX

1591.

Liang, Xinle; Liu, Yang; Luo, Jiahuan; He, Yuanqin; Chen, Tianjian; Yang, Qiang

Self-supervised Cross-silo Federated Neural Architecture Search Technical Report

2021.

Links | BibTeX

1590.

Mittal, Govind; Korus, Pawel; Memon, Nasir D

FiFTy - Large-Scale File Fragment Type Identification Using Convolutional Neural Networks Journal Article

In: vol. 16, pp. 28-41, 2021.

Links | BibTeX

1589.

Yang, Zhao; Zhang, Shengbing; Li, Ruxu; Li, Chuxi; Wang, Miao; Wang, Danghui; Zhang, Meng

Efficient Resource-Aware Convolutional Neural Architecture Search for Edge Computing with Pareto-Bayesian Optimization Journal Article

In: vol. 21, no. 2, pp. 444, 2021.

Links | BibTeX

1588.

Wei, Tao; Wang, Changhu; Chen, Chang Wen

Modularized Morphing of Deep Convolutional Neural Networks - A Graph Approach Journal Article

In: vol. 70, no. 2, pp. 305-315, 2021.

Links | BibTeX

1587.

Song, Xingyou; Choromanski, Krzysztof; Parker-Holder, Jack; Tang, Yunhao; Peng, Daiyi; Jain, Deepali; Gao, Wenbo; Pacchiano, Aldo; Sarlós, Tamás; Yang, Yuxiang

ES-ENAS - Combining Evolution Strategies with Neural Architecture Search at No Extra Cost for Reinforcement Learning Technical Report

2021.

Links | BibTeX

1586.

Rorabaugh, Ariel Keller; -, Silvina Caíno; II, Michael Wyatt R; Johnston, Travis; Taufer, Michela

PEng4NN: An Accurate Performance Estimation Engine for Efficient Automated Neural Network Architecture Search Technical Report

2021.

Links | BibTeX

1585.

Zhang, Haokui; Gong, Chengrong; Bai, Yunpeng; Bai, Zongwen; Li, Ying

3D-ANAS: 3D Asymmetric Neural Architecture Search for Fast Hyperspectral Image Classification Miscellaneous

2021.

Links | BibTeX

1584.

Gu, Hongyang; Fu, Guangyuan; Li, Jianmin; Zhu, Jun

Auto-ReID+: Searching for a multi-branch ConvNet for person re-identification Journal Article

In: Neurocomputing, vol. 435, pp. 53-66, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1583.

He, Xin; Wang, Shihao; Chu, Xiaowen; Shi, Shaohuai; Tang, Jiangping; Liu, Xin; Yan, Chenggang; Zhang, Jiyong; Ding, Guiguang

Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans Technical Report

2021.

Links | BibTeX

1582.

Zhou, Benjia; Li, Yunan; Wan, Jun

Regional Attention with Architecture-Rebuilt 3D Network for RGB-D Gesture Recognition Technical Report

2021.

Links | BibTeX

1581.

Yang, Zhao; Zhang, Shengbing; Li, Ruxu; Li, Chuxi; Wang, Miao; Wang, Danghui; Zhang, Meng

Efficient Resource-Aware Convolutional Neural Architecture Search for Edge Computing with Pareto-Bayesian Optimization Journal Article

In: Sensors, vol. 21, no. 2, 2021, ISSN: 1424-8220.

Abstract | Links | BibTeX

1580.

Weng, Yu; Chen, Zehua; Zhou, Tianbao

Improved differentiable neural architecture search for single image super-resolution Journal Article

In: Peer-to-Peer Networking and Applications, 2021.

Abstract | Links | BibTeX

1579.

Liu, Jia; Jin, Yaochu

Multi-objective Search of Robust Neural Architectures against Multiple Types of Adversarial Attacks Technical Report

2021.

Links | BibTeX

1578.

Wu, Yan; Huang, Zhiwu; Kumar, Suryansh; Sukthanker, Rhea Sanjay; Timofte, Radu; Gool, Luc Van

Trilevel Neural Architecture Search for Efficient Single Image Super-Resolution Technical Report

2021.

Links | BibTeX

1577.

Alparslan, Yigit; Moyer, Ethan Jacob; Isozaki, Isamu Mclean; Schwartz, Daniel; Dunlop, Adam; Dave, Shesh; Kim, Edward

Towards Searching Efficient and Accurate Neural Network Architectures in Binary Classification Problems Technical Report

2021.

Links | BibTeX

1576.

Lee, Sanghyeop; Kim, Junyeob; Kang, Hyeon; Kang, Do-Young; Park, Jangsik

Genetic Algorithm Based Deep Learning Neural Network Structure and Hyperparameter Optimization Journal Article

In: Applied Sciences, vol. 11, no. 2, 2021, ISSN: 2076-3417.

Abstract | Links | BibTeX

1575.

Jiang, Hanliang; Shen, Fuhao; Gao, Fei; Han, Weidong

Learning efficient, explainable and discriminative representations for pulmonary nodules classification Journal Article

In: Pattern Recognition, vol. 113, pp. 107825, 2021, ISSN: 0031-3203.

Abstract | Links | BibTeX

1574.

Alparslan, Yigit; Moyer, Ethan Jacob; Kim, Edward

Evaluating Online and Offline Accuracy Traversal Algorithms for k-Complete Neural Network Architectures Journal Article

In: CoRR, vol. abs/2101.06518, 2021.

Links | BibTeX

1573.

Vaccaro, Lorenzo; Sansonetti, Giuseppe; Micarelli, Alessandro

An Empirical Review of Automated Machine Learning Journal Article

In: Computers, vol. 10, no. 1, 2021, ISSN: 2073-431X.

Abstract | Links | BibTeX

1572.

Li, Qing; Wu, Xia; Liu, Tianming

Differentiable Neural Architecture Search for Optimal Spatial/Temporal Brain Function Network Decomposition Journal Article

In: Medical Image Analysis, pp. 101974, 2021, ISSN: 1361-8415.

Abstract | Links | BibTeX

1571.

Song, Xingyou; Choromanski, Krzysztof; -, Jack Parker; Tang, Yunhao; Peng, Daiyi; Jain, Deepali; Gao, Wenbo; Pacchiano, Aldo; ó, Tamás Sarl; Yang, Yuxiang

ES-ENAS: Combining Evolution Strategies with Neural Architecture Search at No Extra Cost for Reinforcement Learning Technical Report

2021.

Links | BibTeX

1570.

Wu, Haiwei; Zhou, Jiantao

GIID-Net: Generalizable Image Inpainting Detection via Neural Architecture Search and Attention Technical Report

2021.

Links | BibTeX

1569.

Fu, Chaoyou; Hu, Yibo; Wu, Xiang; Shi, Hailin; Mei, Tao; He, Ran

CM-NAS: Rethinking Cross-Modality Neural Architectures for Visible-Infrared Person Re-Identification Technical Report

2021.

Links | BibTeX

1568.

Abdelfattah, Mohamed S; Mehrotra, Abhinav; Dudziak, Lukasz; Lane, Nicholas D

Zero-Cost Proxies for Lightweight NAS Technical Report

2021.

Links | BibTeX

1567.

Benmeziane, Hadjer; Maghraoui, Kaoutar El; Ouarnoughi, Hamza; ï, Sma; Wistuba, Martin; Wang, Naigang

A Comprehensive Survey on Hardware-Aware Neural Architecture Search Technical Report

2021.

Links | BibTeX

1566.

He, Xin; Wang, Shihao; Ying, Guohao; Zhang, Jiyong; Chu, Xiaowen

Efficient Multi-objective Evolutionary 3D Neural Architecture Search for COVID-19 Detection with Chest CT Scans Technical Report

2021.

Links | BibTeX

4015 entries « 49 of 81 »