AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


2034 entries « 37 of 41 »

2019

234.

Behjat, Amir; Chidambaran, Sharat; Chowdhury, Souma

Adaptive Genomic Evolution of Neural Network Topologies (AGENT) for State-to-Action Mapping in Autonomous Agents Inproceedings

In: pp. 9638-9644, 2019.

Links | BibTeX

233.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

2019.

Links | BibTeX

232.

Borsos, Zalán; Khorlin, Andrey; Gesmundo, Andrea

Transfer NAS - Knowledge Transfer between Search Spaces with Transformer Agents Technical Report

2019.

Links | BibTeX

231.

Nayman, Niv; Noy, Asaf; Ridnik, Tal; Friedman, Itamar; Jin, Rong; Zelnik-Manor, Lihi

XNAS - Neural Architecture Search with Expert Advice Inproceedings

In: pp. 1975-1985, 2019.

Links | BibTeX

230.

Singh, Prabhant; Jacobs, Tobias; Nicolas, Sebastien; Schmidt, Mischa

A Study of the Learning Progress in Neural Architecture Search Techniques Technical Report

2019.

Links | BibTeX

229.

Srinivas, Sai Vineeth Kalluru; Nair, Harideep; Vidyasagar, Vinay

Hardware Aware Neural Network Architectures using FbNet Technical Report

2019.

Links | BibTeX

228.

Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Action Space Technical Report

2019.

Links | BibTeX

227.

Cheng, Hsin-Pai; Zhang, Tunhou; Yang, Yukun; Yan, Feng; Li, Shiyu; Teague, Harris; Li, Hai Helen; Chen, Yiran

SwiftNet - Using Graph Propagation as Meta-knowledge to Search Highly Representative Neural Architectures Technical Report

2019.

Links | BibTeX

226.

Yu, Qihang; Yang, Dong; Roth, Holger; Bai, Yutong; Zhang, Yixiao; Yuille, Alan L; Xu, Daguang

C2FNAS: Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation Technical Report

2019.

Links | BibTeX

225.

Pasunuru, Ramakanth; Bansal, Mohit

Continual and Multi-Task Architecture Search Inproceedings

In: pp. 1911-1922, 2019.

Links | BibTeX

224.

Cho, Minsu; Soltani, Mohammadreza; Hegde, Chinmay

One-Shot Neural Architecture Search via Compressive Sensing Technical Report

2019.

Links | BibTeX

223.

Zhu, Zhuotun; Liu, Chenxi; Yang, Dong; Yuille, Alan L; Xu, Daguang

V-NAS - Neural Architecture Search for Volumetric Medical Image Segmentation Inproceedings

In: pp. 240-248, 2019.

Links | BibTeX

222.

An, Jie; Xiong, Haoyi; Ma, Jinwen; Luo, Jiebo; Huan, Jun

StyleNAS - An Empirical Study of Neural Architecture Search to Uncover Surprisingly Fast End-to-End Universal Style Transfer Networks Technical Report

2019.

Links | BibTeX

221.

Hu, Hanzhang; Langford, John; Caruana, Rich; Mukherjee, Saurajit; Horvitz, Eric; Dey, Debadeepta

Efficient Forward Architecture Search Inproceedings

In: pp. 10122-10131, 2019.

Links | BibTeX

220.

Yao, Quanming; Xu, Ju; Tu, Wei-Wei; Zhu, Zhanxing

Differentiable Neural Architecture Search via Proximal Iterations Technical Report

2019.

Links | BibTeX

219.

Zheng, Xiawu; Ji, Rongrong; Tang, Lang; Wan, Yan; Zhang, Baochang; Wu, Yongjian; Wu, Yunsheng; Shao, Ling

Dynamic Distribution Pruning for Efficient Network Architecture Search Technical Report

2019.

Links | BibTeX

218.

Junior, Francisco Erivaldo Fernandes; Yen, Gary G

Particle swarm optimization of deep neural networks architectures for image classification Journal Article

In: vol. 49, pp. 62-74, 2019.

Links | BibTeX

217.

Radosavovic, Ilija; Johnson, Justin; Xie, Saining; Lo, Wan-Yen; Dollár, Piotr

On Network Design Spaces for Visual Recognition Inproceedings

In: pp. 1882-1890, 2019.

Links | BibTeX

216.

Tan, Mingxing; Le, Quoc V

EfficientNet - Rethinking Model Scaling for Convolutional Neural Networks Inproceedings

In: pp. 6105-6114, 2019.

Links | BibTeX

215.

Pahuja, Vardaan; Fu, Jie; Chandar, Sarath; Pal, Christopher Joseph

Structure Learning for Neural Module Networks Inproceedings

In: pp. 1-10, 2019.

Links | BibTeX

214.

Fedorov, Igor; Adams, Ryan P; Mattina, Matthew; Whatmough, Paul N

SpArSe - Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers Inproceedings

In: pp. 4978-4990, 2019.

Links | BibTeX

213.

Dong, Xuanyi; Yang, Yi

Network Pruning via Transformable Architecture Search Inproceedings

In: pp. 759-770, 2019.

Links | BibTeX

212.

Cho, Hyunghun; Kim, Yongjin; Lee, Eunjung; Choi, Daeyoung; Lee, Yongjae; Rhee, Wonjong

DEEP-BO for Hyperparameter Optimization of Deep Networks Technical Report

2019.

Links | BibTeX

211.

Akimoto, Youhei; Shirakawa, Shinichi; Yoshinari, Nozomu; Uchida, Kento; Saito, Shota; Nishida, Kouhei

Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search Inproceedings

In: pp. 171-180, 2019.

Links | BibTeX

210.

Zheng, Xiawu; Ji, Rongrong; Tang, Lang; Zhang, Baochang; Liu, Jianzhuang; Tian, Qi

Multinomial Distribution Learning for Effective Neural Architecture Search Inproceedings

In: pp. 1304-1313, 2019.

Links | BibTeX

209.

Zhu, Hui; An, Zhulin; Yang, Chuanguang; Xu, Kaiqiang; Zhao, Erhu; Xu, Yongjun

EENA - Efficient Evolution of Neural Architecture Inproceedings

In: pp. 1891-1899, 2019.

Links | BibTeX

208.

Byla, Edvinas; Pang, Wei

DeepSwarm - Optimising Convolutional Neural Networks Using Swarm Intelligence Inproceedings

In: pp. 119-130, 2019.

Links | BibTeX

207.

Saikia, Tonmoy; Marrakchi, Yassine; Zela, Arber; Hutter, Frank; Brox, Thomas

AutoDispNet - Improving Disparity Estimation With AutoML Inproceedings

In: pp. 1812-1823, 2019.

Links | BibTeX

206.

Lin, Chen; Guo, Minghao; Li, Chuming; Yuan, Xin; Wu, Wei; Yan, Junjie; Lin, Dahua; Ouyang, Wanli

Online Hyper-Parameter Learning for Auto-Augmentation Strategy Inproceedings

In: pp. 6578-6587, 2019.

Links | BibTeX

205.

Saltori, Cristiano; Roy, Subhankar; Sebe, Nicu; Iacca, Giovanni

Regularized Evolutionary Algorithm for Dynamic Neural Topology Search Inproceedings

In: pp. 219-230, 2019.

Links | BibTeX

204.

Ma, Lizheng; Cui, Jiaxu; Yang, Bo

Deep Neural Architecture Search with Deep Graph Bayesian Optimization Inproceedings

In: pp. 500-507, 2019.

Links | BibTeX

203.

Laredo, David; Qin, Yulin; Schütze, Oliver; Sun, Jian-Qiao

Automatic Model Selection for Neural Networks Technical Report

2019.

Links | BibTeX

202.

Klein, Aaron; Hutter, Frank

Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization Technical Report

2019.

Links | BibTeX

201.

Zhou, Hongpeng; Yang, Minghao; Wang, Jun; Pan, Wei

BayesNAS - A Bayesian Approach for Neural Architecture Search Inproceedings

In: pp. 7603-7613, 2019.

Links | BibTeX

200.

Stamoulis, Dimitrios; Ding, Ruizhou; Wang, Di; Lymberopoulos, Dimitrios; Priyantha, Bodhi; Liu, Jie; Marculescu, Diana

Single-Path NAS - Device-Aware Efficient ConvNet Design Technical Report

2019.

Links | BibTeX

199.

Assunção, Filipe; Correia, João; Conceição, Rúben; Pimenta, Mário; Tomé, Bernardo; Lourenço, Nuno; Machado, Penousal

Automatic Design of Artificial Neural Networks for Gamma-Ray Detection Journal Article

In: vol. 7, pp. 110531-110540, 2019.

Links | BibTeX

198.

Jiang, Yang; Zhao, Cong; Pang, Lei

Neural Architecture Refinement - A Practical Way for Avoiding Overfitting in NAS Technical Report

2019.

Links | BibTeX

197.

Hahn, Lukas; Roese-Koerner, Lutz; Friedrichs, Klaus; Kummert, Anton

Fast and reliable architecture selection for convolutional neural networks Inproceedings

In: 2019.

Links | BibTeX

196.

Chang, Jianlong; Zhang, Xinbang; Guo, Yiwen; Meng, Gaofeng; Xiang, Shiming; Pan, Chunhong

Differentiable Architecture Search with Ensemble Gumbel-Softmax Technical Report

2019.

Links | BibTeX

195.

Dong, Xuanyi; Yang, Yi

Searching for a Robust Neural Architecture in Four GPU Hours Inproceedings

In: pp. 1761-1770, 2019.

Links | BibTeX

194.

Sun, Yanan; Yen, Gary G; Yi, Zhang

Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations Journal Article

In: vol. 23, no. 1, pp. 89-103, 2019.

Links | BibTeX

193.

Chen, Yushi; Zhu, Kaiqiang; Zhu, Lin; He, Xin; Ghamisi, Pedram; Benediktsson, Atli Jón

Automatic Design of Convolutional Neural Network for Hyperspectral Image Classification Journal Article

In: vol. 57, no. 9, pp. 7048-7066, 2019.

Links | BibTeX

192.

Chen, Xin; Xie, Lingxi; Wu, Jun; Tian, Qi

Progressive Differentiable Architecture Search - Bridging the Depth Gap Between Search and Evaluation Inproceedings

In: pp. 1294-1303, 2019.

Links | BibTeX

191.

Han, Song; Cai, Han; Zhu, Ligeng; Lin, Ji; Wang, Kuan; Liu, Zhijian; Lin, Yujun

Design Automation for Efficient Deep Learning Computing Technical Report

2019.

Links | BibTeX

190.

Pakrashi, Arjun; Namee, Brian Mac

CascadeML - An Automatic Neural Network Architecture Evolution and Training Algorithm for Multi-label Classification (Best Technical Paper) Inproceedings

In: pp. 3-17, 2019.

Links | BibTeX

189.

Gao, Yang; Yang, Hong; Zhang, Peng; Zhou, Chuan; Hu, Yue

GraphNAS - Graph Neural Architecture Search with Reinforcement Learning Technical Report

2019.

Links | BibTeX

188.

Gessert, Nils; Schlaefer, Alexander

Efficient Neural Architecture Search on Low-Dimensional Data for OCT Image Segmentation Technical Report

2019.

Links | BibTeX

187.

Weng, Yu; Zhou, Tianbao; Li, Yujie; Qiu, Xiaoyu

NAS-Unet - Neural Architecture Search for Medical Image Segmentation Journal Article

In: vol. 7, pp. 44247-44257, 2019.

Links | BibTeX

186.

Assunção, Filipe; Lourenço, Nuno; Machado, Penousal; Ribeiro, Bernardete

Fast DENSER - Efficient Deep NeuroEvolution Inproceedings

In: pp. 197-212, 2019.

Links | BibTeX

185.

Ghiasi, Golnaz; Lin, Tsung-Yi; Le, Quoc V

NAS-FPN - Learning Scalable Feature Pyramid Architecture for Object Detection Inproceedings

In: pp. 7036-7045, 2019.

Links | BibTeX

2034 entries « 37 of 41 »