AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


2034 entries « 39 of 41 »

2019

134.

White, Colin; Neiswanger, Willie; Savani, Yash

BANANAS - Bayesian Optimization with Neural Architectures for Neural Architecture Search Technical Report

2019.

Links | BibTeX

133.

Wistuba, Martin; Rawat, Ambrish; Pedapati, Tejaswini

A Survey on Neural Architecture Search Technical Report

2019.

Links | BibTeX

132.

Chen, Yukang; Meng, Gaofeng; Zhang, Qian; Xiang, Shiming; Huang, Chang; Mu, Lisen; Wang, Xinggang

RENAS - Reinforced Evolutionary Neural Architecture Search Inproceedings

In: pp. 4787-4796, 2019.

Links | BibTeX

131.

Bashivan, Pouya; Tensen, Mark; DiCarlo, James J

Teacher Guided Architecture Search Inproceedings

In: pp. 5319-5328, 2019.

Links | BibTeX

130.

Tan, Mingxing; Chen, Bo; Pang, Ruoming; Vasudevan, Vijay; Sandler, Mark; Howard, Andrew; Le, Quoc V

MnasNet - Platform-Aware Neural Architecture Search for Mobile Inproceedings

In: pp. 2820-2828, 2019.

Links | BibTeX

129.

Istrate, Roxana; Scheidegger, Florian; Mariani, Giovanni; Nikolopoulos, Dimitrios S; Bekas, Constantine; Malossi, Adelmo Cristiano Innocenza

TAPAS - Train-Less Accuracy Predictor for Architecture Search Inproceedings

In: pp. 3927-3934, 2019.

Links | BibTeX

128.

Real, Esteban; Aggarwal, Alok; Huang, Yanping; Le, Quoc V

Regularized Evolution for Image Classifier Architecture Search Inproceedings

In: pp. 4780-4789, 2019.

Links | BibTeX

127.

Märtens, Marcus; Izzo, Dario

Neural network architecture search with differentiable cartesian genetic programming for regression Inproceedings

In: pp. 181-182, 2019.

Links | BibTeX

126.

Cao, Shengcao; Wang, Xiaofang; Kitani, Kris M

Learnable Embedding Space for Efficient Neural Architecture Compression Technical Report

2019.

Links | BibTeX

125.

Mendoza, Hector; Klein, Aaron; Feurer, Matthias; Springenberg, Jost Tobias; Urban, Matthias; Burkart, Michael; Dippel, Maximilian; Lindauer, Marius; Hutter, Frank

Towards Automatically-Tuned Deep Neural Networks Technical Report

2019.

Links | BibTeX

124.

Kwasigroch, Arkadiusz; Grochowski, Michal; Mikolajczyk, Mateusz

Deep neural network architecture search using network morphism Inproceedings

In: pp. 30-35, 2019.

Links | BibTeX

2018

123.

Lindqvist, Blerta; Sugrim, Shridatt; Izmailov, Rauf

AutoGAN: Robust Classifier Against Adversarial Attacks Technical Report

2018.

Links | BibTeX

122.

Sun, Man-Chin; Hsu, Shih-Huan; Yang, Min-Chun; Chien, Jen-Hsien

Context-aware Cascade Attention-based RNN for Video Emotion Recognition Technical Report

2018.

Links | BibTeX

121.

Ritter, Hippolyt; Botev, Aleksandar; Barber, David

Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting Technical Report

2018.

Links | BibTeX

120.

Zhang, Honglei; Kiranyaz, Serkan; Gabbouj, Moncef

Finding Better Topologies for Deep Convolutional Neural Networks by Evolution Technical Report

2018.

Links | BibTeX

119.

Kandasamy, Kirthevasan; Neiswanger, Willie; Schneider, Jeff; Poczos, Barnabas; Xing, Eric

Neural Architecture Search with Bayesian Optimisation and Optimal Transport Technical Report

2018.

Links | BibTeX

118.

Hamraz, Hamid; Jacobs, Nathan B; Contreras, Marco A; Clark, Chase H

Deep learning for conifer/deciduous classification of airborne LiDAR 3D point clouds representing individual trees Technical Report

2018.

Links | BibTeX

117.

Perez-Rua, Juan-Manuel; Baccouche, Moez; Pateux, Stephane

Efficient Progressive Neural Architecture Search Technical Report

2018.

Links | BibTeX

116.

Deglint, Jason L; Jin, Chao; Chao, Angela; Wong, Alexander

The feasibility of automated identification of six algae types using neural networks and fluorescence-based spectral-morphological features Technical Report

2018.

Links | BibTeX

115.

Kamath, Purushotham; Singh, Abhishek; Dutta, Debo

AMLA: an AutoML frAmework for Neural Network Design Technical Report

2018.

Links | BibTeX

114.

de Laroussilhe, Quentin; Jastrzebski, Stanislaw; Houlsby, Neil; Gesmundo, Andrea

Neural Architecture Search Over a Graph Search Space Technical Report

2018.

Links | BibTeX

113.

Jaâfra, Yesmina; Laurent, Jean Luc; Deruyver, Aline; Naceur, Mohamed Saber

A Review of Meta-Reinforcement Learning for Deep Neural Networks Architecture Search Technical Report

2018.

Links | BibTeX

112.

Wu, Bichen; Wang, Yanghan; Zhang, Peizhao; Tian, Yuandong; Vajda, Peter; Keutzer, Kurt

Mixed Precision Quantization of ConvNets via Differentiable Neural Architecture Search Technical Report

2018.

Links | BibTeX

111.

Wang, Bin; Sun, Yanan; Xue, Bing; Zhang, Mengjie

Evolving Deep Convolutional Neural Networks by Variable-Length Particle Swarm Optimization for Image Classification Inproceedings

In: pp. 1-8, 2018.

Links | BibTeX

110.

Wang, Bin; Sun, Yanan; Xue, Bing; Zhang, Mengjie

A Hybrid Differential Evolution Approach to Designing Deep Convolutional Neural Networks for Image Classification Inproceedings

In: pp. 237-250, 2018.

Links | BibTeX

109.

Maziarz, Krzysztof; Khorlin, Andrey; de Laroussilhe, Quentin; Gesmundo, Andrea

Evolutionary-Neural Hybrid Agents for Architecture Search Technical Report

2018.

Links | BibTeX

108.

Chen, Yukang; Meng, Gaofeng; Zhang, Qian; Zhang, Xinbang; Song, Liangchen; Xiang, Shiming; Pan, Chunhong

Joint Neural Architecture Search and Quantization Technical Report

2018.

Links | BibTeX

107.

Wong, Catherine; Houlsby, Neil; Lu, Yifeng; Gesmundo, Andrea

Transfer Learning with Neural AutoML Inproceedings

In: pp. 8366-8375, 2018.

Links | BibTeX

106.

Fielding, Ben; Zhang, Li

Evolving Image Classification Architectures With Enhanced Particle Swarm Optimisation Journal Article

In: vol. 6, pp. 68560-68575, 2018.

Links | BibTeX

105.

Lu, Zhichao; Whalen, Ian; Boddeti, Vishnu; Dhebar, Yashesh D; Deb, Kalyanmoy; Goodman, Erik D; Banzhaf, Wolfgang

NSGA-NET - A Multi-Objective Genetic Algorithm for Neural Architecture Search Technical Report

2018.

Links | BibTeX

104.

Zhang, Xinbang; Huang, Zehao; Wang, Naiyan

You Only Search Once - Single Shot Neural Architecture Search via Direct Sparse Optimization Technical Report

2018.

Links | BibTeX

103.

Sun, Yanan; Xue, Bing; Zhang, Mengjie

Automatically Evolving CNN Architectures Based on Blocks Technical Report

2018.

Links | BibTeX

102.

Mitschke, Norbert; Heizmann, Michael; Noffz, Klaus-Henning; Wittmann, Ralf

Gradient Based Evolution to Optimize the Structure of Convolutional Neural Networks Inproceedings

In: pp. 3438-3442, 2018.

Links | BibTeX

101.

Cheng, An-Chieh; Dong, Jin-Dong; Hsu, Chi-Hung; Chang, Shu-Huan; Sun, Min; Chang, Shih-Chieh; Pan, Jia-Yu; Chen, Yu-Ting; Wei, Wei; Juan, Da-Cheng

Searching toward pareto-optimal device-aware neural architectures Inproceedings

In: pp. 136, 2018.

Links | BibTeX

100.

Chen, Junkun; Chen, Kaiyu; Chen, Xinchi; Qiu, Xipeng; Huang, Xuanjing

Exploring Shared Structures and Hierarchies for Multiple NLP Tasks Technical Report

2018.

Links | BibTeX

99.

Zhong, Zhao; Yang, Zichen; Deng, Boyang; Yan, Junjie; Wu, Wei; Shao, Jing; Liu, Cheng-Lin

BlockQNN - Efficient Block-wise Neural Network Architecture Generation Technical Report

2018.

Links | BibTeX

98.

Zela, Arber; Klein, Aaron; Falkner, Stefan; Hutter, Frank

Towards Automated Deep Learning - Efficient Joint Neural Architecture and Hyperparameter Search Technical Report

2018.

Links | BibTeX

97.

Mortazi, Aliasghar; Bagci, Ulas

Automatically Designing CNN Architectures for Medical Image Segmentation Inproceedings

In: pp. 98-106, 2018.

Links | BibTeX

96.

Hsu, Chi-Hung; Chang, Shu-Huan; Juan, Da-Cheng; Pan, Jia-Yu; Chen, Yu-Ting; Wei, Wei; Chang, Shih-Chieh

MONAS - Multi-Objective Neural Architecture Search using Reinforcement Learning Technical Report

2018.

Links | BibTeX

95.

Cai, Han; Yang, Jiacheng; Zhang, Weinan; Han, Song; Yu, Yong

Path-Level Network Transformation for Efficient Architecture Search Inproceedings

In: pp. 677-686, 2018.

Links | BibTeX

94.

Prellberg, Jonas; Kramer, Oliver

Lamarckian Evolution of Convolutional Neural Networks Inproceedings

In: pp. 424-435, 2018.

Links | BibTeX

93.

Wistuba, Martin

Deep Learning Architecture Search by Neuro-Cell-Based Evolution with Function-Preserving Mutations Inproceedings

In: pp. 243-258, 2018.

Links | BibTeX

92.

Rohekar, Raanan Yehezkel Y; Nisimov, Shami; Gurwicz, Yaniv; Koren, Guy; Novik, Gal

Constructing Deep Neural Networks by Bayesian Network Structure Learning Inproceedings

In: pp. 3051-3062, 2018.

Links | BibTeX

91.

Jin, Haifeng; Song, Qingquan; Hu, Xia

Efficient Neural Architecture Search with Network Morphism Technical Report

2018.

Links | BibTeX

90.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Multi-objective Architecture Search for CNNs Technical Report

2018.

Links | BibTeX

89.

Huang, Siyu; Li, Xi; Cheng, Zhiqi; Zhang, Zhongfei; Hauptmann, Alexander G

GNAS - A Greedy Neural Architecture Search Method for Multi-Attribute Learning Inproceedings

In: pp. 2049-2057, 2018.

Links | BibTeX

88.

Liang, Jason Zhi; Meyerson, Elliot; Miikkulainen, Risto

Evolutionary architecture search for deep multitask networks Inproceedings

In: pp. 466-473, 2018.

Links | BibTeX

87.

Rawal, Aditya; Miikkulainen, Risto

From Nodes to Networks - Evolving Recurrent Neural Networks Technical Report

2018.

Links | BibTeX

86.

Kamath, Purushotham; Singh, Abhishek; Dutta, Debo

Neural Architecture Construction using EnvelopeNets Technical Report

2018.

Links | BibTeX

85.

Wong, Catherine; Houlsby, Neil; Lu, Yifeng; Gesmundo, Andrea

Transfer Automatic Machine Learning Technical Report

2018.

Links | BibTeX

2034 entries « 39 of 41 »