AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1930 entries « 38 of 39 »

2018

80.

Pham, Hieu; Guan, Melody Y; Zoph, Barret; Le, Quoc V; Dean, Jeff

Efficient Neural Architecture Search via Parameter Sharing Inproceedings

In: pp. 4092-4101, 2018.

Links | BibTeX

79.

Dutta, Jayanta K; Liu, Jiayi; Kurup, Unmesh; Shah, Mohak

Effective Building Block Design for Deep Convolutional Neural Networks using Search Technical Report

2018.

Links | BibTeX

78.

Wang, Jiazhuo; Xu, Jason; Wang, Xuejun

Combination of Hyperband and Bayesian Optimization for Hyperparameter Optimization in Deep Learning Technical Report

2018.

Links | BibTeX

77.

Lorenzo, Pablo Ribalta; Nalepa, Jakub

Memetic evolution of deep neural networks Inproceedings

In: pp. 505-512, 2018.

Links | BibTeX

76.

Bender, Gabriel; Kindermans, Pieter-Jan; Zoph, Barret; Vasudevan, Vijay; Le, Quoc V

Understanding and Simplifying One-Shot Architecture Search Inproceedings

In: pp. 549-558, 2018.

Links | BibTeX

75.

Dong, Jin-Dong; Cheng, An-Chieh; Juan, Da-Cheng; Wei, Wei; Sun, Min

PPP-Net - Platform-aware Progressive Search for Pareto-optimal Neural Architectures Inproceedings

In: 2018.

Links | BibTeX

74.

Hinz, Tobias; Navarro-Guerrero, Nicolás; Magg, Sven; Wermter, Stefan

Speeding up the Hyperparameter Optimization of Deep Convolutional Neural Networks Journal Article

In: vol. 17, no. 2, pp. 1850008:1-1850008:15, 2018.

Links | BibTeX

73.

Bennani-Smires, Kamil; Musat, Claudiu; Hossmann, Andreea; Baeriswyl, Michael

GitGraph - from Computational Subgraphs to Smaller Architecture Search Spaces Inproceedings

In: 2018.

Links | BibTeX

72.

Ashok, Anubhav; Rhinehart, Nicholas; Beainy, Fares; Kitani, Kris M

N2N learning - Network to Network Compression via Policy Gradient Reinforcement Learning Inproceedings

In: 2018.

Links | BibTeX

71.

Gordon, Ariel; Eban, Elad; Nachum, Ofir; Chen, Bo; Wu, Hao; Yang, Tien-Ju; Choi, Edward

MorphNet - Fast & Simple Resource-Constrained Structure Learning of Deep Networks Inproceedings

In: pp. 1586-1595, 2018.

Links | BibTeX

70.

Ahmed, Karim; Torresani, Lorenzo

MaskConnect - Connectivity Learning by Gradient Descent Inproceedings

In: pp. 362-378, 2018.

Links | BibTeX

69.

Schrimpf, Martin; Merity, Stephen; Bradbury, James; Socher, Richard

A Flexible Approach to Automated RNN Architecture Generation Inproceedings

In: 2018.

Links | BibTeX

68.

Suganuma, Masanori; Shirakawa, Shinichi; Nagao, Tomoharu

A Genetic Programming Approach to Designing Convolutional Neural Network Architectures Inproceedings

In: pp. 5369-5373, 2018.

Links | BibTeX

67.

Zhong, Zhao; Yan, Junjie; Wu, Wei; Shao, Jing; Liu, Cheng-Lin

Practical Block-Wise Neural Network Architecture Generation Inproceedings

In: pp. 2423-2432, 2018.

Links | BibTeX

66.

Baker, Bowen; Gupta, Otkrist; Raskar, Ramesh; Naik, Nikhil

Accelerating Neural Architecture Search using Performance Prediction Inproceedings

In: 2018.

Links | BibTeX

65.

Liu, Hanxiao; Simonyan, Karen; Vinyals, Oriol; Fernando, Chrisantha; Kavukcuoglu, Koray

Hierarchical Representations for Efficient Architecture Search Inproceedings

In: 2018.

Links | BibTeX

64.

Zoph, Barret; Vasudevan, Vijay; Shlens, Jonathon; Le, Quoc V

Learning Transferable Architectures for Scalable Image Recognition Inproceedings

In: pp. 8697-8710, 2018.

Links | BibTeX

63.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Simple and efficient architecture search for Convolutional Neural Networks Inproceedings

In: 2018.

Links | BibTeX

62.

Hazan, Elad; Klivans, Adam R; Yuan, Yang

Hyperparameter optimization - a spectral approach Inproceedings

In: 2018.

Links | BibTeX

61.

Brock, Andrew; Lim, Theodore; Ritchie, James M; Weston, Nick

SMASH - One-Shot Model Architecture Search through HyperNetworks Inproceedings

In: 2018.

Links | BibTeX

60.

Cai, Han; Chen, Tianyao; Zhang, Weinan; Yu, Yong; Wang, Jun

Efficient Architecture Search by Network Transformation Inproceedings

In: pp. 2787-2794, 2018.

Links | BibTeX

59.

Chen, Liang-Chieh; Collins, Maxwell D.; Zhu, Yukun; Papandreou, George; Zoph, Barret; Schroff, Florian; Adam, Hartwig; Shlens, Jonathon

Searching for Efficient Multi-Scale Architectures for Dense Image Prediction Inproceedings

In: Bengio, Samy; Wallach, Hanna M.; Larochelle, Hugo; Grauman, Kristen; Cesa-Bianchi, Nicolò; Garnett, Roman (Ed.): Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montréal, Canada, pp. 8713–8724, 2018.

Links | BibTeX

2017

58.

Chang, Hao

Skin cancer reorganization and classification with deep neural network Technical Report

2017.

Links | BibTeX

57.

Suganuma, Masanori; Shirakawa, Shinichi; Nagao, Tomoharu

A Genetic Programming Approach to Designing Convolutional Neural Network Architectures Technical Report

2017.

Links | BibTeX

56.

Chang, Hao

Skin cancer reorganization and classification with deep neural network Technical Report

2017.

Links | BibTeX

55.

Kani, Nagoor J; Elsheikh, Ahmed H

DR-RNN: A deep residual recurrent neural network for model reduction Technical Report

2017.

Links | BibTeX

54.

Sun, Yanan; Xue, Bing; Zhang, Mengjie

A Particle Swarm Optimization-based Flexible Convolutional Auto-Encoder for Image Classification Technical Report

2017.

Links | BibTeX

53.

Negrinho, Renato; Gordon, Geoffrey J

DeepArchitect - Automatically Designing and Training Deep Architectures Technical Report

2017.

Links | BibTeX

52.

Real, Esteban; Moore, Sherry; Selle, Andrew; Saxena, Saurabh; Suematsu, Yutaka Leon; Tan, Jie; Le, Quoc V; Kurakin, Alexey

Large-Scale Evolution of Image Classifiers Inproceedings

In: pp. 2902-2911, 2017.

Links | BibTeX

51.

Bello, Irwan; Zoph, Barret; Vasudevan, Vijay; Le, Quoc V

Neural Optimizer Search with Reinforcement Learning Inproceedings

In: pp. 459-468, 2017.

Links | BibTeX

50.

Wistuba, Martin

Finding Competitive Network Architectures Within a Day Using UCT Technical Report

2017.

Links | BibTeX

49.

Cortes, Corinna; Gonzalvo, Xavier; Kuznetsov, Vitaly; Mohri, Mehryar; Yang, Scott

AdaNet - Adaptive Structural Learning of Artificial Neural Networks Inproceedings

In: pp. 874-883, 2017.

Links | BibTeX

48.

Baker, Bowen; Gupta, Otkrist; Naik, Nikhil; Raskar, Ramesh

Designing Neural Network Architectures using Reinforcement Learning Inproceedings

In: 2017.

Links | BibTeX

47.

Klein, Aaron; Falkner, Stefan; Springenberg, Jost Tobias; Hutter, Frank

Learning Curve Prediction with Bayesian Neural Networks Inproceedings

In: 2017.

Links | BibTeX

46.

Li, Lisha; Jamieson, Kevin G; DeSalvo, Giulia; Rostamizadeh, Afshin; Talwalkar, Ameet

Hyperband - A Novel Bandit-Based Approach to Hyperparameter Optimization Journal Article

In: vol. 18, pp. 185:1-185:52, 2017.

Links | BibTeX

2016

45.

Vu, Ngoc Thang; Adel, Heike; Gupta, Pankaj; Schütze, Hinrich

Combining Recurrent and Convolutional Neural Networks for Relation Classification Technical Report

2016.

Links | BibTeX

44.

Chen, Long; Zhang, Hanwang; Xiao, Jun; Nie, Liqiang; Shao, Jian; Liu, Wei; Chua, Tat-Seng

SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning Technical Report

2016.

Links | BibTeX

43.

Smithson, Sean C; Yang, Guang; Gross, Warren J; Meyer, Brett H

Neural networks designing neural networks - multi-objective hyper-parameter optimization Inproceedings

In: pp. 104, 2016.

Links | BibTeX

42.

Saxena, Shreyas; Verbeek, Jakob

Convolutional Neural Fabrics Inproceedings

In: pp. 4053-4061, 2016.

Links | BibTeX

41.

Loshchilov, Ilya; Hutter, Frank

CMA-ES for Hyperparameter Optimization of Deep Neural Networks Technical Report

2016.

Links | BibTeX

40.

Chen, Tianqi; Goodfellow, Ian J; Shlens, Jonathon

Net2Net - Accelerating Learning via Knowledge Transfer Inproceedings

In: 2016.

Links | BibTeX

39.

Chen, Justin

Combinatorially Generated Piecewise Activation Functions Technical Report

2016.

Links | BibTeX

2015

38.

Kulish, Vadym V; Malyi, Oleksandr I; Persson, Clas; Wu, Ping

Evaluation of Phosphorene as Anode Material for Na-ion Batteries from First Principles Technical Report

2015.

Links | BibTeX

37.

Young, Steven R; Rose, Derek C; Karnowski, Thomas P; Lim, Seung-Hwan; Patton, Robert M

Optimizing deep learning hyper-parameters through an evolutionary algorithm Inproceedings

In: pp. 4:1-4:5, 2015.

Links | BibTeX

2013

36.

Lopez, Pablo; Fernandez, David; Marin-Perez, Rafael; Jara, Antonio J; Gomez-Skarmeta, Antonio F

Scalable Oriented-Service Architecture for Heterogeneous and Ubiquitous IoT Domains Technical Report

2013.

Links | BibTeX

35.

Fister, Iztok; Jr., Iztok Fister; Yang, Xin-She; Brest, Janez

A comprehensive review of firefly algorithms Technical Report

2013.

Links | BibTeX

2012

34.

Anas, M; Javaid, N; Mahmood, A; Raza, S M; Qasim, U; Khan, Z A

Minimizing Electricity Theft using Smart Meters in AMI Technical Report

2012.

Links | BibTeX

33.

Snoek, Jasper; Larochelle, Hugo; Adams, Ryan P

Practical Bayesian Optimization of Machine Learning Algorithms Inproceedings

In: pp. 2960-2968, 2012.

Links | BibTeX

2009

32.

Jaffres-Runser, Katia; Gorce, Jean-Marie; Comaniciu, Cristina

A multiobjective Tabu framework for the optimization and evaluation of wireless systems Technical Report

2009.

Links | BibTeX

31.

Stanley, Kenneth O; D'Ambrosio, David B; Gauci, Jason

A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks Journal Article

In: vol. 15, no. 2, pp. 185-212, 2009.

Links | BibTeX

1930 entries « 38 of 39 »