AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1385 entries « 28 of 28 »

2017

35.

Li, Lisha; Jamieson, Kevin G; DeSalvo, Giulia; Rostamizadeh, Afshin; Talwalkar, Ameet

Hyperband - A Novel Bandit-Based Approach to Hyperparameter Optimization Journal Article

In: 18 , pp. 185:1-185:52, 2017.

Links | BibTeX

34.

Chang, Hao

Skin cancer reorganization and classification with deep neural network Technical Report

2017.

Links | BibTeX

33.

Suganuma, Masanori; Shirakawa, Shinichi; Nagao, Tomoharu

A Genetic Programming Approach to Designing Convolutional Neural Network Architectures Technical Report

2017.

Links | BibTeX

32.

Chang, Hao

Skin cancer reorganization and classification with deep neural network Technical Report

2017.

Links | BibTeX

31.

Kani, Nagoor J; Elsheikh, Ahmed H

DR-RNN: A deep residual recurrent neural network for model reduction Technical Report

2017.

Links | BibTeX

2016

30.

Vu, Ngoc Thang; Adel, Heike; Gupta, Pankaj; Schütze, Hinrich

Combining Recurrent and Convolutional Neural Networks for Relation Classification Technical Report

2016.

Links | BibTeX

29.

Chen, Long; Zhang, Hanwang; Xiao, Jun; Nie, Liqiang; Shao, Jian; Liu, Wei; Chua, Tat-Seng

SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning Technical Report

2016.

Links | BibTeX

28.

Smithson, Sean C; Yang, Guang; Gross, Warren J; Meyer, Brett H

Neural networks designing neural networks - multi-objective hyper-parameter optimization Inproceedings

In: pp. 104, 2016.

Links | BibTeX

27.

Saxena, Shreyas; Verbeek, Jakob

Convolutional Neural Fabrics Inproceedings

In: pp. 4053-4061, 2016.

Links | BibTeX

26.

Loshchilov, Ilya; Hutter, Frank

CMA-ES for Hyperparameter Optimization of Deep Neural Networks Technical Report

, 2016.

Links | BibTeX

25.

Chen, Tianqi; Goodfellow, Ian J; Shlens, Jonathon

Net2Net - Accelerating Learning via Knowledge Transfer Inproceedings

In: 2016.

Links | BibTeX

24.

Chen, Justin

Combinatorially Generated Piecewise Activation Functions Technical Report

2016.

Links | BibTeX

2015

23.

Young, Steven R; Rose, Derek C; Karnowski, Thomas P; Lim, Seung-Hwan; Patton, Robert M

Optimizing deep learning hyper-parameters through an evolutionary algorithm Inproceedings

In: pp. 4:1-4:5, 2015.

Links | BibTeX

22.

Kulish, Vadym V; Malyi, Oleksandr I; Persson, Clas; Wu, Ping

Evaluation of Phosphorene as Anode Material for Na-ion Batteries from First Principles Technical Report

2015.

Links | BibTeX

2013

21.

Lopez, Pablo; Fernandez, David; Marin-Perez, Rafael; Jara, Antonio J; Gomez-Skarmeta, Antonio F

Scalable Oriented-Service Architecture for Heterogeneous and Ubiquitous IoT Domains Technical Report

2013.

Links | BibTeX

20.

Fister, Iztok; Jr., Iztok Fister; Yang, Xin-She; Brest, Janez

A comprehensive review of firefly algorithms Technical Report

2013.

Links | BibTeX

2012

19.

Anas, M; Javaid, N; Mahmood, A; Raza, S M; Qasim, U; Khan, Z A

Minimizing Electricity Theft using Smart Meters in AMI Technical Report

2012.

Links | BibTeX

18.

Snoek, Jasper; Larochelle, Hugo; Adams, Ryan P

Practical Bayesian Optimization of Machine Learning Algorithms Inproceedings

In: pp. 2960-2968, 2012.

Links | BibTeX

2009

17.

Stanley, Kenneth O; D'Ambrosio, David B; Gauci, Jason

A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks Journal Article

In: 15 (2), pp. 185-212, 2009.

Links | BibTeX

16.

Jaffres-Runser, Katia; Gorce, Jean-Marie; Comaniciu, Cristina

A multiobjective Tabu framework for the optimization and evaluation of wireless systems Technical Report

2009.

Links | BibTeX

2008

15.

Floreano, Dario; Dürr, Peter; Mattiussi, Claudio

Neuroevolution - from architectures to learning Journal Article

In: 1 (1), pp. 47-62, 2008.

Links | BibTeX

2005

14.

Czarnowski, Ireneusz; Jedrzejowicz, Piotr

An Agent-Based PLA for the Cascade Correlation Learning Architecture Inproceedings

In: pp. 197-202, 2005.

Links | BibTeX

2004

13.

Roy, N K; Potter, Walter D; Landau, D P

Designing Polymer Blends Using Neural Networks, Genetic Algorithms, and Markov Chains Journal Article

In: 20 (3), pp. 215-229, 2004.

Links | BibTeX

1994

12.

Angeline, Peter J; Saunders, Gregory M; Pollack, Jordan B

An evolutionary algorithm that constructs recurrent neural networks Journal Article

In: 5 (1), pp. 54-65, 1994.

Links | BibTeX

1990

11.

Kitano, Hiroaki

Designing Neural Networks Using Genetic Algorithms with Graph Generation System Journal Article

In: 4 (4), 1990.

Links | BibTeX

1988

10.

Tenorio, Manoel Fernando; Lee, Wei-Tsih

Self Organizing Neural Networks for the Identification Problem Inproceedings

In: pp. 57-64, 1988.

Links | BibTeX

0000

9.

Soniya,; Singh, Lotika; Paul, Sandeep

Hybrid evolutionary network architecture search (HyENAS) for convolution class of deep neural networks with applications Journal Article

In: Expert Systems, n/a (n/a), pp. e12690, 0000.

Abstract | Links | BibTeX

8.

Zhang, Bao Feng; Zhou, Guo Qiang

Control the number of skip-connects to improve robustness of the NAS algorithm Journal Article

In: IET Computer Vision, n/a (n/a), 0000.

Abstract | Links | BibTeX

7.

Shashirangana, Jithmi; Padmasiri, Heshan; Meedeniya, Dulani; Perera, Charith; Nayak, Soumya R; Nayak, Janmenjoy; Vimal, Shanmuganthan; Kadry, Seifidine

License plate recognition using neural architecture search for edge devices Journal Article

In: International Journal of Intelligent Systems, n/a (n/a), 0000.

Abstract | Links | BibTeX

6.

Wang, Xingbin; Zhao, Boyan; Hou, Rui; Awad, Amro; Tian, Zhihong; Meng, Dan

NASGuard: A Novel Accelerator Architecture for Robust Neural Architecture Search (NAS) Networks Inproceedings

In: 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA), 0000.

Links | BibTeX

5.

Zhang, Jianwei; Li, Dong; Wang, Lituan; Zhang, Lei

One-Shot Neural Architecture Search by Dynamically Pruning Supernet in Hierarchical Order Journal Article

In: International Journal of Neural Systems, 0000, (PMID: 34128778).

Abstract | Links | BibTeX

4.

Li, Xiao; Lei, Lin; Kuang, Gangyao

Multi-Modal Fusion Architecture Search for Land over Classification using Heterogeneous Remote Sensing Images Technical Report

0000.

Links | BibTeX

3.

Sapra, Dolly; Pimentel, Andy D.

Designing convolutional neural networks with constrained evolutionary piecemeal training Journal Article

In: Applied Intelligence , 0000.

Links | BibTeX

2.

Artin, Javad; Valizadeh, Amin; Ahmadi, Mohsen; Kumar, Sathish A. P.; Sharifi, Abbas

Presentation of a Novel Method for Prediction of Traffic with Climate Condition Based on Ensemble Learning of Neural Architecture Search (NAS) and Linear Regression Journal Article

In: Complexity, 0000.

Abstract | Links | BibTeX

1.

Gong, Yunhong; Sun, Yanan; Peng, Dezhong; Chen, Peng; Yan, Zhongtai; Yang, Ke

Analyze COVID-19 CT images based on evolutionary algorithm with dynamic searching space Journal Article

In: Complex & Intelligent Systems , 0000.

Links | BibTeX

1385 entries « 28 of 28 »