AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1646 entries « 33 of 33 »

2017

46.

Sun, Yanan; Xue, Bing; Zhang, Mengjie

A Particle Swarm Optimization-based Flexible Convolutional Auto-Encoder for Image Classification Technical Report

, 2017.

Links | BibTeX

45.

Negrinho, Renato; Gordon, Geoffrey J

DeepArchitect - Automatically Designing and Training Deep Architectures Technical Report

, 2017.

Links | BibTeX

44.

Real, Esteban; Moore, Sherry; Selle, Andrew; Saxena, Saurabh; Suematsu, Yutaka Leon; Tan, Jie; Le, Quoc V; Kurakin, Alexey

Large-Scale Evolution of Image Classifiers Inproceedings

In: pp. 2902-2911, 2017.

Links | BibTeX

43.

Bello, Irwan; Zoph, Barret; Vasudevan, Vijay; Le, Quoc V

Neural Optimizer Search with Reinforcement Learning Inproceedings

In: pp. 459-468, 2017.

Links | BibTeX

42.

Wistuba, Martin

Finding Competitive Network Architectures Within a Day Using UCT Technical Report

, 2017.

Links | BibTeX

41.

Cortes, Corinna; Gonzalvo, Xavier; Kuznetsov, Vitaly; Mohri, Mehryar; Yang, Scott

AdaNet - Adaptive Structural Learning of Artificial Neural Networks Inproceedings

In: pp. 874-883, 2017.

Links | BibTeX

40.

Baker, Bowen; Gupta, Otkrist; Naik, Nikhil; Raskar, Ramesh

Designing Neural Network Architectures using Reinforcement Learning Inproceedings

In: 2017.

Links | BibTeX

39.

Klein, Aaron; Falkner, Stefan; Springenberg, Jost Tobias; Hutter, Frank

Learning Curve Prediction with Bayesian Neural Networks Inproceedings

In: 2017.

Links | BibTeX

38.

Li, Lisha; Jamieson, Kevin G; DeSalvo, Giulia; Rostamizadeh, Afshin; Talwalkar, Ameet

Hyperband - A Novel Bandit-Based Approach to Hyperparameter Optimization Journal Article

In: 18 , pp. 185:1-185:52, 2017.

Links | BibTeX

2016

37.

Vu, Ngoc Thang; Adel, Heike; Gupta, Pankaj; Schütze, Hinrich

Combining Recurrent and Convolutional Neural Networks for Relation Classification Technical Report

2016.

Links | BibTeX

36.

Chen, Long; Zhang, Hanwang; Xiao, Jun; Nie, Liqiang; Shao, Jian; Liu, Wei; Chua, Tat-Seng

SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning Technical Report

2016.

Links | BibTeX

35.

Smithson, Sean C; Yang, Guang; Gross, Warren J; Meyer, Brett H

Neural networks designing neural networks - multi-objective hyper-parameter optimization Inproceedings

In: pp. 104, 2016.

Links | BibTeX

34.

Saxena, Shreyas; Verbeek, Jakob

Convolutional Neural Fabrics Inproceedings

In: pp. 4053-4061, 2016.

Links | BibTeX

33.

Loshchilov, Ilya; Hutter, Frank

CMA-ES for Hyperparameter Optimization of Deep Neural Networks Technical Report

, 2016.

Links | BibTeX

32.

Chen, Tianqi; Goodfellow, Ian J; Shlens, Jonathon

Net2Net - Accelerating Learning via Knowledge Transfer Inproceedings

In: 2016.

Links | BibTeX

31.

Chen, Justin

Combinatorially Generated Piecewise Activation Functions Technical Report

2016.

Links | BibTeX

2015

30.

Kulish, Vadym V; Malyi, Oleksandr I; Persson, Clas; Wu, Ping

Evaluation of Phosphorene as Anode Material for Na-ion Batteries from First Principles Technical Report

2015.

Links | BibTeX

29.

Young, Steven R; Rose, Derek C; Karnowski, Thomas P; Lim, Seung-Hwan; Patton, Robert M

Optimizing deep learning hyper-parameters through an evolutionary algorithm Inproceedings

In: pp. 4:1-4:5, 2015.

Links | BibTeX

2013

28.

Lopez, Pablo; Fernandez, David; Marin-Perez, Rafael; Jara, Antonio J; Gomez-Skarmeta, Antonio F

Scalable Oriented-Service Architecture for Heterogeneous and Ubiquitous IoT Domains Technical Report

2013.

Links | BibTeX

27.

Fister, Iztok; Jr., Iztok Fister; Yang, Xin-She; Brest, Janez

A comprehensive review of firefly algorithms Technical Report

2013.

Links | BibTeX

2012

26.

Anas, M; Javaid, N; Mahmood, A; Raza, S M; Qasim, U; Khan, Z A

Minimizing Electricity Theft using Smart Meters in AMI Technical Report

2012.

Links | BibTeX

25.

Snoek, Jasper; Larochelle, Hugo; Adams, Ryan P

Practical Bayesian Optimization of Machine Learning Algorithms Inproceedings

In: pp. 2960-2968, 2012.

Links | BibTeX

2009

24.

Jaffres-Runser, Katia; Gorce, Jean-Marie; Comaniciu, Cristina

A multiobjective Tabu framework for the optimization and evaluation of wireless systems Technical Report

2009.

Links | BibTeX

23.

Stanley, Kenneth O; D'Ambrosio, David B; Gauci, Jason

A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks Journal Article

In: 15 (2), pp. 185-212, 2009.

Links | BibTeX

2008

22.

Floreano, Dario; Dürr, Peter; Mattiussi, Claudio

Neuroevolution - from architectures to learning Journal Article

In: 1 (1), pp. 47-62, 2008.

Links | BibTeX

2005

21.

Czarnowski, Ireneusz; Jedrzejowicz, Piotr

An Agent-Based PLA for the Cascade Correlation Learning Architecture Inproceedings

In: pp. 197-202, 2005.

Links | BibTeX

2004

20.

Roy, N K; Potter, Walter D; Landau, D P

Designing Polymer Blends Using Neural Networks, Genetic Algorithms, and Markov Chains Journal Article

In: 20 (3), pp. 215-229, 2004.

Links | BibTeX

1994

19.

Angeline, Peter J; Saunders, Gregory M; Pollack, Jordan B

An evolutionary algorithm that constructs recurrent neural networks Journal Article

In: 5 (1), pp. 54-65, 1994.

Links | BibTeX

1990

18.

Kitano, Hiroaki

Designing Neural Networks Using Genetic Algorithms with Graph Generation System Journal Article

In: 4 (4), 1990.

Links | BibTeX

1988

17.

Tenorio, Manoel Fernando; Lee, Wei-Tsih

Self Organizing Neural Networks for the Identification Problem Inproceedings

In: pp. 57-64, 1988.

Links | BibTeX

0000

16.

Soniya,; Singh, Lotika; Paul, Sandeep

Hybrid evolutionary network architecture search (HyENAS) for convolution class of deep neural networks with applications Journal Article

In: Expert Systems, n/a (n/a), pp. e12690, 0000.

Abstract | Links | BibTeX

15.

Zhang, Bao Feng; Zhou, Guo Qiang

Control the number of skip-connects to improve robustness of the NAS algorithm Journal Article

In: IET Computer Vision, n/a (n/a), 0000.

Abstract | Links | BibTeX

14.

Shashirangana, Jithmi; Padmasiri, Heshan; Meedeniya, Dulani; Perera, Charith; Nayak, Soumya R; Nayak, Janmenjoy; Vimal, Shanmuganthan; Kadry, Seifidine

License plate recognition using neural architecture search for edge devices Journal Article

In: International Journal of Intelligent Systems, n/a (n/a), 0000.

Abstract | Links | BibTeX

13.

Wang, Xingbin; Zhao, Boyan; Hou, Rui; Awad, Amro; Tian, Zhihong; Meng, Dan

NASGuard: A Novel Accelerator Architecture for Robust Neural Architecture Search (NAS) Networks Inproceedings

In: 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA), 0000.

Links | BibTeX

12.

Zhang, Jianwei; Li, Dong; Wang, Lituan; Zhang, Lei

One-Shot Neural Architecture Search by Dynamically Pruning Supernet in Hierarchical Order Journal Article

In: International Journal of Neural Systems, 0000, (PMID: 34128778).

Abstract | Links | BibTeX

11.

Li, Xiao; Lei, Lin; Kuang, Gangyao

Multi-Modal Fusion Architecture Search for Land over Classification using Heterogeneous Remote Sensing Images Technical Report

0000.

Links | BibTeX

10.

Sapra, Dolly; Pimentel, Andy D.

Designing convolutional neural networks with constrained evolutionary piecemeal training Journal Article

In: Applied Intelligence , 0000.

Links | BibTeX

9.

Artin, Javad; Valizadeh, Amin; Ahmadi, Mohsen; Kumar, Sathish A. P.; Sharifi, Abbas

Presentation of a Novel Method for Prediction of Traffic with Climate Condition Based on Ensemble Learning of Neural Architecture Search (NAS) and Linear Regression Journal Article

In: Complexity, 0000.

Abstract | Links | BibTeX

8.

Gong, Yunhong; Sun, Yanan; Peng, Dezhong; Chen, Peng; Yan, Zhongtai; Yang, Ke

Analyze COVID-19 CT images based on evolutionary algorithm with dynamic searching space Journal Article

In: Complex & Intelligent Systems , 0000.

Links | BibTeX

7.

Cheng, Hsin-Pai

Efficient and Generalizable Neural Architecture Search for Visual Recognition PhD Thesis

0000.

Links | BibTeX

6.

Zhu, Xunyu; Li, Jian; Liu, Yong; Liao, Jun; Wang, Weiping

Operation-level Progressive Differentiable Architecture Search Technical Report

0000.

Links | BibTeX

5.

Huang, Sian-Yao; Chu, Wei-Ta

OSNASLib: One-Shot NAS Library Inproceedings

In: ICCV 2021 Workshop on Neural Architectures: Past, Present and Future, 0000.

Links | BibTeX

4.

Madhu, G.; Bharadwaj, B. Lalith; Boddeda, Rohit; Vardhan, Sai; Kautish, K. Sandeep; Alnowibet, Khalid; Alrasheedi, Adel F.; Mohamed, Ali Wagdy

Deep Stacked Ensemble Learning Model for COVID-19 Classification Technical Report

0000.

Links | BibTeX

3.

Kandukuri, Nikhil; Sakhtivel, Sangeetha; Xie, Pengtao

Neural Architecture Search For Skin Cancer Detection Technical Report

0000.

Links | BibTeX

2.

Jiang, Yingying; Gan, Zhuoxin; Lin, Ke; A, Yong

AttNAS: Searching Attentions for Lightweight Semantic Segmentation Inproceedings

In: British Machine Vision Conference (BMVC) 2021, 0000.

Links | BibTeX

1.

Loni, Mohammad; Mousavi, Hamid; Riazati, Mohammad; Daneshtalab, Masoud; Sjödin, Mikael

TAS : Ternarized Neural Architecture Search for Resource-Constrained Edge Devices Inproceedings

In: Design, Automation and Test in Europe ConferenceDesign, Automation and Test in Europe Conference (DATE) 2022, ANTWERP, BELGIUM :, 0000.

Abstract | Links | BibTeX

1646 entries « 33 of 33 »