AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4564 entries « 78 of 92 »

2020

714.

Devaguptapu, Chaitanya; Agarwal, Devansh; Mittal, Gaurav; Balasubramanian, Vineeth N

An Empirical Study on the Robustness of NAS based Architectures Technical Report

2020.

Links | BibTeX

713.

Wang, Xiaoxing; Xue, Chao; Yan, Junchi; Yang, Xiaokang; Hu, Yonggang; Sun, Kewei

MergeNAS - Merge Operations into One for Differentiable Architecture Search Proceedings Article

In: pp. 3065-3072, 2020.

Links | BibTeX

712.

Hong, Weijun; Li, Guilin; Zhang, Weinan; Tang, Ruiming; Wang, Yunhe; Li, Zhenguo; Yu, Yong

DropNAS - Grouped Operation Dropout for Differentiable Architecture Search Proceedings Article

In: pp. 2326-2332, 2020.

Links | BibTeX

711.

Kotyan, Shashank; Vargas, Danilo Vasconcellos

Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article

In: pp. 135-136, 2020.

Links | BibTeX

710.

Nekrasov, Vladimir; Chen, Hao; Shen, Chunhua; Reid, Ian D

Architecture Search of Dynamic Cells for Semantic Video Segmentation Proceedings Article

In: pp. 1959-1968, 2020.

Links | BibTeX

709.

Guo, Yong; Chen, Yaofo; Zheng, Yin; Zhao, Peilin; Chen, Jian; Huang, Junzhou; Tan, Mingkui

Breaking the Curse of Space Explosion - Towards Efficient NAS with Curriculum Search Proceedings Article

In: pp. 3822-3831, 2020.

Links | BibTeX

708.

Song, Qingquan; Cheng, Dehua; Zhou, Hanning; Yang, Jiyan; Tian, Yuandong; Hu, Xia

Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction Proceedings Article

In: pp. 945-955, 2020.

Links | BibTeX

707.

Yan, Xingang; Jiang, Weiwen; Shi, Yiyu; Zhuo, Cheng

MS-NAS - Multi-scale Neural Architecture Search for Medical Image Segmentation Proceedings Article

In: pp. 388-397, 2020.

Links | BibTeX

706.

Ferianc, Martin; Fan, Hongxiang; Rodrigues, Miguel

VINNAS - Variational Inference-based Neural Network Architecture Search Technical Report

2020.

Links | BibTeX

705.

Peng, Yige; Bi, Lei; Fulham, Michael J; Feng, Dagan; Kim, Jinman

Multi-modality Information Fusion for Radiomics-Based Neural Architecture Search Proceedings Article

In: pp. 763-771, 2020.

Links | BibTeX

704.

Li, Wei; Gong, Shaogang; Zhu, Xiatian

Neural Graph Embedding for Neural Architecture Search Proceedings Article

In: pp. 4707-4714, 2020.

Links | BibTeX

703.

Herron, Emily J; Young, Steven R; Potok, Thomas E

Ensembles of Networks Produced from Neural Architecture Search Proceedings Article

In: pp. 223-234, 2020.

Links | BibTeX

702.

White, Colin; Neiswanger, Willie; Nolen, Sam; Savani, Yash

A Study on Encodings for Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

701.

Luo, Renqian; Tan, Xu; Wang, Rui; Qin, Tao; Chen, Enhong; Liu, Tie-Yan

Neural Architecture Search with GBDT Technical Report

2020.

Links | BibTeX

700.

Cheng, Hsin-Pai; Zhang, Tunhou; Li, Shiyu; Yan, Feng; Li, Meng; Chandra, Vikas; Li, Hai Helen; Chen, Yiran

NASGEM - Neural Architecture Search via Graph Embedding Method Technical Report

2020.

Links | BibTeX

699.

Waris, Faisal; Reynolds, Robert G

Neuro-evolution using game-driven cultural algorithms Proceedings Article

In: pp. 1857-1865, 2020.

Links | BibTeX

698.

Kobayashi, Masayuki; Nagao, Tomoharu

An evolution-based approach for efficient differentiable architecture search Proceedings Article

In: pp. 131-132, 2020.

Links | BibTeX

697.

Souquet, Léo; Shvai, Nadiya; Llanza, Arcadi; Nakib, Amir

HyperFDA: A Bi-Level Optimization Approach to Neural Architecture Search and Hyperparameters' Optimization via Fractal Decomposition-Based Algorithm Technical Report

Cancún, Mexico, 2020, ISBN: 9781450371278.

Links | BibTeX

696.

Kotyan, Shashank; Vargas, Danilo Vasconcellos

Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article

In: pp. 135-136, 2020.

Links | BibTeX

695.

Barnes, Dustin K; Davis, Sara R; Hand, Emily M; Louis, Sushil J

A first step toward incremental evolution of convolutional neural networks Proceedings Article

In: pp. 115-116, 2020.

Links | BibTeX

694.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

693.

Lee, Royson; Dudziak, Lukasz; Abdelfattah, Mohamed S; Venieris, Stylianos I; Kim, Hyeji; Wen, Hongkai; Lane, Nicholas D

Journey Towards Tiny Perceptual Super-Resolution Proceedings Article

In: pp. 85-102, 2020.

Links | BibTeX

692.

Cho, Minsu; Soltani, Mohammadreza; Hegde, Chinmay

Hyperparameter Optimization in Neural Networks via Structured Sparse Recovery Technical Report

2020.

Links | BibTeX

691.

Bi, Kaifeng; Xie, Lingxi; Chen, Xin; Wei, Longhui; Tian, Qi

GOLD-NAS - Gradual, One-Level, Differentiable Technical Report

2020.

Links | BibTeX

690.

Tian, Yunjie; Liu, Chang; Xie, Lingxi; Jiao, Jianbin; Ye, Qixiang

Discretization-Aware Architecture Search Technical Report

2020.

Links | BibTeX

689.

Vertechi, Pietro; Frosini, Patrizio; Bergomi, Mattia G

Parametric machines - a fresh approach to architecture search Technical Report

2020.

Links | BibTeX

688.

Wang, Chunnan; Wang, Hongzhi; Feng, Guocheng; Geng, Fei

Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation Technical Report

2020.

Links | BibTeX

687.

Wang, Bin; Xue, Bing; Zhang, Mengjie

Surrogate-assisted Particle Swarm Optimisation for Evolving Variable-length Transferable Blocks for Image Classification Journal Article

In: IEEE transactions on Neural Networks and Learning Systems, vol. abs/2007.01556, pp. 1-14, 2020.

Links | BibTeX

686.

Wang, Jiaxing; Wu, Jiaxiang; Bai, Haoli; Cheng, Jian

M-NAS - Meta Neural Architecture Search Proceedings Article

In: pp. 6186-6193, 2020.

Links | BibTeX

685.

Wang, Junjue; Zhong, Yanfei; Zheng, Zhuo; Ma, Ailong; Zhang, Liangpei

RSNet: The Search for Remote Sensing Deep Neural Networks in Recognition Tasks Technical Report

2020.

Links | BibTeX

684.

Zhou, Pan; Xiong, Caiming; Socher, Richard; Hoi, Steven Chu-Hong

Theory-Inspired Path-Regularized Differential Network Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

683.

Li, Yawei; Li, Wen; Danelljan, Martin; Zhang, Kai; Gu, Shuhang; Gool, Luc Van; Timofte, Radu

The Heterogeneity Hypothesis - Finding Layer-Wise Dissimilated Network Architecture Technical Report

2020.

Links | BibTeX

682.

Trillos, Nicolás García; Morales, Javier

Semi-discrete optimization through semi-discrete optimal transport - a framework for neural architecture search Technical Report

2020.

Links | BibTeX

681.

Trillos, Nicolás García; Morales, Felix; Morales, Javier

Traditional and accelerated gradient descent for neural architecture search Technical Report

2020.

Links | BibTeX

680.

Kügler, David; Uecker, Marc; Kuijper, Arjan; Mukhopadhyay, Anirban

AutoSNAP - Automatically Learning Neural Architectures for Instrument Pose Estimation Proceedings Article

In: pp. 375-384, 2020.

Links | BibTeX

679.

Li, Ting; Zhang, Junbo; Bao, Kainan; Liang, Yuxuan; Li, Yexin; Zheng, Yu

AutoST - Efficient Neural Architecture Search for Spatio-Temporal Prediction Proceedings Article

In: pp. 794-802, 2020.

Links | BibTeX

678.

O'Neill, Damien; Xue, Bing; Zhang, Mengjie

Neural architecture search for sparse DenseNets with dynamic compression Proceedings Article

In: pp. 386-394, 2020.

Links | BibTeX

677.

Zhou, Peng; Xie, Lingxi; Zhang, Xiaopeng; Ni, Bingbing; Tian, Qi

Searching towards Class-Aware Generators for Conditional Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

676.

Lin, Ming; Chen, Hesen; Sun, Xiuyu; Qian, Qi; Li, Hao; Jin, Rong

Neural Architecture Design for GPU-Efficient Networks Technical Report

2020.

Links | BibTeX

675.

Süzen, Mehmet

Equivalence in Deep Neural Networks via Conjugate Matrix Ensembles Technical Report

2020.

Links | BibTeX

674.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-PyTorch Tabular - Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Technical Report

2020.

Links | BibTeX

673.

Panda, Rameswar; Merler, Michele; Jaiswal, Mayoore; Wu, Hui; Ramakrishnan, Kandan; Finkler, Ulrich; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

NASTransfer - Analyzing Architecture Transferability in Large Scale Neural Architecture Search Technical Report

2020.

Links | BibTeX

672.

Fang, Jiemin; Sun, Yuzhu; Zhang, Qian; Peng, Kangjian; Li, Yuan; Liu, Wenyu; Wang, Xinggang

FNA++ - Fast Network Adaptation via Parameter Remapping and Architecture Search Technical Report

2020.

Links | BibTeX

671.

Janik, Romuald A; Nowak, Aleksandra

Neural networks adapting to datasets - learning network size and topology Technical Report

2020.

Links | BibTeX

670.

Li, Yuening; Chen, Zhengzhang; Zha, Daochen; Zhou, Kaixiong; Jin, Haifeng; Chen, Haifeng; Hu, Xia

AutoOD - Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning Technical Report

2020.

Links | BibTeX

669.

Yang, Jianhua; Lu, Beiling; Xiao, Liang; Kang, Xiangui; Shi, Yunqing

Reinforcement Learning Aided Network Architecture Generation for JPEG Image Steganalysis Proceedings Article

In: pp. 23-32, 2020.

Links | BibTeX

668.

Rakhshani, Hojjat; Fawaz, Hassan Ismail; Idoumghar, Lhassane; Forestier, Germain; Lepagnot, Julien; Weber, Jonathan; Brévilliers, Mathieu; Muller, Pierre-Alain

Neural Architecture Search for Time Series Classification Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

667.

Yu, Hongyuan; Peng, Houwen

Cyclic Differentiable Architecture Search Technical Report

2020.

Links | BibTeX

666.

Singh, Ishika; Zhou, Haoyi; Yang, Kunlin; Ding, Meng; Lin, Bill; Xie, Pengtao

Differentially-private Federated Neural Architecture Search Technical Report

2020.

Links | BibTeX

665.

Chen, Xiangning; Wang, Ruochen; Cheng, Minhao; Tang, Xiaocheng; Hsieh, Cho-Jui

DrNAS - Dirichlet Neural Architecture Search Technical Report

2020.

Links | BibTeX

4564 entries « 78 of 92 »