AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3273 entries « 50 of 66 »

2020

823.

Shao, Laëtitia; Moroz, Max; Eban, Elad; Movshovitz-Attias, Yair

Neighbourhood Distillation - On the benefits of non end-to-end distillation Technical Report

2020.

Links | BibTeX

822.

Yuan, Kun; Li, Quanquan; Chen, Dapeng; Zhou, Aojun; Yan, Junjie

Dynamic Graph - Learning Instance-aware Connectivity for Neural Networks Technical Report

2020.

Links | BibTeX

821.

Xu, Ju; Li, Mengzhang; Zhu, Zhanxing

Automatic Data Augmentation for 3D Medical Image Segmentation Proceedings Article

In: pp. 378-387, 2020.

Links | BibTeX

820.

Zhang, Tingting; Lan, Yushi; Song, Aiguo; Liu, Kun; Wang, Nan

Structural Combinatorial of Network Information System of Systems based on Evolutionary Optimization Method Technical Report

2020.

Links | BibTeX

819.

Gu, Yuchao; Liu, Yun; Yang, Yi; Wu, Yu-Huan; Lu, Shao-Ping; Cheng, Ming-Ming

DOTS - Decoupling Operation and Topology in Differentiable Architecture Search Proceedings Article

In: CVPR2021, 2020.

Links | BibTeX

818.

Wang, Haixia; Li, Rui; Chen, Xuan; Duan, Bin; Xiong, Linfewi; Yang, Xin; Fan, Haining; Ni, Dong

Remote Intelligent Assisted Diagnosis System for Hepatic Echinococcosis Technical Report

2020, ISBN: 978-3-030-60334-2.

Links | BibTeX

817.

Li, Qing; Zhang, Wei; Lv, Jinglei; Wu, Xia; Liu, Tianming

Neural Architecture Search for Optimization of Spatial-Temporal Brain Network Decomposition Technical Report

2020.

Links | BibTeX

816.

Ferianc, Martin; Fan, Hongxiang; Rodrigues, Miguel

VINNAS: Variational Inference-based Neural Network Architecture Search Technical Report

2020.

Links | BibTeX

815.

Liu, Zuhao; Wang, Huan; Zhang, Shaoting; Wang, Guotai; Qi, Jin

NAS-SCAM: Neural Architecture Search-Based Spatial and Channel Joint Attention Module for Nuclei Semantic Segmentation and Classification Technical Report

2020, ISBN: 978-3-030-59710-8.

Links | BibTeX

814.

Xiao, Bin; He, Naying; Wang, Qian; Xue, Zhong; Chen, Lei; Yan, Fuhua; Shi, Feng; Shen, Dinggang

Joint Appearance-Feature Domain Adaptation: Application to QSM Segmentation Transfer Technical Report

2020, ISBN: 978-3-030-59861-7.

Links | BibTeX

813.

Zhu, Yanming; Meijering, Erik

Neural Architecture Search for Microscopy Cell Segmentation Technical Report

Cham, 2020, ISBN: 978-3-030-59861-7.

Links | BibTeX

812.

Chen, Jie; Huang, Haozhe; Peng, Jian; Zhu, Jiawei; Chen, Li; Li, Wenbo; Sun, Binyu; Li, Haifeng

Convolution Neural Network Architecture Learning for Remote Sensing Scene Classification Technical Report

2020.

Links | BibTeX

811.

Evans, Nicholas; Plested, Jo; Gedeon, Tom

Exploring the Correlation Between Random Convolutional Architectures and the Trained Equivalent Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

810.

Zhu, Hui; An, Zhulin; Yang, Chuanguang; Hu, Xiaolong; Xu, Kaiqiang; Xu, Yongjun

Efficient Search for the Number of Channels for Convolutional Neural Networks Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

809.

Li, Nannan; Chen, Yaran; Ding, Zixiang; Zhao, Dongbin

Shift-Invariant Convolutional Network Search Proceedings Article

In: pp. 1-7, 2020.

Links | BibTeX

808.

Jing, Weipeng; Ren, Quanlin; Zhou, Jun; Song, Houbing

AutoRSISC - Automatic design of neural architecture for remote sensing image scene classification Journal Article

In: vol. 140, pp. 186-192, 2020.

Links | BibTeX

807.

Liu, Haiyang; Zhang, Cheng

Reinforcement Learning based Neural Architecture Search for Audio Tagging Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

806.

Jing, Kun; Xu, Jungang; Xu, Hui

NASABN - A Neural Architecture Search Framework for Attention-Based Networks Proceedings Article

In: pp. 1-7, 2020.

Links | BibTeX

805.

Nakai, Kohei; Matsubara, Takashi; Uehara, Kuniaki

Att-DARTS - Differentiable Neural Architecture Search for Attention Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

804.

Hu, Kai; Shuo, Tian; Guo, Shasha; Li, Nan; Luo, Li; Wang, Lei

Recurrent Neural Architecture Search based on Randomness-Enhanced Tabu Algorithm Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

803.

Cioflan, Cristian; Timofte, Radu

MS-RANAS - Multi-Scale Resource-Aware Neural Architecture Search Technical Report

2020.

Links | BibTeX

802.

Zheng, Xinyue; Wang, Peng; Wang, Qigang; Shi, Zhongchao

Disentangled Neural Architecture Search Technical Report

2020.

Links | BibTeX

801.

Tyagi, Anjul; Xie, Cong; Mueller, Klaus

Visual Steering for One-Shot Deep Neural Network Synthesis Technical Report

2020.

Links | BibTeX

800.

Zhang, Yongqi

Autokge: towards automated knowledge graph embedding Technical Report

2020.

Links | BibTeX

799.

Gao, Peng; Hori, Chiori; Geng, Shijie; Hori, Takaaki; Roux, Jonathan Le

Multi-Pass Transformer for Machine Translation Technical Report

2020.

Links | BibTeX

798.

Zhu, Wei; Qiu, Xipeng; Ni, Yuan; Xie, Guotong

AutoRC - Improving BERT Based Relation Classification Models via Architecture Search Technical Report

2020.

Links | BibTeX

797.

Cooper, Alexis; Zhou, Xin; Heidbrink, Scott; Dunlavy, Daniel M

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models Technical Report

2020.

Links | BibTeX

796.

Shi, Min; Wilson, David A; Zhu, Xingquan; Huang, Yu; Zhuang, Yuan; Liu, Jianxun; Tang, Yufei

Evolutionary Architecture Search for Graph Neural Networks Technical Report

2020.

Links | BibTeX

795.

Achararit, Paniti; Hanif, Muhammad Abdullah; Putra, Rachmad Vidya Wicaksana; Shafique, Muhammad; Hara-Azumi, Yuko

APNAS - Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators Journal Article

In: vol. 8, pp. 165319-165334, 2020.

Links | BibTeX

794.

Zhao, Yiren; Wang, Duo; Bates, Daniel; Mullins, Robert D; Jamnik, Mateja; Liò, Pietro

Learned Low Precision Graph Neural Networks Technical Report

2020.

Links | BibTeX

793.

Machida, Kengo; Uto, Kuniaki; Shinoda, Koichi; Suzuki, Taiji

Neural Architecture Search Using Stable Rank of Convolutional Layers Technical Report

2020.

Links | BibTeX

792.

Yuan, Zhihang; Liu, Xin; Wu, Bingzhe; Sun, Guangyu

ENAS4D - Efficient Multi-stage CNN Architecture Search for Dynamic Inference Technical Report

2020.

Links | BibTeX

791.

Jing, Weipeng; Lin, Jingbo; Wang, Huihui

Building NAS: Automatic designation of efficient neural architectures for building extraction in high-resolution aerial images Technical Report

2020, ISSN: 0262-8856.

Links | BibTeX

790.

Ding, Zixiang; Chen, Yaran; Li, Nannan; Zhao, Dongbin

Faster Gradient-based NAS Pipeline Combining Broad Scalable Architecture with Confident Learning Rate Technical Report

2020.

Links | BibTeX

789.

Ortiz, Marc; Scheidegger, Florian; Casas, Marc; Malossi, Cristiano; Ayguadé, Eduard

Generating Efficient DNN-Ensembles with Evolutionary Computation Technical Report

2020.

Links | BibTeX

788.

Yang, Zhaohui; Wang, Yunhe; Han, Kai; Xu, Chunjing; Xu, Chao; Tao, Dacheng; Xu, Chang

Searching for Low-Bit Weights in Quantized Neural Networks Proceedings Article

In: 2020.

Links | BibTeX

787.

Broni-Bediako, Clifford; Murata, Yuki; Mormille, Luiz Henrique; Atsumi, Masayasu

Evolutionary NAS with Gene Expression Programming of Cellular Encoding Technical Report

2020.

Links | BibTeX

786.

Ji, Yuanfeng; Zhang, Ruimao; Li, Zhen; Ren, Jiamin; Zhang, Shaoting; Luo, Ping

UXNet - Searching Multi-level Feature Aggregation for 3D Medical Image Segmentation Proceedings Article

In: pp. 346-356, 2020.

Links | BibTeX

785.

Wang, Ching-Chen; Chiu, Ching-Te; Chang, Jheng-Yi

EfficientNet-eLite - Extremely Lightweight and Efficient CNN Models for Edge Devices by Network Candidate Search Technical Report

2020.

Links | BibTeX

784.

Niu, Wei; Kong, Zhenglun; Yuan, Geng; Jiang, Weiwen; Guan, Jiexiong; Ding, Caiwen; Zhao, Pu; Liu, Sijia; Ren, Bin; Wang, Yanzhi

Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization Technical Report

2020.

Links | BibTeX

783.

Choi, Kanghyun; Hong, Deokki; Yoon, Hojae; Yu, Joonsang; Kim, Youngsok; Lee, Jinho

DANCE - Differentiable Accelerator/Network Co-Exploration Technical Report

2020.

Links | BibTeX

782.

Tan, Hao; Cheng, Ran; Huang, Shihua; He, Cheng; Qiu, Changxiao; Yang, Fan; Luo, Ping

RelativeNAS - Relative Neural Architecture Search via Slow-Fast Learning Proceedings Article

In: 2020.

Links | BibTeX

781.

Colangelo, Philip; Segal, Oren; Speicher, Alexander; Margala, Martin

AutoML for Multilayer Perceptron and FPGA Co-design Technical Report

2020.

Links | BibTeX

780.

Zhu, Hangyu; Zhang, Haoyu; Jin, Yaochu

From Federated Learning to Federated Neural Architecture Search - A Survey Technical Report

2020.

Links | BibTeX

779.

Colombo, Nicolò; Gao, Yang

Disentangling Neural Architectures and Weights - A Case Study in Supervised Classification Technical Report

2020.

Links | BibTeX

778.

Wang, Yuke; Feng, Boyuan; Peng, Xueqiao; Ding, Yufei

Optimizing Convolutional Neural Network Architecture via Information Field Technical Report

2020.

Links | BibTeX

777.

Chen, Hanlin; Zhuo, Li'an; Zhang, Baochang; Zheng, Xiawu; Liu, Jianzhuang; Ji, Rongrong; Doermann, David S; Guo, Guodong

Binarized Neural Architecture Search for Efficient Object Recognition Technical Report

2020.

Links | BibTeX

776.

Zhao, Shen; Potter, Lee C; Ahmad, Rizwan

Calibrationless MRI Reconstruction with a Plug-in Denoiser Technical Report

2020.

Links | BibTeX

775.

Zhang, Bo; Li, WenFeng; Li, Qingyuan; Zhuang, Weiji; Chu, Xiangxiang; Wang, Yujun

AutoKWS - Keyword Spotting with Differentiable Architecture Search Technical Report

2020.

Links | BibTeX

774.

Liu, Yang; Qin, Zhenyue; Anwar, Saeed; Caldwell, Sabrina B; Gedeon, Tom

Are Deep Neural Architectures Losing Information? Invertibility is Indispensable Proceedings Article

In: pp. 172-184, 2020.

Links | BibTeX

3273 entries « 50 of 66 »