AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3980 entries « 70 of 80 »

2020

530.

Guo, Yong; Luo, Yongsheng; He, Zhenhao; Huang, Jin; Chen, Jian

Hierarchical Neural Architecture Search for Single Image Super-Resolution Journal Article

In: vol. 27, pp. 1255-1259, 2020.

Links | BibTeX

529.

Yu, Kaicheng; Ranftl, René; Salzmann, Mathieu

How to Train Your Super-Net - An Analysis of Training Heuristics in Weight-Sharing NAS Technical Report

2020.

Links | BibTeX

528.

Real, Esteban; Liang, Chen; So, David R; Le, Quoc V

AutoML-Zero - Evolving Machine Learning Algorithms From Scratch Proceedings Article

In: pp. 8007-8019, 2020.

Links | BibTeX

527.

Gupta, Suyog; Akin, Berkin

Accelerator-aware Neural Network Design using AutoML Technical Report

2020.

Links | BibTeX

526.

Zhu, Hangyu; Jin, Yaochu

Real-time Federated Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

525.

Bulat, Adrian; Martínez, Brais; Tzimiropoulos, Georgios

BATS - Binary ArchitecTure Search Proceedings Article

In: pp. 309-325, 2020.

Links | BibTeX

524.

XuZhang,; ChenjunZhou,; Gu, Bo

ADWPNAS - Architecture-Driven Weight Prediction for Neural Architecture Search Technical Report

2020.

Links | BibTeX

523.

Hu, Yutao; Jiang, Xiaolong; Liu, Xuhui; Zhang, Baochang; Han, Jungong; Cao, Xianbin; Doermann, David S

NAS-Count - Counting-by-Density with Neural Architecture Search Proceedings Article

In: pp. 747-766, 2020.

Links | BibTeX

522.

Chen, Kefan; Pang, Wei

ImmuNetNAS - An Immune-network approach for searching Convolutional Neural Network Architectures Technical Report

2020.

Links | BibTeX

521.

Meng, Rang; Chen, Weijie; Xie, Di; Zhang, Yuan; Pu, Shiliang

Neural Inheritance Relation Guided One-Shot Layer Assignment Search Proceedings Article

In: pp. 5158-5165, 2020.

Links | BibTeX

520.

Shu, Han; Wang, Yunhe

Automatically Searching for U-Net Image Translator Architecture Technical Report

2020.

Links | BibTeX

519.

Zhao, Xiangyu; Wang, Chong; Chen, Ming; Zheng, Xudong; Liu, Xiaobing; Tang, Jiliang

AutoEmb - Automated Embedding Dimensionality Search in Streaming Recommendations Technical Report

2020.

Links | BibTeX

518.

Hong, SeulGi; Kim, Donghyun; Choi, Min-Kook

Memory-Efficient Models for Scene Text Recognition via Neural Architecture Search Proceedings Article

In: pp. 183-191, 2020.

Links | BibTeX

517.

Fernández-Marqués, Javier; Whatmough, Paul N; Mundy, Andrew; Mattina, Matthew

Searching for Winograd-aware Quantized Networks Proceedings Article

In: 2020.

Links | BibTeX

516.

Luo, Renqian; Tan, Xu; Wang, Rui; Qin, Tao; Chen, Enhong; Liu, Tie-Yan

Semi-Supervised Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

515.

Yan, Jiangpeng; Chen, Shou; Zhang, Yongbing; Li, Xiu

Neural Architecture Search for compressed sensing Magnetic Resonance image reconstruction Journal Article

In: vol. 85, pp. 101784, 2020.

Links | BibTeX

514.

Hu, Shoukang; Xie, Sirui; Zheng, Hehui; Liu, Chunxiao; Shi, Jianping; Liu, Xunying; Lin, Dahua

DSNAS - Direct Neural Architecture Search Without Parameter Retraining Proceedings Article

In: pp. 12081-12089, 2020.

Links | BibTeX

513.

Li, Xudong; Hu, Yang; Zheng, Jianhua; Li, Mingtao

Neural Architecture Search For Fault Diagnosis Technical Report

2020.

Links | BibTeX

512.

Kim, Dahyun; Singh, Kunal Pratap; Choi, Jonghyun

Learning Architectures for Binary Networks Proceedings Article

In: pp. 575-591, 2020.

Links | BibTeX

511.

Xu, Mengwei; Zhao, Yuxin; Bian, Kaigui; Huang, Gang; Mei, Qiaozhu; Liu, Xuanzhe

Neural Architecture Search over Decentralized Data Technical Report

2020.

Links | BibTeX

510.

Garciarena, Unai; Mendiburu, Alexander; Santana, Roberto

Automatic Structural Search for Multi-task Learning VALPs Proceedings Article

In: pp. 25-36, 2020.

Links | BibTeX

509.

Alletto, Stefano; Huang, Shenyang; François-Lavet, Vincent; Nakata, Yohei; Rabusseau, Guillaume

RandomNet - Towards Fully Automatic Neural Architecture Design for Multimodal Learning Technical Report

2020.

Links | BibTeX

508.

Eilertsen, Gabriel; Jönsson, Daniel; Ropinski, Timo; Unger, Jonas; Ynnerman, Anders

Classifying the Classifier - Dissecting the Weight Space of Neural Networks Proceedings Article

In: pp. 1119-1126, 2020.

Links | BibTeX

507.

Chen, Xiangning; Hsieh, Cho-Jui

Stabilizing Differentiable Architecture Search via Perturbation-based Regularization Proceedings Article

In: pp. 1554-1565, 2020.

Links | BibTeX

506.

Abdelfattah, Mohamed S; Dudziak, Lukasz; Chau, Thomas C P; Lee, Royson; Kim, Hyeji; Lane, Nicholas D

Best of Both Worlds - AutoML Codesign of a CNN and its Hardware Accelerator Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

505.

Antorán, Javier; Allingham, James Urquhart; Hernández-Lobato, José Miguel

Variational Depth Search in ResNets Technical Report

2020.

Links | BibTeX

504.

Yang, Lei; Yan, Zheyu; Li, Meng; Kwon, Hyoukjun; Lai, Liangzhen; Krishna, Tushar; Chandra, Vikas; Jiang, Weiwen; Shi, Yiyu

Co-Exploration of Neural Architectures and Heterogeneous ASIC Accelerator Designs Targeting Multiple Tasks Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

503.

Basha, Shabbeer S H; Vinakota, Sravan Kumar; Dubey, Shiv Ram; Pulabaigari, Viswanath; Mukherjee, Snehasis

AutoFCL - Automatically Tuning Fully Connected Layers for Transfer Learning Technical Report

2020.

Links | BibTeX

502.

Bian, Song; Jiang, Weiwen; Lu, Qing; Shi, Yiyu; Sato, Takashi

NASS - Optimizing Secure Inference via Neural Architecture Search Proceedings Article

In: pp. 1746-1753, 2020.

Links | BibTeX

501.

Gu, Jindong; Tresp, Volker

Search for Better Students to Learn Distilled Knowledge Proceedings Article

In: pp. 1159-1165, 2020.

Links | BibTeX

500.

Camero, Andrés; Wang, Hao; Alba, Enrique; Bäck, Thomas

Bayesian Neural Architecture Search using A Training-Free Performance Metric Technical Report

2020.

Links | BibTeX

499.

Zela, Arber; Siems, Julien; Hutter, Frank

NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Technical Report

2020.

Links | BibTeX

498.

Chen, Jie; Huang, Haozhe; Peng, Jian; Zhu, Jiawei; Chen, Li; Li, Wenbo; Sun, Bingyu; Li, Haifeng

Convolution Neural Network Architecture Learning for Remote Sensing Scene Classification Technical Report

2020.

Links | BibTeX

497.

Chen, Zewei; Zhou, Fengwei; Trimponias, George; Li, Zhenguo

Multi-objective Neural Architecture Search via Non-stationary Policy Gradient Technical Report

2020.

Links | BibTeX

496.

Ding, Zixiang; Chen, Yaran; Li, Nannan; Zhao, Dongbin; Chen, Philip C L

Efficient Neural Architecture Search - A Broad Version Technical Report

2020.

Links | BibTeX

495.

Fan, Zhun; Wei, Jiahong; Zhu, Guijie; Mo, Jiajie; Li, Wenji

ENAS U-Net - Evolutionary Neural Architecture Search for Retinal Vessel Segmentation Technical Report

2020.

Links | BibTeX

494.

Iqbal, Md Shahriar; Su, Jianhai; Kotthoff, Lars; Jamshidi, Pooyan

FlexiBO - Cost-Aware Multi-Objective Optimization of Deep Neural Networks Technical Report

2020.

Links | BibTeX

493.

Kasim, Muhammad F; Watson-Parris, Duncan; Deaconu, L; Oliver, S; Hatfield, P; Froula, Dustin H; Gregori, G; Jarvis, M; Khatiwala, S; Korenaga, J; Topp-Mugglestone, J; Viezzer, E; Vinko, Sam M

Up to two billion times acceleration of scientific simulations with deep neural architecture search Technical Report

2020.

Links | BibTeX

492.

Xu, Yuhui; Xie, Lingxi; Zhang, Xiaopeng; Chen, Xin; Shi, Bowen; Tian, Qi; Xiong, Hongkai

Latency-Aware Differentiable Neural Architecture Search Technical Report

2020.

Links | BibTeX

491.

Chu, Xiangxiang; Li, Xudong; Lu, Yi; Zhang, Bo; Li, Jixiang

MixPath - A Unified Approach for One-shot Neural Architecture Search Technical Report

2020.

Links | BibTeX

490.

Kwasigroch, Arkadiusz; Grochowski, Michal; Mikolajczyk, Agnieszka

Neural Architecture Search for Skin Lesion Classification Journal Article

In: vol. 8, pp. 9061-9071, 2020.

Links | BibTeX

489.

Chen, Daoyuan; Li, Yaliang; Qiu, Minghui; Wang, Zhen; Li, Bofang; Ding, Bolin; Deng, Hongbo; Huang, Jun; Lin, Wei; Zhou, Jingren

AdaBERT - Task-Adaptive BERT Compression with Differentiable Neural Architecture Search Proceedings Article

In: pp. 2463-2469, 2020.

Links | BibTeX

488.

Ho, Kary; Gilbert, Andrew; Jin, Hailin; Collomosse, John P

Neural Architecture Search for Deep Image Prior Technical Report

2020.

Links | BibTeX

487.

Fang, Jiemin; Sun, Yuzhu; Peng, Kangjian; Zhang, Qian; Li, Yuan; Liu, Wenyu; Wang, Xinggang

Fast Neural Network Adaptation via Parameter Remapping and Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

486.

Li, Wenshuo; Ning, Xuefei; Ge, Guangjun; Chen, Xiaoming; Wang, Yu; Yang, Huazhong

FTT-NAS - Discovering Fault-Tolerant Neural Architecture Proceedings Article

In: pp. 211-216, 2020.

Links | BibTeX

485.

Zhang, Yuge; Lin, Zejun; Jiang, Junyang; Zhang, Quanlu; Wang, Yujing; Xue, Hui; Zhang, Chen; Yang, Yaming

Deeper Insights into Weight Sharing in Neural Architecture Search Technical Report

2020.

Links | BibTeX

484.

Zhou, Dongzhan; Zhou, Xinchi; Zhang, Wenwei; Loy, Chen Change; Yi, Shuai; Zhang, Xuesen; Ouyang, Wanli

EcoNAS - Finding Proxies for Economical Neural Architecture Search Proceedings Article

In: pp. 11393-11401, 2020.

Links | BibTeX

483.

Loni, Mohammad; Sinaei, Sima; Zoljodi, Ali; Daneshtalab, Masoud; Sjödin, Mikael

DeepMaker - A multi-objective optimization framework for deep neural networks in embedded systems Journal Article

In: vol. 73, pp. 102989, 2020.

Links | BibTeX

482.

Ma, Zijun; Zhou, Ziqin; Liu, Yan; Lei, Yinjie; Yan, Hua

Auto-ORVNet - Orientation-Boosted Volumetric Neural Architecture Search for 3D Shape Classification Journal Article

In: vol. 8, pp. 12942-12954, 2020.

Links | BibTeX

481.

Dong, Xuanyi; Yang, Yi

NAS-Bench-201 - Extending the Scope of Reproducible Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

3980 entries « 70 of 80 »