AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3271 entries « 47 of 66 »

2020

971.

Du, Xuefeng; Xie, Pengtao

Small-Group Learning, with Application to Neural Architecture Search Technical Report

2020.

Links | BibTeX

970.

Kim, Heewon; Baik, Sungyong; Choi, Myungsub; Choi, Janghoon; Lee, Kyoung Mu

Searching for Controllable Image Restoration Networks Technical Report

2020.

Links | BibTeX

969.

Hou, Pengfei; Jin, Ying

Single-level Optimization For Differential Architecture Search Technical Report

2020.

Links | BibTeX

968.

Lankford, Séamus; Grimes, Diarmuid

Neural Architecture Search using Particle Swarm and Ant Colony Optimization Proceedings Article

In: pp. 229-240, 2020.

Links | BibTeX

967.

Ning, Xuefei; Tang, Changcheng; Li, Wenshuo; Yang, Songyi; Zhao, Tianchen; Zhang, Niansong; Lu, Tianyi; Liang, Shuang; Yang, Huazhong; Wang, Yu

aw_nas: A Modularized and Extensible NAS framework Technical Report

2020.

Links | BibTeX

966.

Luo, Xiangzhong; Liu, Di; Kong, Hao; Liu, Weichen

EdgeNAS - Discovering Efficient Neural Architectures for Edge Systems Proceedings Article

In: pp. 288-295, 2020.

Links | BibTeX

965.

Fan, Hongxiang; Ferianc, Martin; Liu, Shuanglong; Que, Zhiqiang; Niu, Xinyu; Luk, Wayne

Optimizing FPGA-Based CNN Accelerator Using Differentiable Neural Architecture Search Proceedings Article

In: pp. 465-468, 2020.

Links | BibTeX

964.

Peter, David; Roth, Wolfgang; Pernkopf, Franz

Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization Technical Report

2020.

Links | BibTeX

963.

Rakhshani, Hojjat; Idoumghar, Lhassane; Ghambari, Soheila; Lepagnot, Julien; Brévilliers, Mathieu

On the performance of deep learning for numerical optimization - an application to protein structure prediction Technical Report

2020.

Links | BibTeX

962.

Yuan, Gonglin; Xue, Bing; Zhang, Mengjie

A Graph-Based Approach to Automatic Convolutional Neural Network Construction for Image Classification Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

961.

Zhu, Xinxin; Wang, Weining; Guo, Longteng; Liu, Jing

AutoCaption - Image Captioning with Neural Architecture Search Technical Report

2020.

Links | BibTeX

960.

Kashima, Taiga; Yamada, Yoshihiro; Saito, Shunta

Joint Search of Data Augmentation Policies and Network Architectures Technical Report

2020.

Links | BibTeX

959.

Wang, Chunnan; Wang, Hongzhi; Feng, Guosheng; Geng, Fei

Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation Technical Report

2020.

Links | BibTeX

958.

Moons, Bert; Noorzad, Parham; Skliar, Andrii; Mariani, Giovanni; Mehta, Dushyant; Lott, Chris; Blankevoort, Tijmen

Distilling Optimal Neural Networks - Rapid Search in Diverse Spaces Technical Report

2020.

Links | BibTeX

957.

Zhang, Wenqiang; Fang, Jiemin; Wang, Xinggang; Liu, Wenyu

EfficientPose - Efficient Human Pose Estimation with Neural Architecture Search Technical Report

2020.

Links | BibTeX

956.

Awad, Noor H; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

955.

Sato, Rei; Sakuma, Jun; Akimoto, Youhei

AdvantageNAS - Efficient Neural Architecture Search with Credit Assignment Technical Report

2020.

Links | BibTeX

954.

Gallo, Ignazio; Magistrali, Gabriele; Landro, Nicola; Grassa, Riccardo La

Improving the Efficient Neural Architecture Search via Rewarding Modifications Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

953.

Kumar, Vidhur; Szidon, Andrew

Efficient Incorporation of Multiple Latency Targets in the Once-For-All Network Technical Report

2020.

Links | BibTeX

952.

Steuler, Jan Linus; Beck, Markus; Passow, Benjamin N; Guckert, Michael

Optimizing the Energy Consumption of Neural Networks Proceedings Article

In: pp. 2312-2319, 2020.

Links | BibTeX

951.

Kobayashi, Masayuki; Arai, Satoshi; Nagao, Tomoharu

Evolutionary Generative Contribution Mappings Proceedings Article

In: pp. 1657-1664, 2020.

Links | BibTeX

950.

Liu, Risheng; Ma, Long; Zhang, Jiaao; Fan, Xin; Luo, Zhongxuan

Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement Technical Report

2020.

Links | BibTeX

949.

Li, Zhaoqun; Wang, Hongren; Li, Jinxing

Auto-MVCNN - Neural Architecture Search for Multi-view 3D Shape Recognition Technical Report

2020.

Links | BibTeX

948.

Xie, Pengtao; Du, Xuefeng; Ban, Hao

Skillearn: Machine Learning Inspired by Humans' Learning Skills Technical Report

2020.

Links | BibTeX

947.

Pan, Jingyu; Chang, Chen-Chia; Zhang, Tunhou; Xie, Zhiyao; Hu, Jiang; Qi, Weiyi; Lin, Chung-Wei; Liang, Rongjian; Mitra, Joydeep; Fallon, Elias; Chen, Yiran

Automatic Routability Predictor Development Using Neural Architecture Search Technical Report

2020.

Links | BibTeX

946.

Garcia-Valencia, Sebastian; Betancourt, Alejandro; Pulido, Juan Guillermo Lalinde

Sequence Generation using Deep Recurrent Networks and Embeddings - A study case in music Technical Report

2020.

Links | BibTeX

945.

Wang, Qifei; Ke, Junjie; Greaves, Joshua; Chu, Grace; Bender, Gabriel; Sbaiz, Luciano; Go, Alec; Howard, Andrew; Yang, Feng; Yang, Ming-Hsuan; Gilbert, Jeff; Milanfar, Peyman

Multi-path Neural Networks for On-device Multi-domain Visual Classification Technical Report

2020.

Links | BibTeX

944.

d'Avila Garcez, Artur; Lamb, Luis C

Neurosymbolic AI: The 3rd Wave Technical Report

2020.

Links | BibTeX

943.

Cheng, Hsin-Pai; Liang, Feng; Li, Meng; Cheng, Bowen; Yan, Feng; Li, Hai; Chandra, Vikas; Chen, Yiran

ScaleNAS - One-Shot Learning of Scale-Aware Representations for Visual Recognition Technical Report

2020.

Links | BibTeX

942.

Li, Zhengang; Yuan, Geng; Niu, Wei; Li, Yanyu; Zhao, Pu; Cai, Yuxuan; Shen, Xuan; Zhan, Zheng; Kong, Zhenglun; Jin, Qing; Chen, Zhiyu; Liu, Sijia; Yang, Kaiyuan; Ren, Bin; Wang, Yanzhi; Lin, Xue

67ms on Mobile with over 78% ImageNet Accuracy - Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration Technical Report

2020.

Links | BibTeX

941.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

940.

Zhao, Z; -e Zhang, G; Jiang, M; Feng, L; Tan, K C

EDNAS: An Efficient Neural Architecture Design based on Distribution Estimation Technical Report

2020.

Links | BibTeX

939.

Awad, Noor; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

938.

Mazyavkina, Nina; Moustafa, S; Trofimov, Ilya; Burnaev, Evgeniy

Optimizing the Neural Architecture of Reinforcement Learning Agents Technical Report

2020.

Links | BibTeX

937.

Fan, Y; Tang, X; Zhou, G; Shen, J

EfficientAutoGAN: Predicting the rewards in reinforcement-based neural architecture search for Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

936.

Ma, Benteng; Zhang, Jing; Xia, Yong; Tao, Dacheng

Inter-layer Transition in Neural Architecture Search Technical Report

2020.

Links | BibTeX

935.

Hu, Shengran; Cheng, Ran; He, Cheng; Lu, Zhichao

Multi-objective Neural Architecture Search with Almost No Training Technical Report

2020.

Links | BibTeX

934.

Kyriakides, George; Margaritis, Konstantinos G

NORD - A python framework for Neural Architecture Search Technical Report

2020.

Links | BibTeX

933.

Liang, Yi-Chuan; Liao, Ying-Chiao; Lin, Chen-Ching; Hung, Shih-Hao

Toward Fast Platform-Aware Neural Architecture Search for FPGA-Accelerated Edge AI Applications Proceedings Article

In: pp. 219-225, 2020.

Links | BibTeX

932.

Chen, Hanlin; Zhang, Baochang; Xue, Song; Gong, Xuan; Liu, Hong; Ji, Rongrong; Doermann, David S

Anti-bandit Neural Architecture Search for Model Defense Proceedings Article

In: pp. 70-85, 2020.

Links | BibTeX

931.

Borgohain, Satya; Kowadlo, Gideon; Rawlinson, David; Bergmeir, Christoph; Loo, Kok; Rangarajan, Harivallabha; Kuhlmann, Levin

Self-organising Neural Network Hierarchy Proceedings Article

In: pp. 359-370, 2020.

Links | BibTeX

930.

Mauch, Lukas; Tiedemann, Stephen; García, Javier Alonso; Cong, Bac Nguyen; Yoshiyama, Kazuki; Cardinaux, Fabien; Kemp, Thomas

Efficient Sampling for Predictor-Based Neural Architecture Search Technical Report

2020.

Links | BibTeX

929.

Wang, Xiaoxing; Chu, Xiangxiang; Fan, Yuda; Zhang, Zhexi; Wei, Xiaolin; Yan, Junchi; Yang, Xiaokang

ROME - Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradients Accumulation Technical Report

2020.

Links | BibTeX

928.

Li, Xudong; Hu, Yang; Zheng, Jianhua; Li, Mingtao

Neural Architecture Search For Fault Diagnosis Technical Report

2020.

Links | BibTeX

927.

Yan, Zhicheng; Dai, Xiaoliang; Zhang, Peizhao; Tian, Yuandong; Wu, Bichen; Feiszli, Matt

FP-NAS - Fast Probabilistic Neural Architecture Search Technical Report

2020.

Links | BibTeX

926.

Ci, Yuanzheng; Lin, Chen; Sun, Ming; Chen, Boyu; Zhang, Hongwen; Ouyang, Wanli

Evolving Search Space for Neural Architecture Search Technical Report

2020.

Links | BibTeX

925.

ElSaid, AbdElRahman A; Karns, Joshua; Lyu, Zimeng; Ororbia, Alexander; Desell, Travis

Continuous Ant-Based Neural Topology Search Technical Report

2020.

Links | BibTeX

924.

Zhao, Tianchen; Ning, Xuefei; Yang, Songyi; Liang, Shuang; Lei, Peng; Chen, Jianfei; Yang, Huazhong; Wang, Yu

BARS - Joint Search of Cell Topology and Layout for Accurate and Efficient Binary ARchitectures Technical Report

2020.

Links | BibTeX

923.

Finkler, Ulrich; Merler, Michele; Panda, Rameswar; Jaiswal, Mayoore S; Wu, Hui; Ramakrishnan, Kandan; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

Large Scale Neural Architecture Search with Polyharmonic Splines Technical Report

2020.

Links | BibTeX

922.

Li, Yaoman; King, Irwin

AutoGraph - Automated Graph Neural Network Proceedings Article

In: pp. 189-201, 2020.

Links | BibTeX

3271 entries « 47 of 66 »