Dynamic Algorithm Configuration

  Motivation When designing algorithms we want them to be as flexible as possible such that they can solve as many problems as possible. To solve a specific family of problems well, finding well-performing hyperparameter configurations requires us to either use extensive domain knowledge or resources. The second point is especially true if we want […]

Read More


By Arber Zela and Frank Hutter Understanding and Robustifying Differentiable Architecture Search Optimizing in the search of neural network architectures was initially defined as a discrete problem which intrinsically required to train and evaluate thousands of networks. This of course required huge amount of computational power, which was only possible for few institutions. One-shot neural […]

Read More

AutoDispNet: Improving Disparity Estimation with AutoML

By Arber Zela, Yassine Marrakchi and Frank Hutter Compared to the state of computer vision 20 years ago, deep learning has enabled more generic methodologies that can be applied to various tasks by automatically extracting meaningful features from the data. However, in practice those methodologies are not as generic as it looks at first glance. […]

Read More

LEMONADE: Efficient Multi-objective Neural Architecture Search with Network Morphisms

Most work on neural architecture search (NAS, see our recent survey) solely optimizes for one criterion: high performance (measured in terms of accuracy). This often results in large and complex network architectures that cannot be used in real-world applications with several other important criteria including memory requirement, energy consumption and latency. The other problem in […]

Read More

PoSH Auto-sklearn

We did it again: world champions in AutoML

By André Biedenkapp, Katharina Eggensperger, Matthias Feurer, Frank Hutter Our ML Freiburg lab is the world champion in automatic machine learning (AutoML) again! After winning the first international AutoML challenge (2015-2016), we also just won the second international AutoML challenge (2017-2018). Our system PoSH-Auto-sklearn outperformed all other 41 participating AutoML systems. What is AutoML and […]

Read More