Maximal Update Parametrization allows researchers to predict optimal hyperparameters for a target model from a run that is 100 times smaller

Opening sign-in…