Maximal update parametrization allows AI researchers to predict optimal hyperparameters for large neural network training runs using models that are 100 times smaller
Agree
Disagree
Overview
Debates
Related claims
Topics
Best
Space b5a31f
Loading debates…
Opening sign-in…