Language model pre-training progress can be verified using loss and perplexity benchmarks on held-out test datasets

Opening sign-in…