Perplexity measures how surprised a language model is on average by the correct next words in a text sequence

Opening sign-in…