Post-training language models on synthetically generated data with rigid prompt templates can cause models to generate unnaturally verbose outputs

Opening sign-in…