Based on the fine-tuning results of Arete-27B, Nous Research stated that the state alignment bias layer in Chinese language models is shallow and applied late in training

Opening sign-in…