Nathan Lambert hypothesizes that some aspect of mid-training or common pre-training data makes it difficult to improve open models by simply fine-tuning on reasoning traces from top models

AI

Artificial intelligence research, products, and impact across society.

13 debates·11,658 claims·218 news stories

Open source AI

AI models and tools released with open weights or open licenses.

2 debates·673 claims·117 news stories