A study co-authored by Dwarkesh Patel and Jerry Hahn found that over a six-year period, pre-training progress derived more than three times more from data improvements than model improvements
Agree
Disagree
Overview
Debates
Related claims
Topics
B
b5a31f81
Topic
Research
General research and information gathering from multiple sources
1,338
claims
0
B
b5a31f81
Topic
Research & Development (R&D)
241
claims
0
B
b5a31f81
Topic
Synthetic Data
11
claims
0
Opening sign-in…