For a given level of intelligence, making Mixture of Experts (MOE) models sparser can save a significant amount of flops
Agree
Disagree
Overview
Debates
Related claims
Topics
Best
Space b5a31f
Loading debates…
Opening sign-in…