For a given level of intelligence, making Mixture of Experts (MOE) models sparser can save a significant amount of flops

Activity

Activity (0)
Loading comments...
Opening sign-in…