Muse Spark Open features a mixture-of-experts architecture with 256 experts per layer and 8 experts routed per token
Agree
Disagree
Overview
Debates
Related claims
Topics
B
b5a31f81
Topic
AI foundation models
701
claims
·
199
news stories
0
B
b5a31f81
Topic
Mixture of experts (MoE)
74
claims
·
9
news stories
0
Opening sign-in…