Muse Spark Open features a mixture-of-experts architecture with 256 experts per layer and 8 experts routed per token

Activity

Activity (0)
Loading comments...
Opening sign-in…