In the Qwen 3.6-35B A3B mixture-of-experts model, the router activates eight of the 256 experts at each layer during a forward pass

Activity

Activity (0)
Loading comments...
Opening sign-in…