Serving extremely sparse Mixture of Experts (MOE) models is computationally prohibitive on today's HBM-based GPUs

Activity

Activity (0)
Loading comments...
Opening sign-in…