Noam Shazeer proposed the SwiGLU gated multi-layer perceptron architecture in a 2020 paper

Activity

Activity (0)
Loading comments...
Opening sign-in…