Noam Shazeer proposed the SwiGLU gated multi-layer perceptron architecture in a 2020 paper
Agree
Disagree
Overview
Debates
Related claims
Topics
B
b5a31f81
Topic
Mechanistic interpretability
118
claims
·
1
news story
0
B
b5a31f81
Topic
Preprints & early results
17
claims
0
Opening sign-in…