In SwiGLU multi-layer perceptrons, distinct sets of downstream reader neurons activate depending on context to parse polysemantic neuron outputs

Activity

Activity (0)
Loading comments...
Opening sign-in…