Reka AI's Rho-1 architecture uses two expert weight streams within each transformer block—an understanding stream for language and visual parsing, and a generation stream for denoising latents—which share attention and a single KV cache
Agree
Disagree
Overview
Debates
Related claims
Topics
Sources
5
52c7ae14
Multimodal models
119
claims
·
29
news stories
0