Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper • 2405.21060 • Published • 68
Albert Gu
albertgu
AI & ML interests
None yet
Organizations
authored a
paper about 2 years ago
authored 3
papers over 2 years ago
Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling
Paper • 2403.03234 • Published • 14
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper • 2402.19427 • Published • 58
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper • 2312.00752 • Published • 152