Multi-head latent attention

Also known as MLA, Latent attention. This is the canonical page; those names redirect here.

Pairings in the atlas

Low-rank key-value compressionspecialistAttention memory reduction llm-inference

Rivals: other methods for the same problems

Where it sits

llm-inference · Machine Learning & AI