new · 18 pairs atlas problems fields listen quant AI philosophy

algonow/algorithms/Linformer

Linformer

Pairings in the atlas

Low-rank projected keysspecialistLinear attention llm-inference

Rivals: other methods for the same problems

BigBird
Flash attention
FlashAttention-2
Grouped-query attention
Longformer
Mamba
Mixture of experts
Multi-head latent attention
Multi-query attention
Performer
RWKV
Reformer
Ring attention
Sliding window attention

Where it sits

llm-inference · Machine Learning & AI

Every entry is a real named method. Pairs that share a problem are rivals; that is the point. The live lessons ▸

Created by Eric Allione