algo
now
.net
new ·
18
pairs
atlas
problems
fields
listen
quant
AI
philosophy
algonow
/
algorithms
/
Sliding window attention
Sliding window attention
Pairings in the atlas
Fixed local context
standard
Long-context attention
llm-inference
Rivals: other methods for the same problems
BigBird
Flash attention
FlashAttention-2
Grouped-query attention
Linformer
Longformer
Mamba
Mixture of experts
Multi-head latent attention
Multi-query attention
Performer
RWKV
Reformer
Ring attention
Where it sits
llm-inference
·
Machine Learning & AI