algo
now
.net
AI scenarios
practice areas
algo puzzles
Legacy reference
lessons
atlas
problems
fields
legacy
/
algorithms
/
Flash attention
Flash attention
Pairings in the atlas
Tiled IO-aware softmax
specialist
Efficient attention
deep-learning
Rivals: other methods for the same problems
BigBird
FlashAttention-2
Grouped-query attention
Linformer
Longformer
Mamba
Mixture of experts
Multi-head latent attention
Multi-query attention
Performer
RWKV
Reformer
Ring attention
Sliding window attention
Where it sits
deep-learning
·
Machine Learning & AI