new · 18 pairs atlas problems fields listen quant AI philosophy

algonow/algorithms/SnapKV

SnapKV

Pairings in the atlas

Attention-score poolingspecialistKV cache eviction llm-inference

Rivals: other methods for the same problems

H2O cache eviction
KV cache quantization
PagedAttention
Prefix caching
StreamingLLM

Where it sits

llm-inference · Machine Learning & AI

Every entry is a real named method. Pairs that share a problem are rivals; that is the point. The live lessons ▸

Created by Eric Allione