LLM.int8()

Also known as Int8 outlier decomposition, bitsandbytes int8. This is the canonical page; those names redirect here.

Pairings in the atlas

Mixed-precision outlier decompositionspecialistModel quantization llm-inference

Rivals: other methods for the same problems

Where it sits

llm-inference · Machine Learning & AI