algo
now
.net
AI scenarios
practice areas
algo puzzles
Legacy reference
lessons
atlas
problems
fields
legacy
/
algorithms
/
FP8 training
FP8 training
Pairings in the atlas
Per-tensor scaling factors
specialist
Low-precision training
llm-training-alignment
Rivals: other methods for the same problems
Fully sharded data parallel
Gradient accumulation
Gradient checkpointing
Mixed-precision training
ZeRO
Where it sits
llm-training-alignment
·
Machine Learning & AI