algo
now
.net
AI scenarios
practice areas
algo puzzles
Legacy reference
lessons
atlas
problems
fields
legacy
/
algorithms
/
Tensor parallelism
Tensor parallelism
Pairings in the atlas
Row-column weight sharding
standard
Model parallelism
llm-training-alignment
Rivals: other methods for the same problems
Expert parallelism
Pipeline parallelism
Sequence parallelism
Where it sits
llm-training-alignment
·
Machine Learning & AI