Tensor parallelism splits matrices inside a layer and wants fast intra-node links, pipeline parallelism splits across layers. Matching each to hardware.
more free answers with an account · no card
← ML Infrastructure & GPUs / 20
Model sharding: tensor vs pipeline parallelism across GPUs.
Tensor parallelism splits matrices inside a layer and wants fast intra-node links, pipeline parallelism splits across layers. Matching each to hardware.
Updated Aug 2026 · Grounded in real Applied AI Engineer interview loops and written to a senior-engineer editorial bar.
UP NEXT ON YOUR JOURNEY
Next in this trackHow do you profile and diagnose LLM inference performance (TTFT, inter-token latency, GPU utilization)?Next in this trackWhat are ONNX, TensorRT, and model compilation, and why export/compile a model for serving?Next in this trackWhat is disaggregated (prefill/decode) serving for LLM inference?
DISCUSSION · 0
No comments yet — be the first to share your approach.