When NVLink Actually Helps: llama.cpp vs vLLM on Dual RTX 3090
Whether NVLink is worth anything comes down to how much your GPUs talk between layers. llama.cpp barely does; vLLM's tensor parallelism lives on it. Same two RTX 3090s, two very different bills.