A thread on r/LocalLLM last week picked up traction: a user with three RTX 3090s asking when adding a fourth GPU would require switching platforms. The replies went in several directions — some said never, some said immediately, most gave conflicting advice about PCIe lanes without explaining why they matter.
Here's the full technical answer, including when consumer platforms hit their limits, what Threadripper actually buys you, and how to spec the platform change if you're planning to go beyond three GPUs.
Quick Summary
- 3× RTX 3090 on a consumer AM5 or LGA1700 board is workable — each GPU gets x8 lanes
- Adding a 4th GPU on a consumer board drops one or more cards to x4 lanes — noticeable throughput penalty for multi-GPU inference
- Threadripper Pro 7000 series is the right platform for 4+ GPU setups — 128 PCIe 5.0 lanes, built for this
Why PCIe Lanes Matter for Multi-GPU Inference
PCIe lanes are the communication channels between the CPU, the motherboard, and your GPUs. Each GPU needs a PCIe slot to communicate. More lanes = more bandwidth = less inter-GPU communication bottleneck.
For single-GPU inference, PCIe lanes don't matter much — the GPU loads the model from RAM once and then works internally. But for multi-GPU inference with llama.cpp tensor parallelism or vLLM pipeline parallelism, GPUs constantly communicate with each other and with system RAM. Narrow PCIe lanes create a bottleneck.
PCIe bandwidth per slot:
- x16 PCIe 4.0: 32 GB/s bidirectional
- x8 PCIe 4.0: 16 GB/s bidirectional
- x4 PCIe 4.0: 8 GB/s bidirectional
- x16 PCIe 5.0: 64 GB/s bidirectional
For a 3090 with 936 GB/s internal memory bandwidth, the PCIe x8 slot is already a bottleneck for inter-GPU transfers. x4 is worse. The GPU's internal computations are fine — it's only the cross-GPU tensor operations that slow down.
Consumer Platform Limits
Intel LGA1700 (Core 13th/14th Gen)
CPU PCIe lanes: 16 (from CPU) + 16 more via chipset (Z790), for 32 total PCIe 4.0 equivalent lanes accessible to expansion slots.
In practice, a high-end Z790 board gives you:
- 1× PCIe x16 slot (primary GPU, CPU-direct)
- 1× PCIe x8 slot (second GPU, CPU-direct)
- 1× PCIe x4 slot (third GPU, chipset-routed)
- Remaining M.2 and USB bandwidth competes with the chipset PCIe
Running 3 GPUs: x16/x8/x4 — the third 3090 is at x4, which is suboptimal but functional for inference. Running 4 GPUs: You're at x16/x8/x4/x1 or need to sacrifice M.2 slots. The fourth GPU at x1 is essentially unusable for serious inference.
AMD AM5 (Ryzen 7000/9000 Series)
CPU PCIe lanes: 24 (28 with RDNA 4 APUs), all PCIe 5.0.
A top-end X670E board:
- 1× PCIe x16 slot (PCIe 5.0, CPU-direct)
- 1× PCIe x16 slot running at x8 (PCIe 5.0, CPU-direct)
- 1× PCIe x4 slot (PCIe 4.0, chipset-routed)
Three GPUs works at x16/x8/x4 — better than Intel on paper due to PCIe 5.0's higher bandwidth-per-lane. Four GPUs still doesn't work cleanly without significant trade-offs.
Why Consumer Platforms Cap Out at 3 GPUs
The core limit is CPU-to-expansion slot lane count. Consumer CPUs have 16–24 PCIe lanes from the CPU die. Running 4 GPUs at even x8 each requires 32 CPU-direct lanes. No consumer CPU provides that.
Chipset-routed PCIe is slower than CPU-direct because it goes through the PCIe connection between the CPU and chipset, which itself is typically a 4–8 lane link. For GPU-to-GPU communication, chipset routing adds latency.
When to Switch to Threadripper
The trigger is: when you want 4+ GPUs running tensor parallel inference with acceptable inter-GPU bandwidth.
Not when you add a fourth GPU to store models. Not when the fourth GPU only runs occasionally. When all four are actively participating in model inference with tensor parallelism.
Threadripper Pro 7000 Series (Genoa-X / WRX90)
PCIe lanes: 128 PCIe 5.0 lanes from the CPU — more than any consumer platform by a factor of 4–8.
Practical GPU support:
- 4× GPUs at x16 PCIe 5.0: full bandwidth to each card
- 6× GPUs at x16: still within lane budget, with M.2 and other peripherals
- 8× GPUs at x16: possible on WRX90 boards designed for this
Platform cost:
- Threadripper Pro 7960X (24 cores): ~$1,400
- WRX90 workstation board (Asus Pro WS or similar): ~$800–$1,200
- 256GB DDR5 ECC RDIMM: ~$400–$600
- Platform total (before GPUs): $2,600–$3,200
Total cost for a 4× RTX 3090 Threadripper build:
- Platform: ~$2,800
- 4× RTX 3090 used: ~$2,000
- PSU (2000W): ~$300
- Case + cooling: ~$300
- Total: ~$5,400
This is a serious workstation investment. But it runs 96GB of VRAM across four GPUs, all at x16 PCIe 5.0 bandwidth, on a platform designed for sustained professional workloads.
EPYC as an Alternative
AMD EPYC Genoa processors offer similar or greater PCIe lane counts (128–160 lanes) at lower cost than Threadripper Pro. The tradeoff: EPYC platforms require server boards, server-grade RAM, and less community support for consumer workstation use.
EPYC 9254 (24 cores, 128 PCIe 5.0 lanes): ~$1,600 SP5 server board (Supermicro H13SSL-N or equivalent): ~$600–$900 Registered DDR5 ECC RAM: ~$400–$600 for 256GB
EPYC is the better value than Threadripper Pro if you're comfortable with server hardware. For a home workstation build with standard consumer GPUs, Threadripper Pro's workstation ecosystem (WRX90 boards with consumer PCIe slot layouts) is more practical.
NVLink: Does It Help on the 3→4 GPU Transition?
NVLink bridges connect two consumer GPUs (RTX 30/40/50 series) and provide ~600 GB/s bidirectional bandwidth — dramatically higher than PCIe x16. For a 2-GPU setup, NVLink bridges the bandwidth gap and creates a logical unified memory pool.
For 3 or 4 GPUs, NVLink helps one pair. The other GPUs still communicate over PCIe. NVLink doesn't eliminate the PCIe lane problem — it mitigates it for one pair.
In a 4-GPU setup:
- Pair A (GPU 1 + 2): NVLink connected → ~600 GB/s intra-pair bandwidth
- Pair B (GPU 3 + 4): NVLink connected → ~600 GB/s intra-pair bandwidth
- Pair A ↔ Pair B: PCIe x8/x4 → ~16–8 GB/s inter-pair bandwidth
The inter-pair bottleneck is still there. For 4-GPU inference with tensor parallelism, the NVLink pairs help but don't solve the platform lane problem.
The Practical Recommendation
Stay on consumer platform if:
- You're running 2–3 GPUs and don't plan to add more
- Your 3-GPU setup uses the third card primarily for model storage, not active inference
- You're not running tensor-parallel inference across all three GPUs simultaneously
Move to Threadripper if:
- You're adding a 4th GPU for active inference
- You're running vLLM or llama.cpp tensor parallelism across all GPUs
- You plan to run 5+ GPUs in the next 12 months
- You need sustained professional reliability (ECC RAM, workstation drivers)
The 3-GPU consumer setup is fine for what most local AI builders actually do: load a large model across multiple GPUs for single-query inference. The Threadripper investment only pays off when you're running sustained multi-GPU workloads at production throughput.
FAQ
When do you need a Threadripper platform for multi-GPU local AI? When you need 4 or more GPUs. Consumer AM5 and LGA1700 platforms have 24 PCIe lanes from the CPU — not enough to run 4 GPUs at x8/x16 speeds. Threadripper Pro 7000 series provides 128 PCIe 5.0 lanes, enough for 4x GPUs at x16 with bandwidth to spare.
How many PCIe lanes does a 3-GPU RTX 3090 setup need? Three GPUs need three PCIe slots. At x8/x8/x8 configuration (common on high-end consumer boards), each GPU operates at half the theoretical bandwidth of x16. For inference workloads, x8 is typically sufficient. Moving to 4 GPUs on a consumer board often means x8/x8/x4/x4 — x4 slots meaningfully hurt throughput on the fourth card.
Is Threadripper Pro worth the cost for a home AI server? Only if you're running 4+ GPUs for extended periods. The Threadripper Pro 7960X platform (CPU + compatible WRX90 board) costs $2,000–$3,500 before RAM and GPUs. If you're running 4× RTX 3090s long-term, the platform investment pays back in inference performance within 12–18 months of serious use.