Maybe upgrading is pointless… - PCI-E Gen 4 vs Gen 3

Card in Slot How will it work? - pcie 4 gpu in pcie 3 slot 2 GPU 4 GPU 8 GPU · High Density Server Compute, Storage, and Networking are PCIe PCIe x 16 Slots 7 · 6 · 5 · 4 · 3 · 2 · 1 SSD Slots 5 x pcie slot height DPX instructions comparison NVIDIA HGX™ H100 4-GPU vs dual socket 32-core IceLake For LLMs up to 175 billion parameters, the PCIe-based NVIDIA H100

pcie slot splitter Drive Interface · PCI Express · PCI Express · PCIe Gen 4 x16 · PCIe Gen 3 x16 · PCIe Gen 4 x8 ; Graphics Processing Unit NVIDIA GeForce RTX 4070 Ti