Analysis of Prefix Caching in Large Language Model Inference

NVIDIA/Mellanox MMA4Z00-NS-T Coherent VCSEL & Broadcom DSP Compatible 800G OSFP 2xSR4/SR8 850nm 100m PAM4 DOM MPO/MTP MMF Transceiver Module for SN5610 Series Switch

NVIDIA/Mellanox MMS4X00-NM-T Compatible 800G OSFP 2xDR4/DR8 1310nm 500m PAM4 DDM Dual MPO/MTP-12 SMF Optical Transceiver Module for SN5610 Series Switch

NVIDIA/Mellanox MMS4A00-XM (980-9IAH1-00XM00) Compatible 1.6T 2xDR4/DR8 OSFP224 IHS/Closed Finned Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 500m SMF DOM Dual MPO-12/APC InfiniBand XDR Transceiver Module for Quantum-X800 Air-Cooled Switches

NVIDIA/Mellanox MMS4A50-XM (980-9IAS0-00XM00) Compatible 1.6T 2xFR4 OSFP224 IHS/Closed Finned Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 2km SMF DOM Dual LC Duplex InfiniBand XDR Silicon Photonics Transceiver Module for Quantum-X800 Air-Cooled Switches

NVIDIA/Mellanox MMA4Z00-NS-T Broadcom DSP & Broadcom VCSEL Compatible 800G OSFP 2xVR4/VR8 850nm 50m PAM4 DOM MPO/MTP MMF Transceiver Module for SN5610 Series Switch

NVIDIA/Mellanox MMS4A00-XM-FLT (980-9IAH0-00XM00) Compatible 1.6T 2xDR4/DR8 OSFP224 RHS/Flat Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 500m SMF DOM Dual MPO-12/APC InfiniBand XDR Transceiver Module

NVIDIA/Mellanox Compatible 1.6T 2xFR4 OSFP224 RHS/Flat Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 2km SMF DOM Dual LC Duplex InfiniBand XDR Silicon Photonics Transceiver Module

NVIDIA/Mellanox MMS4A00-XM-FLT (980-9IAH0-00XM00) Compatible 1.6T 2xDR4/DR8 OSFP224 RHS/Flat Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 500m SMF DOM Dual MPO-12/APC Silicon Photonics Transceiver Module for Liquid-Cooled Spectrum-6 SN6600-LD Switch

NVIDIA/Mellanox Compatible 1.6T 2xFR4 OSFP224 RHS/Flat Top PAM4 Broadcom 3nm DSP (Sian3 | BCM83628) 1310nm 2km SMF DOM Dual LC Duplex Silicon Photonics Transceiver Module for Liquid-Cooled Spectrum-6 SN6600-LD Switch

NVIDIA/Mellanox MMS4A00-XM (980-9IAH1-00XM00) twin-port transceiver, 1600Gbps, OSFP 2DR4, InfiniBand XDR, 2xMPO, 1310nm SMF, EML, up to 500m, IHS (Finned Top)