Marvell shows photonic module that puts AI memory 50 meters from the GPU

For years, the fastest memory in an AI server has had to sit practically on top of the processor. Marvell Technology says it can now move that memory up to 50 meters away. The company’s Photonic Fabric Memory Module uses optical links to let high-bandwidth memory, both HBM and DDR, operate at that distance from a GPU or XPU. The usual electrical limit is 1.5 mm. What Marvell actually built Copper wires lose signal quality quickly at the speeds AI chips demand, which is why memory has been bolted right next to the processor. Marvell’s module swaps copper for photonics, meaning data travels as light through optical connections. The module can pool memory across 16 hosts. That pool can include approximately 1 TB of HBM3e alongside 16 to 32 TB of DDR5. The summary describes disaggregated memory pools that can exceed 32 TB. The 50-meter figure is the outer bound. Optical links built without retimers can support practical designs aimed at 25 to 30 meters. Marvell also points to latency claims of under 200 nanoseconds. Why the memory wall keeps getting taller AI accelerators keep getting faster at math, but feeding them data has not kept pace, largely because of electrical signal integrit...