Broadcom's plan for faster AI clusters: strap optics to GPUs

According to Mehta this kind of connectivity could support 512 GPUs in as few as eight racks, acting as a single scale-up system.

That's a biggin!