AI

Co-Packaged Optics Enter Production AI Clusters to Tackle Interconnect Heat

By Reporting from New York

Co-Packaged Optics Enter Production AI Clusters to Tackle Interconnect Heat
Photo via Wikimedia Commons

NEW YORK — What happened

During infrastructure updates in late September 2026, leading cloud operators and AI data center providers confirmed the commercial deployment of their first production clusters built entirely on Co-Packaged Optics (CPO). The systems replace traditional pluggable optical transceivers and copper Direct Attach Cables (DAC) with optical engines integrated directly onto the same substrate as the network switch and accelerator silicon.

Why it matters

As AI training clusters grow to tens of thousands of compute accelerators, the physical cabling connecting them has become an engineering nightmare. High-speed electrical signals moving over traditional copper degrade rapidly across distances longer than two meters, requiring power-hungry digital signal processors (DSPs) to clean up and re-transmit the data. At the 1.6-terabit-per-second network tier common in 2026, the energy consumed just moving bits across copper and pluggable optical cages began eating up 20% to 30% of a cluster's entire power draw. CPO directly attacks this power penalty by bringing the optical interface inches from the compute silicon.

Deep dive

In a CPO-enabled node, external continuous-wave lasers pipe raw optical carrier signals into the package via standard polarization-maintaining fibers. Micro-ring silicon photonic modulators, fabricated directly alongside network ASIC logic, etch data onto the light paths. Because the high-speed electrical traces travel only millimeters across the substrate from the switch logic to the modulator, the need for intermediate retimers and high-power DSP stages is entirely removed.

Operational metrics from the initial 4,096-accelerator deployment show an overall interconnect power reduction of 41% compared to clusters using conventional pluggable optical transceivers. Furthermore, because fiber optic cables are vastly thinner and lighter than shielded copper DAC bundles, airflow impedance through the server racks dropped significantly, lowering the auxiliary power required for liquid-to-air cooling exchanges.

Report check

Early rumors implied that early CPO systems suffered catastrophic failure rates due to laser diode degradation caused by silicon substrate heat. The deployed production units avoid this by adopting a 'detached laser' architecture: the fragile laser diodes are housed in user-serviceable bays on the cooler front panel of the rack, while only the passive silicon photonic modulators reside on the hot accelerator substrate. Claims that CPO lowers deployment costs immediately are inaccurate; current system-level capital costs are roughly 25% higher than copper solutions, with operational savings expected to balance the investment only over three to four years of constant runtime.

Open questions

How rapidly will standardization bodies establish multi-vendor interoperability for silicon photonic fiber connectors to prevent vendor lock-in? What specialized field-repair protocols will data center operators need to adopt when single-fiber connections accumulate dust inside high-density sealed server trays?