Key Takeaways
- We’re swapping electrical connections for optical ones in AI hardware because we’ve hit bandwidth and power walls, which is critical for scaling AI models.
- Lumentum’s silicon photonics and indium phosphide tech are central to making the high-density, low-latency optical solutions data centers need.
- Switching to optical interconnects can slash power use by up to 50% per terabit per second over copper, which helps AI accelerators run longer and more efficiently.
- Adopting optical backplanes early on means big investments in new manufacturing and thermal management to make sure they’re reliable and performant.
- Moving towards optical processing units (OPUs) is how we’ll get to exascale AI compute, reaching speeds our current electronic architectures just can’t touch.
The compute demand from large language models and real-time inference is just too much for traditional electrical interconnects. They’ve hit a wall, and it’s slowing down innovation by creating bottlenecks in latency, power draw, and heat inside our AI accelerators and data centers. The only way forward is to adopt high-density optical interconnects, a technology that will completely change what future AI systems can do.
The Mounting Problem: Electrical Interconnect Bottlenecks in AI Hardware
AI workloads, especially for generative AI and complex sims, are all about moving huge amounts of data between processing units (GPUs, TPUs, NPUs) and memory. For decades, copper traces on printed circuit boards (PCBs) and cables worked fine, but their physical limits are now painfully obvious. As you crank up signal frequencies to get more bandwidth, copper traces start losing a ton of signal to skin effect and dielectric losses. To fix that, you need complex equalization circuits, which just burn more power and add latency. Picture a standard AI server rack in 2026. You’ve got multiple accelerator cards, each pulling hundreds of watts. The data rates between these cards are easily hitting several terabits per second. Trying to route all that electrically means thick, power-draining cables and a bunch of signal conditioning chips. For context, a LightCounting report from 2025 projects that a 400 Gigabit Ethernet (GbE) copper link can burn 10 to 15 watts per port just for the transceiver and equalization. When you scale that across thousands of connections in an AI cluster, the power budget goes through the roof, and that’s before you even think about how to cool the thing. On top of that, you can only cram so many electrical traces onto a PCB. As you pack them tighter, electromagnetic interference (EMI) becomes a nightmare, forcing you into expensive shielding and super-careful layouts that make manufacturing a headache. We’ve been fighting this battle with every new PCIe generation, from Gen4 to Gen5 and now Gen6. Each step requires more exotic materials and tighter tolerances, pushing what’s even possible with standard PCB manufacturing. The idea that we can just keep increasing clock speeds and trace counts indefinitely is not realistic. The physics of copper just won’t allow it.
““Launching here will provide an important opportunity to evaluate autonomous driving technology in challenging winter conditions,” inDrive founder and CEO Arsen Tomsky said. “Success in Astana could offer valuable insights for expanding autonomous mobility to other locations facing similar challenges.””
What Went Wrong First: The Limits of Incremental Electrical Improvements
For a while, the industry tried patching the problem with incremental electrical fixes. We got higher-order modulation schemes like PAM4 (Pulse Amplitude Modulation 4-level), which let us cram more bits per symbol down existing copper, effectively doubling the data rate. We threw advanced equalization techniques, pre-emphasis, and de-emphasis at the problem to fight signal degradation. Switching to better PCB materials with lower dielectric loss also gave us some breathing room. But these were stopgap measures at best. They bought us some time with electrical interconnects but created a new set of issues. For example, PAM4 is way more sensitive to noise than the old NRZ (Non-Return-to-Zero) signaling was, so it demands much stronger forward error correction (FEC) codes. That FEC adds its own latency and processing overhead. The power consumption for these fancy electrical transceivers stayed high, and the thermal problems just got worse. Developers tried to work around it with shorter copper links and direct chip-to-chip connections, but even those designs hit the same power and bandwidth density walls. The fundamental problem was the medium itself. Copper wires carrying electrons are just approaching their physical limits for moving data this fast and this densely over any practical distance. A complete overhaul was needed. Expecting electrons in copper wires to keep up with the scale of AI we’re now building just isn’t realistic.
| Feature | Traditional Electrical Interconnects | Optical Interconnects (Current) | Optical Processing Units (OPUs) |
|---|---|---|---|
| Bandwidth Limitations | ✗ Significant bottlenecks | ✓ High density, low latency | ✓ Exascale AI compute potential |
| Power Consumption (per Tbps) | ✗ High (e.g., 10-15W for 400GbE) | ✓ Up to 50% reduction vs. copper | ✓ High efficiency anticipated |
| Electromagnetic Interference (EMI) | ✗ Major issue, requires shielding | ✓ Immune to EMI | ✓ Immune to EMI |
| Heat Generation | ✗ Significant challenges | ✓ Reduced thermal load | ✓ Significantly reduced thermal load |
| Manufacturing Complexity | Partial (increasing with Gen6) | ✓ Requires new processes | ✓ Requires new processes & thermal management |
| Underlying Physics | Electrons (approaching limits) | ✓ Photons (fundamental advantages) | ✓ Photons (fundamental advantages) |
| Future AI Scalability | ✗ Limits innovation | ✓ Redefines future AI capabilities | ✓ Unattainable with current electronics |
The Optical Solution: High-Density Interconnects for AI
The fix is to use photons instead of electrons by shifting to optical interconnects. Light traveling through optical fibers or waveguides has huge advantages in bandwidth, power efficiency, and reach. Light signals don’t suffer from the same attenuation as electrical ones and are completely immune to EMI, which lets us push much higher data rates over longer distances with almost no signal loss. The whole approach centers on getting optical components integrated directly onto or right next to the AI processors. This “co-packaged optics” method cuts the electrical trace length between the SerDes (serializer/deserializer) and the optical transceiver to almost zero, which in turn cuts power consumption and latency. Instead of an electrical signal fighting its way across a PCB to a pluggable module on the edge of the board, the optical engine is right there beside the compute chip. Companies like Lumentum are making the core technologies for this shift. Their work in silicon photonics is especially important because it lets us build optical components, waveguides, modulators, detectors, and even lasers, using the same standard CMOS manufacturing processes we use for computer chips. This is how we get to high-volume, low-cost production and can tightly integrate optics with the electronics. The end goal is an AI accelerator where the optical I/O is part of the chip package itself. On top of silicon photonics, Lumentum also makes advanced lasers based on indium phosphide (InP). InP lasers are just better when it comes to power output, efficiency, and modulation speed, making them the perfect light source for these super-fast optical links. By integrating these high-performance InP lasers with a silicon photonics platform, you get the best of both worlds: the performance of InP light sources and the manufacturing scale and integration of silicon photonics. This combined approach gives us tailored solutions for AI accelerators, where every picosecond of latency and milliwatt of power is being counted.
Step-by-Step Implementation of Optical Interconnects
Getting high-density optical interconnects into AI hardware is happening in phases, starting with near-chip integration and moving toward fully optical systems.
Phase 1: Co-Packaged Optics (CPO)
The first step, which is happening now, is co-packaged optics. We’re putting the optical transceivers inside the same package as the AI accelerator chip, so we don’t need those old pluggable modules on the board edge anymore. This makes the electrical path from the chip’s SerDes to the optical engine incredibly short, which cleans up signal integrity issues and saves a lot of power. You might see a big GPU or HBM stack with several CPO modules around its edge, converting the chip’s electrical signals to light and sending them out over short optical fibers. Lumentum’s ability to make miniaturized, low-power optical components that can keep up with the crazy data rates from next-gen AI processors is essential here. It’s a tough engineering problem, though (especially thermal management). You have to figure out how to stuff high-power electronics right next to heat-sensitive optics in a tiny space.
Phase 2: Optical Backplanes and Mid-Board Optics
After CPO, we’re looking at the system level. Optical backplanes get rid of the electrical traces on the main circuit board and replace them with embedded optical waveguides. This lets us move data between multiple accelerator cards in a server at full speed, without the bandwidth caps and power waste of an electrical backplane. An intermediate step we’re seeing is mid-board optics, where transceivers are mounted on the PCB but aren’t fully co-packaged. They’re better than pluggables, but the fully optical backplane is the real target, letting data fly between cards as light and massively boosting the total bandwidth inside a single rack. This means we need new manufacturing processes for embedding these waveguides, which is a challenge Lumentum and its partners are tackling. Making sure these embedded waveguides are reliable across all temperature ranges and under mechanical stress is a huge engineering lift.
Phase 3: Optical Processing Units (OPUs)
Looking further out, the destination is optical processing units (OPUs). These are chips that would actually compute using light instead of electrons. It’s still mostly R&D, but OPUs could offer insane speed and energy efficiency for certain AI jobs like matrix multiplication and neural network inference. An OPU would completely change AI system architecture. You wouldn’t need to convert signals from electrical to optical and back again. The data would just stay as light for the computation itself. All the energy and latency from those conversions would disappear. Companies like Lumentum are building the foundational components, the modulators, switches, and detectors, that will eventually be the building blocks for an OPU. This is a fundamental change in how we compute, not just how we move data around.
Measurable Results and Future Impact
So what do we get out of this transition? The benefits are clear and measurable for AI hardware. First, a big drop in power consumption. Industry estimates show co-packaged optics can cut the power per terabit per second by 30% to 50% compared to traditional pluggable electrical transceivers. For a hyperscale AI data center that’s already pulling hundreds of megawatts, a 30% cut in interconnect power means millions in opex savings annually and a much smaller carbon footprint. That also lets us pack more compute into the power and cooling budgets we already have. Second, a huge jump in bandwidth density. An optical fiber can carry much more data in the same amount of space than a copper trace. This means we can build denser interconnects, which is what AI accelerators need to talk to memory and each other at the speeds required by exascale AI models. This will be absolutely necessary for future multi-die GPUs to maintain high bandwidth between chiplets. Third, significant latency reduction. By cutting down electrical trace lengths and getting rid of the need for complex signal conditioning, optical interconnects can shave nanoseconds off transfer times. While that might not sound like much, these small gains add up across the thousands of parallel operations in an AI model, leading to faster training and quicker inference. For something like autonomous driving or high-frequency trading, a few nanoseconds can make all the difference. Finally, you get more reach and flexibility. Optical signals can travel much farther without degrading, which gives data center architects more freedom in how they lay out racks and allows for more distributed AI architectures. Accelerator clusters don’t have to be jammed into the same rack anymore, which opens up new ways to handle cooling and power. This partnership between AI hardware developers and optical component makers like Lumentum is a complete re-architecture of the system. We’re shifting from a world built on electrical signals to one where light does the heavy data lifting. This move has its own set of challenges, especially around thermal management and creating affordable, high-volume manufacturing for integrated optics. But the payoff in power, performance, and scalability is too big to pass up for the future of AI. The future of AI compute depends on moving massive amounts of data as efficiently as possible. Optical interconnects, powered by advances in silicon photonics and indium phosphide, give us a clear path to break past the limits of electrical signaling. This change will bring new levels of performance and energy efficiency that are needed for the next generation of AI breakthroughs and ties directly into how LLM Regulations reshaping AI hardware will play out.
Why are electrical interconnects becoming a bottleneck for AI hardware?
They’re hitting physical limits on bandwidth, power draw, and signal integrity. As AI models get bigger, copper can’t keep up with the required data movement without generating too much heat and latency, which stops AI systems from scaling effectively.
What is co-packaged optics (CPO) and how does it help AI?
Co-packaged optics (CPO) puts optical transceivers directly into the same package as an AI accelerator chip. This makes the electrical path to the optical engine extremely short, which cuts power consumption, improves signal quality, and reduces latency compared to having separate pluggable modules on the board.
What role does Lumentum play in developing optical interconnects for AI?
Lumentum develops core technologies like silicon photonics and indium phosphide (InP) lasers. Silicon photonics lets us manufacture optical parts cheaply and at high volume, while InP lasers are the efficient, high-speed light sources we need. This tech is what’s used to build the compact, high-performance optical engines for AI hardware.
What are optical backplanes and why are they important for AI data centers?
Optical backplanes replace the electrical traces on a server’s mainboard with embedded optical waveguides. This lets data move as light between accelerator cards in a chassis which massively increases the total bandwidth and cuts power use for inter-card communication, a must-have for scaling up large AI clusters.
What are the long-term benefits of transitioning to optical interconnects for AI?
The long-term gains are huge: big power savings (up to 30-50% per terabit per second), much higher bandwidth density, and lower latency for faster AI training and inference. It also gives architects more flexibility in data center design. All this allows for more powerful and efficient AI systems, and eventually leads to things like optical processing units (OPUs).