Hi! I’m a complete outsider to photonics; I recently visited a semiconductors / photonics conference and heard this talking point about photonics improving AI power efficiency:
AI needs a huge amount of power, especially in moving data to memory / across interconnects (which take ~80% of power in AI clusters). AI is bottlenecked by power, not chip manufacturing.
Moving electrons is energy intensive while moving photons takes much less energy (I’ve heard figures of 100x less).
Therefore photonics will be a crucial enabler of scaling in the future.
And the vibe I have (from talking with testing / manufacturing exhibitors at the conference) is that by 2035, photonics may improve deployed AI cluster-level power efficiency by:
1.5x or better (75% confidence)
2x or better (55% confidence)
3x or better (22% confidence).
I’m curious what you posted a year ago? Was it also about improving power efficiency?
For Claude:
My system prompt for Claude
All the LLMs are shoggoths, but I feel like Claude presents as the most “me-shaped” shoggoth of them all, so I treat Claude closest to a mentor.
ChatGPT present more as a boot-licking assistant (sorry for this exaggeration). So I omit “My values—final goals” and any mention of morality or AI safety.