Episode 69: Light-Speed AI: Why China’s Taichi Chip Should Put the U.S. on High Alert

Summary:

In this article, we focus on the Taichi photonic computer chip, a novel AI chip developed in China that leverages light for data processing. This technology could significantly advance China's AI and semiconductor industries, potentially surpassing Western dominance. The chip's energy efficiency and speed are highlighted as major breakthroughs, outperforming current electronic chips by orders of magnitude. We explore the implications of this technological leap, specifically focusing on the potential need for expanded export controls to prevent China from gaining a monopoly in these crucial fields. We also examines the challenges of mass production, including the reliance on various systems and the lack of standardized processing techniques. Restricting exports and carefully regulating access to the core components of this technology may be necessary to prevent China from achieving its self-declared intention of dominance in AI and semiconductor industries—an ambition that has clear economic and strategic ramifications.

Questions to consider as you read/listen:

1. What are the key technical advantages and disadvantages of the Taichi photonic computer chip compared to traditional electronic chips?
2. How does the development of the Taichi photonic computer chip potentially impact the global semiconductor landscape and international relations?
3. What are the potential applications and limitations of the Taichi photonic computer chip in advancing artificial intelligence and other technologies?

Long format:

Light-Speed AI: Why China’s Taichi Chip Should Put the U.S. on High Alert

(One sentence thesis: The Taichi photonic computer chip, a breakthrough AI technology developed in China, poses a strategic challenge to Western dominance in semiconductors, signaling an urgent need for expanded export controls to prevent China’s potential technological and geopolitical ascendancy.)

TL;DR:

The Taichi photonic computer chip is a high-speed, energy-efficient AI chip developed in China that uses light instead of electricity to process data. This chip could give China a major edge in AI and semiconductor technology. To prevent China from gaining dominance in these critical fields, the US, Japan, and Taiwan (and South Korea which has no export restrictions now) should consider expanding export controls to include photonic technology and its components.

Introduction

The Taichi photonic computer chip represents a potential revolutionary advancement in the field of artificial intelligence (AI) and photonics. Developed in China, this cutting-edge technology leverages the speed of light to process complex computations and train artificial general intelligence (AGI) models with unprecedented efficiency. As a potential game-changer in AI and semiconductor technology, the Taichi chip is highly efficient, boasting performance metrics that far exceed the capabilities of traditional electronic chips. It is not yet ready for commercial application and commercial production at scale, but it is coming. With China spearheading this development, the West must consider the geopolitical implications of such technological advancements. Restricting exports and carefully regulating access to the core components of this technology may be necessary to prevent China from achieving its self declared intention of dominance in AI and semiconductor industries—an ambition that has clear economic and strategic ramifications.

What is a Taichi photonic computer chip?

The Taichi photonic computer chip is a large-scale AI chip that uses light to perform calculations and train artificial general intelligence (AGI) models. It is novel and emerging technology. It is being developed in China natively. The Taichi chip uses light-based processing to perform AI tasks, such as processing, transmitting, and reconstructing images. It's designed to be used in high-efficiency AGI applications.

Who discovered it and who is developing it?

Taichi builds upon an earlier photonic chip called the optical parallel computational array (OPCA) developed by the same Tsinghua team. The Taichi chip was developed by a team of engineers lead by Professor Lu Fang and Professor Qinghai Tai from Tsinghua University and the Beijing National Research Center for Information Science and Technology.

How does it work?

Unlike traditional electronic circuits, Taichi utilizes integrated photonic circuits, harnessing the speed of light for processing information. The Taichi chip uses two types of light-based processing: diffraction and interference. Diffraction scatters light signals into channels that combine to solve a problem. Interference combines light waves, which can either boost or inhibit each other. These photons power tiny on-board electrical switches that turn on or off when voltage is applied. Specifically, it uses a fully reconfigurable Mach-Zehnder interferometer (MZI) arrays. Mach-Zehnder interferometers are devices that utilize the interference of light waves to perform operations like splitting, combining, and modulating optical signals.

How is it made?

It uses a chiplet-based construction. The chiplets in the Taichi photonic computer chip work by performing calculations in parallel and then integrating the results to reach a solution. The Taichi chip is made up of multiple chiplets, which are integrated circuits that each carry out a specific function. Chiplets are smaller, specialized dies that are interconnected within a single package. This design allows for greater flexibility, efficiency, and scalability in chip design. In a simple Photonic integrated circuit (PIC) design, light from a laser source would be coupled into a waveguide, then pass through a modulator where the signal is encoded by adjusting the light's phase based on the electrical input. This modulated light would then travel through further waveguides to reach the desired destination on the chip. Other components of the PIC include but are not limited to lasers, optical amplifiers, photodetectors, couplers, splitters, filters, multiplexers, demultiplexers, switches, and various types of optical resonators.

All Photonic integrated circuits (PICs) are generally made in the same way with some notable exceptions that are beyond the scope of this article. The process is similar to how electronic integrated circuits are made: coat the wafer, create a mask, project the pattern (lithography), develop the photoresist and etch and deposit the materials.

It uses Thin-film lithium niobate (TFLN). Thin-film lithium niobate (TFLN) is a crystalline material that's used in integrated photonic devices. It's made by bonding a thin layer of lithium niobate to a substrate like silicon dioxide or sapphire. It is used in components like modulators, and waveguides.

What are its performance characteristics?

As light travels much faster than electrical signals, this allows for potentially much faster computations, which could accelerate AI model training and inference times

The researchers claim that it outperforms current smart chips by two to three orders of magnitude.

The Taichi chip is over 100 times more energy efficient than previous photonic chips. It's also able to process images at nanosecond speeds, which is around a million times faster than current methods. Researchers claim that this product is roughly 100 times more energy efficient and 10 times more area efficient than previous other optical neural networks.

The researchers claim that it is much more energy efficient than the current commercial AI chips on the market. They claim, for example, that it is 1000 times more energy efficient than Nvidia’s high performance H100 GPU chip. 160 tera-operations per second per watt (TOPS/W) energy efficiency.

The Taichi chiplet has shown its impressive abilities through some remarkable accomplishments. For instance, it was able to accurately classify items into 1000 different categories with an accuracy of 91.89%.

Compared to existing photonic neural network chips, Taichi offers a twofold improvement in energy efficiency while maintaining comparable computing accuracy.

How can this change the AI market? Is it ready?

As Elon Musk likes to say, ideas are cheap, manufacturing is expensive.

Integrating Taichi with existing AI infrastructure and software could present technical hurdles.

But, it is a technology to watch. For instance, Taiwan Semiconductor Manufacturing Company (TSMC) has assembled a team of about 200 researchers focused on ultra-high-speed silicon photonic chips and is collaborating with Broadcom and Nvidia. This is especially so as we are reaching the limits of physics when it comes to traditional semiconductors (Moore’s Law).

The chip's architecture allows for modular scaling, enabling the creation of more powerful AI systems by combining multiple Taichi chiplets to handle complex tasks that might be beyond the capabilities of current chips.

As it is currently in research and development it is not ready for commercial mass production as of today, although some PICs are being produced commercially just not the Taichi photonic computer chip. Although the Taichi chip is compact and energy-efficient, it relies on many other systems, such as a laser source and high-speed data coupling. These other systems are far more bulky than a single chip, taking up almost a whole table.

There are also process and manufacturing related issues to work out. For example, photonic materials like thin-film lithium niobate lack standardized processing techniques,

Currently, no country has the capability to harness this technology for mass production beyond proof of concept and limited prototypes.

Will this frustrate US, Dutch, Japanese and Taiwanese export controls?

In the 14th Five-Year Plan, a section on strengthening the power of the country’s strategic technology includes photonics in a list of technologies for which national labs should be built (State Council, March 13, 2021). Xi loves the technology.

Some in the industry claim that this process will allow China to entirely bypass US microchip restrictions. https://wccftech.com/china-claims-a-breakthrough-in-silicon-photonics-as-it-tries-to-circumvent-us-export-controls-on-euv-lithography/ The lithography devices needed are not the cutting edge EUVs or NAEUVs but ones that can work at about 32nm node side. Recall China does have domestic internal capacity and technical knowledge to make DUVs at the 28n m level. If the US and the others want to frustrate China’s quest for semiconductor and AI dominance, it would be wise to include this technology and its component parts to a ban.

Conclusion

In an era where AI and semiconductor advancements are pivotal to national and economic security, the Taichi photonic computer chip exemplifies both the promise and peril of rapid technological innovation. As China progresses in developing this light-based AI processing technology, it challenges the traditional semiconductor strongholds of the US, Japan, and Taiwan. To safeguard their interests and curb China's ambitions, these countries must look to expand export controls to include photonic chips and their associated components. The Taichi chip serves as a reminder of the importance of strategic foresight in technology regulation, especially as we edge closer to an AI-driven future.

Sources:

https://singularityhub.com/2024/04/15/a-new-photonic-computer-chip-uses-light-to-slash-ai-energy-costs/

https://techxplore.com/news/2024-04-taichi-large-scale-diffractive-hybrid.html

https://singularityhub.com/2024/04/15/a-new-photonic-computer-chip-uses-light-to-slash-ai-energy-costs/

https://techxplore.com/news/2024-04-taichi-large-scale-diffractive-hybrid.html

https://www.livescience.com/technology/computing/china-s-upgraded-light-powered-agi-chip-is-now-a-million-times-more-efficient-than-before-researchers-say#:~:text=The%20Taichi%20chip%20works%20similarly,by%20up%20to%202%2C500%20times

https://www.ee.tsinghua.edu.cn/en/info/1076/1572.htm

https://www.edgecomputing-news.com/news/chinas-taichi-photonic-chip-ushers-in-light-speed-ai-revolution/#:~:text=Unprecedented%20energy%20efficiency%20and%20speed,time%20of%20just%206%20nanoseconds

https://www.youtube.com/watch?v=uGFJuzMPwC0

https://www.science.org/doi/10.1126/science.adl1203

https://www.gov.cn/xinwen/2021-03/13/content_5592681.htm

https://archive.ph/THqyp

https://jamestown.org/program/illuminating-the-future-developments-in-prc-photonic-microchip-production/

https://www.edgecomputing-news.com/news/chinas-taichi-photonic-chip-ushers-in-light-speed-ai-revolution/#:~:text=Overall%2C%20as%20an%20AI%20chip,from%20a%20typical%20photonic%20chip

https://www.scmp.com/news/china/science/article/3258854/could-chinas-taichi-light-based-chip-show-way-ai#:~:text=Scientists%20with%20Tsinghua%20University%20have,efficient%20than%20traditional%20electronic%20chips.&text=In%20a%20paper%20published%20in,the%20manner%20of%20various%20artists.&text=The%20chip%20uses%20photonic%20integrated,less%20energy%20than%20electronic%20devices

https://thebossmagazine.com/photonic-chips-ai-energy/