#275 Nandan Nayampally: How Baya Systems is Fixing the Biggest Bottleneck in AI Chips (Data Flow)
Eye On A.I.31 Heinä 2025

#275 Nandan Nayampally: How Baya Systems is Fixing the Biggest Bottleneck in AI Chips (Data Flow)

What if the biggest challenge in AI isn't how fast chips can compute, but how quickly data can move?

In this episode of Eye on AI, Nandan Nayampally, Chief Commercial Officer at Baya Systems, shares how the next era of computing is being shaped by smarter architecture, not just raw processing power. With experience leading teams at ARM, Amazon Alexa, and BrainChip, Nandan brings a rare perspective on how modern chip design is evolving.

We dive into the world of chiplets, network-on-chip (NoC) technology, silicon photonics, and neuromorphic computing. Nandan explains why the traditional path of scaling transistors is no longer enough, and how Baya Systems is solving the real bottlenecks in AI hardware through efficient data movement and modular design.

From punch cards to AGI, this conversation maps the full arc of computing innovation. If you want to understand how to build hardware for the future of AI, this episode is a must-listen.

Subscribe to Eye on AI for more conversations on the future of artificial intelligence and system design.


Stay Updated:
Craig Smith on X:https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI


(00:00) Why AI's Bottleneck Is Data Movement
(01:26) Nandan's Background and Semiconductor Career
(03:06) What Baya Systems Does: Network-on-Chip + Software
(08:40) A Brief History of Computing: From Punch Cards to AGI
(11:47) Silicon Photonics and the Evolution of Data Transfer
(20:04) How Baya Is Solving Real AI Hardware Challenges
(22:13) Understanding CPUs, GPUs, and NPUs in AI Workloads
(24:09) Building Efficient Chips: Cost, Speed, and Customization
(27:17) Performance, Power, and Area (PPA) in Chip Design
(30:55) Partnering to Build Next-Gen Photonic and Copper Systems
(32:29) Why Moore's Law Has Slowed and What Comes Next
(34:49) Wafer-Scale vs Traditional Die: Where Baya Fits In
(36:10) Chiplet Stacking and Composability Explained
(39:44) The Future of On-Chip Networking
(41:10) Neuromorphic Computing: Energy-Efficient AI
(43:02) Edge AI, Small Models, and Structured State Spaces

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(353)

Every Enterprise Is About to Have a 100,000 Agent Problem | Oren Michaels of Barndoor AI

Every Enterprise Is About to Have a 100,000 Agent Problem | Oren Michaels of Barndoor AI

AI agents can now connect to every tool your employees use. The problem is that connecting them and trusting them are two completely different things, and most enterprises have figured out the first w...

6 Kesä 59min

More Customers Chose the AI Agent Than Anyone Expected | Tom Chen, Aircall

More Customers Chose the AI Agent Than Anyone Expected | Tom Chen, Aircall

Every time you hit a phone tree or a chatbot with canned answers, you're experiencing the gap between what AI can already do and what most companies are still delivering. Craig Smith sits down with To...

4 Kesä 56min

Why the Future of AI Isn't Just Bigger Models. It's Models That Evolve | Risto Miikkulainen of Cognizant

Why the Future of AI Isn't Just Bigger Models. It's Models That Evolve | Risto Miikkulainen of Cognizant

Most AI systems follow a gradient, a mathematical slope that tells them exactly how to improve, step by step, toward a known goal. Neuroevolution doesn't follow any gradient. Instead, it runs hundreds...

2 Kesä 1h 4min

How AI Is Reinventing Elder Care | Chia-Lin Simmons of LogicMark

How AI Is Reinventing Elder Care | Chia-Lin Simmons of LogicMark

One in four people over 65 will experience a fall, and for most of them, the technology designed to help is a device that hasn't meaningfully changed since the 1980s. Chia-Lin Simmons, CEO of LogicMar...

1 Kesä 53min

The App of the Future Is Voice — Not a Screen. Mitel's CTO Luiz Domingos Explains Why.

The App of the Future Is Voice — Not a Screen. Mitel's CTO Luiz Domingos Explains Why.

Luiz Domingos has spent 25 years watching enterprise communications evolve, from IP telephony to cloud to AI, and his assessment of where things stand now is unusually concrete. Companies have moved p...

28 Touko 54min

Is ChatGPT Conscious? A Pioneer of AI Explains | Dr. Terry Sejnowski

Is ChatGPT Conscious? A Pioneer of AI Explains | Dr. Terry Sejnowski

A fly with 100,000 neurons can fly, find food, and reproduce. A $100 million supercomputer cannot. Dr. Terry Sejnowski used that observation to silence a room full of MIT AI researchers in the 1980s, ...

28 Touko 56min

Your Child's Data Profile Starts Before They're Born | Eamonn Maguire of Proton

Your Child's Data Profile Starts Before They're Born | Eamonn Maguire of Proton

Your child's data profile doesn't start when they get their first phone. It starts before they're born, the moment a parent emails a gynecologist or visits a fertility clinic website. That's the core ...

28 Touko 55min

Training AI Models Without a Billion-Dollar Data Center | Steffen Cruz of Macrocosmos

Training AI Models Without a Billion-Dollar Data Center | Steffen Cruz of Macrocosmos

Training a frontier AI model today requires hundreds of thousands of GPUs, months of compute time, and a budget that only a handful of companies on earth can afford. Steffen Cruz, co-founder and CTO o...

25 Touko 47min