59. Matthew Stewart - Tiny ML and the future of on-device AI

59. Matthew Stewart - Tiny ML and the future of on-device AI

When it comes to machine learning, we’re often led to believe that bigger is better. It’s now pretty clear that all else being equal, more data, more compute, and larger models add up to give more performance and more generalization power. And cutting edge language models have been growing at an alarming rate — by up to 10X each year.

But size isn’t everything. While larger models are certainly more capable, they can’t be used in all contexts: take, for example, the case of a cell phone or a small drone, where on-device memory and processing power just isn’t enough to accommodate giant neural networks or huge amounts of data. The art of doing machine learning on small devices with significant power and memory constraints is pretty new, and it’s now known as “tiny ML”. Tiny ML unlocks an awful lot of exciting applications, but also raises a number of safety and ethical questions.

And that’s why I wanted to sit down with Matthew Stewart, a Harvard PhD researcher focused on applying tiny ML to environmental monitoring. Matthew has worked with many of the world’s top tiny ML researchers, and our conversation focused on the possibilities and potential risks associated with this promising new field.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(130)

130. Edouard Harris - New Research: Advanced AI may tend to seek power *by default*

130. Edouard Harris - New Research: Advanced AI may tend to seek power *by default*

Progress in AI has been accelerating dramatically in recent years, and even months. It seems like every other day, there’s a new, previously-believed-to-be-impossible feat of AI that’s achieved by a w...

12 Okt 202258min

129. Amber Teng - Building apps with a new generation of language models

129. Amber Teng - Building apps with a new generation of language models

It’s no secret that a new generation of powerful and highly scaled language models is taking the world by storm. Companies like OpenAI, AI21Labs, and Cohere have built models so versatile that they’re...

5 Okt 202251min

128. David Hirko - AI observability and data as a cybersecurity weakness

128. David Hirko - AI observability and data as a cybersecurity weakness

Imagine you’re a big hedge fund, and you want to go out and buy yourself some data. Data is really valuable for you — it’s literally going to shape your investment decisions and determine your outcome...

28 Sep 202249min

127. Matthew Stewart - The emerging world of ML sensors

127. Matthew Stewart - The emerging world of ML sensors

Today, we live in the era of AI scaling. It seems like everywhere you look people are pushing to make large language models larger, or more multi-modal and leveraging ungodly amounts of processing pow...

21 Sep 202241min

126. JR King - Does the brain run on deep learning?

126. JR King - Does the brain run on deep learning?

Deep learning models — transformers in particular — are defining the cutting edge of AI today. They’re based on an architecture called an artificial neural network, as you probably already know if you...

14 Sep 202255min

125. Ryan Fedasiuk - Can the U.S. and China collaborate on AI safety?

125. Ryan Fedasiuk - Can the U.S. and China collaborate on AI safety?

It’s no secret that the US and China are geopolitical rivals. And it’s also no secret that that rivalry extends into AI — an area both countries consider to be strategically critical. But in a context...

7 Sep 202248min

124. Alex Watson - Synthetic data could change everything

124. Alex Watson - Synthetic data could change everything

There’s a website called thispersondoesnotexist.com. When you visit it, you’re confronted by a high-resolution, photorealistic AI-generated picture of a human face. As the website’s name suggests, the...

18 Mai 202251min

123. Ala Shaabana and Jacob Steeves - AI on the blockchain (it actually might just make sense)

123. Ala Shaabana and Jacob Steeves - AI on the blockchain (it actually might just make sense)

Two ML researchers with world-class pedigrees who decided to build a company that puts AI on the blockchain. Now to most people — myself included — “AI on the blockchain” sounds like a winning entry i...

12 Mai 202254min

Populært innen Teknologi

lydartikler-fra-aftenposten
tomprat-med-gunnar-tjomlid
teknisk-sett
elektropodden
shifter
rss-ai-forklart
hans-petter-og-co
rss-alt-som-gar-pa-strom
fornybaren
rss-digitaliseringspadden
smart-forklart
energi-og-klima
rss-bak-skyen
teknologi-og-mennesker
rss-grenser-for-ki
rss-snakk-om-sikkerhet
rss-teknologioptimistene-energibransjens-it-podcast
sosialt-sett-om-teknologi-kommunikasjon-og-livet-i-mellom
rss-kritisk-linje
f32no-en-podcast-om-foto-og-annen-teknologi