55. Rohin Shah - Effective altruism, AI safety, and learning human preferences from the state of the world
Towards Data Science28 Loka 2020

55. Rohin Shah - Effective altruism, AI safety, and learning human preferences from the state of the world

If you walked into a room filled with objects that were scattered around somewhat randomly, how important or expensive would you assume those objects were?

What if you walked into the same room, and instead found those objects carefully arranged in a very specific configuration that was unlikely to happen by chance?

These two scenarios hint at something important: human beings have shaped our environments in ways that reflect what we value. You might just learn more about what I value by taking a 10 minute stroll through my apartment than by spending 30 minutes talking to me as I try to put my life philosophy into words.

And that’s a pretty important idea, because as it turns out, one of the most important challenges in advanced AI today is finding ways to communicate our values to machines. If our environments implicitly encode part of our value system, then we might be able to teach machines to observe it, and learn about our preferences without our having to express them explicitly.

The idea of leveraging deriving human values from the state of an human-inhabited environment was first developed in a paper co-authored by Berkeley PhD and incoming DeepMind researcher Rohin Shah. Rohin has spent the last several years working on AI safety, and publishes the widely read AI alignment newsletter — and he was kind enough to join us for this episode of the Towards Data Science podcast, where we discussed his approach to AI safety, and his thoughts on risk mitigation strategies for advanced AI systems.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(130)

130. Edouard Harris - New Research: Advanced AI may tend to seek power *by default*

130. Edouard Harris - New Research: Advanced AI may tend to seek power *by default*

Progress in AI has been accelerating dramatically in recent years, and even months. It seems like every other day, there’s a new, previously-believed-to-be-impossible feat of AI that’s achieved by a w...

12 Loka 202258min

129. Amber Teng - Building apps with a new generation of language models

129. Amber Teng - Building apps with a new generation of language models

It’s no secret that a new generation of powerful and highly scaled language models is taking the world by storm. Companies like OpenAI, AI21Labs, and Cohere have built models so versatile that they’re...

5 Loka 202251min

128. David Hirko - AI observability and data as a cybersecurity weakness

128. David Hirko - AI observability and data as a cybersecurity weakness

Imagine you’re a big hedge fund, and you want to go out and buy yourself some data. Data is really valuable for you — it’s literally going to shape your investment decisions and determine your outcome...

28 Syys 202249min

127. Matthew Stewart - The emerging world of ML sensors

127. Matthew Stewart - The emerging world of ML sensors

Today, we live in the era of AI scaling. It seems like everywhere you look people are pushing to make large language models larger, or more multi-modal and leveraging ungodly amounts of processing pow...

21 Syys 202241min

126. JR King - Does the brain run on deep learning?

126. JR King - Does the brain run on deep learning?

Deep learning models — transformers in particular — are defining the cutting edge of AI today. They’re based on an architecture called an artificial neural network, as you probably already know if you...

14 Syys 202255min

125. Ryan Fedasiuk - Can the U.S. and China collaborate on AI safety?

125. Ryan Fedasiuk - Can the U.S. and China collaborate on AI safety?

It’s no secret that the US and China are geopolitical rivals. And it’s also no secret that that rivalry extends into AI — an area both countries consider to be strategically critical. But in a context...

7 Syys 202248min

124. Alex Watson - Synthetic data could change everything

124. Alex Watson - Synthetic data could change everything

There’s a website called thispersondoesnotexist.com. When you visit it, you’re confronted by a high-resolution, photorealistic AI-generated picture of a human face. As the website’s name suggests, the...

18 Touko 202251min

123. Ala Shaabana and Jacob Steeves - AI on the blockchain (it actually might just make sense)

123. Ala Shaabana and Jacob Steeves - AI on the blockchain (it actually might just make sense)

Two ML researchers with world-class pedigrees who decided to build a company that puts AI on the blockchain. Now to most people — myself included — “AI on the blockchain” sounds like a winning entry i...

12 Touko 202254min