The Stack Overflow Podcast23 Kesä 2021

From search trees to neural nets, a deep dive into natural language processing

We chatted with three guests:

Josh Dong: AI Engineering Manager

Jenny Drexler: Senior Speech Scientist

When Jette was studying mathematics in the early 2000s, his focus was on computational biology, and more specifically, phylogenetic trees, and DNA sequences. He wanted to understand the evolution of certain traits and the forces that explain why our bones are a certain length or our brains a certain size. As it turned out, the algorithms and techniques he learned in this field mapped very well to the emerging discipline of automatic speech recognition, or ASR.

During this period, Montreal was emerging as a hotbed for artificial intelligence, and Jette found himself working for Nuance, the company behind the original implementation of Siri. That experience led him to several positions in the world of speech recognition, and he eventually landed at Rev, where he founded the company’s AI department.

Jette describes Rev as an “Uber for Transcription.” Anyone can sign up for the platform and earn money by listening to audio submitted by clients and transcribing the speech into text. This means the company has a tremendous dataset of raw audio that has been annotated by human beings and, in many cases, assessed a second time by the client. For someone looking to build an AI system that mastered the domain of speech to text, this was a goldmine.

Jette built the earliest version of Rev’s AI, but it was up to our second guest, Josh Dong, to productize and scale that system. He helped the department transition from older technologies like Perl to more popular languages like Python. He also focused on practical concerns like modularity and reusable components. To combine machine learning and DevOps, Dong added Docker containers and a testing pipeline. If you’re interested in the nuts and bolts of keeping a system like Rev’s running at tremendous scale, you’ll want to check out this part of the show.

We also explore some of the fascinating future and promise this technology holds in our time with Jenny Drexler. She explains how Rev is moving from a hybrid model—one that combines Jette’s older statistical techniques with Dong’s newer machine learning approach—to a new system that will be ML from end-to-end. This will open up the door for powerful applications, like a single system that can convert speech text across multiple languages in a single piece of audio.

“One of the things that's really cool about these end to end models is that basically, whatever data you have, it can learn to handle it. So a very similar architecture can do sequence to sequence learning with different kinds of sequences. The model architecture that you might use for speech recognition can actually look very similar to what you might use for translation. And you can use that same architecture, to say, feed in audio in lots of different languages and be able to do transcription for any of them within one model. It's much harder with the hybrid models to sort of put all the right pieces together to make that happen,” explains Drexler.

If you’re interested in learning more about the past, present, and future of artificial intelligence that can understand our spoken language and learn how to respond, check out the full episode. If you want to learn more about Rev or check out some of the positions they have open, you can find their careers page here.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Kokeile Premiumia

Nauti 14 päivää ilmaiseksi

Tilaa Premium

Jaksot(899)

Salesforce wants to do for agentic AI what they did for SaaS

The new Salesforce Developer Edition includes access to Data Cloud and Agentforce, Salesforce’s platform for building, customizing, and deploying autonomous AI agents. Developers can sign up here to start building.Connect with Christophe on LinkedIn. Instead of a badge, we have a question for you: If you are a developer who is working with AI agents, what are you building? What tools are you looking for? What problems are you interested in solving with AI tools? Send us an email at podcast@stackoverflow.com. See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

16 Touko 202529min

Next-level observability: live breakpoint debugging

SPONSORED BY DYNATRACEDynatrace is an AI-powered observability platform. It empowers today’s AI-enabled digital enterprises to understand their systems and data so they can analyze, automate, and innovate faster.Learn more about Dynatrace’s Live Debugger.Connect with Henrik Rexed on LinkedIn or check out Is it Observable on YouTube.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

14 Touko 202526min

Is the enterprise (actually) ready for AI?

watsonx.ai is an enterprise-grade AI studio. Developers can get started in the watsonx Developer Hub.We published a technical behind-the-scenes look at watsonx, as well as a Q&A on why it’s business-ready. Find Maryam on LinkedIn. Congrats to Stack Overflow user Michael Kolber, who earned a Lifeboat badge with a straightforward and effective answer to Is it possible to download a website’s entire code, HTML, CSS and JavaScript files?.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

13 Touko 202529min

Using AI to find patient zero in marketing campaigns

Alembic is an AI platform that helps organizations see how marketing spend connects to revenue so they can illuminate blind spots and make more informed business decisions.Connect with Abby on LinkedIn.Stack Overflow user krishnan muthiah pillai earned a Lifeboat badge with a top-notch answer to How to forget a wireless network in android programmatically?.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

9 Touko 202528min

Moving beyond velocity: Measuring real business impact

In this episode of Leaders of Code, Dan Lines, cofounder and COO of LinearB; Ben Matthews, Senior Director of Engineering at Stack Overflow; and host Ben Popper talk about why velocity should be a diagnostic tool, not the primary goal of engineering teams. They also touch on the need for cross-disciplinary collaboration to align engineering with business objectives. They also discuss: AI's potential to automate repetitive tasks, allowing engineers to focus on more complex work. The challenges of scaling organizations and the importance of centralized developer experience teams to improve productivity. How non-technical staff can contribute to engineering tasks through the democratization of technology, enabling more innovation. Episode notes: Connect with Dan Lines on LinkedIn. If you're looking to improve productivity for your engineering organization, check out LinearB. See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

8 Touko 202530min

Mastering microservices with a former Uber and Netflix architect

Orkes is a developer-first enterprise workflow orchestration platform. Explore the developer edition or dive into the docs.Before cofounding Orkes, Jeu was an architect at Uber and Netflix. Find him on LinkedIn.Shoutout to Stack Overflow user Alex Stiff, whose answer to Bash - Sort a list of strings earned them a Lifeboat badge.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

6 Touko 202530min

Improving on a 30-year-old hardware architecture

SambaNova makes a full-stack AI platform and an “intelligent chip” capable of running models of up to five trillion parameters, allowing developers to run state-of-the-art open source models without the time-consuming work of tuning and modeling. See what developers are building with the tech.Find Rodrigo on LinkedIn.This episode was recorded at HumanX in March. Next year’s event will be April 6-9, 2026 in San Francisco. Register today! See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

2 Touko 202534min

“We’re not replacing you; we’re with you”: Where AI meets infrastructure

The Geminus platform is built to automatically integrate data, physics, and computation for autonomous control of complex systems. Explore the platform or get in touch.Find Greg on LinkedIn.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

29 Huhti 202521min

Kaikki yhdessä sovelluksessa

Kuuntele kaikki suosikkipodcastisi ja -äänikirjasi yhdessä paikassa.

Sinulle valikoitua sisältöä

Podme-sovelluksessa kokoat suosikkisi helposti omaan kirjastoosi. Saat meiltä myös kuuntelusuosituksia!

Jatka kuuntelua koska tahansa

Voit jatkaa siitä mihin jäit, myös offline-tilassa.

Premium

9,99 €/kk

Kaikki premium-podcastit
Ei mainoksia
Ei sitoutumista, peruuta koska tahansa

Aloita 14 päivän kokeilu

Premium

13,99 €/kk

Kaikki premium-podcastit
Ei mainoksia
Ei sitoutumista, peruuta koska tahansa
Yksi lisäkäyttäjä

Kokeile 14 päivää maksutta

Suosittua kategoriassa Liike-elämä ja talous

Tarinat ja äänet, joita rakastat kuunnella

Kuuntele kaikki suosikkipodcastisi ja -äänikirjasi

Lue lisää