From search trees to neural nets, a deep dive into natural language processing
The Stack Overflow Podcast23 Kesä 2021

From search trees to neural nets, a deep dive into natural language processing

We chatted with three guests:

Miguel Jetté: Head of AI R&D

Josh Dong: AI Engineering Manager

Jenny Drexler: Senior Speech Scientist

When Jette was studying mathematics in the early 2000s, his focus was on computational biology, and more specifically, phylogenetic trees, and DNA sequences. He wanted to understand the evolution of certain traits and the forces that explain why our bones are a certain length or our brains a certain size. As it turned out, the algorithms and techniques he learned in this field mapped very well to the emerging discipline of automatic speech recognition, or ASR.

During this period, Montreal was emerging as a hotbed for artificial intelligence, and Jette found himself working for Nuance, the company behind the original implementation of Siri. That experience led him to several positions in the world of speech recognition, and he eventually landed at Rev, where he founded the company’s AI department.

Jette describes Rev as an “Uber for Transcription.” Anyone can sign up for the platform and earn money by listening to audio submitted by clients and transcribing the speech into text. This means the company has a tremendous dataset of raw audio that has been annotated by human beings and, in many cases, assessed a second time by the client. For someone looking to build an AI system that mastered the domain of speech to text, this was a goldmine.

Jette built the earliest version of Rev’s AI, but it was up to our second guest, Josh Dong, to productize and scale that system. He helped the department transition from older technologies like Perl to more popular languages like Python. He also focused on practical concerns like modularity and reusable components. To combine machine learning and DevOps, Dong added Docker containers and a testing pipeline. If you’re interested in the nuts and bolts of keeping a system like Rev’s running at tremendous scale, you’ll want to check out this part of the show.

We also explore some of the fascinating future and promise this technology holds in our time with Jenny Drexler. She explains how Rev is moving from a hybrid model—one that combines Jette’s older statistical techniques with Dong’s newer machine learning approach—to a new system that will be ML from end-to-end. This will open up the door for powerful applications, like a single system that can convert speech text across multiple languages in a single piece of audio.

“One of the things that's really cool about these end to end models is that basically, whatever data you have, it can learn to handle it. So a very similar architecture can do sequence to sequence learning with different kinds of sequences. The model architecture that you might use for speech recognition can actually look very similar to what you might use for translation. And you can use that same architecture, to say, feed in audio in lots of different languages and be able to do transcription for any of them within one model. It's much harder with the hybrid models to sort of put all the right pieces together to make that happen,” explains Drexler.

If you’re interested in learning more about the past, present, and future of artificial intelligence that can understand our spoken language and learn how to respond, check out the full episode. If you want to learn more about Rev or check out some of the positions they have open, you can find their careers page here.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Jaksot(896)

There is no golden path anymore: Engineering practices are being rewritten

There is no golden path anymore: Engineering practices are being rewritten

In this episode of Leaders of Code, Ben Matthews, Senior Director of Engineering at Stack Overflow, and Loïc Houssier, CTO at Superhuman, dive into how engineering teams can navigate paradigm shifts in a world of constant technological change. They discuss the importance of leadership in an ever-shifting industry and highlight the concept of aligned autonomy as a way to empower teams and increase organizational velocity.The conversation also covers: The impact of AI on workflows and practices across the entire organization at Superhuman, including improving onboarding, helping employees streamline their work, and enabling teams to tackle projects that were previously put on hold. The strategic use of qualitative and quantitative engineering performance metrics to measure and improve team effectiveness. Episode notes: Connect with Loïc Houssier on LinkedIn. Learn more about Superhuman, the leading AI-native email app for high-performing teams. Connect with Ben Matthews on LinkedIn or Bluesky. See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

10 Heinä 36min

Attention isn’t all we need; we need ownership too

Attention isn’t all we need; we need ownership too

NEAR is the blockchain for AI, enabling AI agents to transact freely across networks.Connect with Illia on LinkedIn and X, and read the original Transformers paper that Illia co-authored in 2017.Today’s shoutout goes to Populous badge winner Adi Lester for answering the question DataTable - foreach Row, EXCEPT FIRST ONE.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

8 Heinä 36min

Why call one API when you can use GraphQL to call them all?

Why call one API when you can use GraphQL to call them all?

Apollo GraphQL lets you orchestrate APIs with a composable, declarative, self-service model. Apollo's MCP Server is now available.Connect with Matt on LinkedIn.Today we’re shouting out a Famous Question badge winner, user jkfe, for their question How to hide/show thymeleaf fields based on controller condition?.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

4 Heinä 25min

Programming problems that seem easy, but aren't, featuring Jon Skeet

Programming problems that seem easy, but aren't, featuring Jon Skeet

Jon Skeet, for those not in the know, is legendary here at Stack Overflow. He even got his own Chuck Norris Facts-style jokes. Jon has graced the podcast before in the early days on episodes 4, 72, and 123.He’s so good at answering Stack Overflow questions that he appeared at Stack Overflow’s old NYC office and answered them in person. While he’s not the only million rep user, he was the first, so we ran the numbers on him. Have a question? Jon Skeet has probably answered it on Stack Overflow. You can also find him on Blue Sky.Looking for C# 3.5? Spoiler alert: you won’t find it. Learn why from Jon’s very helpful question What are the correct version numbers for C#?See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

1 Heinä 32min

You’ve got 99 problems but data shouldn’t be one

You’ve got 99 problems but data shouldn’t be one

Tobiko Data is creating a new standard in data transformation with their Cloud and SQL integrations. You can keep up with their work by joining their Slack community.Connect with Toby on LinkedIn.Connect with Iaroslav on LinkedIn.Congrats to Stellar Answer badge winner Christian C. Salvadó, whose answer to What's a quick way to comment/uncomment lines in Vim? was saved by over 100 users.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

27 Kesä 29min

You've vibe coded an app. Now what?

You've vibe coded an app. Now what?

SPONSORED BY HEROKUHeroku is a platform-as-a-service (PaaS) for deploying, scaling, and managing apps. Connect with Vish on X and LinkedIn. Congrats to Populist badge winner AmaDaden  for their answer to How to generate a legend with colors in PlantUML?.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

25 Kesä 26min

How to build your prototypes without a 35% tariff

How to build your prototypes without a 35% tariff

Ryan and Ben welcome Alex Malcoci, CEO and founder of MiniProto, to talk innovations in hardware prototyping, the evolving complexities of the global supply chain, the impact of the US-China trade war on manufacturing, and how automation in production could lead to new training programs for future engineers.Episode notes:MiniProto is a US-based prototyping manufacturer revolutionizing the way we develop and interact with hardware. Connect with Alex on LinkedIn.Shoutout to an Unsung Hero of Stack Overflow, Hamed Jimoh, who deserves upvotes for their more than 10 accepted answers with a zero score.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

24 Kesä 22min

Defending the realm: Trust and safety at Stack Overflow

Defending the realm: Trust and safety at Stack Overflow

The Trust and Safety team is using aliases in this episode. Learn more about who the Community Management team is at Stack Overflow. Explore how we keep our community safe in our Code of Conduct. Congratulations to Lifeboat badge recipient Arvin Yorro, who won it for their helpful answer to the question Docker Desktop - WSL update failed.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

20 Kesä 37min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
rss-rahapodi
mimmit-sijoittaa
inderespodi
taloudellinen-mielenrauha
ostan-asuntoja-podcast
rss-bisnesta-bebeja
pomojen-suusta
rss-rahamania
lakicast
rss-sisalto-kuntoon
rss-seuraava-potilas
rss-paasipodi
herrasmieshakkerit
juristipodi
jahtaa-unelmiasi
rss-ammattipodcast
rss-salonkipodi
rss-karon-grilli