The Uncertain Art of Accelerating ML Models with Sylvain Gugger

The Uncertain Art of Accelerating ML Models with Sylvain Gugger

Sylvain Gugger is a former math teacher who fell into machine learning via a MOOC and became an expert in the low-level performance details of neural networks. He’s now on the ML infrastructure team at Jane Street, where he helps traders speed up their models. In this episode, Sylvain and Ron go deep on learning rate schedules; the subtle performance bugs PyTorch lets you write; how to keep a hungry GPU well-fed; and lots more, including the foremost importance of reproducibility in training runs. They also discuss some of the unique challenges of doing ML in the world of trading, like the unusual size and shape of market data and the need to do inference at shockingly low latencies.

You can find the transcript for this episode on our website.

Some links to topics that came up in the discussion:

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(32)

Learning Goals and the Goals of Learning: Teaching in the Age of AI with Aaron Bauer

Learning Goals and the Goals of Learning: Teaching in the Age of AI with Aaron Bauer

Aaron Bauer is a software engineer and one of Jane Street's few developer educators—a role that splits his time between writing code and teaching other people how to write it. Before joining the firm,...

23 Sep 1h 36min

Wrestling the world into rows with Eric Mannes

Wrestling the world into rows with Eric Mannes

"Alternative data" is Wall Street's name for information that comes from non-traditional sources: satellite photos of parking lots, credit card panels, weather forecasts. Eric Mannes has spent over a ...

2 Sep 1h 25min

Building a data warehouse from scratch with Jacob Baskin

Building a data warehouse from scratch with Jacob Baskin

In university Jacob Baskin studied at the intersection of computer science and economics, thinking about systems that incentivize people to express their true preferences. He put those ideas into prac...

24 Juni 1h 34min

The Network as a Program with Nate Foster

The Network as a Program with Nate Foster

Nate Foster is a professor at EPFL in Switzerland in the Networked Systems Abstractions Lab, and a visiting researcher at Jane Street on the Networking team. In this episode, he and Ron consider what ...

1 Juni 1h 34min

Why Testing is Hard and How to Fix it with Will Wilson

Why Testing is Hard and How to Fix it with Will Wilson

Will Wilson is the founder and CEO of Antithesis, which is trying to change how people test software. The idea is that you run your application inside a special hypervisor environment that intelligent...

17 Mars 1h 48min

Why ML Needs a New Programming Language with Chris Lattner

Why ML Needs a New Programming Language with Chris Lattner

Chris Lattner is the creator of LLVM and led the development of the Swift language at Apple. With Mojo, he’s taking another big swing: How do you make the process of getting the full power out of mode...

3 Sep 20251h 12min

The Thermodynamics of Trading with Daniel Pontecorvo

The Thermodynamics of Trading with Daniel Pontecorvo

Daniel Pontecorvo runs the “physical engineering” team at Jane Street. This group blends architecture, mechanical engineering, electrical engineering, and construction management to build functional p...

25 Juli 202558min

Building Tools for Traders with Ian Henry

Building Tools for Traders with Ian Henry

Ian Henry started his career at Warby Parker and Trello, building consumer apps for millions of users. Now he writes high-performance tools for a small set of experts on Jane Street’s options desk. In...

28 Maj 20251h 19min

Populärt inom Business & ekonomi

framgangspodden
rss-jossan-nina
varvet
rss-borsens-finest
uppgang-och-fall
badfluence
24fragor
avanzapodden
rss-dr-bjorklund
rss-inga-dumma-fragor-om-pengar
lastbilspodden
fill-or-kill
bathina-en-podcast
rss-dagen-med-di
tabberaset
rss-kort-lang-analyspodden-fran-di
borsmorgon
kapitalet-en-podd-om-ekonomi
rikatillsammans-om-privatekonomi-rikedom-i-livet
rss-hos-psykologen