The fastest agent in the race has the best evals

The fastest agent in the race has the best evals

Ryan welcomes Benjamin Klieger, lead engineer at Groq, to explore the infrastructure behind AI agents, how you can turn a one-minute agent into a ten-second agent, and how they used fast inference and effective evals to build their efficient and reliable Compound agent.

Episode notes:

Groq delivers fast, low-cost inference using their custom-designed LPU, the first chip built for inference. Check out their agent, Compound, which can search the web and run code.

Connect with Benjamin on LinkedIn and X.

Congrats to user Bart Kiers for winning a Stellar Answer badge on their response to Regular expression to match a line that doesn't contain a word.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Jaksot(885)

Netlify CEO Matt Biilmann explains what we'll see with UI 2.0

Netlify CEO Matt Biilmann explains what we'll see with UI 2.0

Biilmann says we can't ignore the impact GenAI is having on developer productivity.  One of their engineers created a  GPT that automatically generates stories for React + TypeScript components, and after seeing how successful it was internally, Netlify made it open source for the public.We also chat over the results of their recent State of Web Development survey. The key takeaway is below: The 80% of developers that have integrated AI into their workflow are quickly reaping the benefits. Seventy percent report using AI to automate manual and repetitive tasks and 42% are using it to improve internal knowledge sharing and increase productivity, freeing up more time for impactful work and enabling faster launch times. Over 50% of developers also realized new opportunities that AI created, such as generating new web projects with a single prompt or reading API documentation.However, AI experimentation is not without its own unique challenges. Developers are concerned about receiving incorrect answers and information (65%), security issues and leaking confidential information (52%), a lack of regulation (48%), and a decrease in code quality (45%).So much opportunity, but plenty of risk as well. Last but not least, Biilmann tells us what he's looking forward to in the near future, specifically apps that can reformat their UI on the fly to be more customized to each user. He calls this UI 2.0, and it sounds a bit like what Google showed off in its recent Gemini demo. Congrats to our lifeboat winner of the week, Petrus Theron, who answered the question: How can I make a public struct where all fields are public without repeating `pub` for every field?See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

22 Joulu 202324min

From prompt attacks to data leaks, LLMs offer new capabilities and new threats

From prompt attacks to data leaks, LLMs offer new capabilities and new threats

SPONSORED BY DOITThe broken nose in jail scam is on the rise. With AI improvements, it’ll get harder to spot. OWASP, a non-profit dedicated to software security, tracks the top ten security risks for LLMs.We’ve spoken with DoiT on the podcast before about LLM hallucinations. DoiT’s sales pitch is simple: they provide technology and expertise to clients who want to use the cloud, free of charge, with the big cloud providers paying the bills.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

20 Joulu 202324min

A tax change is hurting startups and developers

A tax change is hurting startups and developers

On today’s home team episode, Ben and Ryan discuss the implications of a lapse in section 174 of the tax code. Here’s a great explainer on how it’s affecting startups and software firms, threatening jobs and potentially bankrupting some struggling companies. Video game employees are exploring a union and Microsoft recently announced it will stay neutral in the process. What’s the difference between a bad game, a low effort developer, and shovelware? Our game development Stack Exchange has some thoughts.Today’s lifeboat badge winner is “that_other_guy”, who explained: What is the difference between kill and kill -9? Hint, you want to terminate your process, not brutally murder it, ok! See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

19 Joulu 202316min

Can an AI get depressed?

Can an AI get depressed?

Does ChatGPT have seasonal depression?AIs aren’t building apps on their own, at least not yet—but they are helping developers build them. Read Isaac Lyman’s article about the three types of AI-assisted programmers.ICYMI: Listen to our interview with linguist Gašper Beguš, director of the Berkeley Speech and Computation Lab, about how LLMs and humans acquire language. Shoutout to Stack Overflow user nhgrif, who earned a Lifeboat badge by rescuing Store only date without time in a database from the ash heap of history.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

15 Joulu 202317min

Bringing context to alerting and incident management

Bringing context to alerting and incident management

SPONSORED BY FIREHYDRANTWhile FireHydrant is mostly known for their incident management software, they’re introducing Signals to modernize alerting and consolidate it with incident management. FireHydrant was born out of an incident where a database was dropped at 5:30pm on a Friday right before network maintenance started. It also led to Robert’s social media handle, Bobby Tables. This one time…at band camp…Robert got paged in the middle of trumpet practice…on his sabbatical.Congrats to Great Question badge winner timdim for asking How can I flush GPU memory using CUDA (physical reset is unavailable)?. 100 people thought it was worth voting for.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

13 Joulu 202322min

What Gemini means for the GenAI boom

What Gemini means for the GenAI boom

Gemini, Google’s new AI model, is great at competitive programming, among other things.AI Explained is a YouTube channel that covers the latest developments in AI.One problem with regulating AI is that the technology evolves (much) faster than regulators can.Wikifunctions is an open repository of code that anyone can use or contribute to.Did we need another study to tell us that longer commutes are bad for mental health? Probably not, but here’s one anyway.Are governments spying on you through push notifications? Sounds like it! In fact, push notifications are a privacy nightmare.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

12 Joulu 202321min

One weird trick for teaching users your software

One weird trick for teaching users your software

CommandBar is a user assistance platform (UAP). Their flagship product, Copilot, is an embedded user assistant agent that companies can configure to help their users with on-demand help, including interactive walkthroughs and personalized responses. Read James’s article about why CommandBar built Copilot, then get started with their docs.Follow James on LinkedIn and Twitter.Follow CommandBar on LinkedIn and Twitter.If you’ve ever wondered Why "Yarn 2" is Yarn 3.0.1, Lifeboat badge winner Ilias Karim has your answer.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

8 Joulu 202330min

Are LLMs the end of computer programming (as we know it)?

Are LLMs the end of computer programming (as we know it)?

Do LLMs herald the end of computer programming (as we know it)? A Harvard lecture weighs in on this contentious topic.An epic hardware bug story.Question from the academic trenches: How bad will it look to prospective employers if you refuse to defend your PhD? (Answer: Pretty bad.)Another intriguing question: Were postal pneumatic tubes in Berlin really cleaned with wine?The Jetsons misled us about many aspects of the future, from flying cars to the role of pneumatics, but they were onto something with the series of tubes.Before influencers and social media algorithms, there were coolhunters.Congrats to Stack Overflow user tjati, who earned a Lifeboat badge by answering What does 'HTML is escaping' mean?.See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

5 Joulu 202322min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
psykopodiaa-podcast
rss-rahapodi
ostan-asuntoja-podcast
rss-lahtijat
rss-rahamania
pomojen-suusta
rss-yritys-ja-erehdys
rss-neuvottelija-sami-miettinen
leadcast
oppimisen-psykologia
hyva-paha-johtaminen
lakicast
inderespodi
herrasmieshakkerit
rss-ammattipodcast
rss-karon-grilli
rss-myynnin-myllerryksessa
rss-rahataito-podcast