Code Conversations5 Des 2025

LLM Process Prompt to Prediction

Natural language processing using generative pre-trained transformers (GPT) algorithms is a rapidly evolving field that offers many opportunities and challenges for application developers. But what is a generative pre-trained transformer, and how does it work? How can you leverage the latest advances in GPT algorithms to create engaging and useful applications? Can my business benefit from creating a GPT powered chat bot?In this demo intensive session Alan will take a deep dive into the architecture of GPT algorithms and the inner workings of ChatGPT. The journey will begin by looking at the fundamental concepts of natural language processing, such as word embedding, vectorization and tokenization. He will then demonstrate how you can apply these techniques to train a GPT2 model that can generate song lyrics, showing the internals of how word sequences are predicted.Alan will then shift the focus to larger language models, such as ChatGPT and GPT4, demonstrating their power, capabilities, and limitations. The use of hyperparameters such as temperature and frequency penalty will be explained and their effect on the generated output demonstrated. He will then cover the concepts of prompt engineering and demonstrate how Retrieval Augmented Generation (RAG) patterns can be leveraged to create a ChatGPT experience based on your own textual data.

Ref: https://www.youtube.com/watch?v=P2cTtiirPnU&list=PL03Lrmd9CiGey6VY_mGu_N8uI10FrTtXZ&index=31

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(131)

MCP vs API

MCP or API: Which transforms AI integration? Martin Keen explains how the Model Context Protocol (MCP) revolutionizes AI agents by enabling dynamic discovery, tool execution, and seamless external dat...

7 Mai 18min

Why MCP really is a big deal

Tim Berglund is back at the lightboard with MCP (Model Context Protocol). MCP really is a big deal, but most people are missing the point. It's not just about enhancing desktop applications with agent...

30 Apr 17min

Skills for the age of AI developer tools

With the rise of AI and automation, how do we as humans find our value in the workplace? How do we work with these new technologies? How do we build resilience to changes? What skills are needed for u...

23 Apr 19min

Devs want specs, Product Owners want speed

Learn how AI can change the game in an important scenario. The age-old battle between Product Owners and Developers rages on: POs push for speed, while devs demand clarity. When specs are too vague, d...

16 Apr 23min

When Copilots Run Wild

Copilots are everywhere these days, and… rightfully so! Let's face it: these tools are incredible at getting things done. They have the potential to turn any one of us into a 20x developer. Need a new...

8 Apr 26min

AI for MRI Diagnostics

Explore how AI and continual learning can revolutionize MRI diagnostics, using our real-world case study in detecting Focal Cortical Dysplasias (FCD)—a crucial factor in epilepsy treatment. In this se...

1 Apr 23min

AI-Driven Code Refactoring

Ready to give your old code a makeover? Step into the world of AI-powered code refactoring, where smart algorithms take on the challenge of sprucing up cluttered codebases. See how AI deciphers code D...

25 Mar 22min

The past, present, and future of AI for application developers

So we all know AI is changing the software industry right now. Whether you build backend systems, web or native UIs, or embedded devices, you keep hearing it: the next generation of users will simply ...

18 Mar 12min