Code Conversations5 Des 2025

LLM Process Prompt to Prediction

Natural language processing using generative pre-trained transformers (GPT) algorithms is a rapidly evolving field that offers many opportunities and challenges for application developers. But what is a generative pre-trained transformer, and how does it work? How can you leverage the latest advances in GPT algorithms to create engaging and useful applications? Can my business benefit from creating a GPT powered chat bot?In this demo intensive session Alan will take a deep dive into the architecture of GPT algorithms and the inner workings of ChatGPT. The journey will begin by looking at the fundamental concepts of natural language processing, such as word embedding, vectorization and tokenization. He will then demonstrate how you can apply these techniques to train a GPT2 model that can generate song lyrics, showing the internals of how word sequences are predicted.Alan will then shift the focus to larger language models, such as ChatGPT and GPT4, demonstrating their power, capabilities, and limitations. The use of hyperparameters such as temperature and frequency penalty will be explained and their effect on the generated output demonstrated. He will then cover the concepts of prompt engineering and demonstrate how Retrieval Augmented Generation (RAG) patterns can be leveraged to create a ChatGPT experience based on your own textual data.

Ref: https://www.youtube.com/watch?v=P2cTtiirPnU&list=PL03Lrmd9CiGey6VY_mGu_N8uI10FrTtXZ&index=31

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(131)

Ethical AI: Risks, Mitigation, and Humanitarian Impact

This session covers the ethical use of AI, detailing how to identify, understand, and proactively counter potential risks while sharing examples of impactful solutions built for the nonprofit and huma...

24 Okt 202515min

Engineering Generative AI Confidence

Large Language Models (LLMs), including GPT, operate at their simplest level by attempting to produce a reasonable continuation of the text they are given, basing their predictions on patterns observe...

21 Okt 202515min

Practical Generative AI Applications and LLMs

Recent advances in generative AI, exemplified by LLMs like Stable Diffusion and ChatGPT, have created significant industry hype. Generative AI involves creating new media (such as text or images) by a...

18 Okt 202517min

Next Generation Developer Platforms and Architectural Archetypes

Enterprise software development is currently facing immense executive pressure, driven by boards and CEOs demanding rapid innovation, especially utilizing AI, to increase productivity, save costs, and...

15 Okt 202517min

Advanced HTML for Good Developers

This presentation by Mandy Michael, a Staff Software Engineer and Google Developer Expert, makes a compelling case for using HTML meaningfully to improve web performance and accessibility, arguing tha...

10 Okt 202518min

Azure Custom Neural Voice Clone Yourself

This speech synthesis service allows you to train your own model based on existing base models, utilizing a neural Voder to generate speech from text input. Crucially, Microsoft promotes responsible u...

7 Okt 202511min

Ethical AI: Risks, Mitigation, and Humanitarian Impact

This talk was recorded at NDC Sydney in Sydney, Australia.Ref: https://www.youtube.com/watch?v=odWIkRcqEAU&list=PL03Lrmd9CiGey6VY_mGu_N8uI10FrTtXZ&index=20

19 Sep 202518min

In Prompts We Trust: Engineering Language Models

To trust or not to trust? That depends on the quality of your prompts. Trusting Large Language Models (LLMs) is all about reducing uncertainties, and effective prompt design is the key to achieving th...

16 Sep 202521min