LLMs adding to Technical Debt?  Maintenance?
cloud203026 Aug 2023

LLMs adding to Technical Debt? Maintenance?

What is technical debt, and how does it apply to large language models? We dive into a really interesting conversation that goes from technical debt into system and code maintenance, which is probably a much better way to think about the challenges we have in maintaining the infrastructure systems, code, data and data lakes that we have to deal with on an everyday basis. How do we maintain, store, track and update the LLMs themselves? How do we know and manage which model is being used when we retire a model? References: https://www.linkedin.com/pulse/how-google-measures-manages-tech-debt-abi-noda/ https://devops.com/are-llms-leading-devops-into-a-tech-debt-trap/ Transcript: https://otter.ai/u/ngUClgtMmLLKXCFalDxFNsNdVr4?utm_source=copy_url Image: https://www.pexels.com/photo/anonymous-worker-in-heavy-duty-gloves-3846440/

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(500)

AI Harnesses and Hosting

AI Harnesses and Hosting

This week we have an exciting conversation about harnesses, neoclouds, open weights models, and the current AI infrastructure landscape. We discuss bare metal automation, agent-friendly APIs, CPU comp...

14 Aug 57min

Innovations in Agentic Pipelines

Innovations in Agentic Pipelines

In this episode, we discuss Red Hat’s enterprise AI work, including OpenShift AI, safety guardrails, and router-based model selection. We also talk about smaller AI systems, long-term memory, and the ...

14 Aug 52min

Mirantis IREN Acquisition

Mirantis IREN Acquisition

We discuss the acquisition of Mirantis by the neocloud company IREN, and use it to examine the current market for infrastructure and AI deployment. We look at Mirantis’ consulting business, Kubernetes...

7 Aug 1h 4min

Did AI Kill OpenSource

Did AI Kill OpenSource

In this episode we discuss whether AI and LLMs are changing the role of open source, including the pressure on maintainer review queues and the growing appeal of private forks and internal maintenance...

31 Jul 37min

Vibe 3 Step [TechOps]

Vibe 3 Step [TechOps]

In this episode we work through a Vibe Coding Operations session using Claude AI inside Digital Rebar as an analysis tool. We describe a three-phase flow of plan, execute, and analyze for inspecting a...

24 Jul 38min

When Vibe Fails [TechOps]

When Vibe Fails [TechOps]

This episode we discuss a failure in vibe coding with Claude and Digital Rebar. We try to build a CloudMD-driven setup for running Claude in a container and analyzing inputs, and we run into some prob...

17 Jul 34min

Vibe Digital Rebar Install

Vibe Digital Rebar Install

In this episode, we continue our exploration of vibe coding, this time we build a prompt for installing Digital Rebar. We test and refine the prompt across multiple runs, focusing on readiness checks,...

10 Jul 44min

Vibe Coding for Ops Project Restart [TechOps]

Vibe Coding for Ops Project Restart [TechOps]

This week, we continue our Vibe Coding, and use the lessons and prompt instructions we’ve learned from previous sessions to restart the project using the latest version of Vibe Code. We walk through t...

3 Jul 26min

Populært innen Teknologi

lydartikler-fra-aftenposten
tomprat-med-gunnar-tjomlid
teknisk-sett
shifter
rss-ai-forklart
elektropodden
hans-petter-og-co
fornybaren
rss-ki-praten
rss-alt-som-gar-pa-strom
pedagogisk-intelligens
smart-forklart
rss-bak-skyen
rss-digitaliseringspadden
energi-og-klima
rss-ki-til-kaffen
teknologi-og-mennesker
kortslutning
rss-grenser-for-ki
sosialt-sett-om-teknologi-kommunikasjon-og-livet-i-mellom