Automate evaluations | Microsoft Foundry

Automate evaluations | Microsoft Foundry

Build AI agents that meet your standards for quality, safety, and performance using Microsoft Foundry. Trace every run end-to-end, generate synthetic datasets to stress-test on demand, fire automated Red Team attacks at your own agents, and pin down why evaluations fail — all from the Microsoft Foundry control plane. Lock in guardrails that inspect every tool call at runtime, define the risks once, and enforce them across every agent run.

Mohammad Abuomar, Responsible AI Principal Architect, shares how to turn a coding agent into production-ready software inside Foundry.

► QUICK LINKS:

00:00 - Microsoft Foundry control plane

00:33 - See a finished agent

02:30 - See where the agent started

03:19 - Traces

04:04 - Built-in monitoring

04:34 - Evaluation types

05:51 - Red team evaluations

07:08 - Evaluation results

08:14 - Built-in Guardrails

08:14 - Wrap up

► Link References

Get everything you need in Microsoft Foundry at https://ai.azure.com

► Unfamiliar with Microsoft Mechanics?

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(100)

Windows 365: Five Years In, See What's New

Windows 365: Five Years In, See What's New

An AI agent works inside your Windows 365 Cloud PC from a Teams chat on your phone — finding downloaded files, editing documents, and drafting emails with your laptop lid closed. Microsoft Scout, a ne...

21 Elo 15min

Build your first Power App from data in seconds

Build your first Power App from data in seconds

Build a fully working model-driven app from your existing Dataverse, SharePoint, or SQL data in under a minute — screens, navigation, and forms included. Generate new pages from a natural language pro...

16 Heinä 7min

Microsoft Entra Suite hands-on tour of identity and network access protections

Microsoft Entra Suite hands-on tour of identity and network access protections

Unify identity and network access controls. Enforce least privilege access across every app and resource. Wire lifecycle workflows directly to your HR system to strip stale permissions on role changes...

15 Heinä 9min

New agentic platform in Dynamics 365 for Sales and Service

New agentic platform in Dynamics 365 for Sales and Service

Qualify a lead, close a case, or walk into a renewal meeting fully briefed, all from the sales and service agents built into Dynamics 365. Ask a question and pull a grounded answer straight from your ...

14 Heinä 10min

Tokenomics | The new AI currency & your options explained

Tokenomics | The new AI currency & your options explained

Control what you're billed on. Tokens are the currency of AI, and how you design your app determines how many you spend. Compress conversation history instead of resending it raw, cap output tokens wi...

9 Heinä 14min

Deploy Windows updates to counter AI-discovered threats

Deploy Windows updates to counter AI-discovered threats

The speed that AI can now discover and exploit vulnerabilities means that our defenses also need to adjust. For the devices that you manage where you can afford to tighten deployment timelines, we'll ...

7 Heinä 3min

Zero Trust security for AI agents

Zero Trust security for AI agents

Apply Zero Trust controls to every AI agent in your environment across identity, tool usage, and data access. Extend Conditional Access in Microsoft Entra to evaluate every agent authorization request...

2 Heinä 10min

Secure containers from code to runtime | Microsoft Defender

Secure containers from code to runtime | Microsoft Defender

Secure containerized apps end-to-end using Microsoft Defender for Cloud. Correlate cross-cloud attacks into a single incident, catch runtime threats that image scanning misses, and block vulnerable im...

29 Kesä 9min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
politiikan-puskaradio
ootsa-kuullut-tasta-2
rss-ootsa-kuullut-tasta
rss-vaalirankkurit-podcast
otetaan-yhdet
rss-voi-venaja
politbyroo
rss-podme-livebox
tervo-halme
rss-kaikki-uusiksi
rss-girls-finish-f1rst
rss-seksicast
rss-kovin-paikka
the-ulkopolitist
et-sa-noin-voi-sanoo-esittaa
rss-kuka-mina-olen
rss-rojin-kapinallinen-kurdi
rss-arvojohtaja