{"id":25113,"date":"2026-01-26T09:37:21","date_gmt":"2026-01-26T17:37:21","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/?p=25113"},"modified":"2026-01-26T09:37:21","modified_gmt":"2026-01-26T17:37:21","slug":"introducing-the-evals-for-agent-interop-starter-kit","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/introducing-the-evals-for-agent-interop-starter-kit\/","title":{"rendered":"Introducing the Evals for Agent Interop starter kit"},"content":{"rendered":"

As enterprise customers roll out and govern AI agents through Agent 365<\/strong><\/a>, they have been asking for pre canned evals they can run out of the box. They want transparent, reproducible evaluations that reflect their own work in realistic environments, including interoperability, how agents connect across stacks and into Microsoft Agent 365 systems and tools. In response, we are investing in a comprehensive evaluation suite across Agent 365 Tools<\/strong><\/a> with realistic scenarios, configurable rubrics, and results that stand up to governance and audit as customers deploy agents into production. Introducing Evals for Agent Interop<\/strong>, the way to evaluate those cross-stack connections end to end in realistic scenarios.<\/p>\n

\"Image<\/a><\/p>\n

Introducing Evals for Agent Interop<\/span><\/h2>\n

As a first step, we\u2019re launching \u2018Evals for Agent Interop\u2019, a starter evaluation kit debuting. \u2018Evals for Agent Interop\u2019 provides curated scenarios and representative data that emulate real digital work, along with an evaluation harness that organizations can use to self-run their agents across Microsoft 365 surfaces (Email, Documents, Teams, Calendar, and more). It\u2019s designed to be simple to start, yet capable enough to reveal quality, efficiency, robustness, and user experience tradeoffs between agent implementations, so organizations can make informed choices quickly.<\/p>\n