{"id":21905,"date":"2024-06-13T11:47:18","date_gmt":"2024-06-13T18:47:18","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/?p=21905"},"modified":"2024-12-11T02:32:32","modified_gmt":"2024-12-11T10:32:32","slug":"the-present-and-future-of-copilot-extensibility-top-10-takeaways-from-build-2024","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/the-present-and-future-of-copilot-extensibility-top-10-takeaways-from-build-2024\/","title":{"rendered":"The present and future of Copilot extensibility: Top 10 takeaways from Build 2024"},"content":{"rendered":"<p>We made exciting announcements about our Copilot platform at Microsoft Build this year. We\u2019ve created new pathways for developers to extend, customize, and amplify Copilot capabilities. Here\u2019s a glimpse at our key announcements for developers that are available today and coming soon.<\/p>\n<h3>1. Copilot extensions<\/h3>\n<p>There are three ways to extend Copilot capabilities through connectors, plugins, and your own copilots. These three avenues of extensibility enable you to ground, customize, and enhance Copilot experiences with data and processes for tailored experiences and external data integration. You can develop Copilot extensions with <a id=\"post-21905-_Int_4d2jqj8d\"><\/a>low-code in Copilot Studio or pro-code in Visual Studio Code with the Teams Toolkit extension.<\/p>\n<p style=\"text-align: center;\"><iframe src=\"\/\/www.youtube.com\/embed\/Mc2rz9raNyM\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Web: <a href=\"https:\/\/developer.microsoft.com\/en-us\/microsoft-365\/copilot\">Copilot for Microsoft 365 Dev Center<\/a><\/p>\n<p>Infographic: <a href=\"https:\/\/cdn.graph.office.net\/prod\/media\/microsoft-365\/copilot\/CopilotExtensions-WithLinks.pdf\">Copilot Extensions Infographic<\/a><\/p>\n<p>Documents: <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-365-copilot\/extensibility\/\">Extend Microsoft Copilot for Microsoft 365 | Microsoft Learn<\/a><\/p>\n<p>Build Session: <a href=\"https:\/\/build.microsoft.com\/en-US\/sessions\/9ebe1e90-8cdc-41a9-a172-f3246ca85ae0?wt.mc_ID=Build2024_esc_corp_bl_oo_bl_BON\">Developer\u2019s Guide to Customizing Microsoft Copilot<\/a><\/p>\n<h3>2. Your copilots as extensions<\/h3>\n<p>One way to create Copilot extensions is by publishing your own copilots as extensions. You can create your own copilot in Copilot Studio or in Azure AI Studio and bring it to Copilot as an extension with Teams Toolkit for Visual Studio Code<em>. <\/em>Continue reading to understand the two ways you can build your own copilots.<\/p>\n<p style=\"text-align: center;\"><iframe src=\"\/\/www.youtube.com\/embed\/2TQXVmWOPWo\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Video: <a href=\"https:\/\/www.youtube.com\/watch?v=pI28N5wMoiE\">Build your own copilot! New Microsoft Copilot extensions<\/a><\/p>\n<p>Build Session: <a href=\"https:\/\/build.microsoft.com\/en-US\/sessions\/9ebe1e90-8cdc-41a9-a172-f3246ca85ae0?wt.mc_ID=Build2024_esc_corp_bl_oo_bl_BON\">Developer\u2019s Guide to Customizing Microsoft Copilot<\/a><\/p>\n<p>Build Session: <a href=\"https:\/\/build.microsoft.com\/en-US\/sessions\/30370c2c-8029-480f-a23e-e653b08b9a86\">Build your own copilot with Microsoft Copilot Studio<\/a><\/p>\n<p>Build Session: <a href=\"https:\/\/build.microsoft.com\/en-US\/sessions\/9c884c87-f484-4d63-a33c-d833d5017898?wt.mc_ID=Build2024_esc_corp_bl_oo_bl_BON\">Reach 320M+ users in flow of work building your own copilot for Teams<\/a><\/p>\n<p>Documents: <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoftteams\/platform\/teams-ai-library-tutorial\">Build a custom copilot to chat with your data using Teams AI library and Teams Toolkit &#8211; Teams | Microsoft Learn<\/a>, <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-copilot-studio\/fundamentals-get-started?context=%2Fmicrosoft-365-copilot%2Fextensibility%2Fcontext&amp;tabs=web\">Quickstart: Create and deploy a copilot &#8211; Microsoft Copilot Studio | Microsoft Learn<\/a><\/p>\n<h3>3. Build your own copilots with a managed or custom stack<\/h3>\n<p>We\u2019re introducing two ways to build your own copilots and publish as Copilot extensions. You can choose to build your copilot with a managed stack \u2013<a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-365-copilot\/extensibility\/overview-declarative-copilot\">declarative copilots<\/a>&#8211; to declare workflow instructions, actions, knowledge, and triggers, or build with a custom stack and bring your own foundation models, orchestrator and host additional functionalities for a tailored experience with \u2013<a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-365-copilot\/extensibility\/overview-custom-engine-copilot\">custom engine copilots<\/a>&#8211; powered by the Teams AI Library and built with Teams Toolkit for Visual Studio Code. Go with declarative copilots for scenarios that require focus or specialization, scope to specific data sources, or target specific roles in your organization. Try custom-engine copilots where you want more control over user experience, for scenarios that require usage of specific LLM\/SLM, or you want to publish to Microsoft stores as a SaaS provider.<\/p>\n<p style=\"text-align: center;\"><iframe src=\"\/\/www.youtube.com\/embed\/o1OGMC8aGZ8\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Documents: <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-365-copilot\/extensibility\/overview-declarative-copilot\">Declarative copilots for Microsoft 365 | Microsoft Learn<\/a>, <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-365-copilot\/extensibility\/overview-custom-engine-copilot\">Custom engine copilots for Microsoft 365 | Microsoft Learn<\/a><\/p>\n<h3>4. Copilot connectors<\/h3>\n<p>As another method to build Copilot extensions, connectors allow you to ground responses and seamlessly integrate external data into Copilot, enhancing its knowledge base and response accuracy. Connectors enable Copilot to access relevant data to address queries and initiate actions. Copilot connectors can be built using many out-of-box connectors to data sources, apps, and workflows or with custom code for a continuously innovative environment.<\/p>\n<p style=\"text-align: center;\"><iframe src=\"\/\/www.youtube.com\/embed\/VQnoOy5kQ4w?si=3VX58STs6d92rfq0\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Documents: <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-copilot-studio\/copilot-plugins-overview?context=%2Fmicrosoft-365-copilot%2Fextensibility%2Fcontext\">Copilot connectors and actions overview (preview) &#8211; Microsoft Copilot Studio | Microsoft Learn<\/a><\/p>\n<p>Build Session: <a href=\"https:\/\/build.microsoft.com\/en-US\/sessions\/c0dc5cbb-8cfd-4fce-a2da-10586333584a\">What&#8217;s new with Microsoft Copilot Studio<\/a><\/p>\n<h3>5. Copilot platform handoffs<\/h3>\n<p>This is the process of transitioning a conversation from Copilot to another bot service within the context of the user interaction. This handoff enables users to continue interactions that require specialized knowledge or actions, like IT support queries or product inquiries, with a seamless switch to your custom copilots. The Copilot platform supports this functionality by leveraging existing plugins to handoff to your copilot, and it\u2019s part of the broader Copilot extensibility features.<\/p>\n<p style=\"text-align: center;\"><iframe src=\"\/\/www.youtube.com\/embed\/5oIZA_VaVcI?si=vJ2vnBWVmFVRq6gi\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Documents: <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoftteams\/platform\/bots\/how-to\/conversations\/bot-copilot-handoff?context=%2Fmicrosoft-365-copilot%2Fextensibility%2Fcontext\">Copilot handoff &#8211; Teams | Microsoft Learn<\/a><\/p>\n<h3>6. API plugins<\/h3>\n<p>Another avenue of extensibility is to create powerful plugins for Copilot to take action on external systems or bring data. You can now build these plugins from scratch with an OpenAPI specification leveraging Copilot Studio or Teams Toolkit for Visual Studio Code.<\/p>\n<p style=\"text-align: center;\"><iframe src=\"\/\/www.youtube.com\/embed\/2iFphq-R3G8?si=qbZofpqs7v39iSrF\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Documents: <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-365-copilot\/extensibility\/overview-api-plugins\">API plugins for Microsoft Copilot for Microsoft 365 | Microsoft Learn<\/a><\/p>\n<h3>7. Message extension plugins with actions<\/h3>\n<p>If you already have a Teams app working as a message extension, you can create a plugin for Copilot with it. We\u2019ll be introducing new capabilities to message extension plugins to take action on your behalf on external systems. Action commands are coming soon as updates to message extension plugins and will help you develop new use cases to extend Copilot.<\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Documents: <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-365-copilot\/extensibility\/overview-message-extension-bot\">Build message extensions for Microsoft Copilot for Microsoft 365 | Microsoft Learn<\/a><\/p>\n<p>Build Session: <a href=\"https:\/\/build.microsoft.com\/en-US\/sessions\/8822feb4-ebb8-4427-9e93-67011e4d0620?wt.mc_ID=Build2024_esc_corp_bl_oo_bl_BON\">Developer deep dive on building plugins for Microsoft Copilot<\/a><\/p>\n<h3>8. @ mention plugins<\/h3>\n<p>@ mention plugins in Copilot for Microsoft 365 allow users to mention specific plugins in chat, which scopes all queries to the selected plugin. With this platform capability, users can invoke plugins by mentioning them in their messages, streamlining their workflow within the Copilot for Microsoft 365 environment. This integration coming soon will not only simplify access to plugins but also maintains the continuity of work, allowing users to leverage targeted knowledge without disrupting their current task.<\/p>\n<h3>9. Copilot agents<\/h3>\n<p>We\u2019re introducing a new capability to build copilots with agent capabilities in Copilot Studio. These copilots can act as independent agents that can be triggered by events, not just conversation, and orchestrate complex processes with more autonomy and less human intervention. For example, Copilot agents can resolve IT tickets from start to finish independently under your direction.<\/p>\n<p style=\"text-align: center;\"><iframe src=\"\/\/www.youtube.com\/embed\/5H6_pCUt-mk\" width=\"560\" height=\"314\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span style=\"text-decoration: underline;\">Learn more<\/span><\/p>\n<p>Blog: <a href=\"https:\/\/www.microsoft.com\/en-us\/microsoft-copilot\/blog\/copilot-studio\/microsoft-copilot-studio-building-copilots-with-agent-capabilities\/\">Microsoft Copilot Studio: Building copilots with agent capabilities | Microsoft Copilot Blog<\/a><\/p>\n<h3>10. Availability<\/h3>\n<p>Many of these features are available today with others in preview and coming soon!<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>You can create your own copilots in Copilot Studio and Teams Toolkit for Visual Studio Code in General Availability<\/li>\n<li>Publishing your copilots as Copilot extensions is coming soon<\/li>\n<li>Copilot connectors in Copilot Studio are in public preview<\/li>\n<li>API Plugins will be coming soon<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image.png\"><img decoding=\"async\" class=\"size-full wp-image-21921 aligncenter\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image.png\" alt=\"Copilot Studio\" width=\"1600\" height=\"900\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image.png 1600w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-300x169.png 300w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1024x576.png 1024w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-768x432.png 768w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1536x864.png 1536w\" sizes=\"(max-width: 1600px) 100vw, 1600px\" \/><\/a><\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1.png\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-21922\" src=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1.png\" alt=\"\" width=\"1600\" height=\"900\" srcset=\"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1.png 1600w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1-300x169.png 300w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1-1024x576.png 1024w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1-768x432.png 768w, https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-content\/uploads\/sites\/73\/2024\/06\/MicrosoftTeams-image-1-1536x864.png 1536w\" sizes=\"(max-width: 1600px) 100vw, 1600px\" \/><\/a><\/p>\n<p>Explore <a href=\"https:\/\/developer.microsoft.com\/en-us\/microsoft-365\/copilot\">Copilot for Microsoft 365 Dev Center<\/a> for more information and updates on how to expand your organization&#8217;s AI-powered productivity, skills, and creativity with Copilot extensions.<\/p>\n<p><em>Follow us on <a href=\"http:\/\/twitter.com\/microsoft365dev\">X (Twitter) \/ @Microsoft365Dev<\/a>, <a href=\"https:\/\/www.linkedin.com\/showcase\/microsoft365dev\">LinkedIn<\/a>, and subscribe to our <a href=\"https:\/\/www.youtube.com\/microsoft365developer\">YouTube channel<\/a> to stay up to date on the latest developer news and announcements.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Dive into our key announcements from Build to discover new pathways to extend, customize, and amplify Copilot capabilities.<\/p>\n","protected":false},"author":162179,"featured_media":21913,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[390,1],"tags":[315,242,301,241,280,23,243,44],"class_list":["post-21905","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-365-copilot","category-microsoft-365-developer","tag-build-2024","tag-copilot","tag-copilot-studio","tag-message-extensions","tag-microsoft-copilot","tag-teams-toolkit","tag-teams-ai-library","tag-visual-studio-code"],"acf":[],"blog_post_summary":"<p>Dive into our key announcements from Build to discover new pathways to extend, customize, and amplify Copilot capabilities.<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/posts\/21905","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/users\/162179"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/comments?post=21905"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/posts\/21905\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/media\/21913"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/media?parent=21905"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/categories?post=21905"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/microsoft365dev\/wp-json\/wp\/v2\/tags?post=21905"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}