{"id":140,"date":"2026-11-13T11:10:34","date_gmt":"2026-11-13T19:10:34","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/?p=140"},"modified":"2026-11-13T15:39:53","modified_gmt":"2026-11-13T23:39:53","slug":"aion-instruct-local-ai-windows-gpu","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/aion-instruct-local-ai-windows-gpu\/","title":{"rendered":"Microsoft Aion Instruct: Advancing local AI on Windows and expanding to GPU"},"content":{"rendered":"<p><span data-contrast=\"auto\">Today we&#8217;re sharing the transition plan from Phi Silica to Aion Instruct, Microsoft&#8217;s latest on-device language model for Windows. Aion Instruct will begin rolling out to CP+ devices through the Windows Insider Program in late November, with full Windows Retail availability targeted for late January. We&#8217;re also expanding Aion Instruct to supported GPUs, bringing local language model capabilities to a broader range of Windows devices.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Microsoft Aion Instruct is designed to power fast, responsive language model experiences directly on your device. This transition gives Windows and Microsoft applications a newer, more efficient model foundation while preserving the familiar experiences users rely on today. <\/span><\/p>\n<p><span data-contrast=\"auto\">You can also tune in next Tuesday to <a href=\"https:\/\/ignite.microsoft.com\/en-US\/sessions\/THR888\">THR888<\/a> at Ignite 2026 to learn more about Aion Instruct (recording will be available).<\/span><\/p>\n<h2>Microsoft Aion Instruct: A new foundation for local AI on Windows<\/h2>\n<p><span data-contrast=\"auto\">Local AI enables applications to deliver responsive experiences while keeping processing on device. Aion Instruct builds on our investment in this area with improvements designed to help language model features run efficiently alongside the applications and workflows you already use on Windows.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<table data-tablestyle=\"MsoTableGrid\" data-tablelook=\"1184\" aria-rowcount=\"3\" aria-colcount=\"3\">\n<tbody>\n<tr aria-rowindex=\"1\">\n<td data-celllook=\"0\"><b><span data-contrast=\"auto\">Attribute<\/span><\/b><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<td data-celllook=\"0\"><b><span data-contrast=\"auto\">Phi Silica<\/span><\/b><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<td data-celllook=\"0\"><b><span data-contrast=\"auto\">Aion Instruct<\/span><\/b><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<\/tr>\n<tr aria-rowindex=\"2\">\n<td data-celllook=\"0\"><span data-contrast=\"auto\">Parameters<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<td data-celllook=\"0\"><span data-contrast=\"auto\">3.8B<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<td data-celllook=\"0\"><span data-contrast=\"auto\">2.3B<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<\/tr>\n<tr aria-rowindex=\"3\">\n<td data-celllook=\"0\"><span data-contrast=\"auto\">Input context length limit [tokens]<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<td data-celllook=\"0\"><span data-contrast=\"auto\">3.5K<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<td data-celllook=\"0\"><span data-contrast=\"auto\">32K<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><span data-contrast=\"auto\">A technical report with more details on Aion Instruct is coming soon to the Microsoft <\/span><a href=\"https:\/\/commandline.microsoft.com\/\"><span data-contrast=\"none\">Command Line<\/span><\/a><span data-contrast=\"auto\"> blog.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">As Aion Instruct becomes the foundation for more Windows experiences, users can expect:<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<ul>\n<li aria-setsize=\"-1\" data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">More responsive language model experiences<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-setsize=\"-1\" data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">An increased input context length limit (from 3.5K to 32K tokens)<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-setsize=\"-1\" data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Improved performance and use of device resources<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-setsize=\"-1\" data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Continued innovation across Windows and Microsoft applications<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-setsize=\"-1\" data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"5\" data-aria-level=\"1\"><span data-contrast=\"auto\">A transition designed to preserve familiar workflows and capabilities<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<\/ul>\n<p><span data-contrast=\"auto\">For most app developers, no action will be required. The change will happen behind the scenes as supported experiences move to Aion Instruct. Action will be required for apps that rely on highly custom prompting (ex. Specific system prompts) and custom LoRAs, as well as apps that have custom model output parsing due to our new <\/span><a href=\"https:\/\/learn.microsoft.com\/en-us\/windows\/ai\/apis\/text-watermarking\"><span data-contrast=\"none\">watermarking<\/span><\/a><span data-contrast=\"auto\"> implementation. We\u2019ve added invisible watermarking to Aion Instruct to fulfill <\/span><a href=\"https:\/\/www.microsoft.com\/en-us\/trust-center\/compliance\/eu-ai-act\"><span data-contrast=\"none\">Text Provenance requirements<\/span><\/a><span data-contrast=\"auto\"> in specific regions. Additionally, apps that are heavily reliant on Phi Silica\u2019s specific behavior or output strings should be validated for quality. Since Aion Instruct is a new model, output strings and model behavior are different. To get the most out of Aion Instruct, take a look at our <\/span><a href=\"https:\/\/github.com\/microsoft\/Aion-Instruct-Preview-Sample\/blob\/main\/docs\/prompt-guide.md\"><span data-contrast=\"none\">prompt guidance<\/span><\/a><span data-contrast=\"auto\">.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<h2>Expanding Aion Instruct to GPU<\/h2>\n<p><span data-contrast=\"auto\">Like Phi Silica today, we&#8217;re also expanding Aion Instruct to <\/span><a href=\"https:\/\/learn.microsoft.com\/en-us\/windows\/ai\/apis\/phi-silica\"><span data-contrast=\"none\">supported GPUs,<\/span><\/a><span data-contrast=\"auto\"> including popular dGPUs like NVIDIA\u2019s RTX-series and AMD\u2019s RDNA4 generation. This greatly increases the number of Windows devices that can benefit from Aion Instruct and gives developers greater flexibility when building language model experiences that run on-device.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Our goal is to provide a consistent local AI foundation across supported Windows hardware. In many scenarios, applications can take advantage of available device capabilities without developers requiring separate end user experiences for each type of hardware.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Hardware support will expand in stages as configurations meet our readiness and quality standards.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<h2>What this means for developers<\/h2>\n<p><span data-contrast=\"auto\">For developers building local language model experiences on Windows, Microsoft Aion Instruct provides a newer foundation while continuing to work with familiar Windows AI capabilities and APIs.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">We encourage developers to begin evaluating their applications with Aion Instruct as it becomes available. In particular, developers should validate model-dependent behavior, review any application-specific customizations, and confirm that key scenarios continue to deliver the intended experience. Aion Instruct can be validated end to end now with the package available at aka.ms\/tryaion. Additionally, the Windows Insider Program Beta External build targeted for release on 11\/20 will allow full, end to end validation.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Because language models can differ in how they interpret and produce content, testing is an important part of any model transition&#8211;even when the underlying APIs remain familiar.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">We&#8217;ll provide additional documentation and migration guidance as availability expands.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<h2>Transition timeline<\/h2>\n<p><span data-contrast=\"auto\">The transition will roll out in stages:<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<ol>\n<li aria-setsize=\"-1\" data-leveltext=\"%1.\" data-font=\"\" data-listid=\"2\" data-list-defn-props=\"{&quot;335552541&quot;:0,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769242&quot;:[65533,0],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;%1.&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">October 2026: A standalone package is available at aka.ms\/tryaion for developers to begin testing Aion Instruct and preparing their applications and customizations.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<li aria-setsize=\"-1\" data-leveltext=\"%1.\" data-font=\"\" data-listid=\"2\" data-list-defn-props=\"{&quot;335552541&quot;:0,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769242&quot;:[65533,0],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;%1.&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">November 2026: Aion Instruct is planned to begin rolling out to Windows Insider Preview devices on 11\/20.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<li aria-setsize=\"-1\" data-leveltext=\"%1.\" data-font=\"\" data-listid=\"2\" data-list-defn-props=\"{&quot;335552541&quot;:0,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769242&quot;:[65533,0],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;%1.&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">January 2027: Aion Instruct is planned to roll out to retail devices, completing the transition from Phi Silica.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/li>\n<\/ol>\n<p><span data-contrast=\"auto\">Developers can find the latest transition information in the Windows AI documentation:<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><a href=\"https:\/\/learn.microsoft.com\/en-us\/windows\/ai\/apis\/phi-silica\"><span data-contrast=\"auto\">https:\/\/learn.microsoft.com\/en-us\/windows\/ai\/apis\/phi-silica<\/span><\/a><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<h2>A transition designed for continuity<\/h2>\n<p><span data-contrast=\"auto\">Phi Silica helped establish a foundation for local language-model experiences on Windows. Microsoft Aion Instruct represents the next step in that journey, improving the platform while enabling it to reach more devices. With Aion Instruct, we\u2019ll also be removing key adoption barriers like the need for an LAF token (removal targeted for January).<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">The staged transition gives developers time to evaluate their experiences and prepare for broader adoption. Most existing AI-powered features will continue to work (with the exception of custom LoRAs) as they move to the newer model foundation.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<h2>What&#8217;s next?<\/h2>\n<p><span data-contrast=\"auto\">This is the beginning of the next phase of local AI on Windows. We&#8217;ll continue expanding Aion Instruct across supported hardware and working with developers to improve the experience.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">As the rollout progresses, we&#8217;ll share updated guidance, documentation, and ways for developers to try Aion Instruct and provide feedback.<\/span><span data-ccp-props=\"{}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">We&#8217;re excited to see what you build with Aion Instruct on Windows. Be sure to check out <a href=\"https:\/\/ignite.microsoft.com\/en-US\/sessions\/THR888\">THR888: Build On-Device AI Experiences w\/ Windows AI APIs<\/a> at Ignite 2026 to learn more about Aion Instruct (recording will be available).<\/span><\/p>\n<p>To share feedback, create an Issue in the WinAppSDK repo: <a href=\"https:\/\/github.com\/microsoft\/WindowsAppSDK\/issues\">Issues \u00b7 microsoft\/WindowsAppSDK<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today we&#8217;re sharing the transition plan from Phi Silica to Aion Instruct, Microsoft&#8217;s latest on-device language model for Windows. Aion Instruct will begin rolling out to CP+ devices through the Windows Insider Program in late November, with full Windows Retail availability targeted for late January. We&#8217;re also expanding Aion Instruct to supported GPUs, bringing local [&hellip;]<\/p>\n","protected":false},"author":219760,"featured_media":10,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[34,40,5,37,38,15,41,39,42],"class_list":["post-140","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-foundry-windows","tag-gpu","tag-language-models","tag-local-ai","tag-microsoft-aion-instruct","tag-microsoft-foundry-on-windows","tag-on-device-ai","tag-phi-silica","tag-windows-ai","tag-windows-app-development"],"acf":[],"blog_post_summary":"<p>Today we&#8217;re sharing the transition plan from Phi Silica to Aion Instruct, Microsoft&#8217;s latest on-device language model for Windows. Aion Instruct will begin rolling out to CP+ devices through the Windows Insider Program in late November, with full Windows Retail availability targeted for late January. We&#8217;re also expanding Aion Instruct to supported GPUs, bringing local [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/posts\/140","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/users\/219760"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/comments?post=140"}],"version-history":[{"count":2,"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/posts\/140\/revisions"}],"predecessor-version":[{"id":154,"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/posts\/140\/revisions\/154"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/media\/10"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/media?parent=140"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/categories?post=140"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry-on-windows\/wp-json\/wp\/v2\/tags?post=140"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}