{"id":1234,"date":"2025-09-23T12:01:15","date_gmt":"2025-09-23T19:01:15","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/foundry\/?p=1234"},"modified":"2025-10-07T17:36:56","modified_gmt":"2025-10-08T00:36:56","slug":"foundry-local-meets-more-silicon","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/foundry\/foundry-local-meets-more-silicon\/","title":{"rendered":"Foundry Local Meets More Silicon"},"content":{"rendered":"

Foundry Local is a high-performance local AI runtime stack that brings Azure AI Foundry\u2019s power to client devices. Foundry Local lets you build and ship cross-platform AI apps that run models with acceleration on a wide range of hardware.<\/p>\n

The Evolution of AI Acceleration<\/h2>\n

On-device AI has progressed rapidly. Early workloads ran on CPUs, but performance and power limits made real-time inference difficult. GPUs improved things with parallelism, faster inference. The latest breakthrough is NPUs (Neural Processing Units), designed specifically for neural networks. NPUs deliver far greater efficiency and throughput, making advanced models practical on desktop and mobile applications. This shift enables AI that is faster, more energy-efficient, and privacy-preserving \u2014 without constant reliance on the cloud.<\/p>\n

What\u2019s New<\/h2>\n

With the release of Foundry Local v0.7, we are pleased to announce expanded NPU support, now including Intel and AMD NPUs on Windows 11. We are also continuing to make Foundry Local improvements for NVIDIA and Qualcomm silicon, in partnership with our silicon partners. Furthermore, leveraging Windows ML<\/a>, Foundry Local automatically detects users\u2019 silicon across NPU, GPU, and CPU and downloads the appropriate execution providers, removing the necessity for these to be bundled with Foundry Local.<\/p>\n

\"Example<\/a><\/p>\n

 <\/p>\n

Get Started<\/h2>\n

\u00a0<\/h2>\n

On Windows<\/strong><\/span><\/p>\n

    \n
  1. Open Windows Terminal<\/li>\n
  2. Install Foundry Local using winget\n
    winget install Microsoft.FoundryLocal<\/code><\/pre>\n<\/li>\n
  3. Run a model\n
    foundry model run qwen2.5-0.5b<\/code><\/pre>\n<\/li>\n<\/ol>\n
     <\/p>\n
    On MacOS<\/strong><\/span><\/p>\n
      \n
    1. Open Terminal<\/li>\n
    2. Install Foundry Local\n
      brew tap microsoft\/foundrylocal\r\nbrew install foundrylocal<\/code><\/pre>\n<\/li>\n
    3. Run a model\n
      foundry model run qwen2.5-0.5b<\/code><\/pre>\n<\/li>\n<\/ol>\n
       <\/p>\n
      For more information, check out Foundry Local documentation and samples\u00a0here<\/a>.\u00a0
      For developers interested in bringing their own models to Windows, check out       Windows ML<\/a> now available in general availability.<\/p>\n
       <\/p>\n
       <\/p>\n
       <\/p>\n
       <\/p>\n","protected":false},"excerpt":{"rendered":"
      Foundry Local is a high-performance local AI runtime stack that brings Azure AI Foundry\u2019s power to client devices. Foundry Local lets you build and ship cross-platform AI apps that run models with acceleration on a wide range of hardware. The Evolution of AI Acceleration On-device AI has progressed rapidly. Early workloads ran on CPUs, but […]<\/p>\n","protected":false},"author":189732,"featured_media":1563,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[37,1],"tags":[3,38,2],"class_list":["post-1234","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-foundrylocal","category-microsoft-foundry","tag-ai-development","tag-foundry-local","tag-microsoft-foundry"],"acf":[],"blog_post_summary":"
      Foundry Local is a high-performance local AI runtime stack that brings Azure AI Foundry\u2019s power to client devices. Foundry Local lets you build and ship cross-platform AI apps that run models with acceleration on a wide range of hardware. The Evolution of AI Acceleration On-device AI has progressed rapidly. Early workloads ran on CPUs, but […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/posts\/1234","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/users\/189732"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/comments?post=1234"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/posts\/1234\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/media\/1563"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/media?parent=1234"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/categories?post=1234"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/foundry\/wp-json\/wp\/v2\/tags?post=1234"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}