Microsoft Foundry on Windows Blog
News and guidance on the unified platform for local AI development on Windows
Latest posts
Microsoft Aion Instruct: Advancing local AI on Windows and expanding to GPU
Today we're sharing the transition plan from Phi Silica to Aion Instruct, Microsoft's latest on-device language model for Windows. Aion Instruct will begin rolling out to CP+ devices through the Windows Insider Program in late November, with full Windows Retail availability targeted for late January. We're also expanding Aion Instruct to supported GPUs, bringing local language model capabilities to a broader range of Windows devices. Microsoft Aion Instruct is designed to power fast, responsive language model experiences directly on your device. This transition gives Windows and Microsoft applications a newer...
Challenges of building machine learning compilers across varying hardware architecture
Additional Contributors: Justin Stoecker, Sheil Kumar Overview One of the biggest challenges in building AI/ML platform stacks for mobile, client, or server is creating a machine learning (ML) compiler that is both scalable yet performant. A common approach is to build specialized compilers for specific AI hardware, frameworks, or workload types. For example, independent hardware vendors (IHVs) provide their own frameworks to deploy models on their hardware, and PyTorch includes torch.compile as a framework-specific compiler. Other ML compiler efforts include MLIR (Multi-Level Intermediate Representation), whic...
Advancing the Quality-Efficiency Frontier for Coding AI on Windows PCs
Powered by NVIDIA RTX Spark, we are bringing the promise of unmetered local intelligence to increasingly demanding coding workloads—giving developers greater freedom to experiment, delegate, and iterate on their own hardware, without per-token cloud charges. Highly capable mixture-of-experts (MoE) models are making this opportunity tangible. These models tackle complex coding tasks spanning reasoning, implementation, testing, and debugging, while advances in efficiency are bringing more of that capability onto local devices. With 128 GB of unified memory, RTX Spark PCs enables us to ask a crucial question: how...
AI Development on Windows: from PyTorch and llama.cpp to Windows ML
Today we are highlighting improvements across a few key open-source projects many of you already use, as well as updates to Windows ML. To empower developers, we must support the broad range of tools for experimentation and exploration across inference and training, in addition to our production grade native inference stack. Available today, Windows adds experimental llama.cpp support to Windows ML so you can run GGUF models locally through new task-specific APIs. Windows ML is the unified, high-performance local AI inferencing framework for Windows. Our experimental Windows-native Runtime API is now in preview ...