Windows AI Platform
The Windows AI Platform enables the ML community to build and deploy AI powered experiences on the breadth of Windows devices. This developer blog provides in-depth looks at new and upcoming Windows AI features, customer success stories, and educational material to help developers get started.
Latest posts
DirectML: Accelerating AI on Windows, now with NPUs
We are thrilled to announce our collaboration with Intel®, one of our key partners, to bring the first Neural Processing Unit (NPU) powered by DirectML on Windows. AI is transforming the world, driving innovation, and creating value across industries. NPUs are critical components in enabling amazing AI experiences for developers and consumers alike. An NPU is a processor built for enabling machine learning (ML) workloads that are computationally intensive, do not require graphics interactions, and provide efficient power consumption. These new devices will revolutionize how AI transforms our day-to-day experie...
Boost Your Gen AI Experience with our DirectML extension for Automatic1111’s WebUI
Olive is a powerful open-source Microsoft tool to optimize ONNX models for DirectML. You may remember from this year’s Build that we showcased Olive support for Stable Diffusion, a cutting-edge Generative AI model that creates images from text. We didn’t want to stop there, since many users access Stable Diffusion through Automatic1111's webUI, a popular and versatile interface for Stable Diffusion. Luckily this webUI supports extensions, and today we're thrilled to reveal our DirectML extension! Specifically, our extension offers DirectML support for the compute-heavy uNet models in Stable Diffusion. Th...
Announcing preview support for Llama 2 in DirectML
At Inspire this year we talked about how developers will be able to run Llama 2 on Windows with DirectML and the ONNX Runtime and we've been hard at work to make this a reality. We now have a sample showing our progress with Llama 2 7B! See https://github.com/microsoft/Olive/tree/main/examples/directml/llama_v2 This sample relies on first doing an optimization pass on the model with Olive, a powerful optimization tool for ONNX models. Olive utilizes powerful graph fusion optimizations from the ONNX Runtime and a model architecture optimized for DirectML to speed up inference times by up to 10X! After ...
DirectML at Build 2023
DirectML shared some exciting announcements at Build this year! We demonstrated a few awesome demos and highlighted new capabilities during the Windows AI Breakout session, Deliver AI-powered experiences across cloud and edge, with Windows. We are also excited to announce the launch of our new product landing page! This new product page provides the information you need to bring performant, cross-hardware AI acceleration into your app. DirectML enables Adobe to scale to Intel’s first VPU to market We partnered with Adobe and Intel to showcase how DirectML makes it possible for developers to integrate machine...
Adobe Premiere Pro leverages DirectML on new AI Silicon
DirectML is ushering in a new wave of machine learning integration capabilities on emerging AI silicon. At the Windows AI Breakout BUILD session, we showcased how ONNX Runtime, powered by DirectML, enables Adobe’s Premiere Pro to leverage Intel’s next generation platform, Meteor Lake with integrated VPU. Adobe Premiere Pro with DirectML Adobe Premiere Pro leverages DirectML today to power many features with AI, such as Auto Reframe and Scene Edit Detection: DirectML with ONNX Runtime empowers Adobe to light up hardware acceleration for these features, with the same code path acro...
Optimize DirectML performance with Olive
Are you ready to revolutionize the way you optimize your AI models? Say hello to Olive (ONNX Live), the advanced model optimization tool that integrates seamlessly with DirectML for hardware acceleration across the breadth of the Windows ecosystem. With Olive, you can easily incorporate cutting-edge techniques like model compression, optimization, and compilation, all in one powerful tool. And the best part? You don't need to be an expert in optimizing models for underlying GPUs or NPUs - Olive does all the heavy lifting for you to get the best possible performance with DirectML! In our Stable Diffusion t...
DirectML ❤ Stable Diffusion
Text-to-image models are amazing tools that can transform natural language into stunning images. Stable Diffusion is particularly interesting. The base model can create images from text and since it’s open-source developers can customize it for their own needs and preferences. With some extra training, developers can fine-tune their model to generate images of any domain, subject, or style they want. We are demonstrating what can be done with Stable Diffusion models in two of our Build sessions: Shaping the future of work with AI and Deliver AI-powered experiences across cloud and edge, with Windows. We've ...
Transformer support for PyTorch with DirectML is here!
The latest release of PyTorch with DirectML is available today! This release brings support for training popular Transformer Models like GPT2, BERT, and Detection Transformers. To get started with training Transformer Models using PyTorch with DirectML, you can find a new sample on the DirectML GitHub. The sample covers training a PyTorch implementation of the Transformer Model in the popular paper "Attention is All You Need " (Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin, arxiv, 2017). This release of PyTorch with DirectML also includ...
Real-Time Image Blurring & DirectX Resource Binding in the Windows ML Samples Gallery
Last November, we announced the release of the Windows ML Samples Gallery. The newest release of the gallery adds 4 new samples, 2 of which are discussed in detail below. Real-Time Background Image Blurring Linnea May Real-time machine learning inference is a hot topic in ML, with applications such as real-time object detection in autonomous cars or background image blurring of a video stream during a work call. This new sample demonstrates the best practices to follow with Windows Machine Learning (Windows ML) and Microsoft Media Foundation to run background image blurring during inference on a...
DirectML Plugin for TensorFlow 2 is here
Last October we announced our generally consumable DirectML backend for TensorFlow 1.15. Since then, our team worked to bring machine learning training acceleration to TensorFlow 2. Today, we are happy to announce the release of our DirectML PluggableDevice preview package for TensorFlow on PyPI. Alongside our release, we are excited to announce that TensorFlow-DirectML-Plugin is open-sourced on GitHub. What is TensorFlow-DirectML-Plugin TensorFlow-DirectML-Plugin builds DirectML as a PluggableDevice backend to TensorFlow 2 for machine learning training on Windows and the Windows Subsystem for Linux. DirectML i...
PyTorch-DirectML: Preview Release 3
The Windows AI Platform is excited to announce the Third Preview release of PyTorch-DirectML; a hardware accelerated backend for training PyTorch models on any DirectX12 GPU on Windows and the Windows Subsystem for Linux (WSL). This preview release includes expanded support for computer vision models from the Torchvision library. On the DirectML GitHub, you’ll find additional samples to help you get starting using image classification and object detection models. Try it out today! Download from PyPI and leave feedback on the DirectML GitHub.
PyTorch-DirectML: Preview Release 2
A few months ago, we released the first preview of PyTorch-DirectML: a hardware accelerated backend for training PyTorch models on any DirectX12 GPU on Windows and the Windows Subsystem for Linux (WSL). Today, we are releasing the Second Preview with significant performance improvements and greater coverage for computer vision models. PyTorch-DirectML now works with Python versions 3.6, 3.7, and 3.8, and includes support for GPU device selection. On the DirectML GitHub, you'll find a new public Operator Roadmap indicating current and planned future support for PyTorch operators. We also published updated sampl...
Introducing the Windows ML Samples Gallery
Learn how the Windows ML API can be used to create powerful ML experiences on Windows through the Windows ML Samples Gallery.
Introducing PyTorch-DirectML: Train your machine learning models on any GPU
The Windows AI team is excited to announce the first preview of DirectML as a backend to PyTorch for training ML models! This release is our first step towards unlocking accelerated machine learning training for PyTorch on any DirectX12 GPU on Windows and the Windows Subsystem for Linux (WSL). In order for you to take advantage of DirectML within PyTorch, today we are releasing a preview PyTorch-DirectML package, which provides scoped support for convolutional neural networks (CNNS). In this package, DirectML is integrated with the PyTorch framework by introducing a new device named “DML,” which calls on the D...
GPU accelerated ML workflows broadly available in the Windows Subsystem for Linux
Support for GPU accelerated machine learning (ML) training within the Windows Subsystem for Linux (WSL) is now broadly available with the release of Windows 11. Read on for more details about using WSL with your existing ML workflows.
Train your machine learning models on any GPU with TensorFlow-DirectML
Learn about the first generally consumable package of TensorFlow-DirectML. TensorFlow-DirectML improves the experience and performance of model training through GPU acceleration on the breadth of Windows devices by working across different hardware vendors and supporting the needs of students’ and professionals’ workflows.
Build a Machine Learning Data Analysis Application
Learn how to create a Window Machine Learning application that uses a neural network to analyze tabular data and run predictions.
Windows ML NuGet Package 1.8.0 official release
Windows ML NuGet package 1.8.0 is now available! Take a look to review our new features and optimization work for Windows ML APIs and DirectML EP.