DirectX Developer Blog

Announcing preview support for Llama 2 in DirectML

November 15, 2023 Nov 15, 2023 11/15/23

Jacques van Rhyn, Patrice Vignola

At Inspire this year we talked about how developers will be able to run Llama 2 on Windows with DirectML and the ONNX Runtime and we've been hard at work to make this a reality. We now have a sample showing our progress with Llama 2 7B! See https://github.com/microsoft/Olive/tree/main/examples/directml/llama_v2 This sample relies on ...