{"id":10909,"date":"2025-01-06T20:00:29","date_gmt":"2025-01-07T04:00:29","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/directx\/?p=10909"},"modified":"2025-01-06T16:17:37","modified_gmt":"2025-01-07T00:17:37","slug":"enabling-neural-rendering-in-directx-cooperative-vector-support-coming-soon","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/directx\/enabling-neural-rendering-in-directx-cooperative-vector-support-coming-soon\/","title":{"rendered":"Enabling Neural Rendering in DirectX: Cooperative Vector Support Coming Soon"},"content":{"rendered":"<h3>Neural Rendering: A New Paradigm in 3D Graphics Programming<\/h3>\n<p>In the constantly advancing landscape of 3D graphics, neural rendering technology represents a significant evolution. Neural rendering broadly defines the suite of techniques that leverage AI\/ML to dramatically transform traditional graphics pipelines. These new methods promise to push the boundaries of what\u2019s possible in real-time graphics. DirectX is committed to cross-platform enablement of neural rendering techniques, and cooperative vectors are at the core of this initiative.<\/p>\n<p><strong>We are excited to share our plans to add cooperative vector support to DirectX, which will light up cross-platform enablement of the next generation of neural rendering techniques.<\/strong><\/p>\n<h3>What are Cooperative Vectors, and why do they matter?<\/h3>\n<p>Cooperative vector support will accelerate AI workloads for real-time rendering, which directly improves the performance of neural rendering techniques. It will do so by enabling multiplication of matrices with arbitrarily sized vectors, which optimize the matrix-vector operations that are required in large quantities for AI training, fine-tuning, and inferencing. Cooperative vectors also enable AI tasks to run in different shader stages, which means a small neural network can run in a pixel shader without consuming the entire GPU. Cooperative vectors will enable developers to seamlessly integrate neural graphics techniques into DirectX applications and light up access to AI-accelerator hardware across multiple platforms. Our aim is to provide game developers with the cutting-edge tools they need to create the next generation of immersive experiences.<\/p>\n<h3>What\u2019s Next For Neural Rendering?<\/h3>\n<p>The HLSL team is working with AMD, Intel, NVIDIA, and Qualcomm on bringing cross-vendor support for cooperative vectors to the DirectX ecosystem. <a href=\"https:\/\/github.com\/microsoft\/hlsl-specs\">Stay tuned<\/a> for more updates about cooperative vectors and its upcoming Preview release!<\/p>\n<p>Cooperative vectors will unlock the power of Tensor Cores with neural shading in <a href=\"https:\/\/nvidianews.nvidia.com\/news\/nvidia-blackwell-geforce-rtx-50-series-opens-new-world-of-ai-computer-graphics\">NVIDIA\u2019s new RTX 50-series hardware<\/a>. Neural shaders can be used to visualize game assets with AI, better organize geometry for improved path tracing performance and tools to create game characters with photo-realistic visuals. Learn more about NVIDIA\u2019s plans for neural shaders and DirectX <a href=\"https:\/\/nam06.safelinks.protection.outlook.com\/?url=https%3A%2F%2Fdeveloper.nvidia.com%2Fblog%2Fnvidia-rtx-neural-rendering-introduces-next-era-of-ai-powered-graphics-innovation%2F&amp;data=05%7C02%7Ccahoef%40microsoft.com%7C5e5147f4949546e343f508dd2e8a313c%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638717893314344203%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&amp;sdata=wfOGWRyFkipC%2BZ%2FmPlz%2BiwXFz0jAT0VArYJhh5rY6tE%3D&amp;reserved=0\">here<\/a>.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Neural Rendering: A New Paradigm in 3D Graphics Programming In the constantly advancing landscape of 3D graphics, neural rendering technology represents a significant evolution. Neural rendering broadly defines the suite of techniques that leverage AI\/ML to dramatically transform traditional graphics pipelines. These new methods promise to push the boundaries of what\u2019s possible in real-time graphics. [&hellip;]<\/p>\n","protected":false},"author":1747,"featured_media":12651,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-10909","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-directx"],"acf":[],"blog_post_summary":"<p>Neural Rendering: A New Paradigm in 3D Graphics Programming In the constantly advancing landscape of 3D graphics, neural rendering technology represents a significant evolution. Neural rendering broadly defines the suite of techniques that leverage AI\/ML to dramatically transform traditional graphics pipelines. These new methods promise to push the boundaries of what\u2019s possible in real-time graphics. [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/posts\/10909","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/users\/1747"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/comments?post=10909"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/posts\/10909\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/media\/12651"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/media?parent=10909"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/categories?post=10909"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/directx\/wp-json\/wp\/v2\/tags?post=10909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}