{"id":27039,"date":"2020-11-16T21:00:25","date_gmt":"2020-11-16T21:00:25","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/cppblog\/?p=27039"},"modified":"2023-02-02T19:09:31","modified_gmt":"2023-02-02T19:09:31","slug":"the-coalition-sees-27-9x-iteration-build-improvement-with-visual-studio-2019","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/cppblog\/the-coalition-sees-27-9x-iteration-build-improvement-with-visual-studio-2019\/","title":{"rendered":"The Coalition Sees 27.9X Iteration Build Improvement with Visual Studio 2019"},"content":{"rendered":"

Visual Studio 2019\u00a0<\/span>v16.8 Preview 3.<\/span>2<\/span>\u00a0<\/span>introduces\u00a0<\/span>significant build and link time improvements.\u00a0<\/span>In this blog post,\u00a0<\/span>we\u00a0<\/span>detail how\u00a0<\/span>the team in The Coalition building\u00a0<\/span>Gears 5<\/span>\u00a0<\/span>tested\u00a0<\/span>the\u00a0<\/span>compile and link times in\u00a0<\/span>three\u00a0<\/span>different versions of Visual Studio<\/span>.<\/span>\u00a0<\/span>The experiment was conducted to<\/span>\u00a0<\/span>measure\u00a0<\/span>not only\u00a0<\/span>overall<\/span>\u00a0end-to-end time<\/span>\u00a0improvement<\/span>s<\/span>\u00a0but also\u00a0<\/span>link time improvements in the preview compared to the current release.\u00a0<\/span>Using<\/span>\u00a0Visual Studio 2019<\/span>,<\/span>\u00a0<\/span>the team saw\u00a0<\/span>2.67x faster<\/span><\/b>\u00a0<\/span>e<\/span>nd<\/span>-to-end<\/span>\u00a0build times<\/span>\u00a0<\/span>and<\/span>\u00a0<\/span>27.9x faster<\/span><\/b>\u00a0link times\u00a0<\/span>compared to<\/span>\u00a0<\/span>Visual Studio 2017.<\/span>\u00a0<\/span><\/p>\n

\u201cThe improvements are massive and will greatly improve our iteration times<\/strong><\/em>\u201d<\/strong><\/em>\u00a0<\/span>\u2013<\/span>Aurel Cordonnier<\/span>\u00a0from The Coalition<\/span><\/p>\n

 <\/p>\n

Background<\/h2>\n

Compile times are a consistent theme of feedback from Visual Studio developers. Recently, we launched numerous build optimization efforts. One of which is working closely with our colleagues across Xbox Game Studios. Here, we seek to identify opportunities to improve our Visual Studio developer experience. The following details the build and link time improvements The Coalition saw when using Visual Studio 2019 v16.8 Preview 3.2.<\/p>\n

 <\/p>\n

Building Gears 5<\/h2>\n

\"Image<\/a><\/p>\n

<\/h2>\n

Methodology<\/h2>\n

The Gears 5 team compiled and linked the PC version of the game, using three different build configurations sequentially. The configs compile and link a very large code base into one monolithic executable. To produce consistent results, the team chose not to use \/debug:fastlink with the build machines since the machines need to publish symbols.<\/p>\n

To measure link times, the wall clock execution time of this compilation experiment starts before link is called and ends after linking the final executable. Similarly, the end-to-end times were read from the build system output (total execution time). Then, the link time from linker\u2019s verbose output were subtracted from the total execution time to get the compile times. \u00a0The results are an average of five tests conducted for each configuration to achieve consistency with a low variance.<\/p>\n

 <\/p>\n

Results<\/h2>\n

The results of the experiment showed both compile and link times significantly improved in Visual Studio 2019. The compilation time for all three configurations has been improved by a factor of 2.15<\/strong>. In the ship configuration, Gears 5 took 41 minutes (2461.92 seconds) to compile in Visual Studio 2017. In comparison, the compilation took only 18.76 minutes (1125.61 seconds) in Visual Studio 2019 16.8 Preview 3.2. On average, the link times improved 27.9X<\/strong>. The ship config took only 29.57 seconds compared to 11.28 minutes (677.07 seconds) previously. Overall, the end-to-end compilation time decreased by a factor of 2.67X<\/strong>.<\/p>\n

\"Image<\/a><\/p>\n

\"Image<\/a><\/p>\n

 <\/p>\n\n\n\n\n\n\n\n\n
Compile Time (seconds)<\/strong><\/td>\ndev<\/strong><\/td>\ntest<\/strong><\/td>\nship<\/strong><\/td>\n<\/tr>\n
15.9<\/td>\n2779.80<\/td>\n2605.97<\/td>\n2461.92<\/td>\n<\/tr>\n
16.7.5<\/td>\n1321.47<\/td>\n1155.24<\/td>\n1089.27<\/td>\n<\/tr>\n
16.8.0 p3.2<\/td>\n1338.17<\/td>\n1193.48<\/td>\n1125.61<\/td>\n<\/tr>\n
x times faster<\/em><\/td>\n2.08<\/td>\n2.18<\/td>\n2.19<\/td>\n<\/tr>\n
average x times faster<\/em><\/strong><\/td>\n2.15<\/strong><\/td>\n<\/td>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

 <\/p>\n\n\n\n\n\n\n\n\n
Link Time (seconds)<\/strong><\/td>\ndev<\/strong><\/td>\ntest<\/strong><\/td>\nship<\/strong><\/td>\n<\/tr>\n
15.9<\/td>\n751.93<\/td>\n682.06<\/td>\n677.07<\/td>\n<\/tr>\n
16.7.5<\/td>\n66.76<\/td>\n62.86<\/td>\n59.00<\/td>\n<\/tr>\n
16.8.0 p3.2<\/td>\n26.72<\/td>\n26.25<\/td>\n22.90<\/td>\n<\/tr>\n
x times faster<\/em><\/td>\n28.14<\/td>\n25.98<\/td>\n29.57<\/td>\n<\/tr>\n
average x times faster<\/em><\/strong><\/td>\n27.90<\/strong><\/td>\n<\/td>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

 <\/p>\n\n\n\n\n\n\n\n\n
End-to-end (seconds)<\/strong><\/td>\ndev<\/strong><\/td>\ntest<\/strong><\/td>\nship<\/strong><\/td>\n<\/tr>\n
15.9<\/td>\n3531.73<\/td>\n3288.03<\/td>\n3138.99<\/td>\n<\/tr>\n
16.7.5<\/td>\n1388.23<\/td>\n1218.10<\/td>\n1148.27<\/td>\n<\/tr>\n
16.8.0 p3.2<\/td>\n1364.89<\/td>\n1219.73<\/td>\n1148.51<\/td>\n<\/tr>\n
x times faster<\/em><\/td>\n2.59<\/td>\n2.70<\/td>\n2.73<\/td>\n<\/tr>\n
average x times faster<\/em><\/strong><\/td>\n2.67<\/strong><\/td>\n<\/td>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

 <\/p>\n

<\/h2>\n

Analysis<\/h2>\n

The C++ team made large steps towards Linker performance in Visual Studio version 16.0 and 16.2 with two significant changes to the linker that help speed up the generation of Program Database (PDB) files. Type pruning in the backend removes unreferenced type information. By using a fast hash function to identify identical types, type merging sped up. Please see details in this blog post.<\/a><\/p>\n

In version 16.6, changes were made to algorithms inside the PDB and Debug Interface Access components. Next, optimization efforts were made in version 16.7 to speed up the worst case Incremental Linking time<\/a>. Later, multi-threading the generation of PDB files further improved performance in version 16.8. Please stay tuned for future blogs that dive deeper into these improvements.<\/p>\n

 <\/p>\n

Developer Conversation<\/h2>\n

\"Image<\/a><\/p>\n

Aurel from The Coalition<\/strong> spoke to us about how improved build times have affected the studio.<\/p>\n

What prompted the move to Visual Studio 2019?<\/p>\n

\n

So, we\u2019re not actually moving Gears 5 to 2019. We did the work to get Visual Studio 2019 going on PC for the purpose of comparing build times and providing feedback. Gears 5 shipped over a year ago and the game has been very carefully tuned; therefore, we don\u2019t want to take the risk of changing the toolchain as we have limited testing capacity and very slight optimization changes could change the balance of the game in very subtle ways. In addition, the XDK does not support 2019 so we would need to support two toolchains which is something we don\u2019t have the capacity for.<\/p>\n

The results of the experiment reinforced our desire to stay current with new versions of Visual Studio for our future projects.<\/p>\n<\/blockquote>\n

What are some immediate benefits?<\/p>\n

\n

We are using Visual Studio 2019 on our next (unannounced) project and the benefits are many: faster compile\/link times, more responsive UI, much more stable debugging.<\/p>\n<\/blockquote>\n

What are some potential long-term benefits?<\/p>\n

\n

Developer iteration is key to our success, any time we can shave a few seconds off our iteration loop, it means developers have more time to write quality code, fix bugs etc. Faster build times on the build farm means our testing team can get a build sooner, can find more bugs etc.<\/p>\n

In the end, we will end up with a better game for our fans.<\/p>\n<\/blockquote>\n

How might this change the workflow patterns of the studio?<\/p>\n

\n

With Visual Studio 2017 (and 2019 prior to 16.8), we had to choose between fast link times or debugging stability (by using \/debug:fastlink or not).<\/p>\n

With 16.8, we can have both as link times without fastlink are very fast.<\/p>\n<\/blockquote>\n

Upgrade Visual Studio<\/i><\/b><\/h2>\n

Download the latest Visual Studio 2019 Preview<\/a> and experience faster end-to-end compile times for your own projects.<\/p>\n

How will these improvements impact your day-to-day workflow? Talk to us in the comments below, on Twitter (@VisualC)<\/a>, or via email at visualcpp@microsoft.com<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Visual Studio 2019\u00a0v16.8 Preview 3.2\u00a0introduces\u00a0significant build and link time improvements.\u00a0In this blog post,\u00a0we\u00a0detail how\u00a0the team in The Coalition building\u00a0Gears 5\u00a0tested\u00a0the\u00a0compile and link times in\u00a0three\u00a0different versions of Visual Studio.<\/p>\n","protected":false},"author":39811,"featured_media":27044,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1,3927,218],"tags":[78,140,3883,25],"class_list":["post-27039","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cplusplus","category-game-development","category-performance","tag-build-times","tag-c","tag-gaming","tag-linker"],"acf":[],"blog_post_summary":"

Visual Studio 2019\u00a0v16.8 Preview 3.2\u00a0introduces\u00a0significant build and link time improvements.\u00a0In this blog post,\u00a0we\u00a0detail how\u00a0the team in The Coalition building\u00a0Gears 5\u00a0tested\u00a0the\u00a0compile and link times in\u00a0three\u00a0different versions of Visual Studio.<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts\/27039","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/users\/39811"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/comments?post=27039"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts\/27039\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/media\/27044"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/media?parent=27039"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/categories?post=27039"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/tags?post=27039"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}