{"id":6243,"date":"2006-07-11T14:56:00","date_gmt":"2006-07-11T14:56:00","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/vcblog\/2006\/07\/11\/what-has-the-vc-team-been-doing-since-vs-2005-shipped\/"},"modified":"2019-02-18T18:54:46","modified_gmt":"2019-02-18T18:54:46","slug":"what-has-the-vc-team-been-doing-since-vs-2005-shipped","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/cppblog\/what-has-the-vc-team-been-doing-since-vs-2005-shipped\/","title":{"rendered":"What has the VC++ Team Been Doing since VS 2005 Shipped?"},"content":{"rendered":"<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Hi! My name is Shaun Miller and I&rsquo;m the test lead for the Visual C++ Release and IDE quality assurance teams. I&rsquo;ve been around Microsoft for the last 10 years and Visual C++ has been a big part of my experience here.<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Times New Roman\" size=\"3\"><span><\/p>\n<p><\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>We&rsquo;ve been very busy on the Visual C++ team since we shipped VS 2005. Here are some of the activities that we&rsquo;ve been focusing on since VS 2005.<\/span><\/font><font face=\"Times New Roman\" size=\"3\"><span>&nbsp;<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Times New Roman\" size=\"3\"><span><\/p>\n<p><\/span><\/font>&nbsp;<font face=\"Arial\" size=\"2\"><span>We spent a considerable amount of time transitioning to new software lifecycle processes. I&rsquo;ve got a quick summary. For more information, see <a title=\"https:\/\/channel9.msdn.com\/Showpost.aspx?postid=179307\" href=\"https:\/\/channel9.msdn.com\/Showpost.aspx?postid=179307\">Carol Grojeans channel 9 talk on MQ (Milestone Quality)<\/a>. <\/span><\/font><\/p>\n<ul type=\"disc\">\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Eliminate Test Debt (Test Cases\/Test Infrastructure). We worked fast and furious on VS 2005 and left some bugs in some tests and we delayed some test infrastructure work. We also made changes to our processes to avoid building test debt for Orcas.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>70 percent Automated Code Block Coverage. Not all of the Visual C++ binaries have at least 70% block coverage. We&rsquo;ve done a lot to improve that. It&rsquo;s important to note that we are testing code blocks, not source lines. There are a lot of blocks that are generated by the compiler (for instance, when using exception handling).<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Complete Whidbey threat models. We completed threat models for VS 2005, but upon review some were not as thorough as we would have liked.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Start Orcas with no bug debt. This effort was a transition to get more realistic about how much work we can actually do along with a serious amount of bug fixing. This eventually led to blogging a <a title=\"http:\/\/blogs.msdn.com\/vcblog\/archive\/2006\/5\/30.aspx\" href=\"http:\/\/blogs.msdn.com\/vcblog\/archive\/2006\/5\/30.aspx\">guide<\/a> for the kinds of bugs that we can handle during the Orcas product cycle.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>New setup technology rollout. We moved from an old setup technology to a setup based on XML.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Tests Run anywhere &#8211; not lab specific. Visual Studio is a big product and that requires a lot of teams. Some teams, like Visual C++, existed before there was a Visual Studio and their tests ran in their own ways. We spent some time to further a long term objective to move to a model where any teams&rsquo; tests can run in any lab in Visual Studio.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>BVT 40% Coverage in 1 hr. We increased the coverage of our build verification testing.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Feature Directory Definition and Implementation. We got a lot more formal regarding planning features. We now produce feature specifications and implementation plans for every feature in Orcas.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Build Warning Elimination. In VS 2005, the VC++ compiler eliminated some compiler switches which result in warnings when used and issued new warnings. While we fixed the issues that were critical for VS 2005, the non-critical warnings led to very large build logs. So we did some clean-up to make it easier to find the critical things in our build logs.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Convert our builds to MSBuild. We now use MSBuild to build Visual C++.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Orcas Quality Gates. We implemented process to improve the quality of features before they are integrated into Visual Studio. The result should provide you with a better experience with pre-release versions of Orcas than you had with pre-release versions of VS 2005.<\/span><\/font> \n<\/p>\n<\/li>\n<li class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Team Foundation. We&rsquo;re moving to VS Team Foundation for our source control and bug tracking.<\/span><\/font> <\/li>\n<\/ul>\n<p class=\"MsoNormal\"><font face=\"Times New Roman\" size=\"3\"><span><\/p>\n<p><\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>We&rsquo;ve fixed a lot of bugs:<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; So far, over 200 VC++ bug fixes are going into VS 2005 sp1 <a title=\"http:\/\/blogs.msdn.com\/vcblog\/archive\/2006\/6\/22.aspx\" href=\"http:\/\/blogs.msdn.com\/vcblog\/archive\/2006\/6\/22.aspx\">http:\/\/blogs.msdn.com\/vcblog\/archive\/2006\/6\/22.aspx<\/a>.<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; So far, over 700 VC++ bug fixes are going into Orcas.<\/span><\/font><font face=\"Times New Roman\" size=\"3\"><span>&nbsp;<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>We&rsquo;ve also been working on VS 2003 sp1. We still have a little work left though it is nearing completion.<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span>Of course, we&rsquo;ve also been working on Orcas (the next product to release after VS 2005). But that story will unfold here on the Visual C++ Team Blog in the coming months.<\/span><\/font><font face=\"Times New Roman\" size=\"3\"><span>&nbsp;<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Times New Roman\" size=\"3\"><span>Shaun Miller<br \/>QA Lead<br \/>Visual C++ Release\/IDE<\/span><\/font><\/p>\n<p class=\"MsoNormal\"><font face=\"Arial\" size=\"2\"><span><\/span><\/font><\/p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hi! My name is Shaun Miller and I&rsquo;m the test lead for the Visual C++ Release and IDE quality assurance teams. I&rsquo;ve been around Microsoft for the last 10 years and Visual C++ has been a big part of my experience here. We&rsquo;ve been very busy on the Visual C++ team since we shipped VS [&hellip;]<\/p>\n","protected":false},"author":289,"featured_media":35994,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-6243","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cplusplus"],"acf":[],"blog_post_summary":"<p>Hi! My name is Shaun Miller and I&rsquo;m the test lead for the Visual C++ Release and IDE quality assurance teams. I&rsquo;ve been around Microsoft for the last 10 years and Visual C++ has been a big part of my experience here. We&rsquo;ve been very busy on the Visual C++ team since we shipped VS [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts\/6243","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/users\/289"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/comments?post=6243"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts\/6243\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/media\/35994"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/media?parent=6243"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/categories?post=6243"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/tags?post=6243"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}