{"id":3943,"date":"2012-11-09T13:31:07","date_gmt":"2012-11-09T13:31:07","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/visualstudioalm\/2012\/11\/09\/how-to-manage-unit-tests-in-visual-studio-2012-update-1-part-1using-traits-in-the-unit-test-explorer\/"},"modified":"2022-07-21T06:47:47","modified_gmt":"2022-07-21T14:47:47","slug":"how-to-manage-unit-tests-in-visual-studio-2012-update-1-part-1using-traits-in-the-unit-test-explorer","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/devops\/how-to-manage-unit-tests-in-visual-studio-2012-update-1-part-1using-traits-in-the-unit-test-explorer\/","title":{"rendered":"How to manage unit tests in Visual Studio 2012 Update 1 : Part 1\u2013Using Traits in the Unit Test Explorer"},"content":{"rendered":"

As a result of writing the post: Edit Test Case properties directly from the test runner of Microsoft Test Manager<\/a> I asked one the ALM MVPs, Terje Sandstrom<\/a>, to also look at one of the most requested Visual Studio Update 1 features \u2013 but an area I didn\u2019t have a post on yet: Grouping in the new Unit Test Explorer<\/font><\/em>.\u00a0\u00a0 He takes a look and by morning sends me this post and indicates he wants to do three more in this series! <\/font><\/p>\n

\n

Part 2: Using traits in TFS Build<\/strong><\/p>\n

Part 3: Testing and building using different test frameworks<\/strong><\/p>\n

Part 4: Managing code coverage for unit tests<\/strong><\/p>\n<\/blockquote>\n

***************************************************************<\/font><\/p>\n

<\/font><\/strong><\/p>\n

Part 1:\u00a0 Using Traits in the Unit Test Explorer by Terje Sandstrom<\/strong><\/font><\/strong><\/p>\n

This is the first post in a series on Unit Testing in Visual Studio 2012, focusing on the improvements in Update 1.<\/p>\n

Visual Studio 2012 has a great new Test Explorer.\u00a0 The Test Explorer is where you see the results of your unit tests.\u00a0 In Update 1 it has been extended, and you can now organize and filter the test runs based on several conditions, among them your Projects, and Traits.\u00a0\u00a0 Traits is a new concept,\u00a0 a common denominator for several underlying terms, Test Category, Test Property, Priority, and Owner.\u00a0<\/p>\n

Traits are not only useful as a grouping mechanism in the Test Explorer, it also part of what can control which tests you run.\u00a0 This has been a big request \u2013 because it means the developer can focus on the tests relevant to the work, and not be bothered with running other, perhaps long-running tests, which would otherwise slow down the whole development\u00a0 experience.\u00a0 No longer with Update 1!\u00a0\u00a0<\/p>\n

Traits are also used in TFS Build as one of the criteria to determine which tests to run for the different builds there. TFS Build is not \u201ctrait-aware\u201d in itself, but TFS Build can act on the underlying types, Categories and Properties. The details are in Part 3 in this series of posts.<\/p>\n

\u00a0<\/p>\n

Using Traits and Projects for grouping<\/strong><\/p>\n

Let us start with a MSTest based example.\u00a0 In a sample project we add 3 tests, and put them into separate categories.\u00a0 This is done by adding the TestCategory attribute to the method, and the name of the category as a string.<\/p>\n

\"image_thumb1\"<\/p>\n

Open up the Test Explorer, and choose the Group button.\u00a0 Compared to RTM we have now got 2 more options, Project and Trait.<\/p>\n

\"image_thumb4\"<\/p>\n

Under the menu the three test methods are listed based on Outcome. Changing that to Trait gives us the test grouped by their MSTest Category.<\/p>\n

\"image_thumb5\"<\/p>\n

\u00a0<\/p>\n

The other option is to group by Project, and adding a new test project it looks like this:<\/p>\n

\"image_thumb12\"<\/p>\n

\u00a0<\/p>\n

Using more trait concepts<\/strong><\/p>\n

As mentioned above, Traits can also be based on some other properties.\u00a0\u00a0 Owner and Priority are explicit and straight forward enough,\u00a0 whereas TestProperty gives you a property-value system.\u00a0 That means you can extend the Traits with your own concepts using TestProperties.<\/p>\n

In the code below, we have added these properties, and also a new property called \u201cTime\u201d, to indicate if it is a fast or long running test.<\/p>\n

\"image_thumb2\"<\/p>\n

\u00a0<\/p>\n

In the Text Explorer, still grouping by Trait, this now looks like:<\/p>\n

\"image_thumb3\"<\/p>\n

\u00a0<\/p>\n

Notice that the same test method appears multiple times, but this is just visual, they are only run once, so the total time here is not 57mS but still 19mS.<\/p>\n

Did I say \u201cjust visual\u201d ?\u00a0 It is in fact more than that \"Smile\".\u00a0<\/p>\n

\u00a0<\/p>\n

Using Traits to control test running<\/strong><\/p>\n

The Search field is named and looks like a search field.\u00a0 But a better term for it is that it is a Filter controlling what to run.\u00a0 If you click the small arrow to the right, a drop down menu appears.<\/p>\n

\"SNAGHTML23dfc1c4_thumb1\"<\/p>\n

You see a set of possible Search Filters, and above that a recent list which contains a previous set filter.\u00a0<\/p>\n

If you click on Trait, it appears inside the search field \"image_thumb41\", and you have to fill out the specific trait-name.<\/p>\n

Filtering on trait \u201cCI\u201d gives us this list:<\/p>\n

\"image_thumb6\"<\/p>\n

\u00a0<\/p>\n

The filter term will match any trait you have, be it in a category, a priority, a owner or in a property.\u00a0 In fact it matches also these words, so you can set a filter to<\/p>\n

Trait:\u201dPriority\u201d<\/strong><\/p>\n

and it will match all tests that have any priority set.<\/p>\n

\u00a0<\/p>\n

\u00a0<\/p>\n

The filter set will stay there until you change or clear it, or restart Visual Studio.\u00a0<\/p>\n

With this filter set, the Run All<\/strong> button now runs ONLY<\/strong> the tests within this filter.\u00a0<\/p>\n

\"image_thumb8\"<\/p>\n

This also applies to the automatic test runner \u2013 I assume you are aware of that one ?<\/p>\n

\n

The automatic test runner<\/strong><\/p>\n

\"SNAGHTML23ec2f46_thumb1\"<\/p>\n

The icon to the upper left is enabled here, it means that the background automatic test runner will run every time a build is performed.<\/p>\n

Make it a habit of pressing Shift-Ctrl-B<\/strong> instead of just saving your work.\u00a0 This keyboard shortcut will do a save all and then build your application.\u00a0<\/p>\n

Enabling the automatic test runner can be done either from this button in the Test Explorer or from the menu:<\/p>\n

\"image_thumb10\"<\/p>\n

\u00a0<\/p>\n

Control test runs based on other filter terms<\/strong><\/p>\n

The filter menu allows you to set up filters for not only Traits and Projects, but also for other aspects.\u00a0 The table below summarizes these with the syntax to use:<\/p>\n\n\n\n\n\n\n\n\n\n
\n Filter term<\/strong>\n <\/td>\n\n Syntax:<\/strong>\n <\/td>\n\n Example:<\/strong>\n <\/td>\n\n Comment:<\/strong>\n <\/td>\n<\/tr>\n
\n Error Message\n <\/td>\n\n Message: \n <\/td>\n\n Message:\u201dAssert.Fail\u201d\n <\/td>\n\n \u00a0\n <\/td>\n<\/tr>\n
\n Output\n <\/td>\n\n Output: \n <\/td>\n\n Output:\u201dResult\u201d\n <\/td>\n\n Assume a trace command sending out \u201cResult is\u201d+resultvalue\n <\/td>\n<\/tr>\n
\n Fully Qualified Name\n <\/td>\n\n Fullname: \n <\/td>\n\n FullName:\u201dUnitTestProject1\u201d\n <\/td>\n\n Takes all tests in that namespace\n <\/td>\n<\/tr>\n
\n FilePath\n <\/td>\n\n FilePath: \n <\/td>\n\n FilePath:\u201dIntegration.Test\u201d\n <\/td>\n\n All tests with this in the name. Includes folders above the file too, that is the file\u2019s fully qualified name.\n <\/td>\n<\/tr>\n
\n Outcome\n <\/td>\n\n Outcome: \n <\/td>\n\n Outcome:\u201dFailed\u201d\n <\/td>\n\n \u00a0\n <\/td>\n<\/tr>\n
\n \u00a0\n <\/td>\n\n \u00a0\n <\/td>\n\n \u00a0\n <\/td>\n\n \u00a0\n <\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

A filter expression can be negated by placing a \u2018-\u2018 in front.<\/p>\n

\"image_thumb14\"<\/p>\n

\u00a0<\/p>\n

Filter expressions can be combined, that is, you can add more together, just separate them by spaces.\u00a0 The combined filter expression is the logical AND of the two expressions.<\/p>\n

If we look at first only tests for CI, we find two tests:. In<\/p>\n

\"image_thumb22\"<\/p>\n

Adding another search term, looking for only tests with Owner = Terje, reduces the list.<\/p>\n

\"image_thumb18\"<\/p>\n

The most typical use for the logical AND is to handle property value settings.\u00a0 If you want to explicitly filter on Priority = 2, and be sure not to filter on anything else which uses the number 2, that could be expressed as: \"image_thumb\"<\/p>\n

\u00a0<\/p>\n

By combining the different traits you should be able to limit the number of tests you run locally.\u00a0 Pay attention to creating a set of useful and unique trait names, categories and property\/value based ones.\u00a0 This will make it easier to later set up filters.\u00a0 Also take into account that you use the same traits when filtering unit test cases\u00a0 for running in different builds.\u00a0 We will cover this in Part 3.<\/p>\n

Also note that these traits are not limited to MSTest, but works just as fine with the other test frameworks, we cover that in Part 2.\u00a0<\/p>\n

\u00a0<\/p>\n

\u00a0<\/p>\n

Some useful links:<\/strong><\/p>\n

    \n
  1. Peter Provost has written a great blog post<\/u><\/a> on the features of the new Unit testing in Visual Studio 2012.\u00a0 <\/li>\n
  2. Running unit tests with the Test Explorer is described in <\/u>this MSDN article<\/u><\/a>.\u00a0 <\/li>\n
  3. The different unit test frameworks that can be plugged in, is listed in this post<\/u><\/a>.\u00a0 <\/li>\n
  4. Installing the unit test frameworks is described here<\/u><\/a>. <\/li>\n
  5. Controlling code coverage is described here<\/u><\/a>, <\/li>\n
  6. Modifying the runsettings is here<\/u><\/a>.\u00a0 <\/li>\n
  7. Details on Test Categories<\/u><\/a> <\/li>\n<\/ol>\n

    \u00a0<\/p>\n

    <blockquote>   <p><strong><\/strong><\/p> <\/blockquote>    <p><img src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2012\/11\/terjes_1336086861_84-1.png\" width=\"131\" height=\"120\" \/><\/p>  <p>By <\/p>  <h5><a href=\"http:\/\/geekswithblogs.net\/terje\/Default.aspx\">Terje Sandstrom<\/a><\/h5>  <p>------ Chief Software Geek at Inmeta Consulting in Scandinavia ----- and a Visual Studio ALM MVP<\/p>\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"
    As a result of writing the post: Edit Test Case properties directly from the test runner of Microsoft Test Manager I asked one the ALM MVPs, Terje Sandstrom, to also look at one of the most requested Visual Studio Update 1 features \u2013 but an area I didn\u2019t have a post on yet: Grouping in […]<\/p>\n","protected":false},"author":77,"featured_media":45953,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-3943","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-devops"],"acf":[],"blog_post_summary":"
    As a result of writing the post: Edit Test Case properties directly from the test runner of Microsoft Test Manager I asked one the ALM MVPs, Terje Sandstrom, to also look at one of the most requested Visual Studio Update 1 features \u2013 but an area I didn\u2019t have a post on yet: Grouping in […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/3943","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/users\/77"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/comments?post=3943"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/3943\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media\/45953"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media?parent=3943"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/categories?post=3943"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/tags?post=3943"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}