{"id":53280,"date":"2024-08-21T10:05:00","date_gmt":"2024-08-21T17:05:00","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/dotnet\/?p=53280"},"modified":"2024-08-21T06:26:56","modified_gmt":"2024-08-21T13:26:56","slug":"supercharge-your-testing-experience-with-ms-test-analyzers","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/dotnet\/supercharge-your-testing-experience-with-ms-test-analyzers\/","title":{"rendered":"Supercharge your testing experience with MSTest.Analyzers"},"content":{"rendered":"

MSTest ships with a set of analyzers that inspect your test code and point out common mistakes and pitfalls. These mistakes can be subtle and lead to your tests being completely ignored by the test framework.<\/p>\n

We\u2019ve been shipping these analyzers since 3.2.0, but in the latest 3.5.1, we\u2019ve added some that we think you should not miss.<\/p>\n

The missing test<\/h2>\n

One common problem is when you forget to put [TestClass]<\/code> on your class. MSTest won’t know that there are tests in the class, and it won’t run them:<\/p>\n

\r\npublic class MyTests\r\n\r\n{\r\n    [TestMethod]\r\n    public async Task TestMethod1()\r\n    {\r\n      Assert.Fail();\r\n    }\r\n}<\/code><\/pre>\n
Without MSTest.Analyzers, this code builds without warning or info message. There is no test failure when running the tests either. Because there is no [TestClass]<\/code> attribute on the class, MSTest will skip over the whole class for performance reasons, and your test will never be found.<\/p>\n
But with analyzers you get an info message during build:<\/p>\n
\"Info<\/p>\n
We recommend, to upgrade this message to a warning, or even build error, one such way is by adding this line to your .editorconfig<\/code>:<\/p>\n
[*.cs]\r\n# MSTEST0030: Type containing '[TestMethod]' should be marked with '[TestClass]'\r\ndotnet_diagnostic.MSTEST0030.severity = warning<\/code><\/pre>\n
\"Warning<\/p>\n
Why is this not a warning by default?<\/h3>\n
You might be asking why MSTEST0030<\/code> is an info message and not warning by default. The reason is that we cannot introduce breaking changes in MSTest v3, and the code above is a common pattern for re-using tests from a base class.<\/p>\n
public class MyTestsBase\r\n{\r\n    [TestMethod]\r\n    public async Task CommonTestMethod()\r\n    {\r\n    }\r\n}\r\n\r\n[TestClass]\r\npublic class MyTests : MyTestsBase\r\n{\r\n    [TestMethod]\r\n    public async Task TestMethod1()\r\n    {\r\n      Assert.Fail();\r\n    }\r\n}<\/code><\/pre>\n
In the example above, the test CommonTestMethod<\/code> will not run from MyTestsBase<\/code>, because it does not have [TestClass]<\/code> attribute, but it will be inherited to MyTests<\/code>, and will run there.<\/p>\n
We DO NOT<\/strong> recommend this pattern. Instead, we recommend to always mark classes with [TestClass]<\/code>, and make the base class abstract, if you don\u2019t want to run tests from it.<\/p>\n
[TestClass]\r\npublic abstract class MyTestsBase\r\n{\r\n    [TestMethod]\r\n    public async Task CommonTestMethod()\r\n    {\r\n    }\r\n}\r\n\r\n[TestClass]\r\npublic class MyTests : MyTestsBase\r\n{\r\n    [TestMethod]\r\n    public async Task TestMethod1()\r\n    {\r\n      Assert.Fail();\r\n    }\r\n}<\/code><\/pre>\n
This approach behaves identically to the one above, but you communicate it clearly to the analyzers and the testing framework that the abstract<\/code> base class is holding a shared logic, and should not run by itself.<\/p>\n
Malformed AssemblyInitialize<\/h2>\n
Another example of a useful analyzer is fixing the signature of [AssemblyInitialize]<\/code>, to do a one-time setup for all the tests in the assembly.<\/p>\n
I don’t know about you, but I can’t remember the signature of this method. And when I get it wrong my tests don’t run at all. This is especially annoying in Visual Studio, where the test simply remains blue, and I need to go into the Tests<\/code> output to find the reason.<\/p>\n
But with the analyzers, I can easily find out what is wrong, and there is even an automatic fix that I can apply to my code.<\/p>\n
Here I write method Setup, and VisualStudio will underline it with a warning, and I press Ctrl+.<\/code> to see the automatic fix and apply it:<\/p>\n
[TestClass]\r\npublic class MyTests\r\n{\r\n  [AssemblyInitialize]\r\n  public void Setup()\r\n  {\r\n  }\r\n}<\/code><\/pre>\n
\"Warning\n\"Fixing<\/p>\n
Fixing my code to the correct shape that the testing framework can recognize:<\/p>\n
 [TestClass]\r\n public class MyTests\r\n {\r\n     [AssemblyInitialize]\r\n     public static void Setup(TestContext context)\r\n     {\r\n     }\r\n }<\/code><\/pre>\n
Installation<\/h2>\n
The recommended way to start using MSTest.Analyzers<\/code> is by using the MSTest<\/code> nuget package, or the MSTest project SDK, with version 3.2.0 or newer.<\/p>\n
https:\/\/learn.microsoft.com\/dotnet\/core\/testing\/unit-testing-mstest-getting-started<\/a><\/p>\n
The analyzers can also be installed separately by referencing the MSTest.Analyzers<\/code> NuGet package.<\/p>\n
We wholeheartedly recommend any project that is using MSTest to upgrade to version 3.2.0 and newer, and enable those analyzers.<\/p>\n
Summary<\/h2>\n
The two analyzers showcased in this article are the ones that I find the most useful in my day-to-day. But there is a whole lot more, such as:<\/p>\n