Azure DevOps Blog

DevOps, Git, and Agile updates from the team building Azure DevOps

Accelerated Continuous Testing with Test Impact Analysis – Part 2

The previous post introduced how - for a given code commit - TIA will select and run only the relevant tests required to validate that commit. Thus, without sacrificing quality, both the testrun and its enclosing CI definition will complete faster. Here is how that translated to reality for one of our teams: The top graph plots the time-to-...

Visual Studio Test Platform, MSTest V2 – Transparent Development

Transparent development enables collaboration. When we open sourced the Visual Studio Test Platform and the MSTest Test Framework "MSTest V2", we shared out links to issues, implementation and our roadmap. Here are all the links (including links to groomed backlogs and RFCs) for your convenience: Visual Studio Test Platform: Implementation...

Using ‘Visual Studio Agent Deployment’ task on machines not connected to the internet

'Run Functional Tests' (RFT) task is used for running functional tests using remote machines or to run tests in a distributed manner using multiple machines. With TFS 2017 Update 2 and VSTS, You can use "Run Functional Tests" task to run tests using Visual Studio Test Agent 2017. The RFT task needs a companion 'Deploy Test Agent' task that ...

MSTest V2 is open source

As promised, we announced the open sourcing of MSTest Test Framework "MSTest V2". The community now has a fully supported, open source, cross-platform implementation of the MSTest V2 portfolio with which to write tests targeting .NET Framework, .NET Core and ASP.NET Core on Windows, Linux, and Mac. Here are the public repositories on ...

VSTest task dons a new avatar – testing with unified agents and phases

Visual Studio Test (VSTest) and the Run Functional Test (RFT) tasks are used widely for continuous testing with Team Build and Release Management. As we thought about how test execution in the pipeline should evolve the guiding principles were to ensure that test execution in the pipeline is fast and reliable for all types of tests, be it ...

Accelerated Continuous Testing with Test Impact Analysis – Part 1

Continuous Testing in DevOps In older testing strategies, large software changes were tested as a complete product after a so called "release to QA", running almost all tests just before release. We know the downsides to that. On the other hand, DevOps is all about a fast development to delivery pipeline and continuous delivery of value. ...

MSTest V2 – Now and Ahead

MSTest V2 has crossed 100K downloads. It has been but just a few months since we shipped it on NuGet. Over this course of time, you have reported issues and given us feedback, and we have tried to address them as fast as we can, refreshing the bits at a feverish pace. We are now at a stage where, as of v1.1.11 MSTest V2 has shed the pre-...

Evolving the Visual Studio Test Platform – Part 4: Together, in the Open

[This is the 4th post in a 4-part series on evolving the Visual Studio Test Platform. You can read the earlier parts here: Evolving the Visual Studio Test Platform – Part 3, Evolving the Visual Studio Test Platform – Part 2, Evolving the Visual Studio Test Platform – Part 1] The Test Platform is where it is at thanks to its community...

Evolving the Visual Studio Test Platform – Part 3: .NET Core, convergence, and cross-plat

[This is the 3rd post in the series on evolving the Visual Studio Test Platform. You can read the earlier posts here: Evolving the Visual Studio Test Platform – Part 2, Evolving the Visual Studio Test Platform – Part 1] As .NET Core draws an ever-growing community of developers with existing assets and experiences, it is essential to ...