Remote testing – Distributing tests based on number of machines

Atin Bansal

Atin

With Sprint 102 deployment on Visual Studio Team Services, we have enabled tests from within an assembly to be distributed to remote machines using the Run Functional Tests task (formerly called Run Tests using Test Agent). This has been one of the bigger asks from customers around Remote testing. You will see a new check box in the task as below.  

Distribute Tests by Number of Machines1

Instead of distributing tests at the assembly level, enabling this setting will distribute tests based on the number of machines irrespective of the container assemblies given to the task. Please try it out (see https://blogs.msdn.microsoft.com/visualstudioalm/2015/05/29/testing-in-continuous-integration-and-continuous-deployment-workflows/ for information on how to use the task) and let me know if you have any feedback.

 

Atin Bansal
Atin Bansal

Program Manager, Azure DevOps

Follow Atin   

2 Comments
Avatar
Sunil Buddala 2019-03-06 11:50:50
Hi, I am using this option but we have a problem it's running on the second VM only after finishing on first VM. We have specflow tests(using xunit) in one assembly and using two VMs in the machine group. I checked Distribute tests by number of machines. I disabled parallel execution of tests in the assembly. assembly [assembly: CollectionBehavior(DisableTestParallelization = true)] We want to run tests on the same machine one by one. But run them parallely on multiple machines. How can I achieve this? we are using Microsoft Visual Studio Team Foundation Server Version 16.122.27409.2