{"id":10622,"date":"2015-12-11T11:36:09","date_gmt":"2015-12-11T11:36:09","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/visualstudioalm\/2015\/12\/11\/cloud-load-test-build-task-information\/"},"modified":"2019-02-14T17:36:30","modified_gmt":"2019-02-15T01:36:30","slug":"cloud-load-test-build-task-information","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/devops\/cloud-load-test-build-task-information\/","title":{"rendered":"Cloud Load Test Build Task information"},"content":{"rendered":"<p>We are updating the <a href=\"https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index\">Visual Studio Team Services Build Steps<\/a> and thought these topics would be of interest: <\/p>\n<p><a title=\"https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index\" href=\"https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index\">https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index<\/a>. <\/p>\n<p>If you want to create your own Build Task check out my post here: <\/p>\n<p><a title=\"http:\/\/blogs.msdn.com\/b\/charles_sterling\/archive\/2015\/11\/15\/devops-php-sample-for-cory-fowler-and-his-phpworld-presentation.aspx\" href=\"http:\/\/blogs.msdn.com\/b\/charles_sterling\/archive\/2015\/11\/15\/devops-php-sample-for-cory-fowler-and-his-phpworld-presentation.aspx\">http:\/\/blogs.msdn.com\/b\/charles_sterling\/archive\/2015\/11\/15\/devops-php-sample-for-cory-fowler-and-his-phpworld-presentation.aspx<\/a><\/p>\n<p>&#160;<\/p>\n<p>&#160;<\/p>\n<p>******************************<\/p>\n<p>&#160;<\/p>\n<p>&#160; <a href=\"https:\/\/github.com\/Microsoft\/vso-agent-tasks\/blob\/master\/Tasks\/RunLoadTest\/icon.png\"><img decoding=\"async\" style=\"margin-left: 0px;margin-right: 0px\" alt=\"icon.png\" src=\"\" align=\"left\" \/><\/a>&#160; <\/p>\n<p><strong>Cloud Load Test Build Task<\/strong><\/p>\n<p>Use <a href=\"https:\/\/www.visualstudio.com\/en-us\/get-started\/test\/load-test-your-app-vs\">Visual Studio Cloud-based Load Test<\/a> to understand, test and validate your Applications performance. <\/p>\n<p>Cloud-based Load Test task can be used to trigger a load test on the Visual Studio Online Cloud-based Load Test Service.&#160; The Cloud-based Load Test Service can be used for performance and load testing of your application by generating load from Azure. If you are new to Cloud-based Load Testing then the following links will help you: <\/p>\n<ul>\n<li><a href=\"https:\/\/www.visualstudio.com\/features\/vso-cloud-load-testing-vs\">Cloud-based Load Testing with Visual Studio Online<\/a> <\/li>\n<li><a href=\"https:\/\/channel9.msdn.com\/Events\/Visual-Studio\/Launch-2013\/qe103\">Introduction to Cloud-based Load Testing with VSO<\/a> <\/li>\n<\/ul>\n<h4><strong>Demands<\/strong><\/h4>\n<p>The build agent must have the following capabilities: <\/p>\n<ul>\n<li>MSBuild <\/li>\n<li>Azure Power shell <\/li>\n<\/ul>\n<p>For more information and the source code to this task please see: <a title=\"https:\/\/github.com\/Microsoft\/vso-agent-tasks\/tree\/master\/Tasks\/RunLoadTest\" href=\"https:\/\/github.com\/Microsoft\/vso-agent-tasks\/tree\/master\/Tasks\/RunLoadTest\">https:\/\/github.com\/Microsoft\/vso-agent-tasks\/tree\/master\/Tasks\/RunLoadTest<\/a><\/p>\n<h2 id=\"Arguments\">Arguments<\/h2>\n<table id=\"DataTables_Table_0\" class=\"table table-condensed dataTable no-footer\">\n<thead>\n<tr>\n<td class=\"sorting_disabled\">Argument<\/td>\n<td class=\"sorting_disabled\">Description<\/td>\n<\/tr>\n<\/thead>\n<tbody>\n<tr role=\"row\">\n<td>Registered Connection<\/td>\n<td>\n<p>Generic Service End point is a reference to the Visual Studio Team Services Account you will be running the Load Test from and publishing the results to.<\/p>\n<p>See &lt;<strong><font color=\"#ff0000\">need link to service endpoint<\/font><\/strong> reference or point to this in the short term this <a href=\"http:\/\/roadtoalm.com\/2015\/07\/22\/using-personal-access-tokens-to-access-visual-studio-online\/\">http:\/\/roadtoalm.com\/2015\/07\/22\/using-personal-access-tokens-to-access-visual-studio-online\/<\/a>&gt;<\/p>\n<p>&#160;<\/p>\n<\/td>\n<\/tr>\n<tr role=\"row\">\n<td>Test Settings File<\/td>\n<td>This is the path where this task looks for the files required for the load test &#8211; load test file, test settings file, any deployment items and setup\/clean-up scripts . You can pick the path and the task will do a recursive search starting at that path for your files.<\/td>\n<\/tr>\n<tr role=\"row\">\n<td>Load test files folder<\/td>\n<td>\n<p>Provide the folder path to the Load Test project in this step. This is the path where this task looks for the files required for the load test &#8211; load test file, test settings file, any deployment items and setup\/clean-up scripts . You can pick the path and the task will do a recursive search starting at that path for your files.<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td colspan=\"2\"><\/td>\n<\/tr>\n<tr>\n<td>Load test file<\/td>\n<td>You also have to specify the name of the load test file (xyz.loadtest) that is to be executed as part of this task. You may have more than one load test file to perhaps cater to the various deployment environments that you deploy your App to. So pick the right one. Once these are provided, we have all the data to trigger a load test.<\/td>\n<\/tr>\n<tr>\n<td>Number of permissible threshold violations<\/td>\n<td>Optionally if your load test is already setup with threshold violations (<a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/ff426917.aspx\">Learn more about threshold violations<\/a>), then you can specify the number of critical violations to wait for before the load test should be deemed unsuccessful, in which case, the load test would then be aborted and the load test task would be marked as failed.<\/td>\n<\/tr>\n<tr>\n<td colspan=\"2\">Control Options<\/td>\n<\/tr>\n<tr>\n<td>Enabled<\/td>\n<td>Set whether this task runs as part of the build<\/td>\n<\/tr>\n<tr>\n<td>Continue On Error<\/td>\n<td>\n<p>Sets if the build continues on error<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td>Always Run<\/td>\n<td>\n<p>Sets this task to always run, even if the build has already failed<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>Example<\/h2>\n<p><u><font color=\"#0000ff\">Scheduling Load Test Execution<\/font><\/u><\/p>\n<p>&#160;<\/p>\n<h2>More Information<\/h2>\n<p>&#160;<\/p>\n<p>In your Visual Studio Online account, under the &#8216;Build&#8217; hub, you can create new Build definitions that can include either of the two Cloud-based load test task templates (for guidance on how to create a Build definition, go <a href=\"https:\/\/msdn.microsoft.com\/Library\/vs\/alm\/Build\/vs\/define-build\">here<\/a>):<\/p>\n<ul>\n<li>For help on the &quot;Cloud-based Web Performance Test&quot; go <a href=\"http:\/\/blogs.msdn.com\/b\/visualstudioalm\/p\/quickcltbuildtaskhelp.aspx\">here<\/a>. <\/li>\n<li>For &quot;Cloud-based Load test&quot; read on. <\/li>\n<\/ul>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/00\/00\/00\/45\/92\/metablogapi\/0550.image_47B4057C.png\"><img decoding=\"async\" title=\"image\" style=\"border-left-width: 0px;border-right-width: 0px;border-bottom-width: 0px;border-top-width: 0px\" border=\"0\" alt=\"image\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/3527.image_thumb_6A0B9AF5.png\" width=\"595\" height=\"332\" \/><\/a> <\/p>\n<p>To be successful with this task, you should have already created a load test project with Visual Studio Ultimate IDE with the required web performance tests(<a href=\"https:\/\/www.visualstudio.com\/get-started\/load-test-your-app-vs\">Get started<\/a>) and configured the load test appropriately. This task simply takes an already created load test as input and executes it via the Service.<\/p>\n<p>To use this task, do the following:<\/p>\n<p>1. For &quot;Registered Connection&quot;:<\/p>\n<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/archive\/blogs\/\"><img decoding=\"async\" border=\"0\" alt=\" \" src=\"\" \/><\/a><\/p>\n<p>Select an available connection from the drop down. The selected connection must be for the Visual Studio Online account that you want to use for the load test. If you&#8217;re unsure or don&#8217;t have a connection to select, click on &quot;Manage&quot; to see what the available connections are or to create a new one. You need to be a Project administrator with &quot;Edit Project-level Information&quot; privilege or can ask your administrator to create a connection for you. The connection type to select is &quot;Generic&quot;. This is what you will encounter if don&#8217;t have the required permissions:<\/p>\n<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/archive\/blogs\/\"><img decoding=\"async\" border=\"0\" alt=\" \" src=\"\" \/><\/a><\/p>\n<p>Pick the connection you&#8217;d like to use and move on to step 2.<\/p>\n<p>2. You now need to supply the path to the Load Test settings file in your load test project. You may have more than one test settings file for your Load test, so pick the one to be used for this task. It might be configured with setup and clean scripts (<a href=\"http:\/\/blogs.msdn.com\/b\/visualstudioalm\/archive\/2015\/01\/12\/using-setup-and-cleanup-script-in-cloud-load-test.aspx\">Learn more<\/a>) that might be essential to the load test.<\/p>\n<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/archive\/blogs\/\"><img decoding=\"async\" border=\"0\" alt=\" \" src=\"\" \/><\/a><\/p>\n<p>3. Provide the folder path to the Load Test project in this step. This is the path where this task looks for the files required for the load test &#8211; load test file, test settings file, any deployment items and setup\/clean-up scripts . You can pick the path and the task will do a recursive search starting at that path for your files.<\/p>\n<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/archive\/blogs\/\"><img decoding=\"async\" border=\"0\" alt=\" \" src=\"\" \/><\/a><\/p>\n<p>4. You also have to specify the name of the load test file (xyz.loadtest) that is to be executed as part of this task. You may have more than one load test file to perhaps cater to the various deployment environments that you deploy your App to. So pick the right one. Once these are provided, we have all the data to trigger a load test.<\/p>\n<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/archive\/blogs\/\"><img decoding=\"async\" border=\"0\" alt=\" \" src=\"\" \/><\/a><\/p>\n<p>5. Optionally if your load test is already setup with threshold violations (<a href=\"https:\/\/msdn.microsoft.com\/en-us\/library\/ff426917.aspx\">Learn more about threshold violations<\/a>), then you can specify the number of critical violations to wait for before the load test should be deemed unsuccessful, in which case, the load test would then be aborted and the load test task would be marked as failed.<\/p>\n<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/archive\/blogs\/\"><img decoding=\"async\" border=\"0\" alt=\" \" src=\"\" \/><\/a><\/p>\n<p>6. You can now save the task and then queue a build.<\/p>\n<p>For generic information on Load testing you can look up these <a href=\"https:\/\/aka.ms\/loadtestkb\">additional resources<\/a>.<\/p>\n<p>If you have feedback for us &#8211; for this task or for any other feature, please add them <a href=\"http:\/\/visualstudio.uservoice.com\/forums\/121579-visual-studio\/\">here.<\/a><\/p>\n<p>&#160;<\/p>\n<p>&#160;<\/p>\n<p>There is also a similar task: <\/p>\n<h2>Cloud-based Web Performance Test<\/h2>\n<p>Runs the quick web performance test in cloud, with Visual Studio Team Services.<\/p>\n<p><strong>Cloud Load Test Build Task<\/strong><\/p>\n<p>Use [Visual Studio Cloud-based Load Test][3] to understand, test and validate your Applications performance.<\/p>\n<p>Cloud-based Load Test task can be used to generate load against a URL using the Visual Studio Team Services Cloud-based Load Test Service. The Cloud-based Load Test Service can be used for performance and load testing of your application by generating load from Azure. If you are new to Cloud-based Load Testing then the following links will help you: \u2022Cloud-based Load Testing with Visual Studio Online <a href=\"https:\/\/www.visualstudio.com\/features\/vso-cloud-load-testing-vs\">https:\/\/www.visualstudio.com\/features\/vso-cloud-load-testing-vs<\/a>    <br \/>\u2022Introduction to Cloud-based Load Testing with VSO <a href=\"https:\/\/www.visualstudio.com\/en-us\/get-started\/test\/load-test-your-app-vs\">https:\/\/www.visualstudio.com\/en-us\/get-started\/test\/load-test-your-app-vs<\/a><\/p>\n<h6><strong>Demands<\/strong><\/h6>\n<p>The build agent must have the following capabilities:<\/p>\n<ul>\n<li>MSBuild <\/li>\n<li>Azure Power shell<\/li>\n<\/ul>\n<p>For more information and the source code to this task please see: <\/p>\n<h4>Arguments<\/h4>\n<p>Argument   <br \/>Description<\/p>\n<p>Registered Connection   <br \/>Generic Service End point is a reference to the Visual Studio Team Services Account you will be running the Load Test from and publishing the results to.<\/p>\n<p>Website URL   <br \/>The URL of the application that you&#8217;d like to load test<\/p>\n<p>Test Name   <br \/>The name for this load test. This name will be used to identify this load test when you look up your load test runs in the Visual Studio for reporting and comparing with other runs.<\/p>\n<p>UserLoad   <br \/>The number of users that will be used for this load test. This is the number of concurrent users that you want to simulate in this load test.<\/p>\n<p>Run Duration   <br \/>The duration you&#8217;d like this load test to run for.<\/p>\n<p>Load Location   <br \/>The Location from where you want the load to be generated. You can pick from Azure locations around the world. Select &#8216;Default&#8217; if you want the load to be generated from the default location associated with your Visual Studio Online account.<\/p>\n<h4>Example<\/h4>\n<p>Please see: &quot;Scheduling Load Test Execution&quot; <a href=\"http:\/\/blogs.msdn.com\/b\/visualstudioalm\/archive\/2015\/11\/23\/scheduling-load-test-execution.aspx\">http:\/\/blogs.msdn.com\/b\/visualstudioalm\/archive\/2015\/11\/23\/scheduling-load-test-execution.aspx<\/a><\/p>\n<h4>More Information<\/h4>\n<p>To get started using this task, in your Visual Studio Team Services account, under the &#8216;Build&#8217; hub, you can create new Build definitions that can include either of the two Cloud-based load test task templates (for guidance on how to create a Build definition please see: <a href=\"https:\/\/msdn.microsoft.com\/Library\/vs\/alm\/Build\/vs\/define-build\">https:\/\/msdn.microsoft.com\/Library\/vs\/alm\/Build\/vs\/define-build<\/a> ):<\/p>\n<ul>\n<li>For help on the &quot;Cloud-based Web Performance Test&quot; please see: <a href=\"https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index\">https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index<\/a><\/li>\n<\/ul>\n<p><img decoding=\"async\" title=\"image\" alt=\"image\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/3527.image_thumb_6A0B9AF5.png\" \/><\/p>\n<p>To use this task you will need to have already created and checked into the team project a load test created with Visual Studio Enterprise (for more information on this please see: <a href=\"https:\/\/www.visualstudio.com\/get-started\/load-test-your-app-vs\">https:\/\/www.visualstudio.com\/get-started\/load-test-your-app-vs<\/a>). This task automates the process of running the load test as part of a build or release.<\/p>\n<p>To use this task you will need a &quot;Registered Connection&quot; to your Visual Studio Team Services Account. The selected connection must be for the Visual Studio Online account that you want to use for the load test. If you&#8217;re unsure or don&#8217;t have a connection to select, click on &quot;Manage&quot; to see what the available connections are or to create a new one. You need to be a Project administrator with &quot;Edit Project-level Information&quot; privilege or can ask your administrator to create a connection for you. The connection type that you to select is &quot;Generic&quot;. <\/p>\n<p>For generic information on Load testing you can look up these <a href=\"https:\/\/aka.ms\/loadtestkb\">https:\/\/aka.ms\/loadtestkb<\/a>.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/00\/00\/00\/45\/92\/metablogapi\/4456.image_3B7FC6C7.png\"><img decoding=\"async\" title=\"image\" style=\"border-top: 0px;border-right: 0px;border-bottom: 0px;border-left: 0px\" border=\"0\" alt=\"image\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/8117.image_thumb_29370005.png\" width=\"609\" height=\"359\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We are updating the Visual Studio Team Services Build Steps and thought these topics would be of interest: https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index. If you want to create your own Build Task check out my post here: http:\/\/blogs.msdn.com\/b\/charles_sterling\/archive\/2015\/11\/15\/devops-php-sample-for-cory-fowler-and-his-phpworld-presentation.aspx &#160; &#160; ****************************** &#160; &#160; &#160; Cloud Load Test Build Task Use Visual Studio Cloud-based Load Test to understand, test and [&hellip;]<\/p>\n","protected":false},"author":63,"featured_media":45953,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-10622","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-devops"],"acf":[],"blog_post_summary":"<p>We are updating the Visual Studio Team Services Build Steps and thought these topics would be of interest: https:\/\/msdn.microsoft.com\/en-us\/Library\/vs\/alm\/Build\/steps\/index. If you want to create your own Build Task check out my post here: http:\/\/blogs.msdn.com\/b\/charles_sterling\/archive\/2015\/11\/15\/devops-php-sample-for-cory-fowler-and-his-phpworld-presentation.aspx &#160; &#160; ****************************** &#160; &#160; &#160; Cloud Load Test Build Task Use Visual Studio Cloud-based Load Test to understand, test and [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/10622","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/users\/63"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/comments?post=10622"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/10622\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media\/45953"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media?parent=10622"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/categories?post=10622"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/tags?post=10622"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}