Issue with using Application Insights with load tests

Update – As of Feb 24th 2017, this issue has been addressed and the content below is no longer applicable.

If you use Application Insights to collect app side metrics during load tests, you will find that it currently doesn’t work as expected.

When configuring applications to collect app side metrics in the load test editor in Visual Studio, you will see an error similar to the below:
If you have already configured Application Insights earlier for your load tests, then when running such load tests, you will not see any app metrics being collected and the ‘Status Messages’ in your load test will show a message that ‘Application counter collection failed due to an internal error and will be disabled for this run’.

This is due to an infrastructure issue. We have worked with the Application Insights team to understand this issue and a fix is in progress – ETA for a fix to be available is February 24th. In the meantime to workaround this issue, you can view the application metrics using the Azure portal or use the APIs documented at https://dev.applicationinsights.io/quickstart/

If you have any questions related to load testing, please reach out to us at vsoloadtest@microsoft.com