{"id":35000,"date":"2018-01-19T13:32:24","date_gmt":"2018-01-19T18:32:24","guid":{"rendered":"https:\/\/blog.xamarin.com\/?p=35000"},"modified":"2018-01-19T13:32:24","modified_gmt":"2018-01-19T18:32:24","slug":"running-xamarin-ios-unit-tests-visual-studio-team-services","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/xamarin\/running-xamarin-ios-unit-tests-visual-studio-team-services\/","title":{"rendered":"Running Xamarin.iOS Unit Tests in Visual Studio Team Services"},"content":{"rendered":"

\t\t\t\tIn previous posts, we’ve discussed how to set up continuous integration for your Xamarin.iOS applications inside Visual Studio Team Services(VSTS)<\/a> using the new Hosted macOS Agent. Building the application is only part of the full solution, though, as we want to fully test the logic of our application. We can test our app\u2019s user interface with App Center Test, we can test our business logic with test runners, but how do we test platform specific functionality?<\/p>\n

We can accomplish this by leveraging the Touch.Server on iOS to run our platform-specific tests on a real device or simulator. This is great for the platform-specific code of an application and ideal for testing libraries, such as plugins, that are purely application-specific code. In this post, we’ll show you how to set up continuous unit tests for SettingsPlugin<\/a> projects in VSTS.<\/p>\n

Getting started<\/h2>\n

Download the Touch.Server.exe<\/a> to your project folder, a small tool originally built by Rolf Kvinge<\/a> on the Xamarin.iOS team (this can be automated with a script later on). Touch.Server will make it easier to execute tests on a Simulator or a Device and pull tests results on the build machine for further processing.<\/p>\n

Set the NUNIT_ENABLE_XML_OUTPUT<\/code> and NUNIT_SKIP_LOG_HEADER<\/code> environment variables to “TRUE”<\/strong> in Additional mtouch<\/em> arguments in the Unit test project\u2019s project options\/iOS build.<\/p>\n

\"\"
iOS Project Properties<\/figcaption><\/figure><\/p>\n

The iOS test project generates an excellent test result report by default; however, it is not compatible with the VSTS build system. Setting NUNIT_ENABLE_XML_OUTPUT<\/code> to “TRUE”<\/strong> generates the test results compatible to the VSTS build system, and NUNIT_SKIP_LOG_HEADER<\/code> removes redundant headers in the results file.<\/p>\n

Setting up Build Configuration in VSTS<\/h2>\n

Add the following two additional steps to iOS build process defined on James Montemagno’s blog<\/a>.<\/p>\n

1) Shell Script<\/h3>\n

In this step, configure the shell script to configure test environment ie., set up the iOS simulator, auto execute tests, and provide a location to store test results.<\/p>\n

\"\"
Shell Script Config<\/figcaption><\/figure><\/p>\n

Here is the simple script that does it all –<\/p>\n

\n#!\/bin\/sh\necho 'Output path = ' $1\nTEST_RESULT=$1\/test_results.xml\necho 'Delete test result'\nrm -rf $TEST_RESULT\nmono --debug unit-test-tools\/Touch.Server.exe \\\n--launchsim  \\\n-autoexit \\\n-skipheader \\\n-logfile=$TEST_RESULT \\\n--verbose \\\n--device=\":v2:runtime=com.apple.CoreSimulator.SimRuntime.iOS-11-2,devicetype=com.apple.CoreSimulator.SimDeviceType.iPhone-SE\"\n<\/pre>\n
<\/code><\/p>\n
 <\/p>\n
2) Publish Test Results<\/h3>\n
This is a final step in the process. Once test execution completes, the build process will look for the test_results.xml<\/code> and publish!<\/p>\n
\"\"
Publish Results<\/figcaption><\/figure><\/p>\n
Note that VSTS will report the build successful even when there are failed tests in the published results. This issue is being discussed on GitHub<\/a>.<\/p>\n
Conclusion<\/h2>\n
VSTS will report the summary after every successful\/failed build process with the test results:<\/p>\n
\"\"
Build Summary<\/figcaption><\/figure><\/p>\n
Learn More<\/h3>\n
Be sure to read through Xamarin.iOS Unit Testing documentation<\/a> to see how to setup your apps for testing. Then be sure to see how to set up continuous integration and deployment with Visual Studio Team Services with the Quick Start guide<\/a>.<\/p>\n
Discuss this post in the Xamarin Forums.<\/a><\/em>\t\t<\/p>\n","protected":false},"excerpt":{"rendered":"
In previous posts, we’ve discussed how to set up continuous integration for your Xamarin.iOS applications inside Visual Studio Team Services(VSTS) using the new Hosted macOS Agent. Building the application is only part of the full solution, though, as we want to fully test the logic of our application. We can test our app\u2019s user interface […]<\/p>\n","protected":false},"author":558,"featured_media":35007,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2],"tags":[6,4],"class_list":["post-35000","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-developers","tag-ios","tag-xamarin-platform"],"acf":[],"blog_post_summary":"
In previous posts, we’ve discussed how to set up continuous integration for your Xamarin.iOS applications inside Visual Studio Team Services(VSTS) using the new Hosted macOS Agent. Building the application is only part of the full solution, though, as we want to fully test the logic of our application. We can test our app\u2019s user interface […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/posts\/35000","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/users\/558"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/comments?post=35000"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/posts\/35000\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/media?parent=35000"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/categories?post=35000"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/xamarin\/wp-json\/wp\/v2\/tags?post=35000"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}