{"id":22074,"date":"2013-01-09T09:37:15","date_gmt":"2013-01-09T16:37:15","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/aspnet\/?p=22074"},"modified":"2013-01-09T09:37:15","modified_gmt":"2013-01-09T16:37:15","slug":"real-scenario-folder-deployment-scenarios-with-msdeploy","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/dotnet\/real-scenario-folder-deployment-scenarios-with-msdeploy\/","title":{"rendered":"Real Scenario: folder deployment scenarios with MSDeploy"},"content":{"rendered":"

Hi everyone Sayed<\/a> here. I recently had a customer, Johan, contact me to help with some challenges regarding deployment automation. He had some very specific requirements, but he was able to automate the entire process. He has been kind enough to agree to write up his experience to share with everyone. His story is below. If you have any comments please let us know. I will pass them to Johan.<\/p>\n

I\u2019d like to thank Johan for his willingness to write this up and share it. FYI if you\u2019d like me to help you in your projects I will certainly do my best, but if you are willing to share your story like Johan it will motivate me more \ud83d\ude42 \u2013 Sayed<\/p>\n

\u00a0<\/p>\n

Folder deployment scenarios with the MsDeploy command line utility<\/h3>\n

We have an Umbraco CMS web site where deployment is specific to certain folders only and not the complete website. Below is a snapshot of a typical Umbraco website.<\/p>\n

\"clip_image001\"<\/a><\/p>\n

I have omitted root files such as web.config<\/strong> as they never get deployed. Now as we develop new features, only those purple folders gets modified so there is no need to redeploy the bulky yellow folders which mostly contains the Umbraco CMS admin system. I will refer to these purple folders as release files.<\/p>\n

The green media<\/strong> folder is a special case. Our ecommerce team modifies the content on a daily basis in a CMS environment. They may publish their changes to production at will. Content related files from this folder automatically synchronises to the production environment through a file watcher utility. Thus the CMS and PROD environments always contain the latest versions and we can never overwrite this.<\/p>\n

This results in a special case for deployment. These are the steps we follow:<\/p>\n

1. When preparing the QA environment, we first update the media folder from CMS<\/p>\n

2. Then we transfer all the release files from DEV to QA<\/p>\n

3. After QA sign off, we deploy those same the release files to PROD<\/p>\n

4. Next we update the CMS release files<\/p>\n

5. And then finally the media is transferred to DEV so<\/p>\n

This flow is illustrated below:<\/p>\n

\"clip_image003\"<\/a><\/p>\n

Previously this was done by zipping folders up, transferring it to the different environments, expanding and then overriding the target destination. This was tedious and obviously quite risky. With assistance from Sayed Hashimi<\/a> at Microsoft, I have managed to greatly simplify this task through MsDeploy.<\/p>\n

MsDeploy can be downloaded here<\/a> and the command line utility normally installs at:<\/p>\n\n\n\n
\n

\n c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe\n <\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

The syntax I will concentrate on is as follows (more details can be found here<\/a>):<\/p>\n\n\n\n
\n

\n msdeploy.exe -verb:sync\n <\/p>\n

\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 -source:=\n <\/p>\n

\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 -dest:=\n <\/p>\n

\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 -useCheckSum -disableRule:BackupRule\n <\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

The \u2018useCheckSum\u2019 setting will ensure that only file changes are considered and \u2018disableRule:BackupRule\u2019 setting will stop warnings from being thrown. Automatic backups can be enabled with these<\/a> instructions, but to keep things simple, we will create our own backups.<\/p>\n

For the purposes of illustration, we\u2019ll assume that our websites are all installed at the following location in each environment:<\/p>\n\n\n\n
\n

\n C:\\MsDeployTest\\[Environment]\\Website\n <\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

<\/h4>\n

Step 1: Update the QA media folder<\/h4>\n

\"clip_image004\"<\/a><\/p>\n

First we need to package up the media folder to a zip file, transfer it over to the QA environment and then deploy that package. We\u2019ll create a .bat file and an .xml file that we can reuse in the future. On the CMS box at a location of your choice, create a Package.bat<\/strong> file with the following contents:<\/p>\n\n\n\n
\n

\n @echo off\n <\/p>\n

\n “c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe” ^\n <\/p>\n

\n -verb:sync ^\n <\/p>\n

\n -source:manifest=”Package.xml” ^\n <\/p>\n

\n -dest:package=”Media @ %date:~6,4%-%date:~3,2%-%date:~0,2% %time:~0,2%-%time:~3,2%.zip” ^\n <\/p>\n

\n -useCheckSum ^\n <\/p>\n

\n -disableRule:BackupRule\n <\/p>\n

\n pause\n <\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Also create a Package.xml<\/strong> file at the same location with the following contents:<\/p>\n\n\n\n
\n<\/p>\n<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

When you execute the Package.bat<\/strong> file, it will create a zip file (i.e. Media @ 2013-01-05 10-00.zip<\/strong>) containing the folder and subfolders you listed in Package.xml<\/strong>. Now we transfer the zip file to the QA box into a folder of our choice. In that same folder, create a Deploy.bat<\/strong> file with the following contents:<\/p>\n\n\n\n
\n

\n @echo off\n <\/p>\n

\n set \/p package=Enter the package name (tab to cycle):\n <\/p>\n

\n if ‘%package%’ == ” goto error\n <\/p>\n

\n set \/p manifest=Enter the manifest name (tab to cycle):\n <\/p>\n

\n if ‘%manifest%’ == ” goto error\n <\/p>\n

\n “c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe” ^\n <\/p>\n

\n -verb:sync ^\n <\/p>\n

\n -source:package=%package% ^\n <\/p>\n

\n -dest:manifest=%manifest% ^\n <\/p>\n

\n -useCheckSum ^\n <\/p>\n

\n -disableRule:BackupRule ^\n <\/p>\n

\n -whatif\n <\/p>\n

\n echo.\n <\/p>\n

\n set \/p deploy=Trial run complete – proceed to deployment (Y\/N)?\n <\/p>\n

\n if “%deploy%”==”Y” goto deploy\n <\/p>\n

\n if “%deploy%”==”y” goto deploy\n <\/p>\n

\n goto end\n <\/p>\n

\n :deploy\n <\/p>\n

\n “c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe” ^\n <\/p>\n

\n -verb:sync ^\n <\/p>\n

\n -source:package=%package% ^\n <\/p>\n

\n -dest:manifest=%manifest% ^\n <\/p>\n

\n -useCheckSum ^\n <\/p>\n

\n -disableRule:BackupRule\n <\/p>\n

\n md Archive\n <\/p>\n

\n move %package% Archive\n <\/p>\n

\n goto end\n <\/p>\n

\n :error\n <\/p>\n

\n echo You did not enter a package name\n <\/p>\n

\n :end\n <\/p>\n

\n echo.\n <\/p>\n

\n pause\n <\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Also create a Media.xml<\/strong> file at the same location with the same contents as Package.xml<\/strong> listed above. Update any paths if required.<\/p>\n

When you now execute the batch file, supply the package filename when prompted (you can use the tab key to cycle through files in the same folder)<\/em>. Note that we used the \u2018-dest:manifest=\u201dMedia.xml\u201d\u2019 parameter with MsDeploy. This does not modify Media.xml<\/strong> but rather uses it as reference for deployment instructions. Also note that MsDeploy executes twice, but the first time it uses the \u2018-whatif\u2019 parameter. This gives you the chance to test the deployment first without making any modifications. It will spew out the same output as always but only simulate the syncing of files. Then you will be prompted to commit the deployment and if you proceed, the QA website\u2019s media folder should now be synced up with the CMS environment.<\/p>\n

<\/h4>\n

Step 2: Release to QA<\/h4>\n

\"clip_image005\"<\/a><\/p>\n

On the DEV box in a folder of your choice, create a Package.bat<\/strong> file with the following contents:<\/p>\n\n\n\n
\n

\n @echo off\n <\/p>\n

\n “c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe” ^\n <\/p>\n

\n -verb:sync ^\n <\/p>\n

\n -source:manifest=”Package.xml” ^\n <\/p>\n

\n -dest:package=”Release @ %date:~6,4%-%date:~3,2%-%date:~0,2% %time:~0,2%-%time:~3,2%.zip” ^\n <\/p>\n

\n -useCheckSum ^\n <\/p>\n

\n -disableRule:BackupRule\n <\/p>\n

\n pause\n <\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Also create a Package.xml<\/strong> file with the following contents:<\/p>\n\n\n\n
\n<\/p>\n<\/p>\n<\/p>\n<\/p>\n<\/p>\n<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Executing the batch file will give you a zip file such as Release @ 2013-01-05 10-00.zip<\/strong> containing the release folders. Transfer the zip file to the QA box into the same folder as before. Then create a Release.xml<\/strong> file with the same contents as Package.xml<\/strong> listed above and fix the path names. When you now execute the Deploy.bat<\/strong> batch file and supply the release package filename, the QA website\u2019s release folders should now be synced up with the DEV environment.<\/p>\n

<\/h4>\n

Step 3: Release to PROD<\/h4>\n

\"clip_image006\"<\/a><\/p>\n

This follows the same deployment as in step 2, but here we include in a backup step. So after choosing a suitable folder and transferring the release package file there, create a Deploy.bat<\/strong> file with the following contents:<\/p>\n\n\n\n
\n

\n @echo off\n <\/p>\n

\n set \/p package=Enter the package name (tab to cycle):\n <\/p>\n

\n if ‘%package%’ == ” goto error\n <\/p>\n

\n “c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe” ^\n <\/p>\n

\n -verb:sync ^\n <\/p>\n

\n -source:package=%package% ^\n <\/p>\n

\n -dest:manifest=”Deploy.xml” ^\n <\/p>\n

\n -useCheckSum ^\n <\/p>\n

\n -disableRule:BackupRule ^\n <\/p>\n

\n -whatif\n <\/p>\n

\n echo.\n <\/p>\n

\n set \/p deploy=Trial run complete – proceed to deployment (Y\/N)?\n <\/p>\n

\n if “%deploy%”==”Y” goto deploy\n <\/p>\n

\n if “%deploy%”==”y” goto deploy\n <\/p>\n

\n goto end\n <\/p>\n

\n :deploy\n <\/p>\n

\n md Archive\n <\/p>\n

\n “c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe” ^\n <\/p>\n

\n -verb:sync ^\n <\/p>\n

\n -source:manifest=”Deploy.xml” ^\n <\/p>\n

\n -dest:package=”Archive\\Backup @ %date:~6,4%-%date:~3,2%-%date:~0,2% %time:~0,2%-%time:~3,2%.zip” ^\n <\/p>\n

\n -useCheckSum ^\n <\/p>\n

\n -disableRule:BackupRule\n <\/p>\n

\n echo Backup complete\n <\/p>\n

\n echo.\n <\/p>\n

\n “c:\\Program Files\\IIS\\Microsoft Web Deploy V3\\msdeploy.exe” ^\n <\/p>\n

\n -verb:sync ^\n <\/p>\n

\n -source:package=%package% ^\n <\/p>\n

\n -dest:manifest=”Deploy.xml” ^\n <\/p>\n

\n -useCheckSum ^\n <\/p>\n

\n -disableRule:BackupRule\n <\/p>\n

\n echo Deploy complete\n <\/p>\n

\n echo.\n <\/p>\n

\n move %package% Archive\n <\/p>\n

\n goto end\n <\/p>\n

\n :error\n <\/p>\n

\n echo You did not enter a package name\n <\/p>\n

\n :end\n <\/p>\n

\n echo.\n <\/p>\n

\n pause\n <\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Now create a Deploy.xml<\/strong> file with the same contents as Package.xml<\/strong> from step 2 and fix the paths. Once all is in place and the trail run succeeds, you can proceed and deploy your changes to the PROD website.<\/p>\n

In addition to releasing your changes, it will first create a backup in the Archive<\/strong> folder such as Backup @ 2013-01-05 10-00.zip<\/strong> containing the original folders. If you need to do a restore, you can just execute Deploy.bat<\/strong> with this same backup file.<\/p>\n

Step 4: Release to CMS<\/h4>\n

\"clip_image007\"<\/a><\/p>\n

Now everything becomes a formality and you can just repeat the release part of \u201cStep 2: Release to QA\u201d to update the CMS box. After executing Deploy.bat<\/strong>, all environments are now running the same code.<\/p>\n

<\/h4>\n

Step 5: Update the DEV media folder<\/h4>\n

\"clip_image008\"<\/a><\/p>\n

For this final step just repeat \u201cStep 1: Update the QA media folder\u201d. Now all environments should have the same content.<\/p>\n

I hope this will be helpful to someone with the same problem or something similar where only subsets of folders require updates. There is a lot of room for enhancement, i.e. becoming more creative with the zip file naming convention by including labels. MsDeploy is a great tool and can be used to deploy not just websites, but other kinds of projects which are as well. Please feel free to ask me questions. If I cannot help, I\u2019m sure Sayed or someone at Microsoft will come to the rescue.<\/p>\n

\u00a0<\/p>\n

You can download the SampleFiles<\/a> to help work through the process as well.<\/p>\n

\u00a0<\/p>\n

Johan van der Merwe<\/p>\n

johan.vdmerwe@btinternet.com<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Hi everyone Sayed here. I recently had a customer, Johan, contact me to help with some challenges regarding deployment automation. He had some very specific requirements, but he was able to automate the entire process. He has been kind enough to agree to write up his experience to share with everyone. His story is below. […]<\/p>\n","protected":false},"author":357,"featured_media":58792,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[197],"tags":[9,43,77,108],"class_list":["post-22074","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-aspnet","tag-net-core","tag-bcl","tag-fundamentals","tag-performance"],"acf":[],"blog_post_summary":"

Hi everyone Sayed here. I recently had a customer, Johan, contact me to help with some challenges regarding deployment automation. He had some very specific requirements, but he was able to automate the entire process. He has been kind enough to agree to write up his experience to share with everyone. His story is below. […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/posts\/22074","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/users\/357"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/comments?post=22074"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/posts\/22074\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/media\/58792"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/media?parent=22074"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/categories?post=22074"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/dotnet\/wp-json\/wp\/v2\/tags?post=22074"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}