For a while now I’ve been seeing people struggling with some TFS SP1 install issues and I’ve been silent about it for too long. I was waiting for my team to investigate the issues and compile a summary. I appologize for not speaking up about it sooner. The vast majority of issues come down to a tool we have called TFSQuiesce.exe. The purpose of this tool is to “shutdown” TFS while we perform the SP1 upgrade and restart it when we are done. The biggest set of issues with it are that, for some reason, it does not always shutdown all services and it does not always restart them properly – leaving your server in an inoperable state. The good news is that it is almost always easy to recover from. The bad news is that it makes us look stupid and pisses people off :(. I honestly can’t tell you how we missed this set of issues. We tested the SP1 upgrade process for months and didn’t hit these issues. We didn’t hear about them in the SP1 Beta period. We still don’t know all of the causes. We’re continuing to work on it, but in the mean time, here is all of the information we have.<\/p>\n
Customer Scenarios<\/p>\n
<\/b><\/p>\n
The following scenarios describe the vast majority of issues we have seen around SP1. One important statistic is that we have had zero cases of data-loss. \n <\/p>\n
| \n <\/p>\n <\/b><\/p>\n<\/td>\n | \n Issue<\/p>\n <\/b><\/p>\n<\/td>\n | \n Customer Impact<\/p>\n <\/b><\/p>\n<\/td>\n | \n Workarounds\/Next Steps<\/p>\n <\/b><\/p>\n<\/td>\n<\/tr>\n | ||||||||||||||||
| \n 1<\/p>\n<\/td>\n | \n SP1 fails<\/b> to install on a SQL Cluster<\/p>\n<\/td>\n | \n · <\/span><\/span><\/span>Blocked from installing SP1 or any other DT patches.<\/p>\n<\/td>\n | \n · <\/span><\/span><\/span>None. Look for a patch\/work around coming in the next couple of weeks.<\/p>\n<\/td>\n<\/tr>\n 2<\/p>\n<\/td>\n · <\/span><\/span><\/span>SP1 install fails<\/b> and:<\/p>\n o <\/span><\/span><\/span>TFS databases in single-user mode<\/p>\n o <\/span><\/span><\/span>IIS in state where remote connections are declined<\/p>\n<\/td>\n · <\/span><\/span><\/span> AT won’t start an errors reported in Event Log.<\/p>\n · <\/span><\/span><\/span>Http<\/span> <\/span>403 forbidden error <\/span>with browsers<\/p>\n · <\/span><\/span><\/span>TF2101 message<\/span> from TE (can’t connect)<\/p>\n <\/p>\n<\/td>\n · <\/span><\/span><\/span>To get running (without SP1):<\/p>\n o <\/span><\/span><\/span>Databases must be manually placed back in multi-user mode. Use SQL Management Studio; right click on each TFS database; select properties; Select the Options page; At the very bottom there is an item called “restrict access” – set it to “multi_user”. There is a KB article in the works and should be published soon.<\/p>\n o <\/span><\/span><\/span>IIS must be manually configured to accept remote connections – See section 6.9 of the SP1 Known issues doc below.<\/p>\n · <\/span><\/span><\/span>To install SP1:<\/p>\n o <\/span><\/span><\/span>Manually put remaining databases in single-user mode and retry installation. Use SQL Management Studio; right click on each TFS database; select properties; Select the Options page; At the very bottom there is an item called “restrict access” – set it to “single_user”. This will not always work if other people are trying to use the database at the same time.<\/p>\n <\/p>\n<\/td>\n<\/tr>\n 3<\/p>\n<\/td>\n SP1 install succeeds<\/b> but leaves IIS in state where remote connections are declined<\/p>\n<\/td>\n · <\/span><\/span><\/span>Http<\/span> <\/span>403 forbidden error <\/span>with browsers<\/p>\n · <\/span><\/span><\/span>TF2101 message<\/span> from TE (can’t connect)<\/p>\n<\/td>\n · <\/span><\/span><\/span>IIS must be manually configured to accept remote connections – See section 6.9 of the SP1 Known issues doc below.<\/p>\n<\/td>\n<\/tr>\n 4<\/p>\n<\/td>\n Users can’t uninstall SP1 Beta after installing Quiescing<\/p>\n<\/td>\n The Quiescing logic breaks the Beta from uninstalling but you can’t uninstall Quiescing from Add\/Remove programs because it doesn’t appear there if SP1 Beta is installed. (A chicken and egg issue.) The SP1 RTM will not allow you to install if the SP1 Beta is installed.<\/p>\n<\/td>\n 1. <\/span><\/span>Run a manual uninstall operation from the command-line. See the steps at the bottom of this post…<\/p>\n 2. <\/span><\/span> Uninstall TFS SP1 Beta – using Add\/Remove Programs.<\/p>\n<\/td>\n<\/tr>\n 5<\/p>\n<\/td>\n SP1 fails<\/b> to install<\/p>\n<\/td>\n These error are usually due to changes in configuration after RTM installation that our setup does not handle well. In some cases the customers are left with an unusable server.<\/p>\n<\/td>\n |