{"id":91751,"date":"2015-08-24T07:00:00","date_gmt":"2015-08-24T21:00:00","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/oldnewthing\/20150824-00\/?p=91751\/"},"modified":"2019-03-13T12:18:47","modified_gmt":"2019-03-13T19:18:47","slug":"20150824-00","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/oldnewthing\/20150824-00\/?p=91751","title":{"rendered":"Insightful graph: The ship date predictor"},"content":{"rendered":"

The best graphs are the ones that require no explanation. You are just told what the x<\/i>– and y<\/i>-axes represent, and the answer just jumps out at you. <\/p>\n

One of the greatest graphs I’ve seen at Microsoft is this one that a colleague of mine put together as Windows 95 was nearing completion. He took each email message from management that changed the Windows 95 RTM date (also known as the ship date) and plotted it on a chart. The x<\/i>-axis is the date the statement was made and the y<\/i>-axis is number of days remaining in the project, according to the email. The dotted line is a linear least-squares fit, and the green star is the actual ship date (July 14, 1995<\/a>). <\/p>\n

\n
600 <\/div>\n
500 <\/div>\n
400 <\/div>\n
300 <\/div>\n
200 <\/div>\n
100 <\/div>\n
0 <\/div>\n
 <\/div>\n
 <\/div>\n
 <\/div>\n
 <\/div>\n
 <\/div>\n
 <\/div>\n
 <\/div>\n
 <\/div>\n
\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n<\/p><\/div>\n
\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
▲<\/div>\n
★<\/div>\n<\/p><\/div>\n
\n
Apr<\/p>\n

1992<\/p><\/div>\n

Jul<\/div>\n
Oct<\/div>\n
Jan 1993<\/div>\n
Apr<\/div>\n
Jul<\/div>\n
Oct<\/div>\n
Jan 1994<\/div>\n
Apr<\/div>\n
Jul<\/div>\n
Oct<\/div>\n
Jan 1995<\/div>\n
Apr<\/div>\n
Jul<\/div>\n
Oct<\/div>\n<\/p><\/div>\n<\/p><\/div>\n

What’s so amazing about this chart is that the linear approximation predicts the actual ship date with very high accuracy. The slope of the line is 0.43%, which means that if you took the predicted “days remaining before we ship” and multiplied it by around 2.3, you’d be pretty close to the actual ship date. <\/p>\n

In other words, management fairly consistently underestimated the number of days until RTM by a factor of 2.3. (Another way of looking at it is that the development team consistently underreported the number of days to completion to management by a factor of 2.3.) <\/p>\n

Bonus amusement<\/b> <\/p>\n

Here is a pull quote from each of the announcements, lightly edited. <\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
Date<\/th>\nRevised RTM<\/th>\nRemark<\/th>\n<\/tr>\n
February 1992<\/td>\nJune 1993<\/td>\n“Ready to RTM 6\/93. Otherwise, I’ll be applying for a job at McDonalds.”<\/td>\n<\/tr>\n
April 1992<\/td>\nSeptember 1993<\/td>\n“This is a critical release.”<\/td>\n<\/tr>\n
July 1992<\/td>\nMarch 1994<\/td>\n“The feature set will NOT be expanded to fill the new schedule.” <\/td>\n<\/tr>\n
September 1992<\/td>\nDecember 1993<\/td>\n“This product must RTM by the end of 1993. If we miss this window of opportunity, then the value of this product goes way down.”<\/td>\n<\/tr>\n
January 1993<\/td>\nMarch 1994<\/td>\n “I recently learned that Team X was planning around a Q4 94 ship date!” (Team X provided code to Windows 95.)<\/td>\n<\/tr>\n
March 1993<\/td>\nApril 1994<\/td>\n“We need to formulate plans which get us there.”<\/td>\n<\/tr>\n
August 1993<\/td>\nMay 1994<\/td>\n“It’s really important for the company that we make this date. This must be our last slip.”<\/td>\n<\/tr>\n
December 1993<\/td>\nAugust 1994<\/td>\n“This is about as late as we can go without incurring big financial problems for the company.”<\/td>\n<\/tr>\n
February 1994<\/td>\nSeptember 1994<\/td>\n “What determines the ship date is the team’s commitment to a ship date. We must make our RTM date.”<\/td>\n<\/tr>\n
May 1994<\/td>\nNovember 1994<\/td>\n“Software and hardware vendors are counting on us.”<\/td>\n<\/tr>\n
August 1994<\/td>\nFebruary 1995<\/td>\n“Completing this milestone by the end of the year is absolutely critical to the product gaining quick success.”<\/td>\n<\/tr>\n
December 1994<\/td>\nMay 1995<\/td>\n “People all over are planning their business on when we release. We must make our current date.”<\/td>\n<\/tr>\n<\/table>\n

Today marks the 20th anniversary of the public release of Windows 95. Just one more year, and you’ll be old enough to buy a drink!¹ <\/p>\n

Bonus reading<\/b>: Start Me Up (again)<\/a>: Brad Chase (who ran the worldwide launch of Windows 95) tells the story of how Start Me Up<\/i> became the anthem for Windows 95, and addresses the legend that that it cost $14 million<\/a> to license the song. (Spoiler: It was more like $3 million<\/span><\/a>.) <\/p>\n

Bonus chatter<\/b>: The ticket price for the Windows 95 team reunion party is $47.50<\/a>. This seems like an odd number, but it makes more sense when you buy two tickets (one for you, and one for your partner). <\/p>\n

¹ In the United States, the age at which it is legal to purchase alcohol is 21. <\/p>\n","protected":false},"excerpt":{"rendered":"

Factor of two (and a little).<\/p>\n","protected":false},"author":1069,"featured_media":111744,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[103],"class_list":["post-91751","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-oldnewthing","tag-non-computer"],"acf":[],"blog_post_summary":"

Factor of two (and a little).<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/posts\/91751","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/users\/1069"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/comments?post=91751"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/posts\/91751\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/media\/111744"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/media?parent=91751"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/categories?post=91751"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/tags?post=91751"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}