August 24th, 2015

Insightful graph: The ship date predictor

The best graphs are the ones that require no explanation. You are just told what the x– and y-axes represent, and the answer just jumps out at you.

One of the greatest graphs I’ve seen at Microsoft is this one that a colleague of mine put together as Windows 95 was nearing completion. He took each email message from management that changed the Windows 95 RTM date (also known as the ship date) and plotted it on a chart. The x-axis is the date the statement was made and the y-axis is number of days remaining in the project, according to the email. The dotted line is a linear least-squares fit, and the green star is the actual ship date (July 14, 1995).

600 
500 
400 
300 
200 
100 
 
 
 
 
 
 
 
 

Apr

1992

Jul
Oct
Jan 1993
Apr
Jul
Oct
Jan 1994
Apr
Jul
Oct
Jan 1995
Apr
Jul
Oct

What’s so amazing about this chart is that the linear approximation predicts the actual ship date with very high accuracy. The slope of the line is 0.43%, which means that if you took the predicted “days remaining before we ship” and multiplied it by around 2.3, you’d be pretty close to the actual ship date.

In other words, management fairly consistently underestimated the number of days until RTM by a factor of 2.3. (Another way of looking at it is that the development team consistently underreported the number of days to completion to management by a factor of 2.3.)

Bonus amusement

Here is a pull quote from each of the announcements, lightly edited.

Date Revised RTM Remark
February 1992 June 1993 “Ready to RTM 6/93. Otherwise, I’ll be applying for a job at McDonalds.”
April 1992 September 1993 “This is a critical release.”
July 1992 March 1994 “The feature set will NOT be expanded to fill the new schedule.”
September 1992 December 1993 “This product must RTM by the end of 1993. If we miss this window of opportunity, then the value of this product goes way down.”
January 1993 March 1994 “I recently learned that Team X was planning around a Q4 94 ship date!” (Team X provided code to Windows 95.)
March 1993 April 1994 “We need to formulate plans which get us there.”
August 1993 May 1994 “It’s really important for the company that we make this date. This must be our last slip.”
December 1993 August 1994 “This is about as late as we can go without incurring big financial problems for the company.”
February 1994 September 1994 “What determines the ship date is the team’s commitment to a ship date. We must make our RTM date.”
May 1994 November 1994 “Software and hardware vendors are counting on us.”
August 1994 February 1995 “Completing this milestone by the end of the year is absolutely critical to the product gaining quick success.”
December 1994 May 1995 “People all over are planning their business on when we release. We must make our current date.”

Today marks the 20th anniversary of the public release of Windows 95. Just one more year, and you’ll be old enough to buy a drink!¹

Bonus reading: Start Me Up (again): Brad Chase (who ran the worldwide launch of Windows 95) tells the story of how Start Me Up became the anthem for Windows 95, and addresses the legend that that it cost $14 million to license the song. (Spoiler: It was more like $3 million.)

Bonus chatter: The ticket price for the Windows 95 team reunion party is $47.50. This seems like an odd number, but it makes more sense when you buy two tickets (one for you, and one for your partner).

¹ In the United States, the age at which it is legal to purchase alcohol is 21.

Author

Raymond has been involved in the evolution of Windows for more than 30 years. In 2003, he began a Web site known as The Old New Thing which has grown in popularity far beyond his wildest imagination, a development which still gives him the heebie-jeebies. The Web site spawned a book, coincidentally also titled The Old New Thing (Addison Wesley 2007). He occasionally appears on the Windows Dev Docs Twitter account to tell stories which convey no useful information.

0 comments

Discussion are closed.