Performance Zone is brought to you in partnership with:

Sean Hull is a renowned author, speaker and advisor on MySQL & Oracle databases, web performance and scalability, EC2, Linux & Internet Architecture. He is the author of "Oracle & Open Source" O'Reilly, 2001, and speaks widely at conferences and forums. With 20 years of professional experience, he consults with large enterprises and startups in New York City and the San Francisco Bay Area. Sean is a DZone MVB and is not an employee of DZone and has posted 64 posts at DZone. You can read more from them at their website. View Full User Profile

Why the Twitter IPO Mentions Scalability

  • submit to reddit


1. High availability is hard

After seven years in the business you might think Twitter has operations and scalability nailed. I wouldn’t blame you for hoping, but here’s one thing they said in their IPO filing:

“We are not currently serving traffic equally through our co-located data centers”

What does this mean exactly? Let’s think of your daily drive to work. Remember that one intersection that’s always congested? Could the city designers have envisioned that 50 or 100 years ago? Probably not. In the present day, with all the buildings and roads, can we redesign around it? Not easily. So we adapt, evolve, and deal with the day-to-day realities of an evolving city.

James Urquhart says that these are complex systems. The internet, the cloud and your startup infrastructure are by nature brittle.

2. Fail whale is part of the DNA

The graphic above is a whimsical remake of Twitter’s own by Shanna Banan. Consider, though, that someone at Twitter was tasked with designing a graphic for when the site fails. The DevOps team then built a page for failure, and have it at the ready for when there’s an outage, not if. It’s symbolic of the many other things your operations team does behind the scenes in expectation of that fateful day.

As Eric Ries argues, design for failure. Then manage it.

3. Investors, Wall Street: we’re working on it

What Twitter is really saying is, "Hey investors, we understand that five nines is extremely difficult, we’re vulnerable in certain ways and want to disclose that."

ReadWrite argues Twitter has not banished the fail whale and is “surprisingly vulnerable”. Readwrite, I ask you… who has? Google? Nope. Facebook? Nope. Not AirBNB or Reddit, either.

These are world class firms. They’ve got the deep pockets to do it right, and the engineering talent to match. They still have failures.

Published at DZone with permission of Sean Hull, author and DZone MVB. (source)

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)


Hendy Irawan replied on Wed, 2013/10/09 - 7:41am

Nice article until the "Google? Facebook? They still have failures." part. Which unfortunately is the finale of this article. 

Failure can be targeted, and measured. If you want to compare Twitter with others, please back up with stats. You mentioned "deep pockets", "engineering talent". So make a chart, comparing Google, Facebook, and Twitter's budget & HR & downtime on the past few years, please....?

Otherwise, please leave out the (unfair?) comparison.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.