Performance Zone is brought to you in partnership with:

Allen is a published fiction and non-fiction writer working on his second novel. He currently resides in Hanoi, Vietnam where he is traveling around SE Asia. He is an avid reader and lifelong geek interested in fiction, philosophy, and technology. Allen is a DZone Zone Leader and has posted 284 posts at DZone. You can read more from them at their website. View Full User Profile

Explore Web Performance with Google's BigQuery

09.24.2013
| 3410 views |
  • submit to reddit

This article by Google web performance engineer and developer advocate Ilya Grigorik is a great introduction to Google's BigQuery, which you can use to peruse some performance statistics about 300,000 of the web's most popular websites. BigQuery provides all of this data through HTTP Archive, a project that crawls those hundreds of thousands of websites twice a month and takes some statistics about how the sites are built and what kind of performance they boast.

Using SQL queries, you can search HTTP Archive on BigQuery to answer virtually any question you may have about web performance. How fast do the fastest websites loads? What makes them fast? How are they built? What libraries do they use?

Here's a talk by Grigorik from Velocity 2013, in which he talks about using BigQuery to search the almost 400 GB of raw CSV data from HTTP Archive:

Check out Grigorik's article to learn the answers to some of the questions posed above, including which JavaScript library is the most popular (though you can probably guess).