Did you know? DZone has great portals for Python, Cloud, NoSQL, and HTML5!

Mitch Pronschinske is the Senior Content Curator (aka. "Lord of the Zones") at DZone. That means he writes and searches for the finest developer content in the land so that you don't have to. He often has hotdogs for lunch, likes to make his own ringtones, enjoys card and board games, and is married to an underwear model. Mitch is a DZone employee and has posted 1666 posts at DZone. View Full User Profile

Solr at Etsy

January 26, 2012 AT 8:01 AM
  • submit to reddit
This search technologogy content is part of the Solr-Lucene Microzone, supported by Lucid Imagination, a company of Solr/Lucene all-stars that provides free distributions, training, and a search application development platform called LucidWorks Enterprise.

Solr @ Etsy Giovanni Fernandez-Kincade, Etsy.com, Eurocon 2011 from Lucene Revolution on Vimeo.

Search at Etsy poses significant challenges. Our marketplace is filled with millions of unique, short-lived items and people trying to find them over 10 million times a day. In this session we'll discuss many of the solutions we've engineered to meet these challenges. These include:

  • Infrastructure approaches like using Thrift as our interface to Solr and writing our own load-balancer.
  • Writing custom code that inter-operates with Solr, from QParserPlugins to in-house Stemmers.
  • Internationalization efforts, including tailoring the search experience to user language and location, and on-the-fly query translation – all a natural result of our efforts to create a global marketplace.

Finally, no talk about Etsy would be complete without some exploration of our incremental development strategy and the tools that empower it. We'll describe in detail how we continuously deploy our search stack, instantly change server configuration, and measure the impact of algorithmic changes using side-by-side user tests and live A/B tests.

Download session slides.