Javalobby

Mitch Pronschinske is the Senior Content Analyst aka. the CZO (Chief Zones Officer) aka. "Lord of the Zones" at DZone. That means he writes and searches for the finest developer content in the land so that you don't have to. He often eats peanut butter and bananas, likes to make his own ringtones, enjoys card and board games, and is married to an underwear model. My G+ Profile Mitch is a DZone Zone Leader and has posted 2039 posts at DZone. You can read more from them at their website. View Full User Profile

Lessons Learned: Refactoring a Solr-Based API App

01.15.2012
| 3768 views |
  • submit to reddit

In this case study I'll discuss architectural lessons learned from refactoring an existing REST-API backed by Apache Solr. The initial goal of the refactoring was to speed up data access while scaling from 5m documents to 20-50m documents stored in Solr. Under consideration was the hosting infrastructure, the REST API Java code and the Solr documents and configuration. In this talk I'll give a brief review of the results.

"Pimping" the Solr configuration, the client access and the document structure achieved better results. But the elementary lesson learned was, that a significant increase of data access speed can only be realized with a functional redesign and a simplification of the REST API. NO CAPS ON CORES & SHARDS) I'll explain how this led us directly to distinct Solr cores and why we dropped the introduction of Solr shards or a breathing cloud infrastructure.

Download session slide.


Source: http://www.lucidimagination.com/devzone/events/conferences/ApacheLuceneEurocon2011/lessons-learned-refactoring-solr-based-api-app

"Starting from scratch" is seductive but disease ridden
-Pithy Advice for Programmers