A tattooed digital marketer. I love baseball, the Braves, coffee, and innovative thinking. I can always be found on twitter or at a local ball field. Active and always smiling Will has posted 50 posts at DZone. You can read more from them at their website. View Full User Profile

Introducing Hydra: An Open Source Document Processing Framework

06.13.2012
| 6689 views |
  • submit to reddit

 The above presentation details the document-processing framework named Hydra that was developed by Findwise.

This presentation will detail the document-processing framework called Hydra that has been developed by Findwise. It is intended as a description of the framework and the problem it aims to solve. We will first discuss the need for scalable document processing, outlining that there is a missing link between the open source chain to bridge the gap between source system and the search engine, then will move on to describe the design goals of Hydra, as well as how it has been implemented to meet those demands on flexibility, robustness and ease of use. This session will end by discussing some of the possibilities that this new pipeline framework can offer, such as freely seamlessly scaling up the solution during peak loads, metadata enrichment as well as proposed integration with Hadoop for Map/Reduce tasks such as page rank calculations.

Published at DZone with permission of its author, Will Soprano. (source)

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)

Tags: