Using Solr Cloud, For Real!
Using Solr Cloud, For Real!, Jon Gifford, Loggly, Eurocon 2011 from Lucene Revolution on Vimeo.
Loggly is a cloud based logging service. It helps you collect, index, and store all your log data and then makes it accessible through search for analysis and reporting. All this is done without having to download or install anything on your servers. We have hundreds of customers, each of whom may have dozens of shards, quickly growing to thousands of individual indexes. To manage this explosion of indexes, I'll describe how we're using Solr Cloud to manage each and every index - from creation, through migration from box to box, and finally destruction. I'll describe some of the performance issues we had to deal with, especially with ZooKeeper.
(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)





Comments
John David replied on Tue, 2011/12/20 - 12:01pm
what is the difference between Log4J and this cloud based Loggly?
Also can we used our Log4J with solr to get the same result. We just log our data with the Log4J and then create indexes using Solr to search the log files.
I will wait for you to share more information on the Loggly.