Mitch Pronschinske is a Senior Content Analyst at DZone. That means he writes and searches for the finest developer content in the land so that you don't have to. He often eats peanut butter and bananas, likes to make his own ringtones, enjoys card and board games, and is married to an underwear model. Mitch is a DZone Zone Leader and has posted 2574 posts at DZone. You can read more from them at their website. View Full User Profile

Integrating Lucene into a Transactional XML Database

05.24.2012
| 4529 views |
  • submit to reddit
Petr Pleshachkov of EMC lead a really cool and informative session recently about how to use Lucene with an XML database (xDB).  (abstract below)


In this talk we will present an integration of the Lucene search engine with EMC Documentum xDB database (native XML database). We will introduce a new approach implemented in xDB 10.3 which integrates Lucene index (used for XQuery queries optimization) into transactional xDB engine on the storage level. That is, Lucene files are stored to the XDB data pages instead of the file system as in earlier releases, Lucene accesses all the files through xDB buffer pool instead of the just the Operating system buffer cache. This approach allows us to simplify the implementation of traditional database features for Lucene within xDB like transactions isolation, rollbacks, recovery after database crashes, snapshots construction , replication, hot backups, buffer management, etc. We cover performance analysis of new approach for queries and ingest operations, performance tuning tips and future optimization techniques in the area. The presentation is intended as a description of an implementation and performance analysis.

Comments

Herry Johnson replied on Tue, 2012/06/12 - 12:58pm

There is no best. No matter what the situation or context, don't ever look for "the best".

One possible solution that many Java applications employ is to put the file in the user home directory. You can get it in the code with System.getProperty("user.home"). This has a few advantages:

- its cross-platform, at least across all major ones (win, mac, lin)
- you can be sure that this directory exists
- you can be sure that the logged in user can read and write there
- it is user specific, so different users don't have to share the same settings

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.