Re: Storing large number of files

2012-01-26 Thread Stefan Guggisberg
On Thu, Jan 26, 2012 at 3:09 AM, Peri Subrahmanya peri.subrahma...@gmail.com wrote: I am using JCR 2.3.7 (latest stable release) for storing large number of files. I am keeping the node sizes to 10K (requirement is to store upto 100M records) but I am seeing a performance issues no matter how

Re: Storing large number of files

2012-01-26 Thread Peri Subrahmanya
wrote: On Thu, Jan 26, 2012 at 3:09 AM, Peri Subrahmanya peri.subrahma...@gmail.com wrote: I am using JCR 2.3.7 (latest stable release) for storing large number of files. I am keeping the node sizes to 10K (requirement is to store upto 100M records) but I am seeing a performance issues

Re: Storing large number of files

2012-01-26 Thread Thomas Mueller
Hi, As I understood filesystem model doesn't provide atomocity i.e no transactional support I'm not sure if you read the data store documentation at http://wiki.apache.org/jackrabbit/DataStore - the data store is write-only, and doesn't require that much transactional support (what the file

Re: Storing large number of files

2012-01-26 Thread Peri Subrahmanya
Thomas, Thanks for the response. I did read the documentation and I think I got mixed up the on the information about datastore vs persistence managers in that the file based persistence managers are not atomic but the database persistence managers are. And in my case even though I am using