Re: Index file size limitation of 2GB

2007-08-13 Thread Erick Erickson
There is no *lucene* limitation of a 2GB index file. I've had no trouble with single indexes over 8G. If you're referring to this page... http://wiki.apache.org/lucene-java/LuceneFAQ?highlight=%282gb%29 then it's talking about an *operating system* limitation. So I wouldn't worry about this unless

Re: Index file size limitation of 2GB

2007-08-13 Thread Chris Lu
Hi, Rohit, You need to create index reader in the sub directory where you created the index files. Lucene's IndexReader won't find your index if you simply move the index to a sub directory. Yes, if you have several index directory, you need to combine them together. But you can achieve this by u

Index file size limitation of 2GB

2007-08-12 Thread rohit saini
Hi all, I have bulk of data to be indexed and that may cross index file size of 2GB. As lucene faq tells that if index file size increses to 2GB there will be problems. but faq tells to make index subdirectory in this case. I have tried to do so made a index subdirectory in index main directory wh