Re: How many documents in the biggest Lucene index to date?

2007-01-30 Thread Daniel Noll
karl wettin wrote: I think the big undertaking would be to refactor all of Lucene to use longs as document numbers. But not in the store. There it would still be integers, and the MultiReader can keep track of Integer.MAX_VALUE stores. Integer.MAX_VALUE*Integer.MAX_VALUE = Long.MAX_VALUE. So

Re: How many documents in the biggest Lucene index to date?

2007-01-30 Thread karl wettin
30 jan 2007 kl. 04.18 skrev Daniel Noll: karl wettin wrote: Then it hit me that perheps the integer limitation should be in the store (Directory) and not the IndexReader? If not now, perhaps in the future when everybody is running on 64bit JVMs. I don't think it will be a very expensive th

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread Daniel Noll
karl wettin wrote: Then it hit me that perheps the integer limitation should be in the store (Directory) and not the IndexReader? If not now, perhaps in the future when everybody is running on 64bit JVMs. I don't think it will be a very expensive thing to implement. But did anyone need that yet

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread karl wettin
29 jan 2007 kl. 23.21 skrev Daniel Noll: karl wettin wrote: The maximum number of documents in an index is Integer.MAX_VALUE (2 147 483 647), but it it possible to combine multiple indices. It's true that you can combine multiple indexes, but don't make assumptions that this lets you brea

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread Daniel Noll
karl wettin wrote: The maximum number of documents in an index is Integer.MAX_VALUE (2 147 483 647), but it it possible to combine multiple indices. It's true that you can combine multiple indexes, but don't make assumptions that this lets you break the limitation. MultiReader still extends

Re: How many documents in the biggest Lucene index to date?

2007-01-29 Thread Grant Ingersoll
gersoll <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Friday, January 26, 2007 8:03:11 AM Subject: Re: How many documents in the biggest Lucene index to date? I just indexed a collection w/ 15+ million docs in one index. Index size is roughly 42 gb. On Jan 26, 2007, at 12:45 AM, B

Re: How many documents in the biggest Lucene index to date?

2007-01-28 Thread Erik Hatcher
ge From: Bill Taylor <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Friday, January 26, 2007 12:45:43 AM Subject: How many documents in the biggest Lucene index to date? I have used Lucene to index a small collection - only a few hundred documents. I have a potential client

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Otis Gospodnetic
t; To: java-user@lucene.apache.org Sent: Friday, January 26, 2007 12:45:43 AM Subject: How many documents in the biggest Lucene index to date? I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Chiradeep Vittal
ssage From: Grant Ingersoll <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Friday, January 26, 2007 8:03:11 AM Subject: Re: How many documents in the biggest Lucene index to date? I just indexed a collection w/ 15+ million docs in one index. Index size is roughly 42 gb.

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Grant Ingersoll
I just indexed a collection w/ 15+ million docs in one index. Index size is roughly 42 gb. On Jan 26, 2007, at 12:45 AM, Bill Taylor wrote: I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread mark harwood
pache.org Sent: Friday, 26 January, 2007 8:32:01 AM Subject: Re: How many documents in the biggest Lucene index to date? Bill Taylor wrote: > I have used Lucene to index a small collection - only a few hundred > documents. I have a potential client who wants to index a collection > whic

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread Andrzej Bialecki
Bill Taylor wrote: I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million documents and could easily grow to two million. Has anyone used Lucene with an index that large? I

Re: How many documents in the biggest Lucene index to date?

2007-01-26 Thread karl wettin
26 jan 2007 kl. 06.45 skrev Bill Taylor: I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million documents and could easily grow to two million. The maximum number of d

How many documents in the biggest Lucene index to date?

2007-01-25 Thread Bill Taylor
I have used Lucene to index a small collection - only a few hundred documents. I have a potential client who wants to index a collection which will start at about a million documents and could easily grow to two million. Has anyone used Lucene with an index that large? Thank you very much