Re: segments and sorting

2013-06-20 Thread Sriram Sankar
Thanks. If I end up doing it, we can try to get it in. Sriram. On Wed, Jun 19, 2013 at 1:10 AM, Adrien Grand wrote: > Hi, > > On Wed, Jun 19, 2013 at 12:16 AM, Sriram Sankar wrote: > > Is it possible to do this more efficiently using a merge sort? Assuming > > the individual segments are al

Re: segments and sorting

2013-06-19 Thread Adrien Grand
Hi, On Wed, Jun 19, 2013 at 12:16 AM, Sriram Sankar wrote: > Is it possible to do this more efficiently using a merge sort? Assuming > the individual segments are already sorted, is there a wrapper that I can > use where I can pass the same sorting function? I'm guessing the > SlowCompositeRead

Re: segments and sorting

2013-06-18 Thread Sriram Sankar
> You can sort each segment independently or have a single segment, both > options are available. To have a single segment, you just need to wrap > your top-level index reader with SlowCompositeReaderWrapper before > wrapping it again in a SortingAtomicReader and calling > IndexWriter.addIndexes.

Re: segments and sorting

2013-06-18 Thread Adrien Grand
On Tue, Jun 18, 2013 at 1:05 AM, Sriram Sankar wrote: > I'm sorry - I meant "DocValue" not "FieldValue". Slide 20 in the following > deck talks about the 2Gb limit. Doc values don't have this limit anymore. However, there is a limit of ~32kb per term, but this shouldn't be a problem with reasona

Re: segments and sorting

2013-06-17 Thread Sriram Sankar
I'm sorry - I meant "DocValue" not "FieldValue". Slide 20 in the following deck talks about the 2Gb limit. Sriram. http://www.slideshare.net/lucenerevolution/willnauer-simon-doc-values-column-stride-fields-in-lucene On Sat, Jun 15, 2013 at 1:52 AM, Adrien Grand wrote: > Hi, > > On Fri, Jun 1

Re: segments and sorting

2013-06-15 Thread Adrien Grand
Hi, On Fri, Jun 14, 2013 at 11:24 PM, Sriram Sankar wrote: > For my use case of having all docs sorted by a static rank and being able > to cut off retrieval after a certain number of docs, I have to sort all my > docs using the static rank (and Lucene 4 has a way to do this). > > When an index h

segments and sorting

2013-06-14 Thread Sriram Sankar
Quick question on segments: For my use case of having all docs sorted by a static rank and being able to cut off retrieval after a certain number of docs, I have to sort all my docs using the static rank (and Lucene 4 has a way to do this). When an index has multiple segments, how does this sorti