Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-11 Thread Chitra R
Hi Shai, i)Hope, when opening SortedSetDocValuesReaderState , we are calculating ordinals( this will be used to calculate facet count ) for doc values field and this only made the state instance somewhat costly. Am I right or any other reason behind that?

Re: Getting list of committed documents

2016-11-11 Thread Michael McCandless
Hi lukes, First, IW never "auto commits". The maxBufferedDocs/RAMBufferSizeMB settings control when IW moves the recently indexed documents from RAM to disk, but that moving, which writes new segments files, does not commit them. It just writes them to disk, not visible yet to an external reader

Too long token is not handled properly?

2016-11-11 Thread Alexey Makeev
Hello, I'm using lucene 6.2.0 and expecting the following test to pass: import org.apache.lucene.analysis.BaseTokenStreamTestCase; import org.apache.lucene.analysis.standard.StandardTokenizer; import java.io.IOException; import java.io.StringReader; public class TestStandardTokenizer extends Ba

How exclude empty fields?

2016-11-11 Thread voidmind
Hi, I have indexed content about Promotions with effectiveDate and endDate fields for when the promotions start and end. I want to query for expired promotions so I do have this criteria, which works fine: +Promotion.endDate:[210100TOvariable containing yesterday's date] The issue I hav

Re: Too long token is not handled properly?

2016-11-11 Thread Steve Rowe
Hi Alexey, The behavior you mention is an intentional change from the behavior in Lucene 4.9.0 and earlier, when tokens longer than maxTokenLenth were silently ignored: see LUCENE-5897[1] and LUCENE-5400[2]. The new behavior is as follows: Token matching rules are no longer allowed to match ag

Re: How exclude empty fields?

2016-11-11 Thread Ahmet Arslan
Hi, Match all docs query minus Promotion.endDate:[* TO *] +*:* -Promotion.endDate:[* TO *] Ahmet On Friday, November 11, 2016 5:59 PM, voidmind wrote: Hi, I have indexed content about Promotions with effectiveDate and endDate fields for when the promotions start and end. I want to query for

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-11 Thread Michael McCandless
On Fri, Nov 11, 2016 at 5:21 AM, Chitra R wrote: > i)Hope, when opening SortedSetDocValuesReaderState , we are > calculating ordinals( this will be used to calculate facet count ) for doc > values field and this only made the state instance somewhat costly. > Am I ri