Lucene DocValuesField, SortedDocValuesField usage for filtering and sorting

2014-12-15 Thread Piotr Idzikowski
Hello. I am going to switch to newest (4.10.2) version of Lucene and I'd like to make some optimization in my index and code. I would like to use DocValuesField to get values but also for filtering and sorting. So here I have some questions: If I'd like to use range filter (FieldCacheRangeFilter) I

Lucene DocValuesField, SortedDocValuesField usage for filtering and sorting

2014-12-15 Thread Piotr Idzikowski
Hello. I am going to switch to newest (4.10.2) version of Lucene and I'd like to make some optimization in my index and code. I would like to use DocValuesField to get values but also for filtering and sorting. So here I have some questions: If I'd like to use range filter (FieldCacheRangeFilter) I

Re: Lucene DocValuesField, SortedDocValuesField usage for filtering and sorting

2014-12-16 Thread Piotr Idzikowski
Hello. Thanks for your replay. On Tue, Dec 16, 2014 at 3:14 PM, Adrien Grand wrote: > > Hi Piotr, > > On Mon, Dec 15, 2014 at 9:43 PM, Piotr Idzikowski > wrote: > > Hello. > > I am going to switch to newest (4.10.2) version of Lucene and I'd like to > >

Re: Lucene DocValuesField, SortedDocValuesField usage for filtering and sorting

2014-12-16 Thread Piotr Idzikowski
> > >> So for instance if I store documents with ie creation date and I have a > data (millions of documents) from last let's say 3 years and I'd like to do > range filter to get socs from some month only is it better to use ordinary > numeric query instead of FieldCacheRangeQuery? > > Of course I

Lucene search/count performance abrupt degradation (MMapDirectory)

2014-12-23 Thread Piotr Idzikowski
Hello. I have a performance problem with Lucene search queries running on Java 7u71 Linux platform. I use the newest 4.10 version, but we also experience the same problem with Lucene 4.7.2. I observed that after some time (1 or 2 days), even without any heavy use, Lucene search and count slow dow

Re: Lucene search/count performance abrupt degradation (MMapDirectory)

2015-01-08 Thread Piotr Idzikowski
on in Lucene installation manuals. It is quite interesting that the article refrains from using the word "bug" (be it of Lucene, Java or OS origin), while in our opinion it is the most accurate term for this rather bizarre case. Regards Piotr On Tue, Dec 23, 2014 at 9:32 PM, Piotr Idzikowski

Re: Lucene Version Upgrade (3->4) and Java JVM Versions(6->8)

2015-02-06 Thread Piotr Idzikowski
Hello. A little bit delayed question. But recently I have found this articles: https://wiki.apache.org/solr/SolrPerformanceProblems https://wiki.apache.org/solr/ShawnHeisey#GC_Tuning Especially this part from first url: *Using the ConcurrentMarkSweep (CMS) collector with tuning parameters is a ver

RE: Lucene Version Upgrade (3->4) and Java JVM Versions(6->8)

2015-02-08 Thread Piotr Idzikowski
yway), G1GC seems to > work well with Lucene. > > Jim > ________ > From: Piotr Idzikowski [[email protected]] > Sent: Friday, February 06, 2015 5:35 AM > To: [email protected] > Subject: Re: Lucene Version Upgrade (3->4)

StandardTokenizer#setMaxTokenLength

2015-07-16 Thread Piotr Idzikowski
old array content into the new one. Regards Piotr Idzikowski

Re: StandardTokenizer#setMaxTokenLength

2015-07-20 Thread Piotr Idzikowski
here is the output: 300*a: 0 255*a: 1 45*a: 1 TERMS 45: a 255: aaa Regards Piotr On Fri, Jul 17, 2015 at 4:40 PM, Steve Rowe wrote: > Hi Piotr, > > Thanks for reporting! > > See https://issues.apach

Re: StandardTokenizer#setMaxTokenLength

2015-07-20 Thread Piotr Idzikowski
I should add that this is Lucene 4.10.4. But I have checked it on the 5.2.1 version and I have got the same result Regards Piotr On Mon, Jul 20, 2015 at 9:44 AM, Piotr Idzikowski wrote: > Hello Steve, > It is always pleasure to help you develop such a great lib. > Talk

Re: StandardTokenizer#setMaxTokenLength

2015-07-20 Thread Piotr Idzikowski
Hello. Btw, I think ClassicAnalyzer has the same problem Regards On Fri, Jul 17, 2015 at 4:40 PM, Steve Rowe wrote: > Hi Piotr, > > Thanks for reporting! > > See https://issues.apache.org/jira/browse/LUCENE-6682 > > Steve > www.lucidworks.com > > > On Jul 16, 2