RE: how to "load" mmap directory into memory?

2014-12-03 Thread Toke Eskildsen
Li Li [fancye...@gmail.com] wrote: > I am using mmap fs directory in lucene. My index is small (about 3GB > in disk) and I have plenty of memory available. The problem is that > when the term is first queried, it's slow. How can I "load" all > directory into memory? Yes. One of the smart things ab

RE: Reminder: FOSDEM 2015 - Open Source Search Dev Room

2014-12-03 Thread Uwe Schindler
Hello everyone, We have extended the deadline for submissions to the FOSDEM 2015 Open Source Search Dev Room to Monday, 9 December at 23:59 CET. We are looking forward to your talk proposal! Cheers, Uwe - Uwe Schindler uschind...@apache.org Apache Lucene PMC Member / Committer Bremen, Ger

RE: how to "load" mmap directory into memory?

2014-12-03 Thread Uwe Schindler
Hi, the first searches are always slower, which is not only caused by the FS cache. In general, searchers must be warmed, so you execute a set of search queries or calculate facets initially after opening (or reopening) an IndexReader. This will have the side effect of also warming the disk cac

Re: A question on implementing new operators

2014-12-03 Thread rama44ster
Hi David, Many thanks for the pointers and sharing the slides. I will take a look in that direction. Regards, Prasad. On Tue, Dec 2, 2014 at 8:38 PM, david.w.smi...@gmail.com < david.w.smi...@gmail.com> wrote: > Hi Prasad, > > Firstly, the Lucene ‘general’ list is not the appropriate list; it’s

Re: how to "load" mmap directory into memory?

2014-12-03 Thread brettgleeson83
"Indin _bull? Sent from my BlackBerry® wireless device -Original Message- From: Toke Eskildsen Date: Wed, 3 Dec 2014 08:25:04 To: java-user@lucene.apache.org Reply-To: java-user@lucene.apache.org Subject: RE: how to "load" mmap directory into memory? Li Li [fancye...@gmail.com] wrote: >

Re: how to "load" mmap directory into memory?

2014-12-03 Thread brettgleeson83
Canuaddalotofnonsenseorshallwebedirect!?!?! X Sent from my BlackBerry® wireless device -Original Message- From: "Uwe Schindler" Date: Wed, 3 Dec 2014 11:54:27 To: Reply-To: java-user@lucene.apache.org Subject: RE: how to "load" mmap directory into memory? Hi, the first searches are al

Re: How best to compare tow sentences

2014-12-03 Thread Barry Coughlan
Hi Paul, I don't have much expertise in this area so hopefully others will answer, but maybe this is better than nothing. I don't know many out-of-the-box solutions for this problem, but I'm sure they exist. Mahout and Carrot2 might be worth investigating. Similarity Metrics: - Jaccard Index. Me

Re: How best to compare tow sentences

2014-12-03 Thread Paul Taylor
On 03/12/2014 15:14, Barry Coughlan wrote: Hi Paul, I don't have much expertise in this area so hopefully others will answer, but maybe this is better than nothing. I don't know many out-of-the-box solutions for this problem, but I'm sure they exist. Mahout and Carrot2 might be worth investi

Re: How best to compare tow sentences

2014-12-03 Thread Shashi Kant
Paul, for a pair-wise comparison Cosine Similarity does pretty good for most purposes. On Wed, Dec 3, 2014 at 10:45 AM, Paul Taylor wrote: > On 03/12/2014 15:14, Barry Coughlan wrote: >> >> Hi Paul, >> >> I don't have much expertise in this area so hopefully others will answer, >> but maybe this

CfP: ISORC 2015 - IEEE International Symposium On Real-time Computing

2014-12-03 Thread Peter Puschner
[ We apologize to those who receive multiple copies of this message. ] === CALL FOR PAPERS The 18th IEEE International Symposium On Real-Time Computing ISORC 2015