Re: In memory index (current status in Lucene)

2013-07-04 Thread Adrien Grand
On Tue, Jul 2, 2013 at 10:09 AM, Toke Eskildsen wrote: > I wonder if Java's ByteBuffer could be used to make a more GC-friendly > RAMDirectory? For the record, there is an open issue about it: https://issues.apache.org/jira/browse/LUCENE-2292. -- Adrien

Re: In memory index (current status in Lucene)

2013-07-04 Thread Ramkumar R. Aiyengar
Have you tried using MMapDirectory over a RAM disk (assuming you are on Linux)? You can avoid writing to disk (and thus the other ways to get to it persistently as Steven mentions), but still MMap it. On 1 Jul 2013 22:41, "Lance Norskog" wrote: > My current open source project is a Directory that

Regarding Lucene Highlighting feature.

2013-07-04 Thread VIGNESH S
Hi, Is it mandatory to use "Store.YES" when using Highlighting Feature. is it Possible to use Highlighting Feature without using "Store.Yes" while indexing because it almost doubles index size. Please Kindly Help. -- Thanks and Regards Vignesh Srinivasan 9739135640

Re: Facets ordering

2013-07-04 Thread Shai Erera
RangeFacetRequest will be released in 4.4, I guess a couple of weeks away. Shai On Jul 4, 2013 12:02 PM, "Nicola Buso" wrote: > On Wed, 2013-07-03 at 21:58 +0300, Shai Erera wrote: > > What's maxCount? What I mean is that if you create a FacetRequest with > > numResults = 5*K (for example), then

Re: Possible location of word inside the file.

2013-07-04 Thread Ian Lea
Yes, read and index each line. If that's a performance problem I suggest you upgrade your hardware. Try it - never worry about performance in advance. Bottlenecks are generally not where you expect. -- Ian. On Thu, Jul 4, 2013 at 10:53 AM, Ankit Murarka wrote: > Thanks.Indeed I am indexing e

Re: Possible location of word inside the file.

2013-07-04 Thread Ankit Murarka
Thanks.Indeed I am indexing each file. But how do I index each line of a file. This will essentially mean-> First I need to index each file to know whether the word exist or not. Then I need to index each line of the file to know them location. This does not seem to be a problem. Problem is If

Re: Facets ordering

2013-07-04 Thread Nicola Buso
On Wed, 2013-07-03 at 21:58 +0300, Shai Erera wrote: > What's maxCount? What I mean is that if you create a FacetRequest with > numResults = 5*K (for example), then you get the top-5K categories and can > choose the best top-K of those, by their label. Yes, this will hurt top-K > computation the le

Re: Possible location of word inside the file.

2013-07-04 Thread Ian Lea
Sounds like you're indexing each log file as one lucene document. Obvious answer is to index each line in each log file as a separate doc. Searches would then match lines in files and you can display those lines, summarizing counts per file if you want that, If you wanted to be able to show surro

Possible location of word inside the file.

2013-07-04 Thread Ankit Murarka
Dear Team, I have a potential usecase. I have large number of log files which are archived in a particular directory. Now the administrator would like to view certain information which might/might not be present in any of the files inside the directory. Using lucene, I was ab