Greetings, community :)

2006-03-23 Thread Eivind Hasle Amundsen
Hello, World! I'm totally new to Lucene, but I'll be dealing with it in my master thesis (among other things) for the next year or so. I've acquired the LIA book and started to have a brief look at the API. First I want to thank Mr. Hatcher and Mr. Gospodnetic for what seems to be an excelle

RE: Native code compilation

2006-03-23 Thread Seeta Somagani
Yeah, I'm too lazy to write the code again in C++. Was just trying to see if compiling to native code works. Thanks Seeta -Original Message- From: Otis Gospodnetic [mailto:[EMAIL PROTECTED] Sent: Thursday, March 23, 2006 5:44 PM To: java-user@lucene.apache.org Subject: Re: Native code com

Re: lucene NFS support

2006-03-23 Thread Doug Cutting
Dai, Chunhe wrote: Does anyone know whether Lucene plans to support NFS in later release(2.0)? We are planning to integrate Lucene into our products and cluster support is definitely needed. We want to check whether NFS support is in the plan or not before implementing a new file locking ourselve

Re: Read past EOF error in Windows

2006-03-23 Thread Raghavendra Prabhu
Check Whether it has got anything to do with UTF There is a new line difference between windows and linux Rgds Prabhu On 3/24/06, Chris Cain <[EMAIL PROTECTED]> wrote: > > No that doesnt seem to be the problem. > > Anyone have any other ideas? > > On Tue, 21 Mar 2006 [EMAIL PROTECTED] > > I had

RE: lucene NFS support

2006-03-23 Thread Dai, Chunhe
Thanks, Otis. The reason is that some of our customers definitely use NFS and it is hard to convince all of the hundreds of customers not to use NFS. So naturally, the correct thing for us to do is to just support it since we already have file locking mechanism that works on NFS. -Original M

Re: Joins between index and database

2006-03-23 Thread markharw00d
See RangeFilter.bits() for some example code that creates a filter from terms. Also see TermsFilter in the "queries" module in the contrib section. ___ To help you stay safe and secure online, we've developed the al

Re: lucene NFS support

2006-03-23 Thread Otis Gospodnetic
Hi Chunhe, There are no NFS-specific plans. Out of personal curiosity - why go for NFS and not NAS? Otis - Original Message From: "Dai, Chunhe" <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Thursday, March 23, 2006 4:58:13 PM Subject: lucene NFS support Hi, Does anyon

RE: java.lang.OutOfMemoryError in lucene

2006-03-23 Thread Koji Sekiguchi
> But i have the IBM JDK 1.4.2, do you know if this version still have the > problem?? I'm sorry I don't know that. But you can try it and if it solves the problem, you can add your experience to FAQ :) Koji - To unsubscribe,

Re: Native code compilation

2006-03-23 Thread Otis Gospodnetic
Native code There is a C++ port called CLucene, if that suits you more than coffee beans... Otis - Original Message From: Seeta Somagani <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Thursday, March 23, 2006 4:47:33 PM Subject: Native code compilation Hi all, Has anyon

Re: Read past EOF error in Windows

2006-03-23 Thread Chris Cain
No that doesnt seem to be the problem. Anyone have any other ideas? On Tue, 21 Mar 2006 [EMAIL PROTECTED] I had a problem in the past with security on the folder where your index is located...but your error does not seem to show that ... I would check anyway though... -Original Message-

lucene NFS support

2006-03-23 Thread Dai, Chunhe
Hi, Does anyone know whether Lucene plans to support NFS in later release(2.0)? We are planning to integrate Lucene into our products and cluster support is definitely needed. We want to check whether NFS support is in the plan or not before implementing a new file locking ourselves with it.

Native code compilation

2006-03-23 Thread Seeta Somagani
Hi all, Has anyone tried to compile their Lucene applications into native code? Mine works fine in a VM but the call to search() on IndexSearcher is crashing the application, after I compile it into native code. There is apparently no problem in instantiating an IndexSearcher though. I tried this

Re: Changing ranking

2006-03-23 Thread Chris Hostetter
: Is there anyway I can change luicene to rank longer documents with more : phrase occurences higher if what you care about is only the number of occurences, and you don't want the length to be a factor at all, then using Field.setOmitNorms(true) on the Field for every document you add will not o

Re: Query question

2006-03-23 Thread Chris Hostetter
: Use "Keyword" (untokenized) field to index your paths. : Consider using PerFieldAnalyzerWrapper to specify KeywordAnalyzer for your path field. : Use the force, Luke - http://www.getopt.org/luke/ , to ensure your paths are indexed correctly. you also don't wnat to use QueryParser.escape when y

Re: Can i use lucene to search the internet.

2006-03-23 Thread Bill Janssen
Let's stop this thread. > Can i use lucene to search the internet. No. You may be able to use Lucene to *index* the internet, and then search the resulting index. Read the book "Lucene in Action" for a better idea of what this would entail. Bill ---

Re: Multiple threads in Lucene

2006-03-23 Thread Doug Cutting
Olivier Jaquemet wrote: IndexReader.unlock(indexDir); // unlock directory in case of unproper shutdown This should be used very carefully. In particular, you should only call it when you are certain that no other applications are accessing the index. Doug ---

Re: Joins between index and database

2006-03-23 Thread Paul Elschot
On Thursday 23 March 2006 20:51, Tom Hill wrote: > Hi - > > I have an application where I'm using Lucene to index the contents of > a database. That's working fine. > > But I have a problem where I'd like to retrieve a subset of the > documents that match a search, based on a join table in the

Joins between index and database

2006-03-23 Thread Tom Hill
Hi - I have an application where I'm using Lucene to index the contents of a database. That's working fine. But I have a problem where I'd like to retrieve a subset of the documents that match a search, based on a join table in the database. How do people typically handle combining the resu

Re: Changing ranking

2006-03-23 Thread Marvin Humphrey
On Mar 23, 2006, at 11:22 AM, Otis Gospodnetic wrote: The place to start would be to look at the DefaultSimilarity, and the norms method there. Perhaps you want to create your own Similarity implementation that returns either a constant 1 or something else that will favour longer text. S

Re: Multiple threads in Lucene

2006-03-23 Thread Otis Gospodnetic
Nikhil (if using reply-all, please remove direct email...) Sounds like you are doing everything correctly. Does your code work correctly with just 1 thread (i.e. just the "main" thread)? Make sure you get that working first. If that works, and N threads does not, then your threads are probably

Re: Changing ranking

2006-03-23 Thread Otis Gospodnetic
The place to start would be to look at the DefaultSimilarity, and the norms method there. Perhaps you want to create your own Similarity implementation that returns either a constant 1 or something else that will favour longer text. Somebody else with more experience in this area may have bett

Re: Multiple threads in Lucene

2006-03-23 Thread Olivier Jaquemet
Hi, In order to prevent such problem, here is how you should open your index: Directory indexDir = FSDirectory.getDirectory(luceneDir, !IndexReader.indexExists(luceneDir)); IndexReader.unlock(indexDir); // unlock directory in case of unproper shutdown if (!IndexReader.indexExists(luce

Re: Multiple threads in Lucene

2006-03-23 Thread Nikhil Goel
Hi Otis, Thanks for the reply but I have one question to ask here. You said big no no for opening opening multiple IndexWriters. I want to clarify :- 1) Do you mean multiple IndexWriters at the same time? I am not doing this. At a time there is only one Indexwriter opened. or 1) Do you mean I cant

Changing ranking

2006-03-23 Thread Leon Chaddock
Hi, At present lucene seems to rank very short documents over longer documents where the phrase occurs more regularily for instance which the search term "cat" "the cat went home" ranks higher than "the black cat when home past some other cats, on cat street" Is there anyway I can change lu

Re: Speed up Indexing

2006-03-23 Thread Jeff Rodenburg
I run Lucene.Net as well, and your indexing performance is dependent on more factors aside from whether you're using the Java or C# version. As a basic suggestion, learn what you can about minMergeDocs and mergeFactor as well as the compound file format. Try different combinations to understand w

RE: java.lang.OutOfMemoryError in lucene

2006-03-23 Thread escobar5
But i have the IBM JDK 1.4.2, do you know if this version still have the problem?? -- View this message in context: http://www.nabble.com/java.lang.OutOfMemoryError-in-lucene-t1324911.html#a3551247 Sent from the Lucene - Java Users forum at Nabble.com. --

Re: FileNotFoundException: Corrupted Index? => Use jvm ShutdownHook

2006-03-23 Thread Olivier Jaquemet
Hi Otis, Thanks for your reply. I will also put the writer shutdown hook for this index, as you said. I had already done that for other part of our code where we use other lucene index, but thought it would not be needed for this special index due to the fact that we rarely write on it. But th

RE: Can i use lucene to search the internet.

2006-03-23 Thread Babu, KameshNarayana \(GE, Research, consultant\)
hi , thanks for the reply. Can i do without cygwin. Which list i should use for these queries. kindly help me. -Original Message- From: Raghavendra Prabhu [mailto:[EMAIL PROTECTED] Sent: Thursday, March 23, 2006 3:48 PM To: java-user@lucene.apache.org Subject: Re: Can i use lucene to sear

Re: Can i use lucene to search the internet.

2006-03-23 Thread Raghavendra Prabhu
Hi It can be used if you run cygwin (the latest version) Please have a look at nutch wiki And you are mailing the wrong list Rgds Prabhu On 3/23/06, Babu, KameshNarayana (GE, Research, consultant) < [EMAIL PROTECTED]> wrote: > Hai All, > Can NUTCH be used in Windoes OS > > -Original Mess

RE: Can i use lucene to search the internet.

2006-03-23 Thread Babu, KameshNarayana \(GE, Research, consultant\)
Title: Can i use lucene to search the internet. Hai All, Can NUTCH be used in Windoes OS -Original Message-From: gekkokid [mailto:[EMAIL PROTECTED]Sent: Thursday, March 23, 2006 11:22 AMTo: java-user@lucene.apache.orgSubject: Re: Can i use lucene to search the internet. H

RE: Can i use lucene to search the internet.

2006-03-23 Thread Babu, KameshNarayana \(GE, Research, consultant\)
Title: Can i use lucene to search the internet. Hi, Can we use NUTCH in windows OS -Original Message-From: gekkokid [mailto:[EMAIL PROTECTED]Sent: Thursday, March 23, 2006 11:22 AMTo: java-user@lucene.apache.orgSubject: Re: Can i use lucene to search the internet. Hi, ar