Seeking advice on index parameter settings for large index

2005-03-29 Thread Chuck Williams
I'm preparing to help a company run a scalability test and decide whether or not to use Lucene. Relevant particulars for the test include: 1. 2 pairs of indices. Each pair has 1 index with about 7.5 million small documents and 1 index with about 1 million large documents. Each index has a s

java.lang.OutOfMemoryException

2005-03-29 Thread omar didi
Hi all, I am running a search on a large index (100GB), my search consists of 10 booleanQueries that run at the same time and their results is combined to display the results. the first problem is it is very slow, but that is normal i guess for such a big index, the problem i have been having late

Re: Result grouping

2005-03-29 Thread omar didi
Hi all, I am running a search on a large index (100GB), my search consists of 10 booleanQueries that run at the same time and their results is combined to display the results. the first problem is it is very slow, but that is normal i guess for such a big index, the problem i have been having late

Re: pre computing possible search results narrowing and hit counts on those

2005-03-29 Thread Chris Hostetter
: I need two other pieces of information for display - : 1. I want to show a "select" box on the UI, which contains all the : cities that appear in those 50,000 documents : 2. Against each city I want to show the count of matching documents. : My problem is, I do not know how to generate that 'se

pre computing possible search results narrowing and hit counts on those

2005-03-29 Thread Antony Sequeira
Hi I have the above requirement, for which I could not find a good way to do. I think the best way to explain my problem would be to give an example. I have documents where each document represents a real estate property for sale in US. So, each document would have a city associated with it. (We i

Re: how to detect index integrity?

2005-03-29 Thread John Wang
Hi Ravi: I'd like to use this too. Do you have an update on this? Thanks -John On Fri, 25 Mar 2005 07:28:17 -0600, Ravi Rao <[EMAIL PROTECTED]> wrote: > > From: [EMAIL PROTECTED] > > Sent: Fri 3/25/2005 2:19 AM > > > I used your NullDirectory.java, and found it works fine for smaller > >

Re: Implementing security in search

2005-03-29 Thread Chris Hostetter
: maybe it is not the best solution, but : : you can form restriction clause like (+allowedRole1 +allowedRole2 : +allowedRole2 -forbiddenRole1 -forbiddenRole2 ... -forbiddenRoleN) : : where (forbiddenRole1 ... forbiddenRoleN) are all posible roles except : allowed roles. One catch there is that y

Re: Implementing security in search

2005-03-29 Thread Volodymyr Bychkoviak
maybe it is not the best solution, but you can form restriction clause like (+allowedRole1 +allowedRole2 +allowedRole2 -forbiddenRole1 -forbiddenRole2 ... -forbiddenRoleN) where (forbiddenRole1 ... forbiddenRoleN) are all posible roles except allowed roles. regards, Volodymyr Bychkoviak Carlos

Implementing security in search

2005-03-29 Thread Carlos Franco Robles
Hi! I need to implement security in search. When I'm indexing contents, I set a field with the roles assigned to that particular content. The problem is that a content should be retrieved from a search only if the user has *all* the roles assigned to the indexed content, not just one (in that c

Result grouping

2005-03-29 Thread Volodymyr Bychkoviak
Hi All. In my index documents have field named "group". I need to show result of search in form of "N items found in M groups", where is a number of total hits found and is a number of different groups according to "group" field. Does anybody has an idea to to achieve this. P.S. It have to be

Re: batch delete

2005-03-29 Thread Daniel Naber
On Monday 28 March 2005 11:59, Ben wrote: > Is there a typo in the javadoc for Term.compareTo(Term other)? Thanks --the before/after issue has been fixed in SVN some time ago already, I just also fixed the iff -> if. Regards Daniel -- http://www.danielnaber.de --