RE: indexing documents (or pieces of a document) by access controls

2007-06-14 Thread Ard Schrijvers
Hello, When I had those kind of problems (less complex) with lucene, the only idea was to filter from the front-end, according to the ACL policy. Lucene docs and fields weren't protected, but tagged. Searching was always applied with a field audience, with hierarchical values like

Re: problems getting data into solr index

2007-06-14 Thread vanderkerkoff
Hello Hoss Thanks for replying, I tried what you suggested as the iniital step of my troubleshooting and it outputs it fine. It was what I suspected initially as well, but thanks for the advice. hossman_lucene wrote: : I'm running solr1.2 and Jetty, I'm having problems looping through a

Re: problems getting data into solr index

2007-06-14 Thread vanderkerkoff
Hi Yonik Here's the output from netcat POST /solr/update HTTP/1.1 Host: localhost:8983 Accept-Encoding: identity Content-Length: 83 Content-Type: text/xml; charset=utf-8 that looks Ok to me, but I am a bit twp you see. :-) Yonik Seeley wrote: On 6/13/07, vanderkerkoff [EMAIL PROTECTED]

who use time?

2007-06-14 Thread James liu
i write script to get run time to sure how to performance. i find very intresting thing that i query 2 solr box to get data and solr response show me qtime all zero. but i find multi get data script use time is 0.046674966812134(it will change) solr box in my pc. and index data is very small.

Re: problems getting data into solr index

2007-06-14 Thread James liu
is it ok? 2007/6/14, vanderkerkoff [EMAIL PROTECTED]: Hi Yonik Here's the output from netcat POST /solr/update HTTP/1.1 Host: localhost:8983 Accept-Encoding: identity Content-Length: 83 Content-Type: text/xml; charset=utf-8 that looks Ok to me, but I am a bit twp you see. :-) Yonik

Index time boost is not working

2007-06-14 Thread Madhan Subhas
I am using solr in my rails application. When I create the document that need to be stored in Solr I can see the boost values being set on the fields as attributes. However when I browse the indexes through luke I see a boost value of 1. What am I missing. Thanks for your input. -Madhan

Problem with surrogate characters in utf-8

2007-06-14 Thread Burkamp, Christian
Hi all, I have a problem after updating to solr 1.2. I'm using the bundled jetty that comes with the latest solr release. Some of the contents that are stored in my index contain characters from the unicode private section above 0x10. (They are used by some proprietary software and the text

Solr 1.2 HTTP Client for Java

2007-06-14 Thread Daniel Alheiros
Hi I've been using one Java client I got from a colleague but I don't know exactly its version or where to get any update for it. Base package is org.apache.solr.client (where there are some common packages) and the client main package is org.apache.solr.client.solrj. Is it available via Maven2

Re: problems getting data into solr index

2007-06-14 Thread vanderkerkoff
Hi Brian I've now set the mysqldb to be default charset utf8, and everything else is utf8. collation etc etc. I think I know what the problem is, and it's a really old one and I feel foolish now for not realising it earlier. Our content people are copying and pasting sh*t from word into the

Re: Index time boost is not working

2007-06-14 Thread Otis Gospodnetic
Is your field defined with omitNorms=true by any chance? Otis -- Lucene Consulting -- http://lucene-consulting.com/ - Original Message From: Madhan Subhas [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Thursday, June 14, 2007 5:35:17 AM Subject: Index time boost is not

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Martin Grotzke
On Thu, 2007-06-14 at 11:32 +0100, Daniel Alheiros wrote: Hi I've been using one Java client I got from a colleague but I don't know exactly its version or where to get any update for it. Base package is org.apache.solr.client (where there are some common packages) and the client main

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Daniel Alheiros
Thanks Martin. I'm using one of them which the optimize command doesn't work properly Have you seen the same problem? Regards, Daniel On 14/6/07 13:07, Martin Grotzke [EMAIL PROTECTED] wrote: On Thu, 2007-06-14 at 11:32 +0100, Daniel Alheiros wrote: Hi I've been using one Java client

Re: Delete entire index

2007-06-14 Thread Otis Gospodnetic
I think this would be useful. The other day I hit this problem of fq= not working. It turned out that the schema was changed (some non-indexed fields were made indexed), the bulk upload was done, but that bulk upload left the old index files in place, so ended up with double index within

Re: Index time boost is not working

2007-06-14 Thread Thierry Collogne
How do you browse the indexes? On 14/06/07, Otis Gospodnetic [EMAIL PROTECTED] wrote: Is your field defined with omitNorms=true by any chance? Otis -- Lucene Consulting -- http://lucene-consulting.com/ - Original Message From: Madhan Subhas [EMAIL PROTECTED] To:

Re: Index time boost is not working

2007-06-14 Thread Otis Gospodnetic
Check your schema.xml, that's where you'll see how the field is defined. Otis - Original Message From: Thierry Collogne [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Thursday, June 14, 2007 8:27:54 AM Subject: Re: Index time boost is not working How do you browse the

RE: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Will Johnson
The code in http://solrstuff.org/svn/solrj/ is very stable, works with most all features for both searching and indexing and will be moving into the main distribution soon as the standard java client library. - will -Original Message- From: Martin Grotzke [mailto:[EMAIL PROTECTED]

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Thierry Collogne
I tried using that client, but I didn't get any good results while searching for worst with special characters. I have also searched for documentation for that client, but didn't find any. Does anyone know where to find documentation concerning the java client? On 14/06/07, Will Johnson [EMAIL

Conceptual Question

2007-06-14 Thread Andreas Balke [Digiden GmbH]
Hey all, i checked out solr and i'm pretty amazed since this could save us a lot of work. we are working on a document managment system and currently change the document structure to be valid to predefined schemas. each document will contain of several 'complex types' what is compareable to

Re: who use time?

2007-06-14 Thread Yonik Seeley
On 6/14/07, James liu [EMAIL PROTECTED] wrote: i write script to get run time to sure how to performance. i find very intresting thing that i query 2 solr box to get data and solr response show me qtime all zero. but i find multi get data script use time is 0.046674966812134(it will change)

Re: Conceptual Question

2007-06-14 Thread Yonik Seeley
On 6/14/07, Andreas Balke [Digiden GmbH] [EMAIL PROTECTED] wrote: the important point (and first question) is that our schema is very likely to change. that means we will have 'revisions' of documents whereas each revision has its own, slightly different, schema. structuring the documents itself

RE: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Will Johnson
Can you provide some examples of the searches you were running and the errors you were getting? - will -Original Message- From: Thierry Collogne [mailto:[EMAIL PROTECTED] Sent: Thursday, June 14, 2007 10:19 AM To: solr-user@lucene.apache.org Subject: Re: Solr 1.2 HTTP Client for Java I

Re: Problem with surrogate characters in utf-8

2007-06-14 Thread Yonik Seeley
On 6/14/07, Burkamp, Christian [EMAIL PROTECTED] wrote: I tried the new solr 1.2 war file with the old example distribution (solr 1.1 and jetty 5.1). Suprisingly enough this does not reveal the problem. So the whole story might even be a jetty issue. That definitely points to it being a Jetty

RE: Index time boost is not working

2007-06-14 Thread Madhan Subhas
Otis, here is the setting in the schema for the fields I use. OmitNorms is not set to any value here. Should explicitly set the value to false. Thanks Madhan fields field name=id type=string indexed=true stored=true/ field name=default type=text indexed=true stored=false multiValued=true/

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Daniel Alheiros
Excellent. Any idea if you are going to make it distributable via the central Maven repo? It could make things easier for those using maven to build their projects... Like me :) Regards, Daniel On 14/6/07 17:09, Ryan McKinley [EMAIL PROTECTED] wrote: I'm working on integrating the solrj

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Ryan McKinley
Any idea if you are going to make it distributable via the central Maven repo? It will be included in the next official solr release. I don't use maven, but assume all official apache projects are included in their repo. If they do nightly snapshots, it will be there ryan

RE: question about highlight field

2007-06-14 Thread Xuesong Luo
Hi, Chris, I rewrite the prefix wildcard query consult* to (consult consult?*), it works with highlighting. Do you think it's a possible solution? Could you explain a little bit why put a ? before * won't crash solr if matching a lot of terms? Thanks Xuesong In the trunk (soon to be Solr 1.2)

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Sami Siren
Ryan McKinley wrote: Any idea if you are going to make it distributable via the central Maven repo? It will be included in the next official solr release. I don't use maven, but assume all official apache projects are included in their repo. If they do nightly snapshots, it will be

Keep having error on unknown field

2007-06-14 Thread Tiong Jeffrey
Hi, When I tried to use jetty to index my xml, i kept getting the following error even though I have defined properly in the schema.xml. The error is - SEVERE: org.apache.solr.core.SolrException: ERROR:unknown field 'name'... In my schema, it was defined like this - filed name=name

Re: Keep having error on unknown field

2007-06-14 Thread Yonik Seeley
On 6/14/07, Tiong Jeffrey [EMAIL PROTECTED] wrote: The error is - SEVERE: org.apache.solr.core.SolrException: ERROR:unknown field 'name'... In my schema, it was defined like this - filed name=name type=string indexed=true stored=true multiValued=true/ filed = field -Yonik

Re: problem with schema.xml

2007-06-14 Thread Chris Hostetter
: get fresh log messages when the server is started again. The new : schema.xml that shows the changes is via: : : http://localhost:8983/solr/admin/get-file.jsp?file=schema.xml : : Maybe there's some extra magic to getting the new field to show up at : all as null or something valuable? Is that

Re: DisMax request handler doesn't work with stopwords?

2007-06-14 Thread Chris Hostetter
: I'm having the same issues. We are using Dismax, with a stopword list. : Currently we are having customers typing in model ipod, we added model to : the stopwords list and tested with the standard handler..works fine, but not : with dismax (MM = 3lt;-1 5lt;-2 6lt;90%). When i comment out MM, it

Re: Solr 1.2 HTTP Client for Java

2007-06-14 Thread Ryan McKinley
Daniel Alheiros wrote: Excellent. I just added SOLR-20 to trunk. you will need: 1. checkout trunk 2. ant dist 3. include: apache-solr-1.3-dev-common.jar apache-solr-1.3-dev-solrj.jar solrj-lib/*.jar Here is the basic interface:

facet query counts

2007-06-14 Thread Kevin Osborn
I have a large subset (47640) of my total index. Most of them (45335) have a single field, which we will call Field1. Field1 is a sfloat. If my query restricts the resultset to my subset and I do a facet count on Field1, then the number of records returned is 47640. And if I sum up the facet

Re: Keep having error on unknown field

2007-06-14 Thread Tiong Jeffrey
arh! i spent 6-7 hours on this error and didnt see this! thanks! On 6/15/07, Yonik Seeley [EMAIL PROTECTED] wrote: On 6/14/07, Tiong Jeffrey [EMAIL PROTECTED] wrote: The error is - SEVERE: org.apache.solr.core.SolrException: ERROR:unknown field 'name'... In my schema, it was defined like

Re: Keep having error on unknown field

2007-06-14 Thread Walter Underwood
Do we have a bug filed on this? Solr really should have complained about the unknown element. --wunder On 6/14/07 4:54 PM, Tiong Jeffrey [EMAIL PROTECTED] wrote: arh! i spent 6-7 hours on this error and didnt see this! thanks! On 6/15/07, Yonik Seeley [EMAIL PROTECTED] wrote: On 6/14/07,

Re: facet query counts

2007-06-14 Thread Mike Klaas
On 14-Jun-07, at 4:29 PM, Kevin Osborn wrote: I have a large subset (47640) of my total index. Most of them (45335) have a single field, which we will call Field1. Field1 is a sfloat. If my query restricts the resultset to my subset and I do a facet count on Field1, then the number of

Re: facet query counts

2007-06-14 Thread Yonik Seeley
A 32 bit float has about 7 decimal digits of precision, so your range queries actually do overlap since 40f is exactly the same as 39f -Yonik On 6/14/07, Kevin Osborn [EMAIL PROTECTED] wrote: I have a large subset (47640) of my total index. Most of them (45335) have a single

Re: Keep having error on unknown field

2007-06-14 Thread Ryan McKinley
SOLR-133 includes this fix... it squawks if it hits an unknown tag. Walter Underwood wrote: Do we have a bug filed on this? Solr really should have complained about the unknown element. --wunder On 6/14/07 4:54 PM, Tiong Jeffrey [EMAIL PROTECTED] wrote: arh! i spent 6-7 hours on this error

Where are the log files...

2007-06-14 Thread Jack L
It happened twice in the past few days that the solr instance stopped responding (the admin page does not load) while the process was still running. I'd like to find out what's causing this. I notice that I can change logger level from admin page but I didn't figure out where the log files are.

Re: who use time?

2007-06-14 Thread James liu
2007/6/14, Yonik Seeley [EMAIL PROTECTED]: On 6/14/07, James liu [EMAIL PROTECTED] wrote: i write script to get run time to sure how to performance. i find very intresting thing that i query 2 solr box to get data and solr response show me qtime all zero. but i find multi get data script

Re: Where are the log files...

2007-06-14 Thread Ryan McKinley
what version of solr/container are you running? this sounds similar to what people running solr 1.1 with the jetty include in that example... Jack L wrote: It happened twice in the past few days that the solr instance stopped responding (the admin page does not load) while the process was

Re: Where are the log files...

2007-06-14 Thread James liu
if u use jetty, u should see jetty's log. if u use tomcat, u should see tomcat's log. solr is only a program that run with container. 2007/6/15, Ryan McKinley [EMAIL PROTECTED]: what version of solr/container are you running? this sounds similar to what people running solr 1.1 with the

Re: problems getting data into solr index

2007-06-14 Thread Mike Klaas
On 14-Jun-07, at 4:30 AM, vanderkerkoff wrote: Hi Brian I've now set the mysqldb to be default charset utf8, and everything else is utf8. collation etc etc. I think I know what the problem is, and it's a really old one and I feel foolish now for not realising it earlier. Our content

Re[2]: Where are the log files...

2007-06-14 Thread Jack L
Yeah, I'm running 1.1 with jetty. But I didn't find *.log in the whole solr directory. Is jetty putting the log files outside the directory? what version of solr/container are you running? this sounds similar to what people running solr 1.1 with the jetty include in that example... Jack

Ping fails out of the box

2007-06-14 Thread Jack L
I just downloaded version 1.2 and set it up on my Windows PC. Search works but Ping returns error 500: --- HTTP ERROR: 500 Internal Server Error RequestURI=/solr/admin/ping Powered by Jetty:// --- Is there any minimum setting for Ping to

Re: Ping fails out of the box

2007-06-14 Thread Chris Hostetter
: I just downloaded version 1.2 and set it up on my Windows PC. : Search works but Ping returns error 500: : Is there any minimum setting for Ping to work? the ping url triggers a query which can be configured in the solrconfig.xml, it should work out of the box (even without indexing any data)