Few Queries regarding indexes in Solr

2009-06-15 Thread Rakhi Khatwani
Hi, 1. Is it possible to query from another index folder (say index1) in solr? 2. Is it possible to query 2 indexes(folders index1 and index2) stored in the same machine using the same port on a single solr instance? 3. consider a case: i have indexes in 2 shards, and i

Re: Debug Solr in Netbeans..

2009-06-15 Thread noor
Addition to my previous reply:: I am running solr by start.jar file. It has my custom class jar file in its lib folder. Also in netbeans, custom class source has the checkpoint to debug.; and in the project folder, i created the build.properties. So i set the AttachDebugger settings; but it giv

Re: EmbeddedSolrServer seperate process

2009-06-15 Thread pof
It certain does, thank you. Shalin Shekhar Mangar wrote: > > On Tue, Jun 16, 2009 at 8:15 AM, pof wrote: > >> >> Hi, one question: Will EmbeddedSolrServer work on a seperate java process >> than the solr servlet(start.jar) as long as it is run on the same >> machine? >> >> > EmbeddedSolrServe

Re: LRUCache causing locked threads

2009-06-15 Thread Noble Paul നോബിള്‍ नोब्ळ्
the FastLRUCache can be used in 1.3 if it can be compiled and added to the solr.home/lib On Tue, Jun 16, 2009 at 12:40 AM, Yonik Seeley wrote: > On Mon, Jun 15, 2009 at 2:58 PM, CameronL wrote: >> Unfortunately upgrading to 1.4 isn't an option for us at the moment. >> >> Since we're stuck using 1.

Re: EmbeddedSolrServer seperate process

2009-06-15 Thread Shalin Shekhar Mangar
On Tue, Jun 16, 2009 at 8:15 AM, pof wrote: > > Hi, one question: Will EmbeddedSolrServer work on a seperate java process > than the solr servlet(start.jar) as long as it is run on the same machine? > > EmbeddedSolrServer is run in the same process as the application which uses it. CommonsHttpSol

Re: Problem with Query Parser?

2009-06-15 Thread Yonik Seeley
On Tue, Jun 16, 2009 at 12:28 AM, Avlesh Singh wrote: >> >> Probably the analyzer removed the "$", leaving an empty term and causing >> the clause to be removed altogether. >> > > I predicted this behavior while writing the mail yesterday, Yonik. > Does it sound logical and intuitive? It's intuiti

Re: Problem with Query Parser?

2009-06-15 Thread Avlesh Singh
> > Maybe you can use this method directly or at least mimic it in your > application: > ./src/solrj/org/apache/solr/client/solrj/util/ClientUtils.java: public > static String escapeQueryChars(String s) > Does not help either, Otis. (+myField:"$" +city:Mumbai) at best could get converted into (+m

PNW Hadoop / Apache Cloud Stack Users' Meeting, Wed Jun 24th, Seattle

2009-06-15 Thread Bradford Stephens
Greetings, On the heels of our smashing success last month, we're going to be convening the Pacific Northwest (Oregon and Washington) Hadoop/HBase/Lucene/etc. meetup on the last Wednesday of June, the 24th. The meeting should start at 6:45, organized chats will end around 8:00, and then there sh

Re: Problem with Query Parser?

2009-06-15 Thread Avlesh Singh
And here's the debug info: +myField:"$" +city:Mumbai +myField:"$" +city:Mumbai +city:Mumbai +city:Mumbai OldLuceneQParser I found this unintuitive. "No results" rather than "All results" was the expected behavior. Cheers Avlesh On Tue, Jun 16, 2009 at 9:58 AM, Avlesh Singh wrote: > Probably th

Re: Problem with Query Parser?

2009-06-15 Thread Avlesh Singh
> > Probably the analyzer removed the "$", leaving an empty term and causing > the clause to be removed altogether. > I predicted this behavior while writing the mail yesterday, Yonik. Does it sound logical and intuitive? Cheers Avlesh On Tue, Jun 16, 2009 at 9:42 AM, Yonik Seeley wrote: > On M

Re: Problem with Query Parser?

2009-06-15 Thread Yonik Seeley
On Mon, Jun 15, 2009 at 11:53 PM, Avlesh Singh wrote: > How does one explain this? > +myField:"$" give zero result > +myField:"$" +city:"Mumbai" gives result for city:"Mumbai" Probably the analyzer removed the "$", leaving an empty term and causing the clause to be removed altogether. -Yonik http

Re: Problem with Query Parser?

2009-06-15 Thread Avlesh Singh
How does one explain this? +myField:"$" give zero result +myField:"$" +city:"Mumbai" gives result for city:"Mumbai" Cheers Avlesh On Tue, Jun 16, 2009 at 12:50 AM, Otis Gospodnetic < otis_gospodne...@yahoo.com> wrote: > > Hi, > > It looks like the query parser is doing its job of removing certai

Re: UnInvertedField performance on faceted fields containing many unique terms

2009-06-15 Thread Kent Fitch
Hi Yonik, On Tue, Jun 16, 2009 at 10:52 AM, Yonik Seeley wrote: > All the constants you see in UnInvertedField were a best guess - I > wasn't working with any real data.  It's surprising that a big array > allocation every 4096 terms is so significant - I had figured that the > work involved in p

EmbeddedSolrServer seperate process

2009-06-15 Thread pof
Hi, one question: Will EmbeddedSolrServer work on a seperate java process than the solr servlet(start.jar) as long as it is run on the same machine? Thanks. -- View this message in context: http://www.nabble.com/EmbeddedSolrServer-seperate-process-tp24046680p24046680.html Sent from the Solr -

Re: UnInvertedField performance on faceted fields containing many unique terms

2009-06-15 Thread Yonik Seeley
Great writeup Ken, All the constants you see in UnInvertedField were a best guess - I wasn't working with any real data. It's surprising that a big array allocation every 4096 terms is so significant - I had figured that the work involved in processing that many terms would far outweigh realloc+G

Re: Possible Containers

2009-06-15 Thread Eric Pugh
Can you highlight what problems you've had? Solr doesn't have any really odd aspects about it that would prevent it from running in any kind of servlet container. Eric On Jun 15, 2009, at 6:18 PM, John Martyniak wrote: I have been using jetty and have been really happy with the ease of

UnInvertedField performance on faceted fields containing many unique terms

2009-06-15 Thread Kent Fitch
Hi, This may be of interest to other users of SOLR's UnInvertedField who have a very large number of unique terms in faceted fields. Our setup is : - about 34M lucene documents of bibliographic and full text content - index currently 115GB, will at least double over next 6 months - moving to sup

Re: Possible Containers

2009-06-15 Thread John Martyniak
I have been using jetty and have been really happy with the ease of use and performance. -John On Jun 15, 2009, at 3:41 PM, Andrew Oliver wrote: I've had it running in Jetty and Tomcat. Tomcat 6 + JDK6 have some nice performance semantics especially with non-blocking IO, persistent connecti

Re: version of lucene

2009-06-15 Thread JCodina
Ok thanks, yes I found it, the jump from version 2.4 to 2.9 was really disturbing me I've seen the notes on svn, and is clear now. Joan markrmiller wrote: > > > You want to build from svn trunk: > http://svn.apache.org/viewvc/lucene/java/ > > You want revision r779312, because as you can

RE: Using The Tomcat Container

2009-06-15 Thread Mukerjee, Neiloy (Neil)
I followed the steps detailed in this tutorial: http://justin-hayes.com/2009-04-08/installing-apache-tomcat-6-and-solr-nightly-on-ubuntu-804 When I get to the point at which I should be able to see the Solr admin page, my browser displays the following: HTTP Status 404 - /solr/admin type Status

Re: Possible Containers

2009-06-15 Thread Andrew Oliver
I've had it running in Jetty and Tomcat. Tomcat 6 + JDK6 have some nice performance semantics especially with non-blocking IO, persistent connections, etc. It is likely that it will run in Resin, though I haven't tried it. It will also likely run in any of the Tomcat-based stuff (i.e. TC Server

Possible Containers

2009-06-15 Thread Mukerjee, Neiloy (Neil)
Having tried Tomcat and not come to much success upon the realization that I'm using Tomcat 5.5 for other projects I'm working on and that I would be best off using Tomcat 6 for Solr v1.3.0, I am in search of another possible container. What have people used successfully that would be a good sta

Re: Problem with Query Parser?

2009-06-15 Thread Otis Gospodnetic
Hi, It looks like the query parser is doing its job of removing certain characters from the query string. Maybe you can use this method directly or at least mimic it in your application: ./src/solrj/org/apache/solr/client/solrj/util/ClientUtils.java: public static String escapeQueryChars(Str

Re: LRUCache causing locked threads

2009-06-15 Thread Yonik Seeley
On Mon, Jun 15, 2009 at 2:58 PM, CameronL wrote: > Unfortunately upgrading to 1.4 isn't an option for us at the moment. > > Since we're stuck using 1.3, is there anything in particular we need to do > to prevent these threads from locking (through configuration or something) Not really. > or is t

Re: LRUCache causing locked threads

2009-06-15 Thread CameronL
Unfortunately upgrading to 1.4 isn't an option for us at the moment. Since we're stuck using 1.3, is there anything in particular we need to do to prevent these threads from locking (through configuration or something) or is this sort of expected/unavoidable using 1.3? Yonik Seeley-2 wrote: >

localsolr sort

2009-06-15 Thread Nirkhe, Chandra
Hi I am trying to sort local results on geo_distance order. But getting "Unknown solr order" error. HTTP Status 400 - Unknown sort order: asc" Following is the HTTP request: http://localhost:8080/solr/select?indent=on&q=*:*&qt=geo&lat=41.883784&l ong=-87.637668&radius=30&sort=geo_dist

Re: LRUCache causing locked threads

2009-06-15 Thread Yonik Seeley
Solr 1.4 has a cache implementation that's lockless for gets, and faster for gets. There's a new faceting implementation as well. -Yonik http://www.lucidimagination.com On Mon, Jun 15, 2009 at 2:39 PM, CameronL wrote: > > I've searched through the forums and seen a few similar problems to this,

LRUCache causing locked threads

2009-06-15 Thread CameronL
I've searched through the forums and seen a few similar problems to this, but nothing that seemed to help much. We're running Solr 1.3 on Tomcat 6.0.16 and Java 6. We've been having performance problems with our search, causing long query times under normal traffic. We've taken a thread dump

Re: version of lucene

2009-06-15 Thread Mark Miller
JCodina wrote: I have the solr-nightly build of last week, and in the lib foloder i can find the lucene-core-2.9-dev.jar I need to do some changes to the shingle filter in order to remove stopwords from bigrams, but to do so I need to compile lucene, the problem is, lucene is in version 2.4 not

Re: Debug Solr in Netbeans..

2009-06-15 Thread noor
Now, i put that build.properties file in the solr location tooo. But still i am getting. Attaching to localhost:5005 Connection refused Note: Solr lib folder contains, my custom class's jar file. But in netbeans, i am doing the attach-debugger processing. And in browser, i am accessing that clas

version of lucene

2009-06-15 Thread JCodina
I have the solr-nightly build of last week, and in the lib foloder i can find the lucene-core-2.9-dev.jar I need to do some changes to the shingle filter in order to remove stopwords from bigrams, but to do so I need to compile lucene, the problem is, lucene is in version 2.4 not 2.9 If I take, w

Re: Debug Solr in Netbeans..

2009-06-15 Thread Mark Miller
If you don't see that, you may have build.properties in the wrong place. When you run 'solr-example' in debug mode, Listening for transport dt_socket at address: 5005 will be printed to STD out. Once you have that working correctly, you want to attach to port 5005, not 8983. Solr runs on 8983

Re: Debug Solr in Netbeans..

2009-06-15 Thread noor
No. In netbeans, debugger-console output shows, Attaching to localhost:8983 handshake failed - connection prematurally closed i dont know where the problem is ? Mark Miller wrote: Do you see the following printed to std out when you start solr (using 'run-example')? Listening for transport d

Re: Debug Solr in Netbeans..

2009-06-15 Thread Mark Miller
Do you see the following printed to std out when you start solr (using 'run-example')? Listening for transport dt_socket at address: 5005 noor wrote: Addition to the previous reply: I built my custom project and put into solr webapps lib folder. And starts running solr. In netbeans, i made the

Re: Debug Solr in Netbeans..

2009-06-15 Thread noor
Addition to the previous reply: I built my custom project and put into solr webapps lib folder. And starts running solr. In netbeans, i made the changes as i said before. But it shows connection refused error. anybody please give me the solution... noor wrote: Solr starts running in the port 89

Re: Joins or subselects in solr

2009-06-15 Thread Michael Ludwig
Nasseam Elkarra schrieb: I am storing items in an index. Each item has a comma separated list of related items. Is it possible to bring back an item and all of its related items in one query? If so how and how would you distinguish between which one is the main item and which are the related.

Re: fq vs. q

2009-06-15 Thread Michael Ludwig
Shalin Shekhar Mangar schrieb: On Mon, Jun 15, 2009 at 4:39 PM, Michael Ludwig wrote: I think if you truncate dates to incomplete dates, you effectively also lose all the date logic. You may still apply it, but what would you take the result to mean? You can't regain precision you've decided

Re: Debug Solr in Netbeans..

2009-06-15 Thread noor
Solr starts running in the port 8983, i created build.properties in the project folder, where the build.xml is. And in that empty build.properties file, i added, example.debug=true only. And in Netbeans, Debug -> Attach Debugger, - Debugger is JavaDebugger(JPDA); - Connector is SocketAttach(Attach

Re: fq vs. q

2009-06-15 Thread Michael Ludwig
Fergus McMenemie schrieb: The article could explain the difference between fq= and facet.query= and when you should use one in preference to the other. My understanding is that while these query modifiers rely on the same implementation (cached filters) to boost performance, they s

Re: Debug Solr in Netbeans..

2009-06-15 Thread Mark Miller
noor wrote: hi, i am new to apache solr. i got the solr source code, and i created my own (custom) classes. Also, i make the request reference to that newly created classes in solr-config.xml. now i need to debug my code, when the solr search calls my class.. So, for this, i dont know how to d

Debug Solr in Netbeans..

2009-06-15 Thread noor
hi, i am new to apache solr. i got the solr source code, and i created my own (custom) classes. Also, i make the request reference to that newly created classes in solr-config.xml. now i need to debug my code, when the solr search calls my class.. So, for this, i dont know how to debug my code

Re: Custom Request handler Error:

2009-06-15 Thread Noor
I want Solr, to accept my custom class changes and run it. So for this, pls anyone guide me to achieve this.. noor wrote: Yes, i changed "custom" into "/custom", now it calls my class. But, in browser, It shows Null RequestHandler null. So, i need to accept my changes by solr. For that, wha

Problem with Query Parser?

2009-06-15 Thread Avlesh Singh
I noticed a strange behavior of the Query parser for the following query on my index. +(category_name:"$" product_name:"$" brand_name:"$") +is_available:1 Fields, category_name, product_name and brand_name are of type "text" and is_available is a "string" field, storing 0 or 1 for each doc in the i

Re: fq vs. q

2009-06-15 Thread Shalin Shekhar Mangar
On Mon, Jun 15, 2009 at 4:39 PM, Michael Ludwig wrote: > I want to retrieve documents (TV programs) by a particular date and > decided to convert the date to an integer, so I have: > > * 20090615 > * 20090616 > * 20090617 etc. > > I lose all date logic (timezones) for

Re: fq vs. q

2009-06-15 Thread Michael Ludwig
second and thus virutally every filter was unique. It's amazing how something this simple could bring solr to it's knees on a large data set. I want to retrieve documents (TV programs) by a particular date and decided to convert the date to an integer, so I have: * 20090615 * 20090616 * 2