Could solr build two different indexes?

2009-06-17 Thread fei dong
Hi Buddy, I wanna build many instances of solr. My requirement is to statisfy different product search. Could I do that?

Re: Uncommitted documents coutn with autocommit enabled?

2009-06-17 Thread Ingo Renner
Am 16.06.2009 um 19:15 schrieb Otis Gospodnetic: Hi Otis, I believe that's still visible on the Statistics page of the Solr Admin UI. thanks for the pointer. Just so that others will find it when searching for pending documents with autocommit and solr here where to find it:

RE: Query parameter encode issue

2009-06-17 Thread Venkatesan A.
What happens when u don't use encoding? -Original Message- From: Radha C. [mailto:cra...@ceiindia.com] Sent: Tuesday, June 16, 2009 8:20 PM To: solr-user@lucene.apache.org Subject: Query parameter encode issue Hello list, I am having the following query, q=+text:test +site_id:(4 )

Re: Searching across multivalued fields

2009-06-17 Thread Michael Ludwig
MilkDud schrieb: To be more specific, I'm indexing a collection of music albums that have multiple tracks and an album artist. So, some searches will contain both the artist name and the track name. I can't make this a single phrase query as it is indexed across two separate fields. Use the

Facets with an IDF concept

2009-06-17 Thread Asif Rahman
Hi all, We have an index of news articles that are tagged with news topics. Currently, we use solr facets to see which topics are popular for a given query or time period. I'd like to apply the concept of IDF to the facet counts so as to penalize the topics that occur broadly through our index.

Re: Few Queries regarding indexes in Solr

2009-06-17 Thread Michael Ludwig
Otis Gospodnetic schrieb: Regarding that 3rd answer below: Putting it back in context (where it belongs :-) : My (very limited) understanding of shards is that you repartition your documents among shards and send each document to only one shard. (Not sure this is correct.) Yes, that's

OutOfMemoryErrors

2009-06-17 Thread tarjei
Hi, I'm having memory problems on one of my Solr slaves: SEVERE: Error during auto-warming of key:org.apache.solr.search.queryresult...@563c7832:java.lang.OutOfMemoryError: Java heap space errors Jun 17, 2009 1:52:53 PM org.apache.solr.common.SolrException log SEVERE: Error in

Re: what date format to pass for search in Solr?

2009-06-17 Thread Michael Ludwig
chem leakhina schrieb: Does anyone know what date format pass to search in Solr? A restricted subset of the W3C datetime format. See: http://wiki.apache.org/solr/IndexingDates Could you give me any examples for search with Date in solr? Examples can be very easily found searching for

Re: Could solr build two different indexes?

2009-06-17 Thread Michael Ludwig
fei dong schrieb: I wanna build many instances of solr. My requirement is to statisfy different product search. Could I do that? Yes. Read all of the following: Multi-index Design - Chris Masters http://markmail.org/thread/6p7viwpinrwmj6my http://wiki.apache.org/solr/MultipleIndexes

Re: Solr Query | Field:value with dismaxquery

2009-06-17 Thread Michael Ludwig
prerna07 schrieb: I am facing issue with query with dismaxrequest. ?q=facetFormat_product_s:Pfqs ePub eBook Sfqs - return correct results ?q=facetFormat_product_s:Pfqs ePub eBook Sfqsqt=dismaxrequest - dose not return results, although field facetFormat_product_s is defined in dismaxrequest

AttachDebugger in Netbeans, for solr ???

2009-06-17 Thread noor
hi, i am new to solr. I am having the solr package, and it starts running in my pc. I created the custom handler class as a java project through Netbeans. And i put that jar in solr webapps's lib folder; and in solr-config.xml also i changed. before solr gets started. What i need to do is

Re: fq vs. q

2009-06-17 Thread Michael Ludwig
Fergus McMenemie schrieb: While q= and fq= affect the results portion of a search response. The facet.query only affects the facets portion of a response. facet.query(s) are only used where you want a facet summary of your query based on some kind of complex expression rather than the terms

Re: AttachDebugger in Netbeans, for solr ???

2009-06-17 Thread Grant Ingersoll
I usually debug Solr by using the remote debugging capabilities built into Java. Not sure if NetBeans supports it, but I suggest you go look in the NetBeans documentation. On Jun 17, 2009, at 9:29 AM, noor wrote: hi, i am new to solr. I am having the solr package, and it starts running

Re: Searching across multivalued fields

2009-06-17 Thread MilkDud
Michael, That part I understand and is what I have now. It's the fact that since tracks is multivalued, and i search for a track love me, i will also get back artists that have the words love and me in separate tracks. Now with a phrase query with a small ps and a large posIncGap that could

Re: AttachDebugger in Netbeans, for solr ???

2009-06-17 Thread Mark Miller
Indeed it does. At some point, you've got to work it out on your own Noor. I've given you all the info you need. Tracking down whatever is left should not be that difficult. I've remote debugged with Netbeans and Eclipse, and I know it generally works without too much fuss. You just have to

Re: Searching across multivalued fields

2009-06-17 Thread MilkDud
Yea, not using stopwords at all. I do have tracks specified in the pf param along with a few other fields. That said, with a phrase query I lose the ability to search for an artist and track combined. Two solutions i've thought of include indexing at the track level only (right now i have

POSTing to /select

2009-06-17 Thread Brian_K
Is it possible to query /select using http POST rather than GET? Is the syntax different it so? When I try, I receive an 500 response and a big fat exception. java.lang.NullPointerException at java.io.StringReader.lt;initgt;(Unknown Source) at

Re: Searching across multivalued fields

2009-06-17 Thread Erick Erickson
H. Could you expand a bit more on the problem you're trying to solve? The index organization you're hinting at seems close enough to a set of database tables to make me wonder if you're using an inappropriate index structure given the problem you want to solve. Not that I know enough about

Re: POSTing to /select

2009-06-17 Thread Erik Hatcher
On Jun 17, 2009, at 12:01 PM, Brian_K wrote: Is it possible to query /select using http POST rather than GET? Is the syntax different it so? When I try, I receive an 500 response and a big fat exception. java.lang.NullPointerException at java.io.StringReader.lt;initgt;(Unknown

Re: POSTing to /select

2009-06-17 Thread Walter Underwood
On the other hand, POST is the wrong HTTP semantic for a search request and makes it impossible to use HTTP caching. POST also makes all your requests look identical in the HTTP logs, so you can't do any log analysis. If GET works, always use GET. wunder On 6/17/09 9:18 AM, Erik Hatcher

Re: Searching across multivalued fields

2009-06-17 Thread MilkDud
Sure. To be clear, I am actually revamping an existing index, that I've found numerous problems with so far. Basically, what I am trying to do is index a collection of music for an online music store. This contains information on the track, album, and artist levels. These are all different

Re: Searching across multivalued fields

2009-06-17 Thread Michael Ludwig
MilkDud schrieb: Basically, what I am trying to do is index a collection of music for an online music store. This contains information on the track, album, and artist levels. These are all different object types in the same schema and it does contain a lot of redundant information. What's a

Error with Solr configuration in Tomcat container

2009-06-17 Thread Mukerjee, Neiloy (Neil)
When trying to integrate Tomcat 6.0.20 and Solr 1.3.0, I get the below error after trying to view the Solr admin page. I downloaded Tomcat from the Apache website, and its installation went well, as indicated by the fact that I can see the Apache Tomcat page in my browser when typing in my IP

Re: Problem getting Solr statistics

2009-06-17 Thread Development Team
So for all those wondering what the problem was: It turns out I can't just initialize my own CoreContainer; that just gives me a *new* set of cores, and since those are not the cores being used by the SolrDispatchFilter, they're never accessed and thus the stats remain the same (such as having 2

Solr Replication on Windows

2009-06-17 Thread vaibhav joshi
Hi, I am using Solr 1.3 release and have different set of machines for Query and Master for Indexer. These machines are windows boxes. The Solr replication in wiki scripts are unix shell scritps. Are there any scritpt or Java version of Replication available with Solr 1.3..I saw Java

Re: Searching across multivalued fields

2009-06-17 Thread MilkDud
Ok, so lets suppose i did index across just the album. Using that index, how would I be able to handle searches of the form artist name track name. If i do the search using a phrase query, this won't match anything because the artist and track are not in one field (hence my idea of creating a

RE: Error with Solr configuration in Tomcat container

2009-06-17 Thread vaibhav joshi
Looks like SolrHome Property is not set. Here is link which mentions the step to configure Solr Home http://wiki.apache.org/solr/SolrTomcat From: neil.muker...@alcatel-lucent.com To: solr-user@lucene.apache.org Date: Wed, 17 Jun 2009 12:34:54 -0500 Subject: Error with Solr configuration

Re: POSTing to /select

2009-06-17 Thread Brian_K
I did not have the content type set appropriately, to application/x-www-form-urlencoded. :wistle: Erik Hatcher wrote: On Jun 17, 2009, at 12:01 PM, Brian_K wrote: Is it possible to query /select using http POST rather than GET? Is the syntax different it so? When I try, I

RE: Error with Solr configuration in Tomcat container

2009-06-17 Thread Mukerjee, Neiloy (Neil)
The issue was indeed in the Java options in the startup file for Tomcat. In order to fix the issue, all I had to do was go to /etc/init.d/, edit the Tomcat startup file to include: explort JAVA_OPTS=$JAVA_OPTS -Dsolr.solr.home=/usr/local/tomcat6.0.20/solr, and restart Tomcat. Thank you!

Re: Solr Replication on Windows

2009-06-17 Thread Jaco
Hi, In my experience, you can just migrate to 1.4. We are using this in production without any problems, and the Java Replication ( http://wiki.apache.org/solr/SolrReplication) works excellent. Bye, Jaco. 2009/6/17 vaibhav joshi callvaib...@hotmail.com Hi, I am using Solr 1.3 release and

Re: Few Queries regarding indexes in Solr

2009-06-17 Thread Otis Gospodnetic
Hi Michael, - Original Message From: Michael Ludwig m...@as-guides.com To: solr-user@lucene.apache.org Sent: Wednesday, June 17, 2009 8:34:10 AM Subject: Re: Few Queries regarding indexes in Solr Otis Gospodnetic schrieb: Regarding that 3rd answer below: Putting it back in

pk vs. uniqueKey with DIH delta-import

2009-06-17 Thread Erik Hatcher
First - DIH has worked pretty well in a new customer engagement of ours. We've easily imported tens of millions of records with no problem. Kudos to the developers/contributors to DIH - it got us up and running quickly. But now we're delving into more complexities and having some

FilterCache issue

2009-06-17 Thread Manepalli, Kalyan
Hi, I am seeing an issue with the filtercache setting on my solr app which is causing slower faceting. Here is the configuration. filterCache class=solr.LRUCache size=512 initialSize=512 autowarmCount=256/ Statistics: description: LRU Cache(maxSize=512, initialSize=512,

RE: FilterCache issue

2009-06-17 Thread Manepalli, Kalyan
Got that, if its number of cache entries, definitely its very low. I have around 10,000 unique items to facet on. Does the RAM size depend on Document size. Thanks, Kalyan Manepalli -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Wednesday, June 17, 2009 7:13

Re: FilterCache issue

2009-06-17 Thread Mark Miller
Right, so if you are on 1.3 or early 1.4 dev, with so many uniques, you should be using the FieldCache method of faceting. The RAM depends on the number of documents and number of uniques terms mostly. With 1.4 you may be using an UninvertedField though (are your facet fields multivalued or

OutOfMemory error on solrslaves

2009-06-17 Thread Francis Yakin
We are experiencing OutOfMemory error frequently on our slaves, this is the error: SEVERE: Error during auto-warming of key:org.apache.solr.search.queryresult...@a8c6f867:java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5120080, Num elements: 1280015

Re: OutOfMemory error on solrslaves

2009-06-17 Thread Koji Sekiguchi
Francis Yakin wrote: We are experiencing OutOfMemory error frequently on our slaves, this is the error: SEVERE: Error during auto-warming of key:org.apache.solr.search.queryresult...@a8c6f867:java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5120080, Num elements: 1280015

RE: OutOfMemory error on solrslaves

2009-06-17 Thread Francis Yakin
Ok Thanks Koji! We have a test machine that currently running 1.3.0, I see the queryResultMaxDocsCached200/queryResultMaxDocsCached This set to 200 by default, should I increase it, if yes what should I set to? Regards, Francis -Original Message- From: Koji Sekiguchi

Re: OutOfMemory error on solrslaves

2009-06-17 Thread Koji Sekiguchi
Francis Yakin wrote: Ok Thanks Koji! We have a test machine that currently running 1.3.0, I see the queryResultMaxDocsCached200/queryResultMaxDocsCached This set to 200 by default, should I increase it, if yes what should I set to? Francis, It depends. To know what the parameter is,