Re: Apache Solr Quiz

2012-10-31 Thread Yulia Crowder
I will love to cover other parts of SOLR management. If you have any Solr quiz question on mind, please send it to me and I will insert it to the quiz (and to the site). Together we can make a good SOLR quiz questions for the community. Thank you all. Yulia

Re: SolrCloud AutoSharding? In enterprise environment?

2012-10-31 Thread joseph_12345
Thanks Otis for the response. 1. Is there any performance impact if the client is invoking the solr index using the VIP url instead of individual shard URLs? If the default sharding of SOLR is based on uniqueId.hashcode % numServers, how does the SOLR identify which Shard to get the data if

RE: Unable to build trunk

2012-10-31 Thread Markus Jelsma
Hi, Where is that lock file located? I triggered it again (in another contrib) and wil trigger it again in the future and don't want to remove my ivy cache each time :) Thanks -Original message- From:Robert Muir rcm...@gmail.com Sent: Tue 30-Oct-2012 15:14 To:

Re: Unable to build trunk

2012-10-31 Thread Robert Muir
you will have to use 'find' on your .ivy2 ! On Wed, Oct 31, 2012 at 6:32 AM, Markus Jelsma markus.jel...@openindex.io wrote: Hi, Where is that lock file located? I triggered it again (in another contrib) and wil trigger it again in the future and don't want to remove my ivy cache each time

Re: Are there any limitations on multi-value field joins?

2012-10-31 Thread Erick Erickson
As I remember, the underlying algorithm enumerates all the unique values in the field when doing the join (or something like that). So when the filed you're joining has many unique values, it performs poorly. Worse, it'll be fine on small data sets, the kind we usually develop with. But then when

Re: need help on solr search

2012-10-31 Thread Erick Erickson
You need to provide significantly more information than you have. What are your perf requirements? How big is your data set? What kinds of searches are you talking about here? How are you measuring response? This really feels like an XY problem. Best Erick On Wed, Oct 31, 2012 at 1:33 AM,

Re: SolrCloud AutoSharding? In enterprise environment?

2012-10-31 Thread Erick Erickson
There's no real magic about the index structure, it's just the same as non-cloud Solr. So presumably you have example and example2 directories or some such. They're just standard Solr installations with the index in the usual place, the docs for the particular shard are stored in the data/index

Query regarding range search on int fields

2012-10-31 Thread Leena Jawale
Hi, I have created Solr XML data source. In that I want to make range query on int field which is price. But by default it is considering that field as text. So I have added Price in the fields section making price as int, Indexed=true, Search by default=true, Stored=true, Include in

SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: java.math.BigDecimal:1848.66

2012-10-31 Thread Marcin Pilaczynski
Welcome all, We have a very strange problem with SOLR 3.5. It SOMETIMES throws exceptions: 2012-10-31 10:20:06,408 SEVERE [org.apache.solr.core.SolrCore:185] (http-10.205.49.74-8080-155) org.apache.solr.common.SolrException: ERROR: [doc=MyDoc # d3mo1351674222122-1 # 2012-10-31 08:03:42.122]

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: java.math.BigDecimal:1848.66

2012-10-31 Thread Rafał Kuć
Hello! Look at what Solr returns in the error - you send the following value java.math.BigDecimal:1848.66 - remove the java.math.BigDecimal: and your problem should be gone. -- Regards, Rafał Kuć Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - ElasticSearch Welcome all, We

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: java.math.BigDecimal:1848.66

2012-10-31 Thread Erick Erickson
It _looks_ like somehow the string you're sending as a BigDecimal is, literally, java.math.BigDecimal:1848.66 rather than 1848.66. How are you generating the field value? I'm guessing that your (SolrJ?) program is somehow messing this up... Best Erick On Wed, Oct 31, 2012 at 7:28 AM, Marcin

Re: Query regarding range search on int fields

2012-10-31 Thread Erick Erickson
Is this LucidWorks? You'll need to ask on the LucidWorks forums if so. Best Erick On Wed, Oct 31, 2012 at 7:26 AM, Leena Jawale leena.jaw...@lntinfotech.comwrote: Hi, I have created Solr XML data source. In that I want to make range query on int field which is price. But by default it is

No lockType configured for NRTCachingDirectory

2012-10-31 Thread Markus Jelsma
Hi, Besides replication issues (see other thread) we're also seeing these warnings in the logs on all 10 nodes and for all cores using today's or yesterday's trunk. 2012-10-31 11:01:03,328 WARN [solr.core.CachingDirectoryFactory] - [main] - : No lockType configured for

Re: Query regarding range search on int fields

2012-10-31 Thread Gora Mohanty
On 31 October 2012 16:56, Leena Jawale leena.jaw...@lntinfotech.com wrote: Hi, I have created Solr XML data source. In that I want to make range query on int field which is price. But by default it is considering that field as text. So I have added Price in the fields section making price

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: java.math.BigDecimal:1848.66

2012-10-31 Thread Marcin Pilaczynski
First we were adding BigDecimal object to SolrInputDocument directly as field value. Now we are adding BigDecimal.toPlainString() as field value. SOLR relies on JavaBinCodec class which does de/serialization in it's own way - some kind of bug in there? I don't know what is the proper way to

Re: Grouping based on multiple criteria

2012-10-31 Thread Marcio Ghiraldelli
I have a similar issue, and I am solving it by implementing my own components and dealiing with the resultings doc IDs public class MerchantShuffleComponent extends SearchComponent { ... ctx.docs = shuffledDocList; rb.rsp.getValues().remove(response); rb.rsp.add(response,

After to SOLR 4.0.0 Upgrade - ClusterState says we are the leader, but locally we don't think so

2012-10-31 Thread balaji.gandhi
Hi, After upgrading from Solr 4.0.0-Beta to Solr 4.0.0 we are getting this error from ALL the leader nodes:- Oct 31, 2012 6:44:03 AM org.apache.solr.update.processor.DistributedUpdateProcessor doDefensiveChecks SEVERE: ClusterState says we are the leader, but locally we don't think so Is there

Re: Datefaceting on multiple value in solr

2012-10-31 Thread Sagar Joshi1304
Thanks Chris, seems it is working fine, below is the query http://localhost:8993/solr/select?q=*:*fq=(!tag=test)name:test*fq=(!tag=test1)name:test1fq=(!tag=test3)name:test3facet=truefacet.range={!key=test ex=test1,test3}Admission_Datefacet.range={!key=test1

Re: No lockType configured for NRTCachingDirectory

2012-10-31 Thread Mark Miller
By trunk do you mean 4X or 5X? On Wed, Oct 31, 2012 at 7:47 AM, Markus Jelsma markus.jel...@openindex.io wrote: Hi, Besides replication issues (see other thread) we're also seeing these warnings in the logs on all 10 nodes and for all cores using today's or yesterday's trunk. 2012-10-31

RE: No lockType configured for NRTCachingDirectory

2012-10-31 Thread Markus Jelsma
That's 5, the actual trunk/ -Original message- From:Mark Miller markrmil...@gmail.com Sent: Wed 31-Oct-2012 16:29 To: solr-user@lucene.apache.org Subject: Re: No lockType configured for NRTCachingDirectory By trunk do you mean 4X or 5X? On Wed, Oct 31, 2012 at 7:47 AM, Markus

Re: Solr4.0 / SolrCloud queries

2012-10-31 Thread Mark Miller
If you can share any logs, that would help as well. - Mark

Re: Solr Swap Function doesn't work when using Solr Cloud - SOLR3866

2012-10-31 Thread Andre Bois-Crettez
Hello, Same as Sam, I believe the SWAP command is important for important use cases. For example, with Solr 3, we do use Current and Temp cores, so that incremental updates to the index are done live on Current, as well as searches. Whenever a full/baseline/from scratch index need to be

Re: After to SOLR 4.0.0 Upgrade - ClusterState says we are the leader, but locally we don't think so

2012-10-31 Thread balaji.gandhi
Mark, We have tried the following:- 1. Removing everything in the ZooKeeper snapshot directory 2. Removing the indexes We get the same error in both the cases. Attached the cloud dumps:- cloud_dump.json http://lucene.472066.n3.nabble.com/file/n4017315/cloud_dump.json Thanks, Balaji --

Re: SolrJ 4.0.0 addFilterQuery() issue ?

2012-10-31 Thread Indika Tantrigoda
Just created the defect in Jira. https://issues.apache.org/jira/browse/SOLR-4020 Thanks. On 31 October 2012 10:47, Indika Tantrigoda indik...@gmail.com wrote: Thanks for the reply Chris. Yes you are correct, SolrJ is serializing a String[] instead of the separate String values. Using

Re: need help on solr search

2012-10-31 Thread jchen2000
Sure. here are some more details: 1) we are having 30M ~ 60M documents per node (right now we have 4 nodes, but that will increase in the future). Documents are relatively small (around 3K), but 99% searches must be returned within 200ms and this is measured by test drivers sitting right in

Re: SOLR 3.5 sometimes throws java.lang.NumberFormatException: For input string: java.math.BigDecimal:1848.66

2012-10-31 Thread Chris Hostetter
: SOLR relies on JavaBinCodec class which does de/serialization in it's : own way - some kind of bug in there? : : I don't know what is the proper way to handle BigDecimal values in : SOLR 3.5 after all? The safe thing to do is only add primitive java objects that Solr understands natively -

Re: SolrCloud Tomcat configuration: problems and doubts.

2012-10-31 Thread Mark Miller
A big difference if you are using tomcat is that you still need to specify jetty.port - unless you change the name of that sys prop in solr.xml. Some more below: On Wed, Oct 31, 2012 at 2:09 PM, Luis Cappa Banda luisca...@gmail.com wrote: Hello! How are you?I followed SolrCloud Wiki tutorial

Re: Anyone working on adapting AnalyzingQueryParser to solr?

2012-10-31 Thread balaji.gandhi
Hi, Is the AnalyzingQueryParser ported to SOLR? I read that it it available in Lucene. Not sure about SOLR. We are trying to workaround this limitation:- On wildcard and fuzzy searches, no text analysis is performed on the search word.

Re: need help on solr search

2012-10-31 Thread Otis Gospodnetic
Hi, Not sure if I follow your requirements correctly, but it sounds like you may be looking for phrase queries (as opposed to term/keyword queries). Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Wed,

Re: Datefaceting on multiple value in solr

2012-10-31 Thread Otis Gospodnetic
Hi, I didn't follow the thread, but maybe you are looking for fq=(name1 OR name2 OR ) for those 100 names you mentioned, so that 1 doesn't filter out the other 99. Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring -

Solr 4.0 admin panel

2012-10-31 Thread Tannen, Lev (USAEO) [Contractor]
Hi, I apologize for the trivial question, but I cannot find out what is wrong. I try to switch from Solr 3.6 to Solr 4.0. All what I have done was I have downloaded and unzipped the official binary file for Windows (32 bit) and run just an example and it does not work. In Solr 3.6 the request

Re: Anyone working on adapting AnalyzingQueryParser to solr?

2012-10-31 Thread Ahmet Arslan
We are trying to workaround this limitation:- On wildcard and fuzzy searches, no text analysis is performed on the search word. I think http://wiki.apache.org/solr/MultitermQueryAnalysis is a more elegant way to deal with this.

Re: Solr 4.0 admin panel

2012-10-31 Thread Péter Király
Dear Lev, core0 is only available on multicore environment. You should start Solr as java -Dsolr.solr.home=multicore -jar start.jar cheers, Péter 2012/10/31 Tannen, Lev (USAEO) [Contractor] lev.tan...@usdoj.gov: Hi, I apologize for the trivial question, but I cannot find out what is wrong. I

Re: Solr 4.0 admin panel

2012-10-31 Thread James Ji
The right address to go is http://localhost:8983/solr/ on Solr 4.0. http://localhost:8983/solr/admin links to nothing if you go check the servlet. Cheers James On Wed, Oct 31, 2012 at 3:25 PM, Tannen, Lev (USAEO) [Contractor] lev.tan...@usdoj.gov wrote: Hi, I apologize for the trivial

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Jack Krupansky
Scoring or ranking of document relevancy is called similarity. You can create your own similarity class, or even have a field-specific similarity class. See, for example: http://lucene.apache.org/core/4_0_0/core/org/apache/lucene/search/similarities/TFIDFSimilarity.html

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Ahmet Arslan
I would like to lower or eliminate the contribution of the fieldNorm on some searches. I figured that a LocalParam might help, but I cannot find any documentation on it. Is there documentation on how to reduce the consideration for tf, idf, fieldNorm, and coord? Where is that?

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Dotan Cohen
On Wed, Oct 31, 2012 at 11:50 PM, Ahmet Arslan iori...@yahoo.com wrote: omitNorms=true|false This is arguably an advanced option. Set to true to omit the norms associated with this field (this disables length normalization and index-time boosting for the field, and saves some memory). Only

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Jack Krupansky
You could write a custom search component that checked for your desired request parameters, and then it could set them for a custom similarity class, which you would also have to write. -- Jack Krupansky -Original Message- From: Dotan Cohen Sent: Wednesday, October 31, 2012 6:07 PM

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Dotan Cohen
On Wed, Oct 31, 2012 at 11:44 PM, Jack Krupansky j...@basetechnology.com wrote: Scoring or ranking of document relevancy is called similarity. You can create your own similarity class, or even have a field-specific similarity class. See, for example:

Re: Solr 4.0 admin panel

2012-10-31 Thread Chris Hostetter
: The right address to go is http://localhost:8983/solr/ on Solr 4.0. : http://localhost:8983/solr/admin links to nothing if you go check the : servlet. For back compat, http://localhost:8983/solr/admin should automatially redirect to http://localhost:8983/solr/#/ -- regardless of wether you

Re: Eliminate or reduce fieldNorm as a consideration.

2012-10-31 Thread Dotan Cohen
On Thu, Nov 1, 2012 at 12:16 AM, Jack Krupansky j...@basetechnology.com wrote: You could write a custom search component that checked for your desired request parameters, and then it could set them for a custom similarity class, which you would also have to write. Perhaps, but if I'm going

Re: Anyone working on adapting AnalyzingQueryParser to solr?

2012-10-31 Thread balaji.gandhi
Hi iorixxx, this is how we our email field defined. fieldType name=text_email class=solr.TextField positionIncrementGap=100 analyzer tokenizer class=solr.StandardTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter

Re: solr blocking on commit

2012-10-31 Thread dbabits
I second the original poster- all selects are blocked during commits. I have Master replicating to Slave. Indexing happens to Master, few docs/about every 30 secs Selects are run against Slave. This is the pattern from the Slave log: Oct 30, 2012 12:33:23 AM

Re: After adding field to schema, the field is not being returned in results.

2012-10-31 Thread Otis Gospodnetic
Hi, That should work just fine. It;s either a bug or you are doing something you didn't mention. Maybe you can provide a small, self-enclosed unit test and stick it in JIRA? Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring -

Re: After adding field to schema, the field is not being returned in results.

2012-10-31 Thread Alexandre Rafalovitch
And - just to get stupid options out of the way - you don't have any parameters defined on the handlers that may list the fields to return? Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature

Re: After adding field to schema, the field is not being returned in results.

2012-10-31 Thread Dotan Cohen
On Thu, Nov 1, 2012 at 2:52 AM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi, That should work just fine. It;s either a bug or you are doing something you didn't mention. Maybe you can provide a small, self-enclosed unit test and stick it in JIRA? I would assume that it's me

SOLRJ - Error while using CommonsHttpSolrServer

2012-10-31 Thread Jegannathan Mehalingam
- I tried using HttpSolrServer, but had some problems and some news groups mentioned that it is buggy and I should be using CommonsHttpSolrServer. So, I am using CommonsHttpSolrServer. But both approaches does not work. - I have tried using SOLR 4.0 as well as 3.6.1. I get errors in both