Re: [MASSMAIL]Re: High fieldNorm values causing really odd results

Regarding the experiment, sorry If I explained myself in the wrong way, the indexed document doesn't have 119669 terms have a lot less terms (less than a 1000 terms, I don't have the exact number here now), instead 119669 is the number of distinct terms reported by luke (Top-terms total in the a

Full Copy during cluster restarts

We are running a solr 4.10.2 cluster with dozens of nodes. When ever we restart the cluster we see that 2-3 nodes goes in to a fullCopy mode, which takes for ever to recover. Because of the recovery our entire cluster runs very slow and eventually becomes unresponsive. Any thoughts? Thanks Paddy

Re: Suggester

This might help: http://lucidworks.com/blog/solr-suggester/ Best, Erick On Thu, May 14, 2015 at 12:43 PM, lreg wrote: > Could you please explain how you solved the problem I am having the same > issue :( > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Suggester-t

Re: [MASSMAIL]Re: High fieldNorm values causing really odd results

: Sorry for leaving the Solr version out in my previous email, I'm using : Solr 4.10.3 running on Centos7, with the following JRE: Oracle : Corporation OpenJDK 64-Bit Server VM (1.7.0_75 24.75-b04) I can't reproduce Using Solr 4.10.3 (or 4.10.4 - mistread your email the first time) Are you ce

Re: [MASSMAIL]Re: High fieldNorm values causing really odd results

Hi Hoss, First of all, thank you for your reply. Sorry for leaving the Solr version out in my previous email, I'm using Solr 4.10.3 running on Centos7, with the following JRE: Oracle Corporation OpenJDK 64-Bit Server VM (1.7.0_75 24.75-b04) This are the relevant portions of my schema.xml

RE: Is copyField a must?

Yes, it does support POST. As to format, I believe that's handled by the container. So if you're url-encoding the parameter values, you'll probably need to set Content-Type: application/x-www-form-urlencoded for the HTTP POST header. -Original Message- From: Steven White [mailto:swhit

Re: Is copyField a must?

Anyone knows the answer to Shawn's question? Does Solr support POST request and is the format the same as GET? If it does than it means I don't have to create multiple request handlers. Thanks Steve On Wed, May 13, 2015 at 6:02 PM, Shawn Heisey wrote: > On 5/13/2015 3:36 PM, Steven White wro

Re: High fieldNorm values causing really odd results

: { : "match":true, : "value":655360, : "description":"fieldNorm(doc=5316)" : } ... : This match is in the "title" field, which has 119669 total terms (which : isn't such big number) and the total document count in this index is that smells like a

NPE when Faceting with MoreLikeThis handler in Solr 5.1.0

Hi everyone, Recently I upgraded to solr 5.1.0. When trying to generate facets using the more like this handler, I now get a a NullPointerException. I never got this exception while using Solr 4.10.0 Details are below: Stack Trace: at org.apache.solr.request.SimpleFacets.getHeatmapCounts(Simple

Re: Suggester

Could you please explain how you solved the problem I am having the same issue :( -- View this message in context: http://lucene.472066.n3.nabble.com/Suggester-tp4201287p4205460.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Cannot get "uf" (user fields) to work

Thanks Shawn and all for the insight. This was very helpful. Steve On Thu, May 14, 2015 at 10:19 AM, Shawn Heisey wrote: > On 5/14/2015 6:33 AM, Steven White wrote: > > I don't follow. Can you give me an example on how and when to use "uf"? > > The uf parameter controls which fields are allow

re: A Synonym Searching for Phrase?

I have implemented that but it's not open sourced yet. It will be soon. -Chris. From: "Ryan Yacyshyn" Sent: Thursday, May 14, 2015 12:07 PM To: solr-user@lucene.apache.org Subject: A Synonym Searching for Phrase? Hi All, I'm running into

Re: Searcher is opening twice on Reload

I suspect you aren't doing anything wrong, i think it's the same as this bug... https://issues.apache.org/jira/browse/SOLR-7035 : Date: Thu, 14 May 2015 12:53:34 +0530 : From: Aman Tandon : Reply-To: solr-user@lucene.apache.org : To: "solr-user@lucene.apache.org" : Subject: Searcher is openi

Re: A Synonym Searching for Phrase?

There was a similar scission few days ago, take a look here : I found this very interesting article that I think can help in better understanding the problem : http://lucidworks.com/blog/solution-for-multi-term-synonyms-in-lucenesolr-using-the-auto-phrasing-tokenfilter/ And this : http://opensour

Re: Real-Time get and Dynamic Fields: possible bug.

Yep, but those dynamic fields had a field type "string", so the unique indexed therm will be the entire field value and the faceted terms counted will match with exactly with each field value. Thats why I was confused. Typically I use faceting with string non tokenized field values for simple stats

Re: Real-Time get and Dynamic Fields: possible bug.

On Thu, May 14, 2015 at 12:49 PM, Luis Cappa Banda wrote: > If you don' t mark as stored a field indexed and 'facetable', I was > expecting to not be able to return their values, so faceting has no sense. Faceting does not use or retrieve stored field values. The labels faceting returns are from

Re: Real-Time get and Dynamic Fields: possible bug.

That is something I didin' t know, but I thought it was mandatory. I' ll try to explain step by step my (I think) logical way to understand it: - If a field is indexed, you can search by it. - When faceting, you have to index the field (because it can be tokenized and then you would like

Re: Real-Time get and Dynamic Fields: possible bug.

On Thu, May 14, 2015 at 10:47 AM, Luis Cappa Banda wrote: > Hi Yonik, > > Yes, they are the target from copyFields in the schema.xml. This *_target > fields are suposed to be used in some specific searchable (thus, tokenized) > fields that in the future are candidates to be faceted to return some

A Synonym Searching for Phrase?

Hi All, I'm running into an issue where I have some tokens that really mean the same thing as two. For example, there are a couple ways users might want to search for certain type of visa called the "s pass", but they might query for spass or s-pass. I thought I could add a line in my synonym fil

High fieldNorm values causing really odd results

Hi everyone: >From the last couple of week I'm noting some really odd results in my Solr >server, searching for the root cause the one thing I can point out is a very >high value of the fieldNorm parameter in the score calculation, an snippet of >the debug info: { "match":true, "value":4

Re: Searcher is opening twice on Reload

Please help. The solr version is 4.8.1 With Regards Aman Tandon On Thu, May 14, 2015 at 12:53 PM, Aman Tandon wrote: > Hi, > > Please help me here, when I am doing the reload of core, my searcher is > being opening twice. I am also attaching the logs output, please suggest me > what wrong I am

Re: Real-Time get and Dynamic Fields: possible bug.

Hi Yonik, Yes, they are the target from copyFields in the schema.xml. This *_target fields are suposed to be used in some specific searchable (thus, tokenized) fields that in the future are candidates to be faceted to return some stats. For example, imagine that you have a field storing a director

Re: Real-Time get and Dynamic Fields: possible bug.

Ehem, *_target ---> *_facet. 2015-05-14 16:47 GMT+02:00 Luis Cappa Banda : > Hi Yonik, > > Yes, they are the target from copyFields in the schema.xml. This *_target > fields are suposed to be used in some specific searchable (thus, tokenized) > fields that in the future are candidates to be facet

Re: Real-Time get and Dynamic Fields: possible bug.

Are the _facet fields the target of a copyField in the schema? Realtime get either gets the values from the transaction log (and if you didn't send it the values, they won't be there) or gets them from the index to try and reconstruct what was sent in. It's generally not recommended to have copyFi

Re: Transactional Behavior

On 5/12/2015 10:58 AM, Amr Ali wrote: > I have a business case in which I need to be able for the rollback. When I > tried add/commit I was not able to prevent other threads that write to a > given Solr core from committing everything. I also tried indexwriter but Solr > did not get changes unti

Re: Transactional Behavior

Solr does not do transactions at all. The “commit” is to signal the end of a batch load and start the processing. You can hack some things, but there is no way to roll back a delete or a update. If you need this, you need to use a database, not a search engine. I recommend MarkLogic. It is a fu

Re: Cannot get "uf" (user fields) to work

On 5/14/2015 6:33 AM, Steven White wrote: > I don't follow. Can you give me an example on how and when to use "uf"? The uf parameter controls which fields are allowed in the query string. If you have "uf=f1 f2" then "q=f3:foo" won't work the way you would expect. If f3 is in the qf parameter, t

Re: Transactional Behavior

Hi Amr, As far as I am aware, SOLR does not support transaction isolation. If you really need it, you will have to isolate it yourself. Easiest way is to sacrifice concurrent updates. Other way of achieving it would be to to index in separate indices (maybe in memory) concurrently and than merg

Re: Cannot get "uf" (user fields) to work

One example: https://github.com/arafalov/solr-indexing-book/blob/master/published/languages/conf/solrconfig.xml#L36 This is from my book: https://www.packtpub.com/big-data-and-business-intelligence/instant-apache-solr-indexing-data-how-instant But I am not sure if it affects the specific concern

Re: Cannot get "uf" (user fields) to work

Steve, Your config should be like: explicit 20 edismax F3 type,id,score xml true This means when you query with "something" it will be equivalent to F3:something if you use standard parser. If you specify uf, t

Re: Cannot get "uf" (user fields) to work

Hi Emir, Like I replied to Jack, I don't get it. I need to see some concrete examples. Thanks Steve On Thu, May 14, 2015 at 8:30 AM, Emir Arnautovic < emir.arnauto...@sematext.com> wrote: > Hi Steve, > No - you should use qf to limit search to fields you want. If you do not > plan to allow us

Re: Cannot get "uf" (user fields) to work

Hi Jack, I don't follow. Can you give me an example on how and when to use "uf"? Thanks, Steve On Thu, May 14, 2015 at 8:15 AM, Jack Krupansky wrote: > The uf parameter applies to the user query string, the q parameter - the q > parameter may only references fields from uf in the q string. T

Re: Cannot get "uf" (user fields) to work

Hi Steve, No - you should use qf to limit search to fields you want. If you do not plan to allow users to explicitly state fields they want to search, you don't have to use uf parameter. So, drop uf, and set qf to F3. Thanks, Emir On 14.05.2015 14:09, Steven White wrote: Hi Emir, Are you sa

RE: Transactional Behavior

Hello guys, Any expert advice this issue? -- Regards, Amr Ali City stars capital 8 - 3rd floor, Nasr city, Cairo, Egypt Ext: 278 -Original Message- From: Amr Ali Sent: Wednesday, May 13, 2015 10:58 AM To: solr-user@lucene.apache.org Subject: RE: Transactional Behavior Hello Emir,

Re: Cannot get "uf" (user fields) to work

The uf parameter applies to the user query string, the q parameter - the q parameter may only references fields from uf in the q string. The qf parameter specifies fields to be queried behind the scenes and is not seen by the user. The term user refers to the person who is specifying the text that

Re: Cannot get "uf" (user fields) to work

Hi Emir, Are you saying I should remove "qf" if I want to use "uf"? I just tried that and got exception: java.lang.RuntimeException at org.apache.solr.search.ExtendedDismaxQParser$ExtendedDismaxConfiguration.(ExtendedDismaxQParser.java:1497) at org.apache.solr.search.ExtendedDismaxQParser.create

Re: Cannot get "uf" (user fields) to work

Hi Steve, You use qf to limit search on some fields. Thanks, Emir On 14.05.2015 13:49, Steven White wrote: Hi Everyone, I'm trying to utilize "uf" but it doesn't work. My reading of it per: https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Query+Parser is I can use it to li

Cannot get "uf" (user fields) to work

Hi Everyone, I'm trying to utilize "uf" but it doesn't work. My reading of it per: https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Query+Parser is I can use it to limit into which fields a search is performed. E.g.: If my index has F1, F2, F3, F4, and I set "uf" to F3, than

Re: Wiki new user

You have to create it first, then let us know. Create your account here: https://wiki.apache.org/solr , from the login page. The let us know the username you create. > On May 14, 2015, at 2:49 AM, Sergio Velasco wrote: > > Hi Erik, > > SergioVelasco is a

Real-Time get and Dynamic Fields: possible bug.

Hi there, I have the following dynamicFields definition in my schema.xml: I' ve seen that when fetching documents with /select?q=id:whateverId, the results returned include both i18n* and *_facet fields filled. However, when using real-time request handler (/get?ids:whateverIds) the resul

Searcher is opening twice on Reload

Hi, Please help me here, when I am doing the reload of core, my searcher is being opening twice. I am also attaching the logs output, please suggest me what wrong I am doing here or this is default behavior on reload. May 14, 2015 12:47:38 PM org.apache.solr.spelling.DirectSolrSpellChecker > INFO