Inconsistent highlighting in Solr

2013-11-28 Thread harsh kapoor
I have indexed data using Solr.I want to highlight matched keyword in search results. highlighting is inconsistent. eg. if search keyword is 'alonso'. highlighted instances are: *Alonso*,fernando_*alonso*,**#Alonso**MeetVettel non-highlightes instances are : @fernandoalonso, www.alonsodriver.com

Re: Inconsistent highlighting in Solr

2013-11-28 Thread Ahmet Arslan
Hi Harsh, Your query 'alonso' is not matching the text in your non-highlighted instance examples. Thats why they are not highlighted. It seems that you want to be able to search inside words too. You can use wildcard operator for this. Please see for similar discussion: 

Solrj Query Performance

2013-11-28 Thread Prasi S
Hi, We recently saw a behavior which I wanted to confirm, WE are using solrj to query solr. From the code, we use HttpSolrServer to hit the query and return the response 1. When a sample query is hit using Solrj, we get the QTime as 4seconds. The same query when we hit against solr in the

Re: Inconsistent highlighting in Solr

2013-11-28 Thread harsh kapoor
Hi Ahmet, Thanks for your reply but i am still not clear on this.Why highlighting occurs in text (fernando_*alonso, *Fernando*Alonso*(CamelCase) ) these are also words and Solr is highlighting inside words. But no highlighting takes place in lowercase 'fernandoalonso'. why is this? On Thu,

Re: Inconsistent highlighting in Solr

2013-11-28 Thread Ahmet Arslan
Hi Hars, Highlighted text samples are matching because of  WordDelimiterFilterFactory splits them. You can see/test the behaviour of your fieldType name=text at  analysis page.  On Thursday, November 28, 2013 11:51 AM, harsh kapoor harshlnm...@gmail.com wrote: Hi Ahmet, Thanks for your

Custom score solr

2013-11-28 Thread Viva Daniele
Hi guys, I’m using solr 4.5 and for my search i’m using this sort in my query: sort=div(sum(div(termfreq(alltext,”solr),sum(myfield,10)),div(termfreq(alltext,”lucene),sum(myfield,10))),2) desc Now, i’m looking for a tutorial/guide about custom scoring on solr (i’m using solr 4.5) to implement

Re: Solrj Query Performance

2013-11-28 Thread Ahmet Arslan
Hi Parsi, Are you sure you are using the same exact parameters? I would include enhoParams=all and compare parameters. Only wt parameter would be different. wt=javabin for solrJ  On Thursday, November 28, 2013 11:42 AM, Prasi S prasi1...@gmail.com wrote: Hi, We recently saw a behavior which

Re: SolrCloud and 2MB Synonym file

2013-11-28 Thread Puneet Pawaia
Hi Managed to get it working by adding -Djute.maxbuffer=5242880 to zkServer.sh, zkCli.sh and solr startup command. Please let me know if this value for jute.maxbuffer is within acceptable limits Regards Puneet On Thu, Nov 28, 2013 at 6:40 AM, Puneet Pawaia puneet.paw...@gmail.comwrote: I am

Re: SolrCloud and 2MB Synonym file

2013-11-28 Thread Yago Riveiro
In my case I have: - Zookeeper: a file into conf folder named zookeeper-env.sh with: #!/usr/bin/env bash ZOO_ENV=-Djute.maxbuffer=10485761 The zookeeper-env.sh is loaded automatically by the zkEnv.sh if the file exists. - Solr: the -Djute.maxbuffer=10485761 param in start command --

RE: News url is not showing correct

2013-11-28 Thread Vishal GUPTA
Hi Erick Could you please let me know what information you require to reach the root of this problem. I will provide you the same. -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, November 27, 2013 7:56 PM To: solr-user@lucene.apache.org

Re: SolrCloud and 2MB Synonym file

2013-11-28 Thread Puneet Pawaia
Hi Yago, Since the value you have mentioned is less than what I have used and it is working, I won't rock the boat. Thanks for the env.sh direction. I'll use it next time I need to set things up. Regards Puneet On Thu, Nov 28, 2013 at 4:01 PM, Yago Riveiro yago.rive...@gmail.comwrote: In my

Re: Inconsistent highlighting in Solr

2013-11-28 Thread harsh kapoor
Hi Ahmet, Now things are making sense.Thank you for your reply. On Thu, Nov 28, 2013 at 3:26 PM, Ahmet Arslan iori...@yahoo.com wrote: Hi Hars, Highlighted text samples are matching because of WordDelimiterFilterFactory splits them. You can see/test the behaviour of your fieldType

How to Delete A Field From Schema Without Re-Indexing?

2013-11-28 Thread Furkan KAMACI
I use Sol 4.5.1. Let's assume that I have a dynamic field at my schema. I've indexed some documents into my cloud. After a time later can I remove some fields (I know their names) from my index without re-indexing?

RE: Need help on Joining and sorting syntax and limitations between multiple documents in solr-4.4.0

2013-11-28 Thread Sukanta Dey
Hi Colm/Yaan, Based on the comments in the support ticket it seems vjoin has some constraints like I.from and to keys need to be integer whereas in our case these essentially be string values II. Join needs to be happen between multiple cores, in our case

Re: How to Delete A Field From Schema Without Re-Indexing?

2013-11-28 Thread Alexandre Rafalovitch
Why? You can just stop loading them with lazy load. Is it about space? On 28 Nov 2013 18:56, Furkan KAMACI furkankam...@gmail.com wrote: I use Sol 4.5.1. Let's assume that I have a dynamic field at my schema. I've indexed some documents into my cloud. After a time later can I remove some

Per-field/facet TimeZone in query?

2013-11-28 Thread Bram Van Dam
Howdy, Is there any way to specify a time zone per field/facet? There is a global TZ query parameter, but I would like to be able to use a different TZ for different fields or facets in a query. Thx, - Bram

SolrCloud Term Vectors NullPointerException

2013-11-28 Thread Stanislav Sandalnikov
Hello everyone, I have problems with setting up SolrCloud to work with term vectors, failing with error: lst name=error str name=trace java.lang.NullPointerException at org.apache.solr.handler.component.TermVectorComponent.finishStage(TermVectorComponent.java:437) at

Re: Solr 4.x : how to implement an update processor chain working for partial updates

2013-11-28 Thread paule_lecuyer
It works just as I wanted, thanks !! Paule -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-x-how-to-implement-an-update-processor-chain-working-for-partial-updates-tp4103071p4103738.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to Delete A Field From Schema Without Re-Indexing?

2013-11-28 Thread Furkan KAMACI
The problem is that: I want a field that should have payloads (I have other usual fields too). I want to calculate usual document score and if a match occurs at payloaded field I want to add payload to the document score too. However I could not see any working example and I could not get any

Re: Solr 4.x : how to implement an update processor chain working for partial updates

2013-11-28 Thread paule_lecuyer
Hi Alexandre, Reading comments on SOLR-5395, I don't fully understand how the whole update processing is performed (what exactly happens on which data). if you have some time to explain that would be very nice. Thanks Paule -- View this message in context:

How solr text search finding work

2013-11-28 Thread Viresh Modi
For instance,When we searched for “Kredit” and received hits containing the words “Kredit”, “Kredite” and “Kredit-“. However, entries containing the word “Kreditgeber” are not coming up in the results list. Would you know why? Regards Viresh Modi

(info)solr Index Replication can throughput?

2013-11-28 Thread Jacky.J.Wang (mis.cnsh04.Newegg) 41361
Dear solr I have a question that solr index relocation can throughput of network? How to config ,I find not in solrconfig about ReplicationHandler. Eagerly waiting for your answer , thanks very much!

Expansion of fields in fl parameter

2013-11-28 Thread Alvaro Cabrerizo
The question: ¿Is there a way to avoid field expansion when adding flhttp://wiki.apache.org/solr/CommonQueryParameters#flparameter to the request? The environment: Solr 4.4 using the next schema.xml field name=id type=string indexed=true stored=true required=true / field name=01_text

Re: How solr text search finding work

2013-11-28 Thread Ahmet Arslan
Hi Viresh, It all about analysis (field type) of the text you are indexing searching. http://localhost:8983/solr/#/collection1/analysis page is very helpful to obverse/debug how your text is indexed analyzed. It is probably because of your stemmer. Can you paste your field type definition?

Re: How solr text search finding work

2013-11-28 Thread Viresh Modi
Declaration: field name=content type=text_en_splitting indexed=true stored=true termVectors=true termPositions=true termOffsets=true / My Field Type Defination as below: fieldType name=text_en_splitting class=solr.TextField positionIncrementGap=100 autoGeneratePhraseQueries=true analyzer

Re: How solr text search finding work

2013-11-28 Thread Paul Libbrecht
Viresh, there's two ways to solve this. - Using the CompoundWordsAnalyzer. I still haven't been able to find an easy to embark method into there. That would decompose, at indexing and query time, the term Kreditgeber into kredit and geber. For a higher precision, you probably want to do it at

Converting Fast ESP queries(fql) to Solr query syntax

2013-11-28 Thread elmerfudd
I would like to perform searches in Solr using queries I extracted from Fast ESP . The queries are written in FQL (fast query language) format and I want to convert them to Solr query syntax . Is there any way to preform a search like this in Solr? Maybe a tool available? Could not find anything

Re: Expansion of fields in fl parameter

2013-11-28 Thread Ahmet Arslan
Hi Alvaro, That's really weird. When choosing field names it is recommend to use java variable naming conventions. Can you change field names to text_01 , text01 and try again? Problem still exists? Do you have dynamicField definitions? What happens when you request all fields (fl=*)? On

Re: Expansion of fields in fl parameter

2013-11-28 Thread Jack Krupansky
If you have chosen to use improper field names, then in the fl parameter you need to reference them using the field function: fl=id,field(01text) The basic concept is that Solr doesn't ban improper field names, but that they don't work in all contexts. -- Jack Krupansky -Original

Solr 4.5.1 Startup Problem

2013-11-28 Thread Furkan KAMACI
I use Solr 4.5.1 I have a configuration from Solr 4.3. When I start my Solr I get that exception: org.apache.solr.common.SolrException: Could not load config for solrconfig.xml at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:919) at

Re: Solr 4.5.1 Startup Problem

2013-11-28 Thread Furkan KAMACI
A long version of error log: 3756 [coreLoadExecutor-3-thread-1] ERROR org.apache.solr.core.CoreContainer - Unable to create core: collection1 org.apache.solr.common.SolrException: Error opening new searcher at org.apache.solr.core.SolrCore.init(SolrCore.java:821) at

Re: Request for Contributors Group

2013-11-28 Thread Erick Erickson
Done for the Solr wiki, but not Confluence. On Wed, Nov 27, 2013 at 9:37 PM, Ahmet Arslan iori...@yahoo.com wrote: Hello all, Please add my username ( iorixxx ) to Contributors Group. With this, can I edit confluence too?

Re: Request for Contributors Group

2013-11-28 Thread Erick Erickson
Done for the Solr wiki On Thu, Nov 28, 2013 at 1:37 AM, Shinichiro Abe shinichiro.ab...@gmail.comwrote: Hi, Please add my username ( shinichiro ) to Contributors Group. Thanks in advance, Shinichiro Abe

problems with boolean query

2013-11-28 Thread Thomas Kurz
Hi all! I have a question regarding boolean queries. What I want to reach: Return all documents where string-field „access has value ‚allow*‘ or is not set. My query: fq = (access:Allow*) OR (-access:*) But I got only the results where the field has value ‚allow*‘. I am using solr 4.3.1 with

Re: Solr 4.5.1 Startup Problem

2013-11-28 Thread Guido Medina
AFAIK you should have 4.5 just like in my config used to be (4.6 in my case), check for the obvious, no spaces (or hidden spaces), etc. luceneMatchVersion4.6/luceneMatchVersion Also, it looks like your Solr hasn't been upgraded properly, if you verify the list of supported versions it should

Re: Error when creating collection in Solr 4.6

2013-11-28 Thread Erick Erickson
Thanks for letting us know this is an issue with discovery mode as well, I'd only run across old-style before. On Thu, Nov 28, 2013 at 2:53 AM, lansing halim.cha...@wantedanalytics.comwrote: Thank you for your replies, I am using the new-style discovery It worked after adding this setting :

Re: Custom score solr

2013-11-28 Thread Erick Erickson
I'm not quite sure what you're asking here. By sorting you're really making scoring irrelevant. Do you want to implement your sorting function in a custom scorer and do away with the sort clause? Best, Erick On Thu, Nov 28, 2013 at 5:00 AM, Viva Daniele viva.dani...@gmail.comwrote: Hi guys,

Re: Expansion of fields in fl parameter

2013-11-28 Thread Alvaro Cabrerizo
Thanks for your answers. The problem with the use of the field function is that it only works for non multivalued fields. Regards. El 28/11/2013 15:54, Jack Krupansky j...@basetechnology.com escribió: If you have chosen to use improper field names, then in the fl parameter you need to

Re: Request for Contributors Group

2013-11-28 Thread Steve Rowe
Ahmet, Because the Confluence wiki hosts the releasable Solr ref guide, only those who have signed ICLAs can edit it - this is ASF policy. (Sorry, I can’t find a web page describing this policy.) Currently, editing on the Solr space in the Confluence wiki is restricted to Lucene/Solr

Re: problems with boolean query

2013-11-28 Thread Jack Krupansky
Yeah, purely negative sub-queries have had problems, so rewrite: fq = (access:Allow*) OR (-access:*) as fq = (access:Allow*) OR (*:* -access:*) -- Jack Krupansky -Original Message- From: Thomas Kurz Sent: Thursday, November 28, 2013 10:34 AM To: solr-user@lucene.apache.org Subject:

Solr query syntax.

2013-11-28 Thread elmerfudd
Is solr ignoring parts of the query that dont consider fields. something like and(blabla , name: george) It wont throw an exeption, so what is he considering blablabla to? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-query-syntax-tp4103784.html Sent from the Solr

Re: Request for Contributors Group

2013-11-28 Thread Ahmet Arslan
Hi Steve, Thanks for the explanation. I posted my findings to voting threat of ref-guide-4.6.pdf Thanks, Ahmet On Thursday, November 28, 2013 6:29 PM, Steve Rowe sar...@gmail.com wrote: Ahmet, Because the Confluence wiki hosts the releasable Solr ref guide, only those who have signed

SolrCloud - BadRequest error when adding records

2013-11-28 Thread Puneet Pawaia
Hi All, I have an test setup with External Zookeeper and 2 machines with Solr 4.6.0. 2 collections with 2 shards. As such there is no replica at the moment. However, when adding records, I am getting the following error ERROR - 2013-11-28 22:42:26.925;

Re: Solr query syntax.

2013-11-28 Thread Ahmet Arslan
Hi, No it does not ignore. debugQuery=on shows actual parsed query. By the way default query parser does not support prefix AND(a, b, c) notation. Which query parser are you using? On Thursday, November 28, 2013 6:50 PM, elmerfudd na...@012.net.il wrote: Is solr ignoring parts of the query

Re: Solrj Query Performance

2013-11-28 Thread Shawn Heisey
On 11/28/2013 3:01 AM, Ahmet Arslan wrote: Are you sure you are using the same exact parameters? I would include enhoParams=all and compare parameters. Only wt parameter would be different. wt=javabin for solrJ You can also look at the Solr log, which if you are logging at the normal level

Re: Solr 4.5.1 Startup Problem

2013-11-28 Thread Shawn Heisey
On 11/28/2013 8:03 AM, Furkan KAMACI wrote: Caused by: org.apache.solr.common.SolrException: Invalid luceneMatchVersion '4.5', valid values are: [LUCENE_30, LUCENE_31, LUCENE_32, LUCENE_33, LUCENE_34, LUCENE_35, LUCENE_36, LUCENE_40, LUCENE_41, LUCENE_42, LUCENE_43, LUCENE_CURRENT] or a string

RE: LanguageIdentifierUpdateProcessor uses only firstValue() on multivalued fields

2013-11-28 Thread Müller , Stephan
I'm closing this thread on _this_ list (user) and move it as patch proposal to the dev list. Thanks for the feedback! Regards, Stephan Von: Müller, Stephan [muel...@ponton-consulting.de] Gesendet: Mittwoch, 27. November 2013 16:16 An:

Re: LanguageIdentifierUpdateProcessor uses only firstValue() on multivalued fields

2013-11-28 Thread Trey Grainger
Yeah, the documentation is definitely wrong - it definitely doesn't concatenate the values in a multivalued field, it only uses the first one like you mentioned. If you want to detect the language of each of the values in the multi-valued field (as opposed to specifying multiple separate string

Re: SolrCloud - BadRequest error when adding records

2013-11-28 Thread Erick Erickson
How are you trying to update? This looks like the intra-shard URL, What's the process by which you attempt to add the docs? Best, Erick On Thu, Nov 28, 2013 at 12:20 PM, Puneet Pawaia puneet.paw...@gmail.comwrote: Hi All, I have an test setup with External Zookeeper and 2 machines with Solr

Re: News url is not showing correct

2013-11-28 Thread Erick Erickson
Please read the link I provided. You have provided no context for your problem, and have cut/pasted a fragment that appears unrelated to anything I've seen in Solr. Imagine you're entirely ignorant of what you've attempted to do and someone provided you with the information you've provided us.

Re: SolrCloud - BadRequest error when adding records

2013-11-28 Thread Puneet Pawaia
Hi Eric I am adding documents using curl. Each document is a single line document containing a few fields which are generally a few words. Several such documents are stored in a csv file which is uploaded using curl. When these files are uploaded to a single node installation, there are no

ANNOUNCEMENT: GijutsuHyohronBook2013

2013-11-28 Thread Shinichiro Abe
Hi, In Japan, revised Apache Solr introduction book is released. This book revises GijutsuHyohronBook2010, based on Solr 4.5.1. This book includes Solr 4.x's many features, SolrCloud, and ManifoldCF features. See https://wiki.apache.org/solr/GijutsuHyohronBook2013 Thank you, Shinichiro Abe

RE: ANNOUNCEMENT: GijutsuHyohronBook2013

2013-11-28 Thread Raju Shikha
Thank you. Is this book available in English?, where can i get it? Regards, Raju Shikha India -Original Message- From: Shinichiro Abe [mailto:shinichiro.ab...@gmail.com] Sent: 29 November 2013 07:52 To: solr-user@lucene.apache.org Cc: u...@manifoldcf.apache.org Subject: ANNOUNCEMENT:

RE: SolrCloud - BadRequest error when adding records

2013-11-28 Thread Raju Shikha
Hi Puneet, Using curl, Are you trying in this way? curl http://localhost:8983/solr/update?commit=true -H Content-Type: text/xml -d @mem.xml curl http://localhost:7574/solr/update?commit=true -H Content-Type: text/xml -d @monitor2.xml or try using -Durl if it is windows like below,

Re: ANNOUNCEMENT: GijutsuHyohronBook2013

2013-11-28 Thread Shinichiro Abe
Hi, Is this book available in English?, where can i get it? No, this book is available in Japanese only. We can get the book from amazon etc. Regards, Shinichiro Abe On 2013/11/29, at 14:20, Raju Shikha raju.shi...@cigniti.com wrote: Thank you. Is this book available in English?, where can i