Re: Re: How to properly use Levenstein distance with ~ in Java

2014-10-22 Thread karsten-solr
Hi Aleksander,   The Fuzzy Searche '~' is not supported in dismax (defType=dismax) https://cwiki.apache.org/confluence/display/solr/The+DisMax+Query+Parser   You are using SearchComponent "spellchecker". This does not change the query results.   btw: It looks like you are using path "/select" wit

Re: about Solr log file

2014-10-22 Thread Otis Gospodnetic
Hi Chunki, Having logs on the local disk is not a problem. You can use tools like rsyslog or Logstash or Flume or fluentd and ship your logs wherever you want - your own centralized logging system or Splunk or Logsene for example. This will make it easier to debug/troubleshoot, too - no need to

RE: about Solr log file

2014-10-22 Thread Will Martin
Hi Lee: I'm returning to the Solr/Lucene community and haven't made it to Solr Clouds yet, but w reference to discrete servers If you put a logback configuration in place, you can with configuration alone and (my choice) gelf4j send each logging flow to a graylog2 server. In graylog2 you could cr

about Solr log file

2014-10-22 Thread Lee Chunki
Hi, I have two questions about Solr log file. First, Is it possible to set log setting to use one log file for each core? Because of I run many cores on one Solr and log file is getting bigger and bigger and it makes me to hard to debug when system error. Second, Is there any setting to gather

Re: Documents Added Not Available After Commit (Both Soft and Hard)

2014-10-22 Thread Arian Pasquali
Hi Justin, I'm having the same situation running solr 4.9.0. Did you managed to find out what was the problem? Arian

Re: QParserPlugin question

2014-10-22 Thread Chris Hostetter
: It's for an optimization. If the keyword is 'match all docs', I want to : remove a custom PostFilter from the query and change the sort parameters : (so the app doesn't have to do it). It looks like the responseHeader is : displaying the 'originalParams', which are immutable. that is in fact t

Re: StatelessScriptUpdateProcessorFactory Access to Solr Core/schema/analyzer etc

2014-10-22 Thread Tom LAMPERT
Thank you, embarrassingly I had not looked at that doc. And thank you to the other repliers. From: Chris Hostetter Sent: 22 October 2014 20:38 To: solr-user@lucene.apache.org Subject: Re: StatelessScriptUpdateProcessorFactory Access to Solr Core/schema/a

Re: mark solr documents as duplicates on hashing the combination of some fields

2014-10-22 Thread Alexandre Rafalovitch
This is the "dark art" knowledge. I've updated the Reference Guide comment with the request to have this text included, but it would also be nice to have it as part of the Javadoc for the Factory or the URP itself. Maybe WIKI as well. I can see not getting this part causing somebody a lot of headac

Re: StatelessScriptUpdateProcessorFactory Access to Solr Core/schema/analyzer etc

2014-10-22 Thread Shawn Heisey
On 10/22/2014 11:50 AM, Tom LAMPERT wrote: > I am attempting to create a script (java script) using the > StatelessScriptUpdateProcessorFactory feature of solr but I am blocked on how > to access the current core instance (ultimately to access it's schema)? In > the wikipedia example the input d

Re: StatelessScriptUpdateProcessorFactory Access to Solr Core/schema/analyzer etc

2014-10-22 Thread Chris Hostetter
: I am attempting to create a script (java script) using the : StatelessScriptUpdateProcessorFactory feature of solr but I am blocked : on how to access the current core instance (ultimately to access it's : schema)? In the wikipedia example the input document is accessible using : doc = cmd.s

Re: StatelessScriptUpdateProcessorFactory Access to Solr Core/schema/analyzer etc

2014-10-22 Thread Ramzi Alqrainy
In the below script you have access to several Solr objects, allowing you for instance to modify the document before it’s indexed by Solr or to add some lines to the Solr log. It’s best demonstrated by an example.

Re: QParserPlugin question

2014-10-22 Thread Peter Keegan
I meant to say: If the keyword is *:* (MachAllDocsQuery)... On Wed, Oct 22, 2014 at 2:17 PM, Peter Keegan wrote: > It's for an optimization. If the keyword is 'match all docs', I want to > remove a custom PostFilter from the query and change the sort parameters > (so the app doesn't have to do i

Re: QParserPlugin question

2014-10-22 Thread Peter Keegan
It's for an optimization. If the keyword is 'match all docs', I want to remove a custom PostFilter from the query and change the sort parameters (so the app doesn't have to do it). It looks like the responseHeader is displaying the 'originalParams', which are immutable. On Wed, Oct 22, 2014 at 2:

Re: mark solr documents as duplicates on hashing the combination of some fields

2014-10-22 Thread Chris Hostetter
: I meant signature will be broken. For example suppose the destination of : hash function for signature fields are "sig". After each partial update it : becomes: "00"! details please. how are you configuring your update processor chain? what does your schema look like? what types of at

Re: QParserPlugin question

2014-10-22 Thread Ramzi Alqrainy
I don't know why you need to change it ? you can use &omitHeader=true on the URL to remove header if you want. -- View this message in context: http://lucene.472066.n3.nabble.com/QParserPlugin-question-tp4165368p4165373.html Sent from the Solr - User mailing list archive at Nabble.com.

StatelessScriptUpdateProcessorFactory Access to Solr Core/schema/analyzer etc

2014-10-22 Thread Tom LAMPERT
Hello, I am attempting to create a script (java script) using the StatelessScriptUpdateProcessorFactory feature of solr but I am blocked on how to access the current core instance (ultimately to access it's schema)? In the wikipedia example the input document is accessible using doc = cmd.solr

Re: javascript form data save to XML in server side

2014-10-22 Thread Dan Davis
I always, always have a web application running that accepts the JavaScript AJAX call and then forwards it on to the Apache Solr request handler. Even if you don't control the web application, and can only add JavaScript, you can put up a API oriented webapp somewhere that only protects Solr for a

QParserPlugin question

2014-10-22 Thread Peter Keegan
I have a custom query parser that modifies the filter query list based on the keyword query. This works, but the 'fq' list in the responseHeader contains the original filter list. The debugQuery output does display the modified filter list. Is there a way to change the responseHeader? I could proba

Re: Nested documents in Solr

2014-10-22 Thread Mikhail Khludnev
Hello Aurélien, There are a lot of materials about this problem. Start from this one: https://www.youtube.com/watch?v=YCkkOyZ-zkM On Wed, Oct 22, 2014 at 6:08 PM, wrote: > Hi Ramzi, > > Thank you but I am not sure to understand well your answer. In your > example, I suppose that the indexed doc

Re: Difference between unloading of cores with LotsOfCores and unloading a core with CoreAdmin

2014-10-22 Thread Xiaolu Zhao
Hi Erick, Thanks a lot for your explanation. Last time, when I try out LotsOfCores, I find JVM memory usage will increase as the total number of cores grows, though the transient cache size is fixed. Finally, JVM will run out of memory when I have thousands of cores. Does it mean other curren

Re: Difference between unloading of cores with LotsOfCores and unloading a core with CoreAdmin

2014-10-22 Thread Erick Erickson
The difference here is that the LotsOfCores is intended to cache open cores and thus limit the number of currently loaded cores. However, cores not currently loaded are available for use; the next request that needs that core will cause it to be loaded (or reloaded). The admin/core/UNLOAD command,

Difference between unloading of cores with LotsOfCores and unloading a core with CoreAdmin

2014-10-22 Thread Xiaolu Zhao
Hi All, I am confused about the difference between unloading of cores with LotsOfCores and unloading a core with CoreAdmin. From my understanding of LotsOfCores, if one core is removed from transient cache, it is pending to close, it means close all resources allocated by the core if it is n

Difference between unloading of cores with LotsOfCores and unloading a core with CoreAdmin

2014-10-22 Thread Xiaolu Zhao
Hi All, I am confused about the difference between unloading of cores with LotsOfCores and unloading a core with CoreAdmin. From my understanding of LotsOfCores, if one core is removed from transient cache, it is pending to close, it means close all resources allocated by the core if it is n

Changing/merging terms of existing documents without reindexing them

2014-10-22 Thread Michael Ryan
I have the following problem: I have many (let's say hundreds of millions) of documents in an existing distributed index that have a field with a variety of values. Two of these values are "dog" and "puppy". I have decided that I want to reclassify these to just all be "dog". I do queries on th

Re: Nested documents in Solr

2014-10-22 Thread aurelien . mazoyer
Hi Ramzi, Thank you but I am not sure to understand well your answer. In your example, I suppose that the indexed docs are flattened. If I want an AND query instead of an OR query (let say, for example 'chapter_title:Lucene AND chapter_content:fun'), how can I be sure that the terms "Lucene" a

Re: mark solr documents as duplicates on hashing the combination of some fields

2014-10-22 Thread Ali Nazemian
I meant signature will be broken. For example suppose the destination of hash function for signature fields are "sig". After each partial update it becomes: "00"! On Wed, Oct 22, 2014 at 2:59 PM, Alexandre Rafalovitch wrote: > What do you mean by 'useless' specifically on the business le

Re: unstable results on refresh

2014-10-22 Thread Erick Erickson
I would rather ask whether such small differences matter enough to do this. Is this something users will _ever_ notice? Optimization is quite a heavyweight operation, and is generally not recommended on indexes that change often, and 5 minutes is certainly below the recommendation for optimizing.

Re: Suggester on Dynamic fields

2014-10-22 Thread Simon
Hi Ramzi, First thanks for your comments. Regarding your line parameters.set("qt", /suggest") My understanding is that "suggest" has to be a handler defined in SolrConfig.xml. And the handler needs to have one of more defined (search) component(s). The search component syntax needs diction

Re: Connection pooling in SolrJ

2014-10-22 Thread Shawn Heisey
On 10/22/2014 4:10 AM, Gopal Jee wrote: > What is best way to enable connection pooling in SolrJ client? > We have solrCloud setup with load balancer between Solr client and Solr > Server. We are using SolrJ 4.10. SolrJ's HttpSolrServer implementation (and all of those implementations that use it

Re: NPE when using pivots

2014-10-22 Thread Neil Ireson
Firstly apologies as I originally sent this to the dev list by mistake... Bit of a weird one and not sure if this counts as a bug. I erroneously created a filter which correctly filters a term into the index (e.g. clouds -> cloud), however if that term is filtered again it returns no value (e.

Re: mark solr documents as duplicates on hashing the combination of some fields

2014-10-22 Thread Alexandre Rafalovitch
What do you mean by 'useless' specifically on the business level? Regards, Alex On 22/10/2014 7:27 am, "Ali Nazemian" wrote: > The problem is when I partially update some fields of document. The > signature becomes useless! Even if the updated fields are not included in > the signatureField

Re: mark solr documents as duplicates on hashing the combination of some fields

2014-10-22 Thread Ali Nazemian
The problem is when I partially update some fields of document. The signature becomes useless! Even if the updated fields are not included in the signatureField! Regards. On Wed, Oct 22, 2014 at 12:44 AM, Chris Hostetter wrote: > > you can still use the SignatureUpdateProcessorFactory for your u

Re: upgrading CommonsHttpSolrServer to HttpSolrServer

2014-10-22 Thread devraj.jaiman
Thanks a lot Shawn. It resolved the issue. Regards, D.Jaiman -- View this message in context: http://lucene.472066.n3.nabble.com/upgrading-CommonsHttpSolrServer-to-HttpSolrServer-tp4164620p4165305.html Sent from the Solr - User mailing list archive at Nabble.com.

Connection pooling in SolrJ

2014-10-22 Thread Gopal Jee
What is best way to enable connection pooling in SolrJ client? We have solrCloud setup with load balancer between Solr client and Solr Server. We are using SolrJ 4.10. -Gopal

Re: unstable results on refresh

2014-10-22 Thread Giovanni Bricconi
I have made some small patch to the application to make this problem less visible, and I'm trying to perform the optimize once per hour, yesterday it took 5 minutes to perform it, this morning 15 minutes. Today I will collect some statistics but the publication process sends documents every 5 minut