Re: 43sec commit duration - blocked by index merge events?

2015-02-13 Thread Timothy Potter
I think Mark found something similar - https://issues.apache.org/jira/browse/SOLR-6838 On Sat, Feb 14, 2015 at 2:05 AM, Erick Erickson wrote: > Exactly how are you issuing the commit? I'm assuming you're > using SolrJ. the server.commit(whatever, true) waits for the searcher > to be opened befor

Re: 43sec commit duration - blocked by index merge events?

2015-02-13 Thread Erick Erickson
Exactly how are you issuing the commit? I'm assuming you're using SolrJ. the server.commit(whatever, true) waits for the searcher to be opened before returning. This includes (I believe) warmup times. It could be that the warmup times are huge in your case, the solr logs should show you the autowar

Re: Solr scoring confusion

2015-02-13 Thread Otis Gospodnetic
Hi Scott, Try optimizing after reindexing and this should go away. Had to do with updated/deleted docs participating in score computation. Otis > On Feb 13, 2015, at 18:29, Scott Johnson wrote: > > We are getting inconsistent scoring results in Solr. It works about 95% of > the time, where

Solr scoring confusion

2015-02-13 Thread Scott Johnson
We are getting inconsistent scoring results in Solr. It works about 95% of the time, where a search on one term returns the results which equal exactly that one term at the top, and results with multiple terms that also contain that one term are returned lower. Occasionally, however, if a subset of

Re: Solr - Mahout

2015-02-13 Thread Jack Krupansky
There is no recommendation built into Solr itself, but you might get some good ideas from this presentation: http://www.slideshare.net/treygrainger/building-a-real-time-solrpowered-recommendation-engine -- Jack Krupansky On Fri, Feb 13, 2015 at 8:33 AM, wrote: > Sir , >I need to know solr

Re: 43sec commit duration - blocked by index merge events?

2015-02-13 Thread Jack Krupansky
I wasn't able to follow Otis' answer but... the purpose of commit is to make make recent document changes (since the last commit) visible to queries, and has nothing to do with merging of segments. IOW, take the new segment that is being created and not yet ready for use by query, and finish it so

Re: How to make SolrCloud more elastic

2015-02-13 Thread Otis Gospodnetic
Hi Matt, See: http://search-lucene.com/?q=query+routing&fc_project=Solr https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On Th

Re: 43sec commit duration - blocked by index merge events?

2015-02-13 Thread Otis Gospodnetic
Check http://search-lucene.com/?q=commit+wait+block&fc_type=mail+_hash_+user e.g. http://search-lucene.com/m/QTPa7Sqx81 Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On Fri, Feb 13, 2015 at 8:50 AM, Gili Nachum

Re: Collations are not working fine.

2015-02-13 Thread Rajesh Hazari
Hi Nitin, Can u try with the below config, we have these config seems to be working for us. text_general wordbreak solr.WordBreakSolrSpellChecker textSpell true false 5 default textSpell solr.IndexBasedSpellChecker ./spellchecker 0.75 0.01 true 5 true default wor

Solr and UIMA, capturing fields

2015-02-13 Thread Tom Devel
Hi, I successfully combined Solr and UIMA with the help of https://wiki.apache.org/solr/SolrUIMA and other pages (and am happy to provide some help about how to reach this step). Right now I can run an analysis engine and get some "primitive" feature/fields which I specify in the schema.xml autom

Re: Dovecot FTS Solr Error [urgent/serious]

2015-02-13 Thread Kevin Laurie
Hi Erik, Below link is my admin_ui output: http://postimg.org/image/4rbubv54x/ Could you confirm if the problem if my system is short of memory? Also my VPS system runs on 2GB ram, should I increase the ram/processor? Thanks Kevin On Sat, Feb 14, 2015 at 2:27 AM, Erick Erickson wrote: > Look a

Re: Dovecot FTS Solr Error [urgent/serious]

2015-02-13 Thread Erick Erickson
Look at the admin UI screen, the overview screen has this in the lower-right corner. To add more memory, you can start it like this: java -Xmx4G -Xms4G -jar start.jar Best, Erick On Fri, Feb 13, 2015 at 10:24 AM, Kevin Laurie wrote: > Hi, > how do i check the heap size for Solr java? > > i am

Re: Index directory containing only segments.gen

2015-02-13 Thread Erick Erickson
Zisis: It's not so much that the behavior has changed, and it's still perfectly possible to use old-style solr.xml. Rather, it's that there has been quite a lot of hardening how SolrCloud creates things. I realize that the Collections API is more of a black box and you have to take on faith that i

Re: Dovecot FTS Solr Error [urgent/serious]

2015-02-13 Thread Kevin Laurie
Hi, how do i check the heap size for Solr java? i am not very well versed with java, only using it for my mail server so appreciate if you could help thanks Kevin On Saturday, February 14, 2015, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > According to the logs, the Solr process has

RE: Collations are not working fine.

2015-02-13 Thread Dyer, James
Nitin, Can you post the full spellcheck response when you query: q=gram_ci:"gone wthh thes wint"&wt=json&indent=true&shards.qt=/spell James Dyer Ingram Content Group -Original Message- From: Nitin Solanki [mailto:nitinml...@gmail.com] Sent: Friday, February 13, 2015 1:05 AM To: solr-u

Re: Dovecot FTS Solr Error [urgent/serious]

2015-02-13 Thread Shalin Shekhar Mangar
According to the logs, the Solr process has run out of memory and therefore it won't accept any more writes. What is the heap size for the Solr java process? The u...@domain.net in the logs is a red herring. Those just seem to be part of the document's id. On Fri, Feb 13, 2015 at 11:06 PM, Kevi

Dovecot FTS Solr Error [urgent/serious]

2015-02-13 Thread Kevin Laurie
Hi Guys, Serious help requested with dovecot and apache solr. Appreciate if someone could see the solr log outputs and tell me whats going wrong. Problem: Dovecot adm keeps reporting error as shown below:- root@mail:/var/log# doveadm index -u u...@domain.net inbox doveadm(t...@sicl.net): Error:

Re: Index directory containing only segments.gen

2015-02-13 Thread Zisis Tachtsidis
Erick Erickson wrote > OK, I think this is the root of your problem: > > bq: Everything was setup using the - now deprecated - tags > > and > > inside solr.xml. > > There are a bunch of ways this could go wrong. I'm pretty sure you > have something that would take quite a while to untangle

Re: Multi words query

2015-02-13 Thread Scott Stults
A couple more things would help debug this. First, could you grab the specific Solr log entry when this query is sent? Also, have you changed the default schema at all? If you're querying "string" fields you have to exactly match what's indexed there, versus "text" which gets tokenized. k/r, Sco

Re: variaton on boosting recent documents gives exception

2015-02-13 Thread Michael Lackhoff
Am 13.02.2015 um 11:18 schrieb Gonzalo Rodriguez: > You can always change the type of your sortyear field to an int, or create an > int version of it and use copyField to populate it. But that would require me to reindex. Would be nice to have some type conversion available within a function que

Re: bulk indexing with optimistick lock

2015-02-13 Thread Scott Stults
This isn't a Solr-specific answer, but the easiest approach might be to just collect the document IDs you're about to add, query for them, and then filter out the ones Solr already has (this'll give you a nice list for later reporting). You'll need to keep your batch sizes below maxBooleanClauses i

Re: 43sec commit duration - blocked by index merge events?

2015-02-13 Thread Gili Nachum
Thanks Otis, can you confirm that a commit call will wait for merges to complete before returning? On Thu, Feb 12, 2015 at 8:46 PM, Otis Gospodnetic < otis.gospodne...@gmail.com> wrote: > If you are using Solr and SPM for Solr, you can check a report that shows > the # of files in an index and th

Solr - Mahout

2015-02-13 Thread mohamed . sahad
Sir , I need to know solr have bulletin recommendation (collaborative filtering) is there or their is it possible to add recommender with out using Mahout. i kindly request give a fast replay Your Mohamed Sahad K P

Re: Stopwords in shingles suggester

2015-02-13 Thread O. Klein
I found the issue in Jira https://issues.apache.org/jira/browse/SOLR-6468 O. Klein wrote > With more and more people starting to use the Suggester it seems that > enablePositionIncrements for StopFilterFactory is still needed. > > Not sure why it is being removed from Solr5, but is there a way t

Re: alternativeTermCount and WordBreakSolrSpellChecker combination not working

2015-02-13 Thread O. Klein
I am using the default on single node, which is frequency. On the Wiki it says: In case of a distributed request to the SpellCheckComponent, the shards are requested for at least five suggestions even if the spellcheck.count parameter value is less than five. Once the suggestions are collected, th

RE: variaton on boosting recent documents gives exception

2015-02-13 Thread Gonzalo Rodriguez
Hello Michael, You can always change the type of your sortyear field to an int, or create an int version of it and use copyField to populate it. And using NOW/YEAR will round the current date to the start of the year, you can read more about this in the Javadoc: http://lucene.apache.org/solr/4

Re: alternativeTermCount and WordBreakSolrSpellChecker combination not working

2015-02-13 Thread Nitin Solanki
Hi O. Klein, How you sorted the suggestion on frequency? I think, You used freq to sort suggestions of frequency. Are you using sharding/multiple servers in Solr because on single node, comparatorClass is working but on multiple servers, it is not working. Please assist me how to

RE: alternativeTermCount and WordBreakSolrSpellChecker combination not working

2015-02-13 Thread iNikkz
Hi O. Klein, How you sorted the suggestion on frequency? I think, You used freq to sort suggestions of frequency. Are you using sharding/multiple servers in Solr because on single node, comparatorClass is working but on multiple servers, it is not working. Please assist me how t