Re: Document boost in Solr

2015-11-15 Thread Andrea Open Source
Hi Aditya,
Looking at the explanation seems that you have a 50.0 boost applied on your 
PRODUCT_TITLE field, 1.5 applied to your PRODUCT_CONTENT field and then you 
have a phrase query with slop 10 and boost 50 on title and boost 1.5 on 
content. In your question you talk about using "rank" as document boost but 
from this query is not clear as I am not sure what those 1.5 and 50.0 come from.

King Regards,
Andrea Roggerone

> On 15/nov/2015, at 06:21, Aditya  wrote:
> 
> Hi
> 
> I am able to analyse the score using http://explain.solr.pl/
> 
> Score of 1st record:
>100% 27.12627 sum of the following:
>33.47% 9.078974 sum of the following:
>19.34% 5.2460585 (MATCH) max of:
>19.34% 5.2460585 PRODUCT_TITLE:machin^50.0
>- 0.37926888 PRODUCT_CONTENT:machin^1.5
>14.13% 3.8329153 (MATCH) max of:
>14.13% 3.8329153 PRODUCT_TITLE:learn^50.0
>- 0.28544438 PRODUCT_CONTENT:learn^1.5
>66.53% 18.047297 (MATCH) max of:
>66.53% 18.047297 PRODUCT_TITLE:"machin learn"~10^50.0
>- 1.3227714 PRODUCT_CONTENT:"machin learn"~10^1.5
> Score of 14th record. This supposed to come in less than 10.
> 100% 14.135922 sum of the following:
>35.52% 5.0206614 sum of the following:
>18.74% 2.6496599 (MATCH) max of:
>18.74% 2.6496599 PRODUCT_TITLE:machin^50.0
>- 0.22348635 PRODUCT_CONTENT:machin^1.5
>16.77% 2.3710015 (MATCH) max of:
>16.77% 2.3710015 PRODUCT_TITLE:learn^50.0
>- 0.18167646 PRODUCT_CONTENT:learn^1.5
>64.48% 9.115261 (MATCH) max of:
>64.48% 9.115261 PRODUCT_TITLE:"machin learn"~10^50.0
>- 0.7794506 PRODUCT_CONTENT:"machin learn"~10^1.5
> 
> How can I analyse whether the document boost is applied or not.
> 
> Regards
> Aditya
> 
> 
> On Sat, Nov 14, 2015 at 8:49 PM, Aditya 
> wrote:
> 
>> I am not able to understand the debug information.
>> 
>> Any specific parameter to look for?
>> 
>> Regards
>> Aditya
>> 
>> On Sat, Nov 14, 2015 at 6:42 PM, Alexandre Rafalovitch >> wrote:
>> 
>>> Did you try using debug.explain.other and seeing how it is ranked?
 On 14 Nov 2015 6:28 am, "Aditya"  wrote:
 
 Hi
 
 My website www.findbestopensource.com provides search over millions of
 open
 source projects.
 
 I recently found this issue in my website. Each project will have its
 description and rank and other set of fields. Rank is set as document
 boost, so that when user performs a search, high ranked projects should
 appear first.
 
 It was working fine with previous versions of Solr. Some time back I
>>> moved
 to 4.10 and after that I am facing this issue. I added a high ranked
 project and when I did a search the project is not showing up in the
>>> search
 results. It is showing the results which were added in older versions of
 Solr.
 
 I am using Solr 4.10  and using Solrj library.
 
 Regards
 Aditya
>> 
>> 


Re: Replication as backup in SolrCloud

2015-11-15 Thread KNitin
We built and open sourced haft precisely for such use cases.
https://github.com/bloomreach/solrcloud-haft

 You can clone an entire
cluster or selective collections between clusters. It has only been tested
upto solr 4.10.

Let me know if you run into issues
Nitin

On Monday, June 22, 2015, Erick Erickson  wrote:

> Currently, one is best off treating these as two separate clusters and
> having your client send the data to both, or reproducing your
> system-of-record and running your DCs completely separately.
>
> Hopefully soon, though, there'll be what you're asking for
> active/passive DCs, see:
> https://issues.apache.org/jira/browse/SOLR-6273
>
> Best,
> Erick
>
> On Mon, Jun 22, 2015 at 10:16 AM, StrW_dev  > wrote:
> > Hi,
> >
> > I have a SolrCloud cluster in one data center, but as backup I want to
> have
> > a second (replicated) cluster in another data center.
> >
> > What I want is to replicate to this second cluster, but I don't want my
> > queries to go to this cluster. Is this possible within SolrCloud? As now
> it
> > seems to replicate, but also distribute the query request to this
> replicated
> > server.
> >
> > Gr
> >
> >
> >
> > --
> > View this message in context:
> http://lucene.472066.n3.nabble.com/Replication-as-backup-in-SolrCloud-tp4213267.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: Replication as backup in SolrCloud

2015-11-15 Thread Arcadius Ahouansou
Hello Gr.

We are in a similar situation to yours... and we are using
https://issues.apache.org/jira/browse/SOLR-8146

It is a small patch for the SolrJ client that can send all of your queries
to your main DC unless all nodes in the main DC are down.
Write/updates/delete and admin operations remain unchanged.

All you need is to come up with a regex describing the SolrCloud nodes in
your main DC and pass the regex to all of your SolrJ clients.

Hope this helps.


Arcadius.


On 15 November 2015 at 14:56, KNitin  wrote:

> We built and open sourced haft precisely for such use cases.
> https://github.com/bloomreach/solrcloud-haft
>
>  You can clone an entire
> cluster or selective collections between clusters. It has only been tested
> upto solr 4.10.
>
> Let me know if you run into issues
> Nitin
>
> On Monday, June 22, 2015, Erick Erickson  wrote:
>
> > Currently, one is best off treating these as two separate clusters and
> > having your client send the data to both, or reproducing your
> > system-of-record and running your DCs completely separately.
> >
> > Hopefully soon, though, there'll be what you're asking for
> > active/passive DCs, see:
> > https://issues.apache.org/jira/browse/SOLR-6273
> >
> > Best,
> > Erick
> >
> > On Mon, Jun 22, 2015 at 10:16 AM, StrW_dev  > > wrote:
> > > Hi,
> > >
> > > I have a SolrCloud cluster in one data center, but as backup I want to
> > have
> > > a second (replicated) cluster in another data center.
> > >
> > > What I want is to replicate to this second cluster, but I don't want my
> > > queries to go to this cluster. Is this possible within SolrCloud? As
> now
> > it
> > > seems to replicate, but also distribute the query request to this
> > replicated
> > > server.
> > >
> > > Gr
> > >
> > >
> > >
> > > --
> > > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/Replication-as-backup-in-SolrCloud-tp4213267.html
> > > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>



-- 
Arcadius Ahouansou
Menelic Ltd | Information is Power
M: 07908761999
W: www.menelic.com
---


StringIndexOutOfBoundsException using spellcheck and synonyms

2015-11-15 Thread Derek Poh

Hi
Iam using spellcheck and synonyms.I am getting 
"java.lang.StringIndexOutOfBoundsException: String index out of range: 
-1" for some keywords.


I think I managed to narrow down to the likely caused of it.
I have thisline of entry in the synonyms.txt file,

body spray,cologne,parfum,parfume,perfume,purfume,toilette

When I search for 'cologne' it will hit the exception.
If I removed the'body spray' from the line, I will not hit the exception.

cologne,parfum,parfume,perfume,purfume,toilette

It seems like it could be due to multi terms in the synonyms files but 
there are some keywords with multi terms in synonyms that does not has 
the issue.
This line has a multi term "paint ball" in it, when I search for 
paintball or paintballs it does not hit the exception.


paintball,paintballs,paint ball


Any advice how can I resolve this issue?


The field use for spellcheck:


multiValued="true"/>


positionIncrementGap="100">

  

words="stopwords.txt" />



  
  

words="stopwords.txt" />
synonyms="synonyms.txt" ignoreCase="true" expand="true"/>


  



Exception stacktrace:
2015-11-16T07:06:43,055 - ERROR [qtp744979286-193443:SolrException@142] 
- null:java.lang.StringIndexOutOfBoundsException: String index out of 
range: -1
at 
java.lang.AbstractStringBuilder.replace(AbstractStringBuilder.java:789)

at java.lang.StringBuilder.replace(StringBuilder.java:266)
at 
org.apache.solr.spelling.SpellCheckCollator.getCollation(SpellCheckCollator.java:235)
at 
org.apache.solr.spelling.SpellCheckCollator.collate(SpellCheckCollator.java:92)
at 
org.apache.solr.handler.component.SpellCheckComponent.addCollationsToResponse(SpellCheckComponent.java:230)
at 
org.apache.solr.handler.component.SpellCheckComponent.process(SpellCheckComponent.java:197)
at 
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:218)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)

at org.apache.solr.core.SolrCore.execute(SolrCore.java:1976)
at 
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)

at org.eclipse.jetty.server.Server.handle(Server.java:497)
at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)

at java.lang.Thread.run(Thread.java:722)

Derek

--
CONFIDENTIALITY NOTICE 

This e-mail (including any attachments) may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error, please inform the sender immediately and delete this e-mail (including any attachments) from your computer, and you must not use, disclose to anyone else or copy this e-mail (including any attachments), whether in whole or in part. 


This e-mail and any reply to it may be monitored for security, legal, 
regulatory compliance and/or other appropriate reasons.

Unable to start solr-5.3.1 properly

2015-11-15 Thread Subh Prakash Singh

Hi,

I am unable to start solr with following java and CentOS version

Apache Solr:
solr-5.3.1.tgz


Java Version:
java version "1.8.0_65"
Java(TM) SE Runtime Environment (build 1.8.0_65-b17)
Java HotSpot(TM) 64-Bit Server VM (build 25.65-b01, mixed mode)


CentOS Version:
CentOS release 5.8 (Final)
Linux solrserver 2.6.18-308.el5 #1 SMP Tue Feb 21 20:06:06 EST 2012 
x86_64 x86_64 x86_64 GNU/Linux



Error on start (bin/solr start):
Waiting up to 30 seconds to see Solr running on port 8983lsof: 
unsupported TCP/TPI info selection: C

lsof: unsupported TCP/TPI info selection: P
lsof: unsupported TCP/TPI info selection: :
lsof: unsupported TCP/TPI info selection: L
lsof: unsupported TCP/TPI info selection: I
lsof: unsupported TCP/TPI info selection: S
lsof: unsupported TCP/TPI info selection: T
lsof: unsupported TCP/TPI info selection: E
lsof: unsupported TCP/TPI info selection: N
lsof 4.78
 latest revision: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/
 latest FAQ: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/FAQ
 latest man page: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/lsof_man
 usage: [-?abhlnNoOPRstUvVX] [+|-c c] [+|-d s] [+D D] [+|-f[gG]] [+|-e s]
 [-F [f]] [-g [s]] [-i [i]] [+|-L [l]] [+m [m]] [+|-M] [-o [o]]
 [-p s] [+|-r [t]] [-S [t]] [-T [t]] [-u s] [+|-w] [-x [fl]] [-Z [Z]] 
[--] [names]

Use the ``-h'' option to get more help information.
lsof: unsupported TCP/TPI info selection: C
lsof: unsupported TCP/TPI info selection: P
lsof: unsupported TCP/TPI info selection: :
lsof: unsupported TCP/TPI info selection: L
lsof: unsupported TCP/TPI info selection: I
lsof: unsupported TCP/TPI info selection: S
lsof: unsupported TCP/TPI info selection: T
lsof: unsupported TCP/TPI info selection: E
lsof: unsupported TCP/TPI info selection: N
lsof 4.78
 latest revision: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/
 latest FAQ: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/FAQ
 latest man page: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/lsof_man
 usage: [-?abhlnNoOPRstUvVX] [+|-c c] [+|-d s] [+D D] [+|-f[gG]] [+|-e s]
 [-F [f]] [-g [s]] [-i [i]] [+|-L [l]] [+m [m]] [+|-M] [-o [o]]
 [-p s] [+|-r [t]] [-S [t]] [-T [t]] [-u s] [+|-w] [-x [fl]] [-Z [Z]] 
[--] [names]

Use the ``-h'' option to get more help information.
 [\]  lsof: unsupported TCP/TPI info selection: C
lsof: unsupported TCP/TPI info selection: P
lsof: unsupported TCP/TPI info selection: :
lsof: unsupported TCP/TPI info selection: L
lsof: unsupported TCP/TPI info selection: I
lsof: unsupported TCP/TPI info selection: S
lsof: unsupported TCP/TPI info selection: T
lsof: unsupported TCP/TPI info selection: E
lsof: unsupported TCP/TPI info selection: N
lsof 4.78
 latest revision: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/
 latest FAQ: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/FAQ
 latest man page: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/lsof_man
 usage: [-?abhlnNoOPRstUvVX] [+|-c c] [+|-d s] [+D D] [+|-f[gG]] [+|-e s]
 [-F [f]] [-g [s]] [-i [i]] [+|-L [l]] [+m [m]] [+|-M] [-o [o]]
 [-p s] [+|-r [t]] [-S [t]] [-T [t]] [-u s] [+|-w] [-x [fl]] [-Z [Z]] 
[--] [names]

Use the ``-h'' option to get more help information.
 [\]  lsof: unsupported TCP/TPI info selection: C
lsof: unsupported TCP/TPI info selection: P
lsof: unsupported TCP/TPI info selection: :
lsof: unsupported TCP/TPI info selection: L
lsof: unsupported TCP/TPI info selection: I
lsof: unsupported TCP/TPI info selection: S
lsof: unsupported TCP/TPI info selection: T
lsof: unsupported TCP/TPI info selection: E
lsof: unsupported TCP/TPI info selection: N
lsof 4.78
 latest revision: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/
 latest FAQ: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/FAQ
 latest man page: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/lsof_man
 usage: [-?abhlnNoOPRstUvVX] [+|-c c] [+|-d s] [+D D] [+|-f[gG]] [+|-e s]
 [-F [f]] [-g [s]] [-i [i]] [+|-L [l]] [+m [m]] [+|-M] [-o [o]]
 [-p s] [+|-r [t]] [-S [t]] [-T [t]] [-u s] [+|-w] [-x [fl]] [-Z [Z]] 
[--] [names]

Use the ``-h'' option to get more help information.
 [\]  lsof: unsupported TCP/TPI info selection: C
lsof: unsupported TCP/TPI info selection: P
lsof: unsupported TCP/TPI info selection: :
lsof: unsupported TCP/TPI info selection: L
lsof: unsupported TCP/TPI info selection: I
lsof: unsupported TCP/TPI info selection: S
lsof: unsupported TCP/TPI info selection: T
lsof: unsupported TCP/TPI info selection: E
lsof: unsupported TCP/TPI info selection: N
lsof 4.78
 latest revision: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/
 latest FAQ: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/FAQ
 latest man page: ftp://lsof.itap.purdue.edu/pub/tools/unix/lsof/lsof_man
 usage: [-?abhlnNoOPRstUvVX] [+|-c c] [+|-d s] [+D D] [+|-f[gG]] [+|-e s]
 [-F [f]] [-g [s]] [-i [i]] [+|-L [l]] [+m [m]] [+|-M] [-o [o]]
 [-p s] [+|-r [t]] [-S [t]] [-T [t]] [-u s] [+|-w] [-x [fl]] [-Z [Z]] 
[--] [names]

Use the ``-h'' option to get more help information.
 [\]  lsof: unsupported TCP/TPI info selection: C
lsof: 

Solr Cloud 5.3.0 Errors in Logs

2015-11-15 Thread Adrian Liew
Hi there,

Will like to get some opinions on the errors encountered below. I have 
currently setup a SolrCloud cluster of 3 servers (each server hosting a Solr 
instance and a Zookeeper instance).

I am encountering the errors below in the logs:
Monday, November 16, 2015 3:22:54 PM ERROR null SolrCore 
org.apache.solr.common.SolrException: Error opening new searcher. exceeded 
limit of maxWarmingSearchers=6,​ try again later.
Monday, November 16, 2015 3:22:54 PM ERROR null SolrCore 
org.apache.solr.common.SolrException: Error opening new searcher. exceeded 
limit of maxWarmingSearchers=6,​ try again later.
Monday, November 16, 2015 3:22:54 PM ERROR null SolrCore 
org.apache.solr.common.SolrException: Error opening new searcher. exceeded 
limit of maxWarmingSearchers=6,​ try again later.
Monday, November 16, 2015 3:22:54 PM ERROR null SolrCore 
org.apache.solr.common.SolrException: Error opening new searcher. exceeded 
limit of maxWarmingSearchers=6,​ try again later.
Monday, November 16, 2015 3:22:54 PM ERROR null SolrCmdDistributor 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at 
http://172.18.111.112:8983/solr/sitecore_master_index_shard1_replica1: Error 
opening new searcher. exceeded limit of maxWarmingSearchers=6,​ try again later.
Monday, November 16, 2015 3:22:54 PM ERROR null SolrCmdDistributor 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at 
http://172.18.111.112:8983/solr/sitecore_master_index_shard1_replica1: Error 
opening new searcher. exceeded limit of maxWarmingSearchers=6,​ try again later.
Monday, November 16, 2015 3:22:54 PM WARN null DistributedUpdateProcessor Error 
sending update to http://172.18.111.112:8983/solr
Monday, November 16, 2015 3:22:54 PM WARN null DistributedUpdateProcessor Error 
sending update to http://172.18.111.112:8983/solr
Monday, November 16, 2015 3:22:54 PM WARN null DistributedUpdateProcessor Error 
sending update to http://172.18.111.112:8983/solr
Monday, November 16, 2015 3:22:54 PM WARN null DistributedUpdateProcessor Error 
sending update to http://172.18.111.112:8983/solr

11/16/2015, 3:17:09 PM

WARN

null

DistributedUpdateProcessor

Error sending update to http://172.18.111.112:8983/solr

11/16/2015, 3:17:09 PM

WARN

null

DistributedUpdateProcessor

Error sending update to http://172.18.111.112:8983/solr

11/16/2015, 3:22:26 PM

ERROR

null

SolrCmdDistributor

org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: 
http://172.18.111.112:8983/solr/sitecore_master_index_shard1_replica1



Main errors are Timeout occurred exceptions, maxWarmingSearchers exceeded. Is 
anyone able to advise or have experienced something the same as the above in 
their SolrCloud setup?

Regards,
Adrian