Docker and Solr Indexing

[solrnoobie]

So we have a dockerized aws environment with the solr docker container having
only 4 gigs for max ram.

Our problem is whenever we index, the container containing the leader shard
will restart after around 2 or less minutes of index time (batch is 50 docs
per batch with 3 threads in our app thread pool). Because of the container
restart, indexing will fail because solrJ will throw an invalid content type
exception because of the quick container restart.

What can possible casue the issues above?



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Potential bug? maxConnectionsPerHost on requestHandler configuration

[Ash Ramesh]

Hi,

I tried setting up a bespoke ShardHandlerFactory configuration for each
request handler in solrconfig.xml. However when I stepped through the code
in debug mode (via IntelliJ) I could see that the ShardHandler created and
used in the searcher still didn't reflect the values in solrconfig (even
after a core RELOAD).

I did find that it did reflect changes to the ShardHandlerFactory in
solr.xml when I changed it, pushed to ZK and restarted Solr.

Is this expected or am I going about this the wrong way.

Example RequestHandler syntax:




6
1000
99



We are trying to understand why our machines have their CPUs stalling at
60-80% all the time. We suspect it's because of the maxConnections, but ran
into this issue first.

Best Regards,

Ash

-- 
*P.S. We've launched a new blog to share the latest ideas and case studies 
from our team. Check it out here: product.canva.com 
. ***
** Empowering the world 
to design
Also, we're hiring. Apply here! 

  
  

Re: group.limit>1 and sorting is not working as expected

[Venkateswarlu Bommineni]

Hello Erik,

Sorry for the confustion . here is the scenario.

We have 2 fields rank,price for each product. multiple products may have
same rank but different prices.

So on products listing page, by default we will group on rank and show 3
products for each group and sort based on Rank.

But Customers can sort on price too. If they do sorting on price then
sorting is happening inside group instead of all the records.

But the requirement is to sort on all the results we show to the customer.


 Query for grouping :
https://localhost/solr/master_shaneco_Product_flip/select?indent=on&q=rank:[1%20TO%20*]&wt=json&group=true&group.limit=3&group.main=true&group.field=rank&rows=50&sort=rank+desc

 Query when customer click on sort by price:

https://localhost/solr/master_shaneco_Product_flip/select?indent=on&q=rank:[1%20TO%20*]&wt=json&group=true&group.limit=3&group.main=true&group.field=rank&rows=50&sort=price+desc


Thanks,
Venkat.

On Mon, Sep 10, 2018 at 5:34 PM Erick Erickson 
wrote:

> bq. I just wanted to know if there is any attribute which says sort on all
> the
> document list instead of relative to group results.
>
> I really don't know what you want here. "sort on all the document list"
> seems
> like just sorting without grouping.
>
> From that problem statement I don't see what grouping has to do with
> anything.
>
> Perhaps if you gave a concrete example of documents and the return you
> expect we could understand your use-case better.
>
> Best,
> Erick
> On Mon, Sep 10, 2018 at 3:03 PM Venkateswarlu Bommineni
>  wrote:
> >
> > Thanks for the reply Shawn.
> >
> > I have tried multiple combination of group.sort and sort but non of them
> > worked.
> >
> > I just wanted to know if there is any attribute which says sort on all
> the
> > document list instead of relative to group results.
> >
> > Can you please help if you have any idea or work around ?
> >
> > Thanks,
> > Venakt.
> >
> > On Sat, Sep 8, 2018 at 8:40 PM Shawn Heisey  wrote:
> >
> > > On 9/8/2018 8:34 PM, Venkateswarlu Bommineni wrote:
> > > > Query ;
> > > > https://
> > >
> /solr/default/select?fq=rank_int:[1%20TO%20*]&indent=on&wt=json&group=true&group.main=true&group.field=
> > > >
> > >
> rank_int&group.limit=3&q=*&fl=code_string,sapRank_int,price&sort=price+desc
> > > >
> > > > I am grouping on field *rank_int with group limit>3 and doing the
> sorting
> > > > on price. sorting is happening inside the group not on whole
> records.*
> > >
> > > You need to find the right combination of sort and group.sort
> parameters.
> > >
> > >
> > >
> https://lucene.apache.org/solr/guide/6_6/result-grouping.html#ResultGrouping-RequestParameters
> > >
> > > Thanks,
> > > Shawn
> > >
> > >
>

Re: local "q.op=AND" ignored for edismax query

[dshih]

Thanks Shawn!

Based on what you said, is my query supposed to work as is if I set
luceneMatchVersion=7.1.0?  It does not appear to.

Also, my understanding is using the local param makes the AND apply only to
the following search terms provided to the "q" query string.  If I add a
q.op=AND as a separate URL parameter, wouldn't that operator also apply for
everything else in the query operation?



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: group.limit>1 and sorting is not working as expected

[Erick Erickson]

bq. I just wanted to know if there is any attribute which says sort on all the
document list instead of relative to group results.

I really don't know what you want here. "sort on all the document list" seems
like just sorting without grouping.

>From that problem statement I don't see what grouping has to do with anything.

Perhaps if you gave a concrete example of documents and the return you
expect we could understand your use-case better.

Best,
Erick
On Mon, Sep 10, 2018 at 3:03 PM Venkateswarlu Bommineni
 wrote:
>
> Thanks for the reply Shawn.
>
> I have tried multiple combination of group.sort and sort but non of them
> worked.
>
> I just wanted to know if there is any attribute which says sort on all the
> document list instead of relative to group results.
>
> Can you please help if you have any idea or work around ?
>
> Thanks,
> Venakt.
>
> On Sat, Sep 8, 2018 at 8:40 PM Shawn Heisey  wrote:
>
> > On 9/8/2018 8:34 PM, Venkateswarlu Bommineni wrote:
> > > Query ;
> > > https://
> > /solr/default/select?fq=rank_int:[1%20TO%20*]&indent=on&wt=json&group=true&group.main=true&group.field=
> > >
> > rank_int&group.limit=3&q=*&fl=code_string,sapRank_int,price&sort=price+desc
> > >
> > > I am grouping on field *rank_int with group limit>3 and doing the sorting
> > > on price. sorting is happening inside the group not on whole records.*
> >
> > You need to find the right combination of sort and group.sort parameters.
> >
> >
> > https://lucene.apache.org/solr/guide/6_6/result-grouping.html#ResultGrouping-RequestParameters
> >
> > Thanks,
> > Shawn
> >
> >

Re: group.limit>1 and sorting is not working as expected

[Venkateswarlu Bommineni]

Thanks for the reply Shawn.

I have tried multiple combination of group.sort and sort but non of them
worked.

I just wanted to know if there is any attribute which says sort on all the
document list instead of relative to group results.

Can you please help if you have any idea or work around ?

Thanks,
Venakt.

On Sat, Sep 8, 2018 at 8:40 PM Shawn Heisey  wrote:

> On 9/8/2018 8:34 PM, Venkateswarlu Bommineni wrote:
> > Query ;
> > https://
> /solr/default/select?fq=rank_int:[1%20TO%20*]&indent=on&wt=json&group=true&group.main=true&group.field=
> >
> rank_int&group.limit=3&q=*&fl=code_string,sapRank_int,price&sort=price+desc
> >
> > I am grouping on field *rank_int with group limit>3 and doing the sorting
> > on price. sorting is happening inside the group not on whole records.*
>
> You need to find the right combination of sort and group.sort parameters.
>
>
> https://lucene.apache.org/solr/guide/6_6/result-grouping.html#ResultGrouping-RequestParameters
>
> Thanks,
> Shawn
>
>

Re: Unable to enable SSL with self-sign certs

[cyndefromva]

TRUS_STORE is a typo (I used what was already there, I just uncommented it). 
I'm on a different network so I have to type everything by hand. I was
hoping I put enough already , but ugh... probably more typos to come. Here
it is:

2018-09-10 19:17:15.311 WARN: (main) [   ] o.e.j.u.c.AbstractLifeCycle
FAILED
SslContextFactory@...(/opt/solr-5.4.1/server/etc/solr-ssl.keystore.jks,) :
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at
org.eclipse.jetty.util.resource.FileResource.getInputStream(FileResource.java:290)
at
org.eclipse.jetty.util.security.CertificateUtils.getKeyStore(CertificateUtils.java:43)
at
org.eclipse.jetty.util.ssl.SslContextFactory.loadTrustStore(SslContextFactory.java:884)
at
org.eclipse.jetty.util.ssl.SslContextFactory.doStart(SslContextFactory.java:274)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at
org.eclipse.jetty.server.SslConnectionFactory.doStart(SslConnectionFactory.java:64)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at
org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:256)
at
org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractConnector.java:81)
at
org.eclipse.jetty.server.ServerConnector.doStart(AbstractConnector.java:236)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:366)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.jetty.xml.XmlConfiguration$1.run(XmlConfiguration.java:1255)
at java.security.AccesController.doPrivileged(Native Method)
at
org.eclipse.jetty.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1174)
at sun.reflect.NativeMethodAccessImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessImpl.invoke(NativeMethodAccessImpl.java:62)
at
sun.reflect.DelegatingMethodAccessImpl.invoke(DelegatingMethodAccessImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.jetty.start.Main.invokeMain(Main.java:321)
at org.eclipse.jetty.start.Main.start(Main.java:817)
at org.eclipse.jetty.start.Main.main(Main.java:112)
2018-09-10 19:17:15.323 WARN: (main) [   ] o.e.j.u.c.AbstractLifeCycle
FAILED
SslConnectionFactory@...{SSL-http/1.1}: java.io.FileNotFoundException:
/opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at
org.eclipse.jetty.util.resource.FileResource.getInputStream(FileResource.java:290)
at
org.eclipse.jetty.util.security.CertificateUtils.getKeyStore(CertificateUtils.java:43)
at
org.eclipse.jetty.util.ssl.SslContextFactory.loadTrustStore(SslContextFactory.java:884)
at
org.eclipse.jetty.util.ssl.SslContextFactory.doStart(SslContextFactory.java:274)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at
org.eclipse.jetty.server.SslConnectionFactory.doStart(SslConnectionFactory.java:64)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at
org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:256)
at
org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractConnector.java:81)
at
org.eclipse.jetty.server.ServerConnector.doStart(AbstractConnector.java:236)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:366)
 

Re: Date Query Using Local Params

[Antelmo Aguilar]

Hi Erik,

Thank you! I did mess with the v parameter, but I was doing it wrong.  I
was doing this v='([2013-07-08 TO 2013-07-09] OR [2013-07-21 TO
2013-07-25])'

Anyways, I needed to use the "fq" parameter and I did this fq=({!field
f=collection_date_range op=Within v='[2013-07-08 TO 2013-07-09]'} OR
{!field f=collection_date_range op=Within v='[2017-01-10 TO 2018-06-17]'})
and it worked like I would expect.

Thank you for all your help!

Best,
Antelmo

On Mon, Sep 10, 2018 at 4:18 PM, Erik Hatcher 
wrote:

> When using the {!...} syntax, and combining it with other clauses, the
> expression parsed needs to come from a local-param `v` parameter
> (otherwise, without `v`, the parser eats the rest of the string after the
> closing curly bracket).  So you could do something like this:
>
>
> q={!field f=collection_date_range op=Within v='[2013-07-08 TO
> 2013-07-09]'} OR {!field
> f=collection_date_range op=Within v='[2013-07-21 TO 2013-07-25]'}
>
> Or you could do this sort of thing, which allows the date ranges to be
> parameterized:
>
> q={!field f=collection_date_range op=Within v=$range1} OR {!field
> f=collection_date_range op=Within v=$range2}
>  &range1=[2013-07-08 TO 2013-07-09]
>  &range2=[2013-07-21 TO 2013-07-25]
>
> Erik
>
>
>
>
>
> > On Sep 10, 2018, at 3:59 PM, Antelmo Aguilar  wrote:
> >
> > Hi Shawn,
> >
> > Thank you.  So just to confirm, there is no way for me to use an OR
> > operator with also using the "within" op parameter described in the
> bottom
> > of this page?
> >
> > https://lucene.apache.org/solr/guide/6_6/working-with-
> dates.html#WorkingwithDates-MoreDateRangeFieldDetails
> >
> > I appreciate your resposne.
> >
> > Best,
> > Antelmo
> >
> > On Mon, Sep 10, 2018 at 3:51 PM, Shawn Heisey 
> wrote:
> >
> >> On 9/10/2018 1:21 PM, Antelmo Aguilar wrote:
> >>
> >>> Hi,
> >>>
> >>> I have a question.  I am trying to use the "within" op parameter in a
> Date
> >>> Search.  This works like I would expect: {!field
> f=collection_date_range
> >>> op=Within}[2013-07-08 TO 2013-07-09]
> >>>
> >>> I would like to use an OR with the query though, something like this:
> >>> {!field
> >>> f=collection_date_range op=Within}[2013-07-08 TO 2013-07-09] OR {!field
> >>> f=collection_date_range op=Within}[2013-07-21 TO 2013-07-25]
> >>>
> >>> However, I tried different approaches and none of them worked.  Is
> there a
> >>> way of doing something like this for querying dates using the "within"
> op
> >>> parameter?
> >>>
> >>
> >> I don't think the field parser can do this.  Also, usually it's not
> >> possible to use localparams in a second query clause like that --
> >> localparams must almost always be the very first thing in the "q"
> >> parameter, or they will not be interpreted as localparams.  Use the
> >> standard (lucene) parser without localparams.  The q parameter should
> look
> >> like this:
> >>
> >> collection_date_range:[2013-07-08 TO 2013-07-09] OR
> >> collection_date_range:[2013-07-21 TO 2013-07-25]
> >>
> >> If the default operator hasn't been changed (which would mean it is
> using
> >> OR), then you could remove the "OR" from that.
> >>
> >> Thanks,
> >> Shawn
> >>
> >>
>
>

Re: Date Query Using Local Params

[Erik Hatcher]

When using the {!...} syntax, and combining it with other clauses, the 
expression parsed needs to come from a local-param `v` parameter (otherwise, 
without `v`, the parser eats the rest of the string after the closing curly 
bracket).  So you could do something like this:


q={!field f=collection_date_range op=Within v='[2013-07-08 TO 2013-07-09]'} 
OR {!field
f=collection_date_range op=Within v='[2013-07-21 TO 2013-07-25]'}

Or you could do this sort of thing, which allows the date ranges to be 
parameterized:

q={!field f=collection_date_range op=Within v=$range1} OR {!field
f=collection_date_range op=Within v=$range2}
 &range1=[2013-07-08 TO 2013-07-09]
 &range2=[2013-07-21 TO 2013-07-25]

Erik





> On Sep 10, 2018, at 3:59 PM, Antelmo Aguilar  wrote:
> 
> Hi Shawn,
> 
> Thank you.  So just to confirm, there is no way for me to use an OR
> operator with also using the "within" op parameter described in the bottom
> of this page?
> 
> https://lucene.apache.org/solr/guide/6_6/working-with-dates.html#WorkingwithDates-MoreDateRangeFieldDetails
> 
> I appreciate your resposne.
> 
> Best,
> Antelmo
> 
> On Mon, Sep 10, 2018 at 3:51 PM, Shawn Heisey  wrote:
> 
>> On 9/10/2018 1:21 PM, Antelmo Aguilar wrote:
>> 
>>> Hi,
>>> 
>>> I have a question.  I am trying to use the "within" op parameter in a Date
>>> Search.  This works like I would expect: {!field f=collection_date_range
>>> op=Within}[2013-07-08 TO 2013-07-09]
>>> 
>>> I would like to use an OR with the query though, something like this:
>>> {!field
>>> f=collection_date_range op=Within}[2013-07-08 TO 2013-07-09] OR {!field
>>> f=collection_date_range op=Within}[2013-07-21 TO 2013-07-25]
>>> 
>>> However, I tried different approaches and none of them worked.  Is there a
>>> way of doing something like this for querying dates using the "within" op
>>> parameter?
>>> 
>> 
>> I don't think the field parser can do this.  Also, usually it's not
>> possible to use localparams in a second query clause like that --
>> localparams must almost always be the very first thing in the "q"
>> parameter, or they will not be interpreted as localparams.  Use the
>> standard (lucene) parser without localparams.  The q parameter should look
>> like this:
>> 
>> collection_date_range:[2013-07-08 TO 2013-07-09] OR
>> collection_date_range:[2013-07-21 TO 2013-07-25]
>> 
>> If the default operator hasn't been changed (which would mean it is using
>> OR), then you could remove the "OR" from that.
>> 
>> Thanks,
>> Shawn
>> 
>> 

Re: Date Query Using Local Params

[Antelmo Aguilar]

Hi Shawn,

Thank you.  So just to confirm, there is no way for me to use an OR
operator with also using the "within" op parameter described in the bottom
of this page?

https://lucene.apache.org/solr/guide/6_6/working-with-dates.html#WorkingwithDates-MoreDateRangeFieldDetails

I appreciate your resposne.

Best,
Antelmo

On Mon, Sep 10, 2018 at 3:51 PM, Shawn Heisey  wrote:

> On 9/10/2018 1:21 PM, Antelmo Aguilar wrote:
>
>> Hi,
>>
>> I have a question.  I am trying to use the "within" op parameter in a Date
>> Search.  This works like I would expect: {!field f=collection_date_range
>> op=Within}[2013-07-08 TO 2013-07-09]
>>
>> I would like to use an OR with the query though, something like this:
>> {!field
>> f=collection_date_range op=Within}[2013-07-08 TO 2013-07-09] OR {!field
>> f=collection_date_range op=Within}[2013-07-21 TO 2013-07-25]
>>
>> However, I tried different approaches and none of them worked.  Is there a
>> way of doing something like this for querying dates using the "within" op
>> parameter?
>>
>
> I don't think the field parser can do this.  Also, usually it's not
> possible to use localparams in a second query clause like that --
> localparams must almost always be the very first thing in the "q"
> parameter, or they will not be interpreted as localparams.  Use the
> standard (lucene) parser without localparams.  The q parameter should look
> like this:
>
> collection_date_range:[2013-07-08 TO 2013-07-09] OR
> collection_date_range:[2013-07-21 TO 2013-07-25]
>
> If the default operator hasn't been changed (which would mean it is using
> OR), then you could remove the "OR" from that.
>
> Thanks,
> Shawn
>
>

Re: Date Query Using Local Params

[Shawn Heisey]

On 9/10/2018 1:21 PM, Antelmo Aguilar wrote:

Hi,

I have a question.  I am trying to use the "within" op parameter in a Date
Search.  This works like I would expect: {!field f=collection_date_range
op=Within}[2013-07-08 TO 2013-07-09]

I would like to use an OR with the query though, something like this: {!field
f=collection_date_range op=Within}[2013-07-08 TO 2013-07-09] OR {!field
f=collection_date_range op=Within}[2013-07-21 TO 2013-07-25]

However, I tried different approaches and none of them worked.  Is there a
way of doing something like this for querying dates using the "within" op
parameter?


I don't think the field parser can do this.  Also, usually it's not 
possible to use localparams in a second query clause like that -- 
localparams must almost always be the very first thing in the "q" 
parameter, or they will not be interpreted as localparams.  Use the 
standard (lucene) parser without localparams.  The q parameter should 
look like this:


collection_date_range:[2013-07-08 TO 2013-07-09] OR 
collection_date_range:[2013-07-21 TO 2013-07-25]


If the default operator hasn't been changed (which would mean it is 
using OR), then you could remove the "OR" from that.


Thanks,
Shawn

Re: Unable to enable SSL with self-sign certs

[Shawn Heisey]

On 9/10/2018 12:47 PM, cyndefromva wrote:

I installed solr 5.4.1 and java 1.8 on its own linux server and used the
install_solr_service.sh file to install and setup solr. At this point I was
able to start the process and access the dashboard from a browser. After
shutting down solr I then attempted to enable SSL via the  Enabling SSL
   page using
self-signed certificates. But I am unable to start the process. Instead I
see the following in the solr.log file:

WARN: (main) AbstractLifeCycle FAILED
SslContextFactory@...(etc/solr-ssl.keystore.jks,) :
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
 at java.io.FileInputStream.open0(Native Method)
 at java.io.FileInputStream.open(FileInputStream.java:195)
 ...


You left out most of the error message.  The entire thing is MANY lines 
long and may have multiple "Caused by" sections each with their own 
stacktrace.


The settings you mentioned have "SOLR_SSL_TRUS_STORE" ... which is a 
typo -- missing the final T in TRUST.  Is this what's actually in the 
solr.in.sh file?


Except for that typo everything seems valid, so we will need the ENTIRE 
error from the logfile.  What you included above is also missing the 
timestamp that is found on all log entries in solr.log, which has me 
wondering why that is the case.


Thanks,
Shawn

Date Query Using Local Params

[Antelmo Aguilar]

Hi,

I have a question.  I am trying to use the "within" op parameter in a Date
Search.  This works like I would expect: {!field f=collection_date_range
op=Within}[2013-07-08 TO 2013-07-09]

I would like to use an OR with the query though, something like this: {!field
f=collection_date_range op=Within}[2013-07-08 TO 2013-07-09] OR {!field
f=collection_date_range op=Within}[2013-07-21 TO 2013-07-25]

However, I tried different approaches and none of them worked.  Is there a
way of doing something like this for querying dates using the "within" op
parameter?

Thanks,
Antelmo

Unable to enable SSL with self-sign certs

[cyndefromva]

I installed solr 5.4.1 and java 1.8 on its own linux server and used the
install_solr_service.sh file to install and setup solr. At this point I was
able to start the process and access the dashboard from a browser. After
shutting down solr I then attempted to enable SSL via the  Enabling SSL
   page using
self-signed certificates. But I am unable to start the process. Instead I
see the following in the solr.log file:

WARN: (main) AbstractLifeCycle FAILED
SslContextFactory@...(etc/solr-ssl.keystore.jks,) :
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195) 
...

WARN: (main) AbstractLifeCycle FAILED org.eclipse.jetty.server.Server@...
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195) 

The above jks is in the etc folder (/opt/solr-5.4.1/server/etc) and the
permissions are 644. The settings in the /etc/default/solr.in.sh file are as
follows:

SOLR_SSL_KEY_STORE=etc/solr-ssl.keystore.jks
SOLR_SSL_KEY_STORE_PASSWORD=...
SOLR_SSL_TRUS_STORE=etc/solr-ssl.keystore.jks
SOLR_SSL_TRUST_STORE_PASSWORD=...
SOLR_SSL_NEED_CLIENT_AUTH=false
SOLR_SSL_WANT_CLIENT_AUTH=false

I also tried the absolute path to the jks file
(/opt/solr-5.4.1/server/etc/solr-ssl.keystore.jks) and with and without
these two additional variables; to no avail:

SOLR_SSL_KEY_STORE_TYPE=JKS
SOLR_SSL_TRUST_STORE_TYPE=JKS


I then changed the permissions to the jks file to 666, with slightly
different but similar results:

WARN: (main) AbstractLifeCycle FAILED
SslContextFactory@...(/opt/solr-5.4.1/server/etc/solr-ssl.keystore.jks,) :
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195) 
...

WARN: (main) AbstractLifeCycle FAILED
SslConnectionFactory@...{SSL-http/1.1}: java.io.FileNotFoundException:
/opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195) 
...

WARN: (main) AbstractLifeCycle FAILED
ServerConnector@...{SSL-http/1.1}{0.0.0.0:8982}:
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195) 
...

WARN: (main) AbstractLifeCycle FAILED org.eclipse.jetty.server.Server@...
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
java.io.FileNotFoundException: /opt/solr-5.4.1/server (Is a directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195) 


Anybody have any clues what I might be missing?



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Silent error from DataImportHandler

[Erick Erickson]

You very often get _much_ more detail in the Solr log rather than the
admin UI BTW
On Mon, Sep 10, 2018 at 8:50 AM Monique Monteiro
 wrote:
>
> Hi Andrea,
>
> In fact, I had to add *logLevel="debug"* to the DIH configuration.  Just
> checking "Debug" on console is not enough.  I also checked "Verbose". Now,
> a database exception (locked account is shown).
>
> Thanks!
> Monique
>
>
> On Mon, Sep 10, 2018 at 12:26 PM Andrea Gazzarini 
> wrote:
>
> > I cannot give you detailed instructions as I don't have in front of me a
> > Solr console with the dataimport enabled, but I remember that there's a
> > detailed section which reports a lot of information.
> >
> > In the meantime: shooting in the dark, if the query is working and
> > "total rows fetched" = 0, then the query is not working for some reason:
> > can you check if some clause in your SQL include < or > ? They need to
> > be escaped (< >)
> >
> > Andrea
> >
> >
> > On 10/09/2018 17:22, Monique Monteiro wrote:
> > > This is shown in the section "Raw Debug-Response".
> > >
> > > On Mon, Sep 10, 2018 at 12:20 PM Andrea Gazzarini 
> > > wrote:
> > >
> > >> Hi Monique, this is the output; when you check the debug checkbox
> > >> another section is printed
> > >>
> > >> Andrea
> > >>
> > >> On 10/09/2018 17:19, Monique Monteiro wrote:
> > >>> Text:
> > >>>
> > >>> { "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [
> > >> "defaults",
> > >>> [ "config", "data-cnpj-config.xml" ] ], "command": "full-import",
> > "mode":
> > >>> "debug", "documents": [], "verbose-output": [], "status": "idle","
> > >>> importResponse": "", "statusMessages": { "Time Elapsed": "0:0:0.432",
> > >> "Total
> > >>> Requests made to DataSource": "1", "Total Rows Fetched": "0", "Total
> > >>> Documents Processed": "0", "Total Documents Skipped": "0", "Full Dump
> > >>> Started": "2018-09-10 12:04:03", "Full Import failed": "2018-09-10
> > >> 12:04:04"
> > >>> } }
> > >>>
> > >>> On Mon, Sep 10, 2018 at 12:08 PM Andrea Gazzarini <
> > a.gazzar...@sease.io>
> > >>> wrote:
> > >>>
> >  Hi Monique,
> >  I think you cannot attach files / images, please post, if available,
> > the
> >  url of the image or a text description.
> > 
> >  Andrea
> > 
> >  On 10/09/2018 17:05, Monique Monteiro wrote:
> > > Hi Andrea,
> > >
> > > Solr console doesn't return a very different information even with
> > > debug mode enabled:
> > >
> > > image.png
> > >
> > > On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini
> > > mailto:a.gazzar...@sease.io>> wrote:
> > >
> > >   You can check the solr.log or the solr-console.log. Another
> > option
> > >   is to
> > >   activate the debug mode in the Solr console before running the
> > >   data import.
> > >
> > >   Andrea
> > >
> > >   On 10/09/2018 16:57, Monique Monteiro wrote:
> > >   > Hi all,
> > >   >
> > >   > I have a data import handler configured with an Oracle SQL
> > query
> > >   which
> > >   > works like a charm.  However, when I have the same query
> > >   configured in
> > >   > Solr's data import handler, nothing happens, and it returns:
> > >   >
> > >   >
> > >   >
> > >   >  "*Total Requests made to DataSource*": "1",
> > >   >
> > >   >  "*Total Rows Fetched*": "0",
> > >   >
> > >   >  "*Total Documents Processed*": "0",
> > >   >
> > >   >  "*Total Documents Skipped*": "0",
> > >   >
> > >   > "Full Dump Started": "2018-09-06 18:15:59", "Full Import
> > >   failed": "2018-09-06
> > >   > 18:16:02"
> > >   >
> > >   > Has anyone any ideas about what may be happening?  Is there
> > any
> > >   log file
> > >   > which can tell the error?
> > >   >
> > >   > Thanks in advance,
> > >   >
> > >
> > >
> > >
> > > --
> > > Monique Monteiro
> > > Twitter: http://twitter.com/monilouise
> > >>
> >
> >
>
> --
> Monique Monteiro
> Twitter: http://twitter.com/monilouise

Re: Corrupt Index error on Target cluster

[Stephen Bianamara]

Oh, I see I missed that fix. The versions were 6.2.1 and 6.6.2 (I
mistakenly said before they were both 6.6).

On Sun, Sep 9, 2018, 2:35 AM Susheel Kumar  wrote:

> Thanks. I have 6.6.2.  Do you remember the exact minor version which you
> run into with corruptIndex.  I did fix it using CheckIndex.
>
> On Sat, Sep 8, 2018 at 2:00 AM Stephen Bianamara  >
> wrote:
>
> > Hmm, when this occurred for me I was also on 6.6 between minor releases.
> So
> > unclear if it's connected to 6.6 specifically.
> >
> > If you want to resolve the problem, you should be able to use the
> > collection api delete that node from the collection, and then re-add it
> > which will trigger resync.
> >
> >
> > On Fri, Sep 7, 2018, 10:35 AM Susheel Kumar 
> wrote:
> >
> > > No. The solr i have is 6.6.
> > >
> > > On Fri, Sep 7, 2018 at 10:51 AM Stephen Bianamara <
> > > sdl1tinsold...@gmail.com>
> > > wrote:
> > >
> > > > I've gotten incorrect checksums when upgrading solr versions across
> the
> > > > cluster. Or in other words, when indexing into a mixed version
> cluster.
> > > Are
> > > > you running mixed versions by chance?
> > > >
> > > > On Fri, Sep 7, 2018, 6:07 AM Susheel Kumar 
> > > wrote:
> > > >
> > > > > Anyone has  insight / have faced above errors ?
> > > > >
> > > > > On Thu, Sep 6, 2018 at 12:04 PM Susheel Kumar <
> susheel2...@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > > Hello,
> > > > > >
> > > > > > We had a running cluster with CDCR and there were some issues
> with
> > > > > > indexing on Source cluster which got resolved after restarting
> the
> > > > nodes
> > > > > > (in my absence...) and now I see  below errors on a shard at
> Target
> > > > > > cluster.  Any suggestions / ideas what could have caused this and
> > > whats
> > > > > the
> > > > > > best way to recover.
> > > > > >
> > > > > > Thnx
> > > > > >
> > > > > > Caused by: org.apache.solr.common.SolrException: Error opening
> new
> > > > > searcher
> > > > > > at
> > > > > > org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2069)
> > > > > > at
> > > > org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2189)
> > > > > > at
> > > > org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1926)
> > > > > > at
> > > > org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1826)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.request.SolrQueryRequestBase.getSearcher(SolrQueryRequestBase.java:127)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:310)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:296)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
> > > > > > at
> > org.apache.solr.core.SolrCore.execute(SolrCore.java:2477)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.solr.handler.PingRequestHandler.handlePing(PingRequestHandler.java:267)
> > > > > > ... 34 more
> > > > > > Caused by: org.apache.lucene.index.CorruptIndexException:
> Corrupted
> > > > > > bitsPerDocBase: 6033
> > > > > >
> > > > >
> > > >
> > >
> >
> (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/app/solr/data/COLL_shard8_replica1/data/index.20180903220548447/_9nsy.tvx")))
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexReader.(CompressingStoredFieldsIndexReader.java:89)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.codecs.compressing.CompressingTermVectorsReader.(CompressingTermVectorsReader.java:126)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsReader(CompressingTermVectorsFormat.java:91)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreReaders.java:128)
> > > > > > at
> > > > > >
> org.apache.lucene.index.SegmentReader.(SegmentReader.java:74)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:197)
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:103)
> > > > > > at
> > > > > >
> org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:467)
> > > > > > at
> > > > > >
> > > org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
> > > > > > at
> > > > > >
> > org.apache.lucene.index.D

Re: Silent error from DataImportHandler

[Monique Monteiro]

Hi Andrea,

In fact, I had to add *logLevel="debug"* to the DIH configuration.  Just
checking "Debug" on console is not enough.  I also checked "Verbose". Now,
a database exception (locked account is shown).

Thanks!
Monique


On Mon, Sep 10, 2018 at 12:26 PM Andrea Gazzarini 
wrote:

> I cannot give you detailed instructions as I don't have in front of me a
> Solr console with the dataimport enabled, but I remember that there's a
> detailed section which reports a lot of information.
>
> In the meantime: shooting in the dark, if the query is working and
> "total rows fetched" = 0, then the query is not working for some reason:
> can you check if some clause in your SQL include < or > ? They need to
> be escaped (< >)
>
> Andrea
>
>
> On 10/09/2018 17:22, Monique Monteiro wrote:
> > This is shown in the section "Raw Debug-Response".
> >
> > On Mon, Sep 10, 2018 at 12:20 PM Andrea Gazzarini 
> > wrote:
> >
> >> Hi Monique, this is the output; when you check the debug checkbox
> >> another section is printed
> >>
> >> Andrea
> >>
> >> On 10/09/2018 17:19, Monique Monteiro wrote:
> >>> Text:
> >>>
> >>> { "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [
> >> "defaults",
> >>> [ "config", "data-cnpj-config.xml" ] ], "command": "full-import",
> "mode":
> >>> "debug", "documents": [], "verbose-output": [], "status": "idle","
> >>> importResponse": "", "statusMessages": { "Time Elapsed": "0:0:0.432",
> >> "Total
> >>> Requests made to DataSource": "1", "Total Rows Fetched": "0", "Total
> >>> Documents Processed": "0", "Total Documents Skipped": "0", "Full Dump
> >>> Started": "2018-09-10 12:04:03", "Full Import failed": "2018-09-10
> >> 12:04:04"
> >>> } }
> >>>
> >>> On Mon, Sep 10, 2018 at 12:08 PM Andrea Gazzarini <
> a.gazzar...@sease.io>
> >>> wrote:
> >>>
>  Hi Monique,
>  I think you cannot attach files / images, please post, if available,
> the
>  url of the image or a text description.
> 
>  Andrea
> 
>  On 10/09/2018 17:05, Monique Monteiro wrote:
> > Hi Andrea,
> >
> > Solr console doesn't return a very different information even with
> > debug mode enabled:
> >
> > image.png
> >
> > On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini
> > mailto:a.gazzar...@sease.io>> wrote:
> >
> >   You can check the solr.log or the solr-console.log. Another
> option
> >   is to
> >   activate the debug mode in the Solr console before running the
> >   data import.
> >
> >   Andrea
> >
> >   On 10/09/2018 16:57, Monique Monteiro wrote:
> >   > Hi all,
> >   >
> >   > I have a data import handler configured with an Oracle SQL
> query
> >   which
> >   > works like a charm.  However, when I have the same query
> >   configured in
> >   > Solr's data import handler, nothing happens, and it returns:
> >   >
> >   >
> >   >
> >   >  "*Total Requests made to DataSource*": "1",
> >   >
> >   >  "*Total Rows Fetched*": "0",
> >   >
> >   >  "*Total Documents Processed*": "0",
> >   >
> >   >  "*Total Documents Skipped*": "0",
> >   >
> >   > "Full Dump Started": "2018-09-06 18:15:59", "Full Import
> >   failed": "2018-09-06
> >   > 18:16:02"
> >   >
> >   > Has anyone any ideas about what may be happening?  Is there
> any
> >   log file
> >   > which can tell the error?
> >   >
> >   > Thanks in advance,
> >   >
> >
> >
> >
> > --
> > Monique Monteiro
> > Twitter: http://twitter.com/monilouise
> >>
>
>

-- 
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Silent error from DataImportHandler

[Andrea Gazzarini]

I cannot give you detailed instructions as I don't have in front of me a 
Solr console with the dataimport enabled, but I remember that there's a 
detailed section which reports a lot of information.


In the meantime: shooting in the dark, if the query is working and 
"total rows fetched" = 0, then the query is not working for some reason: 
can you check if some clause in your SQL include < or > ? They need to 
be escaped (< >)


Andrea


On 10/09/2018 17:22, Monique Monteiro wrote:

This is shown in the section "Raw Debug-Response".

On Mon, Sep 10, 2018 at 12:20 PM Andrea Gazzarini 
wrote:


Hi Monique, this is the output; when you check the debug checkbox
another section is printed

Andrea

On 10/09/2018 17:19, Monique Monteiro wrote:

Text:

{ "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [

"defaults",

[ "config", "data-cnpj-config.xml" ] ], "command": "full-import", "mode":
"debug", "documents": [], "verbose-output": [], "status": "idle","
importResponse": "", "statusMessages": { "Time Elapsed": "0:0:0.432",

"Total

Requests made to DataSource": "1", "Total Rows Fetched": "0", "Total
Documents Processed": "0", "Total Documents Skipped": "0", "Full Dump
Started": "2018-09-10 12:04:03", "Full Import failed": "2018-09-10

12:04:04"

} }

On Mon, Sep 10, 2018 at 12:08 PM Andrea Gazzarini 
wrote:


Hi Monique,
I think you cannot attach files / images, please post, if available, the
url of the image or a text description.

Andrea

On 10/09/2018 17:05, Monique Monteiro wrote:

Hi Andrea,

Solr console doesn't return a very different information even with
debug mode enabled:

image.png

On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini
mailto:a.gazzar...@sease.io>> wrote:

  You can check the solr.log or the solr-console.log. Another option
  is to
  activate the debug mode in the Solr console before running the
  data import.

  Andrea

  On 10/09/2018 16:57, Monique Monteiro wrote:
  > Hi all,
  >
  > I have a data import handler configured with an Oracle SQL query
  which
  > works like a charm.  However, when I have the same query
  configured in
  > Solr's data import handler, nothing happens, and it returns:
  >
  >
  >
  >  "*Total Requests made to DataSource*": "1",
  >
  >  "*Total Rows Fetched*": "0",
  >
  >  "*Total Documents Processed*": "0",
  >
  >  "*Total Documents Skipped*": "0",
  >
  > "Full Dump Started": "2018-09-06 18:15:59", "Full Import
  failed": "2018-09-06
  > 18:16:02"
  >
  > Has anyone any ideas about what may be happening?  Is there any
  log file
  > which can tell the error?
  >
  > Thanks in advance,
  >



--
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Silent error from DataImportHandler

[Monique Monteiro]

This is shown in the section "Raw Debug-Response".

On Mon, Sep 10, 2018 at 12:20 PM Andrea Gazzarini 
wrote:

> Hi Monique, this is the output; when you check the debug checkbox
> another section is printed
>
> Andrea
>
> On 10/09/2018 17:19, Monique Monteiro wrote:
> > Text:
> >
> > { "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [
> "defaults",
> > [ "config", "data-cnpj-config.xml" ] ], "command": "full-import", "mode":
> > "debug", "documents": [], "verbose-output": [], "status": "idle","
> > importResponse": "", "statusMessages": { "Time Elapsed": "0:0:0.432",
> "Total
> > Requests made to DataSource": "1", "Total Rows Fetched": "0", "Total
> > Documents Processed": "0", "Total Documents Skipped": "0", "Full Dump
> > Started": "2018-09-10 12:04:03", "Full Import failed": "2018-09-10
> 12:04:04"
> > } }
> >
> > On Mon, Sep 10, 2018 at 12:08 PM Andrea Gazzarini 
> > wrote:
> >
> >> Hi Monique,
> >> I think you cannot attach files / images, please post, if available, the
> >> url of the image or a text description.
> >>
> >> Andrea
> >>
> >> On 10/09/2018 17:05, Monique Monteiro wrote:
> >>> Hi Andrea,
> >>>
> >>> Solr console doesn't return a very different information even with
> >>> debug mode enabled:
> >>>
> >>> image.png
> >>>
> >>> On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini
> >>> mailto:a.gazzar...@sease.io>> wrote:
> >>>
> >>>  You can check the solr.log or the solr-console.log. Another option
> >>>  is to
> >>>  activate the debug mode in the Solr console before running the
> >>>  data import.
> >>>
> >>>  Andrea
> >>>
> >>>  On 10/09/2018 16:57, Monique Monteiro wrote:
> >>>  > Hi all,
> >>>  >
> >>>  > I have a data import handler configured with an Oracle SQL query
> >>>  which
> >>>  > works like a charm.  However, when I have the same query
> >>>  configured in
> >>>  > Solr's data import handler, nothing happens, and it returns:
> >>>  >
> >>>  >
> >>>  >
> >>>  >  "*Total Requests made to DataSource*": "1",
> >>>  >
> >>>  >  "*Total Rows Fetched*": "0",
> >>>  >
> >>>  >  "*Total Documents Processed*": "0",
> >>>  >
> >>>  >  "*Total Documents Skipped*": "0",
> >>>  >
> >>>  > "Full Dump Started": "2018-09-06 18:15:59", "Full Import
> >>>  failed": "2018-09-06
> >>>  > 18:16:02"
> >>>  >
> >>>  > Has anyone any ideas about what may be happening?  Is there any
> >>>  log file
> >>>  > which can tell the error?
> >>>  >
> >>>  > Thanks in advance,
> >>>  >
> >>>
> >>>
> >>>
> >>> --
> >>> Monique Monteiro
> >>> Twitter: http://twitter.com/monilouise
> >>
>
>

-- 
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Silent error from DataImportHandler

[Andrea Gazzarini]

Hi Monique, this is the output; when you check the debug checkbox 
another section is printed


Andrea

On 10/09/2018 17:19, Monique Monteiro wrote:

Text:

{ "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [ "defaults",
[ "config", "data-cnpj-config.xml" ] ], "command": "full-import", "mode":
"debug", "documents": [], "verbose-output": [], "status": "idle","
importResponse": "", "statusMessages": { "Time Elapsed": "0:0:0.432", "Total
Requests made to DataSource": "1", "Total Rows Fetched": "0", "Total
Documents Processed": "0", "Total Documents Skipped": "0", "Full Dump
Started": "2018-09-10 12:04:03", "Full Import failed": "2018-09-10 12:04:04"
} }

On Mon, Sep 10, 2018 at 12:08 PM Andrea Gazzarini 
wrote:


Hi Monique,
I think you cannot attach files / images, please post, if available, the
url of the image or a text description.

Andrea

On 10/09/2018 17:05, Monique Monteiro wrote:

Hi Andrea,

Solr console doesn't return a very different information even with
debug mode enabled:

image.png

On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini
mailto:a.gazzar...@sease.io>> wrote:

 You can check the solr.log or the solr-console.log. Another option
 is to
 activate the debug mode in the Solr console before running the
 data import.

 Andrea

 On 10/09/2018 16:57, Monique Monteiro wrote:
 > Hi all,
 >
 > I have a data import handler configured with an Oracle SQL query
 which
 > works like a charm.  However, when I have the same query
 configured in
 > Solr's data import handler, nothing happens, and it returns:
 >
 >
 >
 >  "*Total Requests made to DataSource*": "1",
 >
 >  "*Total Rows Fetched*": "0",
 >
 >  "*Total Documents Processed*": "0",
 >
 >  "*Total Documents Skipped*": "0",
 >
 > "Full Dump Started": "2018-09-06 18:15:59", "Full Import
 failed": "2018-09-06
 > 18:16:02"
 >
 > Has anyone any ideas about what may be happening?  Is there any
 log file
 > which can tell the error?
 >
 > Thanks in advance,
 >



--
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Silent error from DataImportHandler

[Monique Monteiro]

Text:

{ "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [ "defaults",
[ "config", "data-cnpj-config.xml" ] ], "command": "full-import", "mode":
"debug", "documents": [], "verbose-output": [], "status": "idle", "
importResponse": "", "statusMessages": { "Time Elapsed": "0:0:0.432", "Total
Requests made to DataSource": "1", "Total Rows Fetched": "0", "Total
Documents Processed": "0", "Total Documents Skipped": "0", "Full Dump
Started": "2018-09-10 12:04:03", "Full Import failed": "2018-09-10 12:04:04"
} }

On Mon, Sep 10, 2018 at 12:08 PM Andrea Gazzarini 
wrote:

> Hi Monique,
> I think you cannot attach files / images, please post, if available, the
> url of the image or a text description.
>
> Andrea
>
> On 10/09/2018 17:05, Monique Monteiro wrote:
> > Hi Andrea,
> >
> > Solr console doesn't return a very different information even with
> > debug mode enabled:
> >
> > image.png
> >
> > On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini
> > mailto:a.gazzar...@sease.io>> wrote:
> >
> > You can check the solr.log or the solr-console.log. Another option
> > is to
> > activate the debug mode in the Solr console before running the
> > data import.
> >
> > Andrea
> >
> > On 10/09/2018 16:57, Monique Monteiro wrote:
> > > Hi all,
> > >
> > > I have a data import handler configured with an Oracle SQL query
> > which
> > > works like a charm.  However, when I have the same query
> > configured in
> > > Solr's data import handler, nothing happens, and it returns:
> > >
> > >
> > >
> > >  "*Total Requests made to DataSource*": "1",
> > >
> > >  "*Total Rows Fetched*": "0",
> > >
> > >  "*Total Documents Processed*": "0",
> > >
> > >  "*Total Documents Skipped*": "0",
> > >
> > > "Full Dump Started": "2018-09-06 18:15:59", "Full Import
> > failed": "2018-09-06
> > > 18:16:02"
> > >
> > > Has anyone any ideas about what may be happening?  Is there any
> > log file
> > > which can tell the error?
> > >
> > > Thanks in advance,
> > >
> >
> >
> >
> > --
> > Monique Monteiro
> > Twitter: http://twitter.com/monilouise
>
>

-- 
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Silent error from DataImportHandler

[Walter Underwood]

Copy and paste the text of the error. Pictures of text aren’t very useful, even 
when
they do make it through the mail reflector.

Also, expand the error (the small info button) to get a stack trace.

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Sep 10, 2018, at 8:05 AM, Monique Monteiro  
> wrote:
> 
> Hi Andrea,
> 
> Solr console doesn't return a very different information even with debug mode 
> enabled:
> 
> 
> 
> On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini  > wrote:
> You can check the solr.log or the solr-console.log. Another option is to 
> activate the debug mode in the Solr console before running the data import.
> 
> Andrea
> 
> On 10/09/2018 16:57, Monique Monteiro wrote:
> > Hi all,
> >
> > I have a data import handler configured with an Oracle SQL query which
> > works like a charm.  However, when I have the same query configured in
> > Solr's data import handler, nothing happens, and it returns:
> >
> >
> >
> >  "*Total Requests made to DataSource*": "1",
> >
> >  "*Total Rows Fetched*": "0",
> >
> >  "*Total Documents Processed*": "0",
> >
> >  "*Total Documents Skipped*": "0",
> >
> > "Full Dump Started": "2018-09-06 18:15:59", "Full Import failed": 
> > "2018-09-06
> > 18:16:02"
> >
> > Has anyone any ideas about what may be happening?  Is there any log file
> > which can tell the error?
> >
> > Thanks in advance,
> >
> 
> 
> 
> -- 
> Monique Monteiro
> Twitter: http://twitter.com/monilouise 

Re: Silent error from DataImportHandler

[Andrea Gazzarini]

Hi Monique,
I think you cannot attach files / images, please post, if available, the 
url of the image or a text description.


Andrea

On 10/09/2018 17:05, Monique Monteiro wrote:

Hi Andrea,

Solr console doesn't return a very different information even with 
debug mode enabled:


image.png

On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini 
mailto:a.gazzar...@sease.io>> wrote:


You can check the solr.log or the solr-console.log. Another option
is to
activate the debug mode in the Solr console before running the
data import.

Andrea

On 10/09/2018 16:57, Monique Monteiro wrote:
> Hi all,
>
> I have a data import handler configured with an Oracle SQL query
which
> works like a charm.  However, when I have the same query
configured in
> Solr's data import handler, nothing happens, and it returns:
>
>
>
>      "*Total Requests made to DataSource*": "1",
>
>      "*Total Rows Fetched*": "0",
>
>      "*Total Documents Processed*": "0",
>
>      "*Total Documents Skipped*": "0",
>
> "Full Dump Started": "2018-09-06 18:15:59", "Full Import
failed": "2018-09-06
> 18:16:02"
>
> Has anyone any ideas about what may be happening?  Is there any
log file
> which can tell the error?
>
> Thanks in advance,
>



--
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Silent error from DataImportHandler

[Monique Monteiro]

Hi Andrea,

Solr console doesn't return a very different information even with debug
mode enabled:

[image: image.png]

On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini 
wrote:

> You can check the solr.log or the solr-console.log. Another option is to
> activate the debug mode in the Solr console before running the data import.
>
> Andrea
>
> On 10/09/2018 16:57, Monique Monteiro wrote:
> > Hi all,
> >
> > I have a data import handler configured with an Oracle SQL query which
> > works like a charm.  However, when I have the same query configured in
> > Solr's data import handler, nothing happens, and it returns:
> >
> >
> >
> >  "*Total Requests made to DataSource*": "1",
> >
> >  "*Total Rows Fetched*": "0",
> >
> >  "*Total Documents Processed*": "0",
> >
> >  "*Total Documents Skipped*": "0",
> >
> > "Full Dump Started": "2018-09-06 18:15:59", "Full Import failed":
> "2018-09-06
> > 18:16:02"
> >
> > Has anyone any ideas about what may be happening?  Is there any log file
> > which can tell the error?
> >
> > Thanks in advance,
> >
>
>

-- 
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Silent error from DataImportHandler

[Andrea Gazzarini]

You can check the solr.log or the solr-console.log. Another option is to 
activate the debug mode in the Solr console before running the data import.


Andrea

On 10/09/2018 16:57, Monique Monteiro wrote:

Hi all,

I have a data import handler configured with an Oracle SQL query which
works like a charm.  However, when I have the same query configured in
Solr's data import handler, nothing happens, and it returns:



 "*Total Requests made to DataSource*": "1",

 "*Total Rows Fetched*": "0",

 "*Total Documents Processed*": "0",

 "*Total Documents Skipped*": "0",

"Full Dump Started": "2018-09-06 18:15:59", "Full Import failed": "2018-09-06
18:16:02"

Has anyone any ideas about what may be happening?  Is there any log file
which can tell the error?

Thanks in advance,

Re: Solr Index Issues

[Walter Underwood]

Every time you see "Expected mime type application/octet-stream but got 
text/html” from SolrJ,
it means that Solr returned an error. Look for an error in the Solr logs at the 
same time as the
SolrJ message.

It could be any error, which is why we can’t help more. After you know the Solr 
error, we might
be able to help.

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Sep 10, 2018, at 7:45 AM, Erick Erickson  wrote:
> 
> It would be best to ask on the Nutch mailing list, this list doesn't
> have very many people who know _how_ Nutch uses Solr though.
> 
> Best,
> Erick
> On Sun, Sep 9, 2018 at 11:47 PM Bineesh  wrote:
>> 
>> Hi Team,
>> 
>> We are using Nutch 1.15 and Solr 6.6.3
>> 
>> We tried crawling one of the URL and and noticed issues while indexing data
>> to solr.Below is the capture from logs
>> 
>> Caused by:
>> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error
>> from server at http://localhost:8983/solr/nutch: Expected mime type
>> application/octet-stream but got text/html. 
>> 
>> Here in the log i see collection name is nutch but the actual collection
>> name i created is Nutch1.15_Test
>> 
>> Given below is the command used for crawling
>> 
>> bin/nutch solrindex http://10.150.17.32:8983/solr/Nutch1.15_Test
>> crawl/crawldb -linkdb crawl/linkdb crawl/segments/*
>> 
>> 
>> Please suggest any workarounds if available. Thank you
>> 
>> 
>> 
>> --
>> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Silent error from DataImportHandler

[Monique Monteiro]

Hi all,

I have a data import handler configured with an Oracle SQL query which
works like a charm.  However, when I have the same query configured in
Solr's data import handler, nothing happens, and it returns:



"*Total Requests made to DataSource*": "1",

"*Total Rows Fetched*": "0",

"*Total Documents Processed*": "0",

"*Total Documents Skipped*": "0",

"Full Dump Started": "2018-09-06 18:15:59", "Full Import failed": "2018-09-06
18:16:02"

Has anyone any ideas about what may be happening?  Is there any log file
which can tell the error?

Thanks in advance,

-- 
Monique Monteiro
Twitter: http://twitter.com/monilouise

Re: Solr Index Issues

[Erick Erickson]

It would be best to ask on the Nutch mailing list, this list doesn't
have very many people who know _how_ Nutch uses Solr though.

Best,
Erick
On Sun, Sep 9, 2018 at 11:47 PM Bineesh  wrote:
>
> Hi Team,
>
> We are using Nutch 1.15 and Solr 6.6.3
>
> We tried crawling one of the URL and and noticed issues while indexing data
> to solr.Below is the capture from logs
>
> Caused by:
> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error
> from server at http://localhost:8983/solr/nutch: Expected mime type
> application/octet-stream but got text/html. 
>
> Here in the log i see collection name is nutch but the actual collection
> name i created is Nutch1.15_Test
>
> Given below is the command used for crawling
>
> bin/nutch solrindex http://10.150.17.32:8983/solr/Nutch1.15_Test
> crawl/crawldb -linkdb crawl/linkdb crawl/segments/*
>
>
> Please suggest any workarounds if available. Thank you
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: solr boost query

[Erick Erickson]

You can't do this with boosting. Boosting affects scoring, i.e. the
ranking. I'd expect this to show many topic As before anything else,
other things being equal.

For a limited number of topics, you could group by the topic and get
the top 70 of each, throwing away the extras in topics B and C.

You could also fire off three separate queries.

Best,
Erick
On Mon, Sep 10, 2018 at 7:42 AM Erick Erickson  wrote:
>
> You can't do this with boosting. Boosting affects scoring, i.e. the ranking. 
> I'd expect this to show
> On Mon, Sep 10, 2018 at 12:37 AM sara hajili  wrote:
> >
> > Hi
> > I have some docs in my solr index. and now i want to run a query. please
> > help me how create this query?
> > i have documents like this:
> > {
> > topic_code:"A"
> > },
> > {
> > topic_code:"B"
> > },
> > {
> > topic_code:"A"
> > },
> > {
> > topic_code:"A"
> > },
> > {
> > topic_code:"C"
> > },
> > {
> > topic_code:"A"
> > },..
> > now i want to get respanse from a solr 100 dosuments , and i want to have
> > 70 document with topic_code:A and 10 documents with topic_code:B and 20
> > document with topic_code:C.
> > so i guess i need SOLR BOOST QUERY.
> > some thing like this :
> > q=(topic_code:A)^70 OR (topic_code:B)^20 OR (topic_code:C)^10 & row=100
> > but this isn't work.
> > could u help me to create a suitable query and get my best result ?
> > tnx.

Re: solr boost query

[Erick Erickson]

You can't do this with boosting. Boosting affects scoring, i.e. the
ranking. I'd expect this to show
On Mon, Sep 10, 2018 at 12:37 AM sara hajili  wrote:
>
> Hi
> I have some docs in my solr index. and now i want to run a query. please
> help me how create this query?
> i have documents like this:
> {
> topic_code:"A"
> },
> {
> topic_code:"B"
> },
> {
> topic_code:"A"
> },
> {
> topic_code:"A"
> },
> {
> topic_code:"C"
> },
> {
> topic_code:"A"
> },..
> now i want to get respanse from a solr 100 dosuments , and i want to have
> 70 document with topic_code:A and 10 documents with topic_code:B and 20
> document with topic_code:C.
> so i guess i need SOLR BOOST QUERY.
> some thing like this :
> q=(topic_code:A)^70 OR (topic_code:B)^20 OR (topic_code:C)^10 & row=100
> but this isn't work.
> could u help me to create a suitable query and get my best result ?
> tnx.

AW: Solr 7.4 and log4j2 JSONLayout

[Michael Aleythe, Sternwald]

Hey Shawn,

i removed the additional jars and tried the foreground option with the 
following result:

2018-09-10 11:41:03.174:INFO::main: Logging initialized @616ms to 
org.eclipse.jetty.util.log.StdErrLog
2018-09-10 11:41:03.313:INFO:oejs.Server:main: jetty-9.4.10.v20180503; built: 
2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 
1.8.0_45-b14
2018-09-10 11:41:03.338:INFO:oejdp.ScanningAppProvider:main: Deployment monitor 
[file:///usr/local/dir/solr-7.4.0/server/contexts/] at interval 0
2018-09-10 11:41:03.578:INFO:oejw.StandardDescriptorProcessor:main: NO JSP 
Support for /solr, did not find org.apache.jasper.servlet.JspServlet
2018-09-10 11:41:03.586:INFO:oejs.session:main: DefaultSessionIdManager 
workerName=node0
2018-09-10 11:41:03.586:INFO:oejs.session:main: No SessionScavenger set, using 
defaults
2018-09-10 11:41:03.588:INFO:oejs.session:main: node0 Scavenging every 60ms
2018-09-10 11:41:05.091:INFO:oejsh.ContextHandler:main: Started 
o.e.j.w.WebAppContext@7c7a06ec{/solr,file:///usr/local/dir/solr-7.4.0/server/solr-webapp/webapp/,AVAILABLE}{file:///usr/local/dir/solr-7.4.0/server//solr-webapp/webapp}
2018-09-10 11:41:05.133:INFO:oejs.AbstractConnector:main: Started 
ServerConnector@10650953{HTTP/1.1,[http/1.1]}{0.0.0.0:8983}
2018-09-10 11:41:05.133:INFO:oejs.Server:main: Started @2575ms

There is absolutely no clue about whats going on.

Regarding the rollover size. I was just playing around to see if the rollover 
works as I expected.

Thanks,
Michael

-Ursprüngliche Nachricht-
Von: Shawn Heisey  
Gesendet: Freitag, 7. September 2018 17:58
An: solr-user@lucene.apache.org
Betreff: Re: Solr 7.4 and log4j2 JSONLayout

On 9/6/2018 7:46 AM, Michael Aleythe, Sternwald wrote:
> I'm trying to edit the log4j2 logging configuration for solr. The goal is to 
> get a log file in json format. I configured the the JSONLayout for this 
> purpose inside the rollingFile appender in the log4j2.xml. After this solr 
> stops logging entirely. Solr.log file is empty. Only the 
> solr-8983-console.log file contains 10 lines. The line "2018-09-06 
> 13:22:25.378:INFO:oejs.Server:main: Started @2814ms" is the last one.
> My first guess was that the jackson-core and jackson-databind jars were 
> missing, but that did not fix the problem.

As Varun said, jackson is already included in Solr.  You won't need to add any 
jars for that.

> Does anyone know where to find error-messages or exceptions that point me 
> towards whats going wrong here?

Start Solr in the foreground, with the -f option.  This will cause Solr to log 
to the console.  When Solr is started in the background, it suppresses console 
logging.

I see that you have changed the logfile rollover size to 1MB.  If your Solr 
server sees much traffic, this is going to result in an extremely fast 
rollover, which may mean that you lose access to logged events VERY quickly.  
This will especially be the case with JSON logging -- each event will take up a 
lot more space.

Thanks,
Shawn

solr boost query

[sara hajili]

Hi
I have some docs in my solr index. and now i want to run a query. please
help me how create this query?
i have documents like this:
{
topic_code:"A"
},
{
topic_code:"B"
},
{
topic_code:"A"
},
{
topic_code:"A"
},
{
topic_code:"C"
},
{
topic_code:"A"
},..
now i want to get respanse from a solr 100 dosuments , and i want to have
70 document with topic_code:A and 10 documents with topic_code:B and 20
document with topic_code:C.
so i guess i need SOLR BOOST QUERY.
some thing like this :
q=(topic_code:A)^70 OR (topic_code:B)^20 OR (topic_code:C)^10 & row=100
but this isn't work.
could u help me to create a suitable query and get my best result ?
tnx.