Re: Integrate nutch with solr
Thanks Shawn for the reply, yes I do have some questions on the solr too. can you please share the steps for solr side to integate the nutch or no steps are needed in solr? On Thu, Oct 18, 2018 at 8:35 PM Shawn Heisey wrote: > On 10/18/2018 12:35 PM, Dinesh Sundaram wrote: > > Can you please share the steps to integrate nutch 2.3.1 with solrcloud > > 7.1.0. > > You will need to speak to the nutch project about how to configure their > software to interact with Solr. If you have questions about Solr > itself, we can answer those. > > http://nutch.apache.org/mailing_lists.html > > Thanks, > Shawn > >
Integrate nutch with solr
Hi Team, Can you please share the steps to integrate nutch 2.3.1 with solrcloud 7.1.0. Thanks, Dinesh Sundaram
solr allow read permission to anonymous/guest user
Hi, Is there any option to allow read permissions to anonymous/guest user? expecting to prompt credentials only if any update or delete operations. Thanks, Dinesh Sundaram
Re: solr basic authentication
Thanks Chris for your help. I tried to find that solution but nothing is working out. it is not accepting the credentils, may be i'm trying with wrong base 64 algorithm. On Thu, Jun 21, 2018 at 12:25 PM, Christopher Schultz < ch...@christopherschultz.net> wrote: > Dinesh, > > On 6/21/18 11:40 AM, Dinesh Sundaram wrote: > > is there any way to disable basic authentication for particular domain. i > > have proxy pass from a domain to solr which is always asking credentials > so > > wanted to disable basic auth only for that domain. is there any way? > > I wouldn't recommend this, in general, because it's not really all that > secure, but since you have a reverse-proxy in between the client and > Solr, why not have the proxy provide the HTTP BASIC authentication > information to Solr? > > That may be a more straightforward solution. > > -chris > >
Re: Solr basic auth
yes, Thanks. I would like to whitelist one domain from the authlogin.
On Thu, Jun 21, 2018 at 12:57 PM, Jan Høydahl wrote:
> Hi,
>
> As I said there is not way to combine multiple authentication plugins at
> the moment.
> So your best shot is probably to create your own CustomAuthPlugin where you
> implement the logic that you need. You can fork the code from BasicAuth
> and add
> the logic you need to whitelist the requests you need.
>
> It is very hard to understand from your initial email how Solr should see
> the
> difference between a request to "the solr URL directly" vs requests done
> indirectly, whatever that would mean. From solr's standpoint ALL requests
> are done to Solr directly :-) I suppose you mean that if a request
> originates
> from a particular frontend server's IP address then it should be
> whitelisted?
>
> You could also suggest in a new JIRA issue to extend Solr's auth feature
> to allow a chain of AuthPlugins, and if the request passes any of them it
> is let through.
>
> --
> Jan Høydahl, search solution architect
> Cominvent AS - www.cominvent.com
>
> > 21. jun. 2018 kl. 17:47 skrev Dinesh Sundaram :
> >
> > thanks for your valuable feedback. I really want to allow this domain
> > without any credentials. i need basic auth only if anyone access the solr
> > url directly. so no option in solr to do that?
> >
> > On Sun, Jun 17, 2018 at 4:18 PM, Jan Høydahl
> wrote:
> >
> >> Of course, but Dinesh explicitly set blockUnknown=true below, so in this
> >> case ALL requests must have credentials. There is currently no feature
> that
> >> lets Solr accept any request by other rules, all requests are forwarded
> to
> >> the chosen authentication plugin.
> >>
> >> --
> >> Jan Høydahl, search solution architect
> >> Cominvent AS - www.cominvent.com
> >>
> >>> 15. jun. 2018 kl. 19:12 skrev Terry Steichen :
> >>>
> >>> "When authentication is enabled ALL requests must carry valid
> >>> credentials." I believe this behavior depends on the value you set for
> >>> the *blockUnknown* authentication parameter.
> >>>
> >>>
> >>> On 06/15/2018 06:25 AM, Jan Høydahl wrote:
> >>>> When authentication is enabled ALL requests must carry valid
> >> credentials.
> >>>>
> >>>> Are you asking for a feature where a request is authenticated based on
> >> IP address of the client, not username/password?
> >>>>
> >>>> Jan
> >>>>
> >>>> Sendt fra min iPhone
> >>>>
> >>>>> 14. jun. 2018 kl. 22:24 skrev Dinesh Sundaram <
> sdineshros...@gmail.com
> >>> :
> >>>>>
> >>>>> Hi,
> >>>>>
> >>>>> I have configured basic auth for solrcloud. it works well when i
> >> access the
> >>>>> solr url directly. i have integrated this solr with test.com domain.
> >> now if
> >>>>> I access the solr url like test.com/solr it prompts the credentials
> >> but I
> >>>>> dont want to ask this time since it is known domain. is there any way
> >> to
> >>>>> achieve this. much appreciate your quick response.
> >>>>>
> >>>>> my security json below. i'm using the default security, want to allow
> >> my
> >>>>> domain default without prompting any credentials.
> >>>>>
> >>>>> {"authentication":{
> >>>>> "blockUnknown": true,
> >>>>> "class":"solr.BasicAuthPlugin",
> >>>>> "credentials":{"solr":"IV0EHq1OnNrj6gvRCwvFwTrZ1+z1oBbnQdiVC3otuq0=
> >>>>> Ndd7LKvVBAaZIF0QAVi1ekCfAJXr1GGfLtRUXhgrF8c="}
> >>>>> },"authorization":{
> >>>>> "class":"solr.RuleBasedAuthorizationPlugin",
> >>>>> "permissions":[{"name":"security-edit",
> >>>>>"role":"admin"}],
> >>>>> "user-role":{"solr":"admin"}
> >>>>> }}
> >>>
> >>
> >>
>
>
Re: Solr basic auth
thanks for your valuable feedback. I really want to allow this domain
without any credentials. i need basic auth only if anyone access the solr
url directly. so no option in solr to do that?
On Sun, Jun 17, 2018 at 4:18 PM, Jan Høydahl wrote:
> Of course, but Dinesh explicitly set blockUnknown=true below, so in this
> case ALL requests must have credentials. There is currently no feature that
> lets Solr accept any request by other rules, all requests are forwarded to
> the chosen authentication plugin.
>
> --
> Jan Høydahl, search solution architect
> Cominvent AS - www.cominvent.com
>
> > 15. jun. 2018 kl. 19:12 skrev Terry Steichen :
> >
> > "When authentication is enabled ALL requests must carry valid
> > credentials." I believe this behavior depends on the value you set for
> > the *blockUnknown* authentication parameter.
> >
> >
> > On 06/15/2018 06:25 AM, Jan Høydahl wrote:
> >> When authentication is enabled ALL requests must carry valid
> credentials.
> >>
> >> Are you asking for a feature where a request is authenticated based on
> IP address of the client, not username/password?
> >>
> >> Jan
> >>
> >> Sendt fra min iPhone
> >>
> >>> 14. jun. 2018 kl. 22:24 skrev Dinesh Sundaram >:
> >>>
> >>> Hi,
> >>>
> >>> I have configured basic auth for solrcloud. it works well when i
> access the
> >>> solr url directly. i have integrated this solr with test.com domain.
> now if
> >>> I access the solr url like test.com/solr it prompts the credentials
> but I
> >>> dont want to ask this time since it is known domain. is there any way
> to
> >>> achieve this. much appreciate your quick response.
> >>>
> >>> my security json below. i'm using the default security, want to allow
> my
> >>> domain default without prompting any credentials.
> >>>
> >>> {"authentication":{
> >>> "blockUnknown": true,
> >>> "class":"solr.BasicAuthPlugin",
> >>> "credentials":{"solr":"IV0EHq1OnNrj6gvRCwvFwTrZ1+z1oBbnQdiVC3otuq0=
> >>> Ndd7LKvVBAaZIF0QAVi1ekCfAJXr1GGfLtRUXhgrF8c="}
> >>> },"authorization":{
> >>> "class":"solr.RuleBasedAuthorizationPlugin",
> >>> "permissions":[{"name":"security-edit",
> >>> "role":"admin"}],
> >>> "user-role":{"solr":"admin"}
> >>> }}
> >
>
>
solr basic authentication
Hi, is there any way to disable basic authentication for particular domain. i have proxy pass from a domain to solr which is always asking credentials so wanted to disable basic auth only for that domain. is there any way? Thanks, Dinesh Sundaram.
Solr basic auth
Hi,
I have configured basic auth for solrcloud. it works well when i access the
solr url directly. i have integrated this solr with test.com domain. now if
I access the solr url like test.com/solr it prompts the credentials but I
dont want to ask this time since it is known domain. is there any way to
achieve this. much appreciate your quick response.
my security json below. i'm using the default security, want to allow my
domain default without prompting any credentials.
{"authentication":{
"blockUnknown": true,
"class":"solr.BasicAuthPlugin",
"credentials":{"solr":"IV0EHq1OnNrj6gvRCwvFwTrZ1+z1oBbnQdiVC3otuq0=
Ndd7LKvVBAaZIF0QAVi1ekCfAJXr1GGfLtRUXhgrF8c="}
},"authorization":{
"class":"solr.RuleBasedAuthorizationPlugin",
"permissions":[{"name":"security-edit",
"role":"admin"}],
"user-role":{"solr":"admin"}
}}
solr search connectivity error with shards
Hi, I have a domain called test.com to process solr search queries with 2 solr instances like below. second URL[2] works fine but I dont want to show up the localhost, portnumber to the end user so I tried to configure like first URL[1] but it is not working. I have the proxy pass in test.com apache to redirect /select to /solr. not sure why the second url[2] is trying to call from my solr server and it is end up with connection timeout error since test.com is not in the same DMZ network. is there any way to achieve this externalizer implementation? NOTE: all the shards URL works individually when it is combined throwing n/w exception because first query reaching target server, second query is originated from target server so connection broken. [1] https://test.com/select/mediator?fl=id,locale,headline,short_description,record,title,description,url&q=(locale:en-us+OR+page_locale:en-us)+AND+((offerSearch:*test*)+OR+(content:test))&rows=8&shards=https://test.com/select/global?fl=id,https://test.com/select/test-global?fl=id&sort=start_time+asc&start=0&wt=json [2] https://test.com/select/mediator?fl=id,locale,headline,short_description,record,title,description,url&q=(locale:en-us+OR+page_locale:en-us)+AND+((offerSearch:*test*)+OR+(content:test))&rows=8&shards=https://localhost:8983/solr/global/select?q=*:*,https://localhost:8983/global/select?q=*:*&sort=start_time+asc&start=0&wt=json Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://test.com:443/select/test-global at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:640) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589)
