RE: Anyone got a good solid example of integrating Spark and Solr

[Adline Dsilva]

Hi
Take a look into https://github.com/lucidworks/spark-solr . this support 
authentication with kerberized solr. Unfortunately this implementation has 
support from solr 5.x+. and CDH has Solr 4.x. One option is to use Apache Solr 
6.X with CDH.

Regards,
Adline
Sent from Mail for Windows 10

From: Nkechi Achara
Sent: Wednesday, September 14, 2016 7:52 PM
To: user@spark.apache.org
Subject: Anyone got a good solid example of integrating Spark and Solr

Hi All,

I am trying to find some good examples on how to implement Spark and Solr and 
coming up blank. Basically the implementation of spark-solr does not seem to 
work correctly with CDH 552 (*1.5.x branch) where i am receiving various issues 
relating to dependencies, which I have not been fully able to unravel.

I have also attempted to implement a custom solution, where i copy the token 
and jaas to each executor, and set the necessary auth Properties, but this 
still is prone to failure due to serialization, and kerberos auth issues.

Has anyone got an example of an implementation of querying solr in a 
distributed way where kerberos is involved?

Thanks,

K


DISCLAIMER:


This e-mail (including any attachments) is for the addressee(s) only and may be 
confidential, especially as regards personal data. If you are not the intended 
recipient, please note that any dealing, review, distribution, printing, 
copying or use of this e-mail is strictly prohibited. If you have received this 
email in error, please notify the sender immediately and delete the original 
message (including any attachments).

MIMOS Berhad is a research and development institution under the purview of the 
Malaysian Ministry of Science, Technology and Innovation. Opinions, conclusions 
and other information in this e-mail that do not relate to the official 
business of MIMOS Berhad and/or its subsidiaries shall be understood as neither 
given nor endorsed by MIMOS Berhad and/or its subsidiaries and neither MIMOS 
Berhad nor its subsidiaries accepts responsibility for the same. All liability 
arising from or in connection with computer viruses and/or corrupted e-mails is 
excluded to the fullest extent permitted by law.

Anyone got a good solid example of integrating Spark and Solr

[Nkechi Achara]

Hi All,

I am trying to find some good examples on how to implement Spark and Solr
and coming up blank. Basically the implementation of spark-solr does not
seem to work correctly with CDH 552 (*1.5.x branch) where i am receiving
various issues relating to dependencies, which I have not been fully able
to unravel.

I have also attempted to implement a custom solution, where i copy the
token and jaas to each executor, and set the necessary auth Properties, but
this still is prone to failure due to serialization, and kerberos auth
issues.

Has anyone got an example of an implementation of querying solr in a
distributed way where kerberos is involved?

Thanks,

K