And a little more details on Spark version, hadoop version and distribution would also help...
On Thu, Oct 13, 2016 at 9:05 PM, ayan guha <guha.a...@gmail.com> wrote: > I think one point you need to mention is your target - HDFS, Hive or Hbase > (or something else) and which end points are used. > > On Thu, Oct 13, 2016 at 8:50 PM, dbolshak <bolshakov.de...@gmail.com> > wrote: > >> Hello community, >> >> We've a challenge and no ideas how to solve it. >> >> The problem, >> >> Say we have the following environment: >> 1. `cluster A`, the cluster does not use kerberos and we use it as a >> source >> of data, important thing is - we don't manage this cluster. >> 2. `cluster B`, small cluster where our spark application is running and >> performing some logic. (we manage this cluster and it does not have >> kerberos). >> 3. `cluster C`, the cluster uses kerberos and we use it to keep results of >> our spark application, we manage this cluster >> >> Our requrements and conditions that are not mentioned yet: >> 1. All clusters are in a single data center, but in the different >> subnetworks. >> 2. We cannot turn on kerberos on `cluster A` >> 3. We cannot turn off kerberos on `cluster C` >> 4. We can turn on/off kerberos on `cluster B`, currently it's turned off. >> 5. Spark app is built on top of RDD and does not depend on spark-sql. >> >> Does anybody know how to write data using RDD api to remote cluster which >> is >> running with Kerberos? >> >> -- >> //with Best Regards >> --Denis Bolshakov >> e-mail: bolshakov.de...@gmail.com >> >> >> >> -- >> View this message in context: http://apache-spark-user-list. >> 1001560.n3.nabble.com/spark-with-kerberos-tp27894.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> >> > > > -- > Best Regards, > Ayan Guha > -- Best Regards, Ayan Guha
