Thanks Steve! 1. spark-submit submitting the YARN app for launch? That you get it if you turn hadoop IPC encruption on, by settingo hadoop.rpc.protection=privacy across the cluster. > That's what I meant: Is there something similar for stand alone or Mesos?
2. communications between spark driver and executor. that can use HTTPS > My understanding is that that you can use HTTPS for the jar server on the driver, and SASL for block transfer. Is there anything else I'm missing? Cheers, Eugene On Tue, Feb 2, 2016 at 7:46 AM, Steve Loughran <ste...@hortonworks.com> wrote: > > > On 1 Feb 2016, at 20:48, eugene miretsky <eugene.miret...@gmail.com> > wrote: > > > > Spark supports client authentication via shared secret or kerberos (on > YARN). However, the job itself is sent unencrypted over the network. Is > there a way to encrypt the jobs the client submits to cluster? > > > define submission? > 1. spark-submit submitting the YARN app for launch? That you get it if > you turn hadoop IPC encruption on, by settingo > hadoop.rpc.protection=privacy across the cluster. 2. communications between spark driver and executor. that can use HTTPS > > > The rational for this is very similar to encrypting the HTTP file > server traffic - Jars may have sensitive data. > > > > Cheers, > > Eugene > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
