On Wed, Jul 19, 2017 at 1:10 PM, Udit Mehrotra <udit.mehrotr...@gmail.com> wrote: > Is there any additional configuration I need for external shuffle besides > setting the following: > spark.network.crypto.enabled true > spark.network.crypto.saslFallback false > spark.authenticate true
Have you set these options on the shuffle service configuration too (which is the YARN xml config file, not spark-defaults.conf)? If you have there might be an issue, and you should probably file a bug and include your NM's log file. -- Marcelo --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
