GitHub user jerryshao opened a pull request:

    https://github.com/apache/spark/pull/19227

    [SPARK-20060][CORE] Support accessing secure Hadoop cluster in standalone 
client mode

    ## What changes were proposed in this pull request?
    
    This PR leverages the facility of SPARK-16742 to support accessing security 
Hadoop cluster in standalone client mode. The key idea is brought from 
SPARK-16742, add a simple logics to support `HadoopDelegationTokenManager` in 
`StandaloneSchedulerBackend`. Besides this PR also address related 
docs/configuration issue:
    
    1. Rename "spark.yarn.principal", "spark.yarn.keytab" to 
"spark.security.principal" and "spark.security.keytab", since principal/keytab 
is not only used in yarn mode, so rename it to be more meaningful.
    2. Move the related docs from `running-on-yarn` page to `security` page, 
since it is not a yarn only feature.
    3. Change `spark-submit --help` output to be more precise about 
`--principal` and `--keytab`.
    
    ## How was this patch tested?
    
    The change is verified in local security cluster.
    
    @tgravescs @vanzin please help to review, thanks! I think the change is 
quite straightforward, mainly on the doc/configuration things, update them to 
be more accurate.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/jerryshao/apache-spark SPARK-20060

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/19227.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #19227
    
----
commit 2b3d2f24f94a1cee63fff9733b27f479673d7a90
Author: jerryshao <ss...@hortonworks.com>
Date:   2017-09-14T02:15:41Z

    Support accessing secure Hadoop cluster in standalone client mode

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to