GitHub user dud225 opened a pull request:
https://github.com/apache/spark/pull/16885
Encryption of shuffle files
Hello
According to my understanding of commits
4b4e329e49f8af28fa6301bd06c48d7097eaf9e6 &
8b325b17ecdf013b7a6edcb7ee3773546bd914df, one may now encrypt shuffle files
regardless of the cluster manager in use.
However I have limited understanding of the code, I'm not able to find out
whether theses changes also comprise all "temporary local storage, such as
shuffle files, cached data, and other application files".
Please feel free to amend or reject my PR if I'm wrong.
dud
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dud225/spark patch-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16885.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16885
----
commit 6f12a77308e09cea7f775efefbbc6a2108453394
Author: Hervé <[email protected]>
Date: 2017-02-10T10:22:40Z
Encryption of shuffle files
Add a note about shuffle files encryption
Shuffle files encryption has been introduced by
4b4e329e49f8af28fa6301bd06c48d7097eaf9e6 and extended for all cluster managers
by 8b325b17ecdf013b7a6edcb7ee3773546bd914df.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
