spark git commit: [SPARK-25023] Clarify Spark security documentation
Repository: spark
Updated Branches:
refs/heads/master e91b60771 -> c00186f90
[SPARK-25023] Clarify Spark security documentation
## What changes were proposed in this pull request?
Clarify documentation about security.
## How was this patch tested?
None, just documentation
Closes #22852 from tgravescs/SPARK-25023.
Authored-by: Thomas Graves
Signed-off-by: Thomas Graves
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c00186f9
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c00186f9
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c00186f9
Branch: refs/heads/master
Commit: c00186f90cfcc33492d760f874ead34f0e3da6ed
Parents: e91b607
Author: Thomas Graves
Authored: Fri Nov 2 10:56:30 2018 -0500
Committer: Thomas Graves
Committed: Fri Nov 2 10:56:30 2018 -0500
--
docs/index.md | 5 +
docs/quick-start.md | 5 +
docs/running-on-kubernetes.md | 5 +
docs/running-on-mesos.md | 5 +
docs/running-on-yarn.md | 5 +
docs/security.md | 17 +++--
docs/spark-standalone.md | 5 +
7 files changed, 45 insertions(+), 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/c00186f9/docs/index.md
--
diff --git a/docs/index.md b/docs/index.md
index d269f54..ac38f1d 100644
--- a/docs/index.md
+++ b/docs/index.md
@@ -10,6 +10,11 @@ It provides high-level APIs in Java, Scala, Python and R,
and an optimized engine that supports general execution graphs.
It also supports a rich set of higher-level tools including [Spark
SQL](sql-programming-guide.html) for SQL and structured data processing,
[MLlib](ml-guide.html) for machine learning,
[GraphX](graphx-programming-guide.html) for graph processing, and [Spark
Streaming](streaming-programming-guide.html).
+# Security
+
+Security in Spark is OFF by default. This could mean you are vulnerable to
attack by default.
+Please see [Spark Security](security.html) before downloading and running
Spark.
+
# Downloading
Get Spark from the [downloads page](https://spark.apache.org/downloads.html)
of the project website. This documentation is for Spark version
{{site.SPARK_VERSION}}. Spark uses Hadoop's client libraries for HDFS and YARN.
Downloads are pre-packaged for a handful of popular Hadoop versions.
http://git-wip-us.apache.org/repos/asf/spark/blob/c00186f9/docs/quick-start.md
--
diff --git a/docs/quick-start.md b/docs/quick-start.md
index ef7af6c..28186c1 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -17,6 +17,11 @@ you can download a package for any version of Hadoop.
Note that, before Spark 2.0, the main programming interface of Spark was the
Resilient Distributed Dataset (RDD). After Spark 2.0, RDDs are replaced by
Dataset, which is strongly-typed like an RDD, but with richer optimizations
under the hood. The RDD interface is still supported, and you can get a more
detailed reference at the [RDD programming guide](rdd-programming-guide.html).
However, we highly recommend you to switch to use Dataset, which has better
performance than RDD. See the [SQL programming
guide](sql-programming-guide.html) to get more information about Dataset.
+# Security
+
+Security in Spark is OFF by default. This could mean you are vulnerable to
attack by default.
+Please see [Spark Security](security.html) before running Spark.
+
# Interactive Analysis with the Spark Shell
## Basics
http://git-wip-us.apache.org/repos/asf/spark/blob/c00186f9/docs/running-on-kubernetes.md
--
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index 2917197..9052268 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -12,6 +12,11 @@ Kubernetes scheduler that has been added to Spark.
In future versions, there may be behavioral changes around configuration,
container images and entrypoints.**
+# Security
+
+Security in Spark is OFF by default. This could mean you are vulnerable to
attack by default.
+Please see [Spark Security](security.html) and the specific security sections
in this doc before running Spark.
+
# Prerequisites
* A runnable distribution of Spark 2.3 or above.
http://git-wip-us.apache.org/repos/asf/spark/blob/c00186f9/docs/running-on-mesos.md
--
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md
index b473e65..2502cd4 100644
--- a/docs/running-on-mesos.md
+++ b/docs/running-on-mesos.md
@@ -13,6 +13,11 @@ The advantages of deploying Spark with Mesos include:
[frameworks](https:
spark git commit: [SPARK-25023] Clarify Spark security documentation
Repository: spark
Updated Branches:
refs/heads/branch-2.4 8c508da2a -> ea11d1142
[SPARK-25023] Clarify Spark security documentation
## What changes were proposed in this pull request?
Clarify documentation about security.
## How was this patch tested?
None, just documentation
Closes #22852 from tgravescs/SPARK-25023.
Authored-by: Thomas Graves
Signed-off-by: Thomas Graves
(cherry picked from commit c00186f90cfcc33492d760f874ead34f0e3da6ed)
Signed-off-by: Thomas Graves
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ea11d114
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ea11d114
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ea11d114
Branch: refs/heads/branch-2.4
Commit: ea11d114264560638129eac1db3aa1dc12a206a2
Parents: 8c508da
Author: Thomas Graves
Authored: Fri Nov 2 10:56:30 2018 -0500
Committer: Thomas Graves
Committed: Fri Nov 2 10:56:44 2018 -0500
--
docs/index.md | 5 +
docs/quick-start.md | 5 +
docs/running-on-kubernetes.md | 5 +
docs/running-on-mesos.md | 5 +
docs/running-on-yarn.md | 5 +
docs/security.md | 17 +++--
docs/spark-standalone.md | 5 +
7 files changed, 45 insertions(+), 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/ea11d114/docs/index.md
--
diff --git a/docs/index.md b/docs/index.md
index 40f628b..0300528 100644
--- a/docs/index.md
+++ b/docs/index.md
@@ -10,6 +10,11 @@ It provides high-level APIs in Java, Scala, Python and R,
and an optimized engine that supports general execution graphs.
It also supports a rich set of higher-level tools including [Spark
SQL](sql-programming-guide.html) for SQL and structured data processing,
[MLlib](ml-guide.html) for machine learning,
[GraphX](graphx-programming-guide.html) for graph processing, and [Spark
Streaming](streaming-programming-guide.html).
+# Security
+
+Security in Spark is OFF by default. This could mean you are vulnerable to
attack by default.
+Please see [Spark Security](security.html) before downloading and running
Spark.
+
# Downloading
Get Spark from the [downloads page](https://spark.apache.org/downloads.html)
of the project website. This documentation is for Spark version
{{site.SPARK_VERSION}}. Spark uses Hadoop's client libraries for HDFS and YARN.
Downloads are pre-packaged for a handful of popular Hadoop versions.
http://git-wip-us.apache.org/repos/asf/spark/blob/ea11d114/docs/quick-start.md
--
diff --git a/docs/quick-start.md b/docs/quick-start.md
index ef7af6c..28186c1 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -17,6 +17,11 @@ you can download a package for any version of Hadoop.
Note that, before Spark 2.0, the main programming interface of Spark was the
Resilient Distributed Dataset (RDD). After Spark 2.0, RDDs are replaced by
Dataset, which is strongly-typed like an RDD, but with richer optimizations
under the hood. The RDD interface is still supported, and you can get a more
detailed reference at the [RDD programming guide](rdd-programming-guide.html).
However, we highly recommend you to switch to use Dataset, which has better
performance than RDD. See the [SQL programming
guide](sql-programming-guide.html) to get more information about Dataset.
+# Security
+
+Security in Spark is OFF by default. This could mean you are vulnerable to
attack by default.
+Please see [Spark Security](security.html) before running Spark.
+
# Interactive Analysis with the Spark Shell
## Basics
http://git-wip-us.apache.org/repos/asf/spark/blob/ea11d114/docs/running-on-kubernetes.md
--
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index f19aa41..754b1ff 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -12,6 +12,11 @@ Kubernetes scheduler that has been added to Spark.
In future versions, there may be behavioral changes around configuration,
container images and entrypoints.**
+# Security
+
+Security in Spark is OFF by default. This could mean you are vulnerable to
attack by default.
+Please see [Spark Security](security.html) and the specific security sections
in this doc before running Spark.
+
# Prerequisites
* A runnable distribution of Spark 2.3 or above.
http://git-wip-us.apache.org/repos/asf/spark/blob/ea11d114/docs/running-on-mesos.md
--
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md
index b473e65..2502cd4 100644
--- a/docs/running-on-mesos.md
+++ b/docs/running-
