svn commit: r30591 - in /dev/spark/v2.4.0-rc5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-11-02 Thread wenchen
Author: wenchen Date: Fri Nov 2 07:13:46 2018 New Revision: 30591 Log: Apache Spark v2.4.0-rc5 docs [This commit notification would consist of 1479 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] -

svn commit: r30592 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_02_00_02-e91b607-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-02 Thread pwendell
Author: pwendell Date: Fri Nov 2 07:16:53 2018 New Revision: 30592 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_02_00_02-e91b607 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r30593 - in /dev/spark/2.4.1-SNAPSHOT-2018_11_02_02_02-8c508da-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-02 Thread pwendell
Author: pwendell Date: Fri Nov 2 09:17:07 2018 New Revision: 30593 Log: Apache Spark 2.4.1-SNAPSHOT-2018_11_02_02_02-8c508da docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25023] Clarify Spark security documentation

2018-11-02 Thread tgraves
Repository: spark Updated Branches: refs/heads/master e91b60771 -> c00186f90 [SPARK-25023] Clarify Spark security documentation ## What changes were proposed in this pull request? Clarify documentation about security. ## How was this patch tested? None, just documentation Closes #22852 fro

spark git commit: [SPARK-25023] Clarify Spark security documentation

2018-11-02 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.4 8c508da2a -> ea11d1142 [SPARK-25023] Clarify Spark security documentation ## What changes were proposed in this pull request? Clarify documentation about security. ## How was this patch tested? None, just documentation Closes #22852

spark git commit: [SPARK-25909] fix documentation on cluster managers

2018-11-02 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.4 ea11d1142 -> 11e07812c [SPARK-25909] fix documentation on cluster managers ## What changes were proposed in this pull request? Propose changing the documentation to state that there are 4, not 3, cluster managers available. ## How wa

spark git commit: [SPARK-25909] fix documentation on cluster managers

2018-11-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master c00186f90 -> c71db43e1 [SPARK-25909] fix documentation on cluster managers ## What changes were proposed in this pull request? Propose changing the documentation to state that there are 4, not 3, cluster managers available. ## How was th

svn commit: r30628 - in /dev/spark/2.4.1-SNAPSHOT-2018_11_02_10_02-11e0781-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-02 Thread pwendell
Author: pwendell Date: Fri Nov 2 17:17:17 2018 New Revision: 30628 Log: Apache Spark 2.4.1-SNAPSHOT-2018_11_02_10_02-11e0781 docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r30630 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_02_12_03-c71db43-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-02 Thread pwendell
Author: pwendell Date: Fri Nov 2 19:17:26 2018 New Revision: 30630 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_02_12_03-c71db43 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25827][CORE] Avoid converting incoming encrypted blocks to byte buffers

2018-11-02 Thread vanzin
Repository: spark Updated Branches: refs/heads/master c71db43e1 -> 7ea594e78 [SPARK-25827][CORE] Avoid converting incoming encrypted blocks to byte buffers ## What changes were proposed in this pull request? Avoid converting encrypted bocks to regular ByteBuffers, to ensure they can be sent

spark git commit: [SPARK-25827][CORE] Avoid converting incoming encrypted blocks to byte buffers

2018-11-02 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.4 11e07812c -> 881a60403 [SPARK-25827][CORE] Avoid converting incoming encrypted blocks to byte buffers ## What changes were proposed in this pull request? Avoid converting encrypted bocks to regular ByteBuffers, to ensure they can be s

[1/2] spark git commit: [SPARK-25875][K8S] Merge code to set up driver command into a single step.

2018-11-02 Thread mcheah
Repository: spark Updated Branches: refs/heads/master 7ea594e78 -> 3404a73f4 http://git-wip-us.apache.org/repos/asf/spark/blob/3404a73f/resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/bindings/PythonDriverFeatureStepSuite.scala -

[2/2] spark git commit: [SPARK-25875][K8S] Merge code to set up driver command into a single step.

2018-11-02 Thread mcheah
[SPARK-25875][K8S] Merge code to set up driver command into a single step. Right now there are 3 different classes dealing with building the driver command to run inside the pod, one for each "binding" supported by Spark. This has two main shortcomings: - the code in the 3 classes is very similar

svn commit: r30632 - in /dev/spark/2.4.1-SNAPSHOT-2018_11_02_14_02-881a604-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-02 Thread pwendell
Author: pwendell Date: Fri Nov 2 21:16:59 2018 New Revision: 30632 Log: Apache Spark 2.4.1-SNAPSHOT-2018_11_02_14_02-881a604 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25861][MINOR][WEBUI] Remove unused refreshInterval parameter from the headerSparkPage method.

2018-11-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3404a73f4 -> ed0c57e10 [SPARK-25861][MINOR][WEBUI] Remove unused refreshInterval parameter from the headerSparkPage method. ## What changes were proposed in this pull request? 'refreshInterval' is not used any where in the headerSparkPage

svn commit: r30635 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_02_16_02-ed0c57e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-02 Thread pwendell
Author: pwendell Date: Fri Nov 2 23:16:34 2018 New Revision: 30635 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_02_16_02-ed0c57e docs [This commit notification would consist of 1471 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25901][CORE] Use only one thread in BarrierTaskContext companion object

2018-11-02 Thread jiangxb1987
Repository: spark Updated Branches: refs/heads/master ed0c57e10 -> 0e318acd0 [SPARK-25901][CORE] Use only one thread in BarrierTaskContext companion object ## What changes were proposed in this pull request? Now we use only one `timer` (and thus a backing thread) in `BarrierTaskContext` comp