spark git commit: [SPARK-24665][PYSPARK] Use SQLConf in PySpark to manage all sql configs

2018-07-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f825847c8 -> 8f91c697e [SPARK-24665][PYSPARK] Use SQLConf in PySpark to manage all sql configs ## What changes were proposed in this pull request? Use SQLConf for PySpark to manage all sql configs, drop all the hard code in config usage.

spark-website git commit: Fix spark 2.1.3 link issues

2018-07-01 Thread holden
Repository: spark-website Updated Branches: refs/heads/asf-site 3a6349595 -> 775127770 Fix spark 2.1.3 link issues Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/77512777 Tree: http://git-wip-us.apache.org

[34/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/allclasses-frame.html -- diff --git a/site/docs/2.1.3/api/java/allclasses-frame.html b/site/docs/2.1.3/api/java/allclasses-frame.html new

[23/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/InternalAccumulator.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/InternalAccumulator.html b/site/docs/2

[33/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.1.3/api/java/allclasses-noframe.html b/site/docs/2.1.3/api/java/allclasses-noframe.htm

[19/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/SparkContext.html b/site/docs/2.1.3/api/java/

[16/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/StopMapOutputTracker.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/StopMapOutputTracker.html b/site/doc

[47/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/ascii.html -- diff --git a/site/docs/2.1.3/api/R/ascii.html b/site/docs/2.1.3/api/R/ascii.html new file mode 100644 index 000..7ff98c5 ---

[29/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/lib/jquery.js -- diff --git a/site/docs/2.1.3/api/java/lib/jquery.js b/site/docs/2.1.3/api/java/lib/jquery.js new file mode 100644 index 0

[48/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/00frame_toc.html -- diff --git a/site/docs/2.1.3/api/R/00frame_toc.html b/site/docs/2.1.3/api/R/00frame_toc.html new file mode 100644 index 0

[35/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/window.html -- diff --git a/site/docs/2.1.3/api/R/window.html b/site/docs/2.1.3/api/R/window.html new file mode 100644 index 000..95900c6

[42/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/limit.html -- diff --git a/site/docs/2.1.3/api/R/limit.html b/site/docs/2.1.3/api/R/limit.html new file mode 100644 index 000..c789317 ---

[43/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/hex.html -- diff --git a/site/docs/2.1.3/api/R/hex.html b/site/docs/2.1.3/api/R/hex.html new file mode 100644 index 000..618d26f --- /dev/

[12/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaFutureAction.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaFutureAction.html

[39/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/sd.html -- diff --git a/site/docs/2.1.3/api/R/sd.html b/site/docs/2.1.3/api/R/sd.html new file mode 100644 index 000..3373251 --- /dev/nul

[24/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/ExecutorRemoved.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/ExecutorRemoved.html b/site/docs/2.1.3/api

[03/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/function/VoidFunction.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/function/VoidFunct

[20/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/SparkConf.html b/site/docs/2.1.3/api/java/org/ap

[46/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/columns.html -- diff --git a/site/docs/2.1.3/api/R/columns.html b/site/docs/2.1.3/api/R/columns.html new file mode 100644 index 000..5940

[15/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/TaskKilled.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/TaskKilled.html b/site/docs/2.1.3/api/java/org/

[25/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/ComplexFutureAction.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/ComplexFutureAction.html b/site/docs/2

[32/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/constant-values.html -- diff --git a/site/docs/2.1.3/api/java/constant-values.html b/site/docs/2.1.3/api/java/constant-values.html new fil

[17/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/SparkJobInfo.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/SparkJobInfo.html b/site/docs/2.1.3/api/java/

[41/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/ncol.html -- diff --git a/site/docs/2.1.3/api/R/ncol.html b/site/docs/2.1.3/api/R/ncol.html new file mode 100644 index 000..0b34287 --- /d

[27/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/AccumulatorParam.Int

[36/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/summary.html -- diff --git a/site/docs/2.1.3/api/R/summary.html b/site/docs/2.1.3/api/R/summary.html new file mode 100644 index 000..b7f0

[37/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/sparkR.conf.html -- diff --git a/site/docs/2.1.3/api/R/sparkR.conf.html b/site/docs/2.1.3/api/R/sparkR.conf.html new file mode 100644 index 0

[13/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaDoubleRDD.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaDoubleRDD.html b/site

[44/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/filter.html -- diff --git a/site/docs/2.1.3/api/R/filter.html b/site/docs/2.1.3/api/R/filter.html new file mode 100644 index 000..322d1e3

[08/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaRDDLike.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaRDDLike.html b/site/doc

[11/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html

[07/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaSparkContext.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaSparkContext.html

[14/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/UnknownReason.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/UnknownReason.html b/site/docs/2.1.3/api/jav

[50/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/documentation.md -- diff --git a/documentation.md b/documentation.md index 5212be3..6c587e0 100644 --- a/documentation.md +++ b/documentation.md @@ -16,6 +16,7 @@ n

[21/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/RangePartitioner.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/RangePartitioner.html b/site/docs/2.1.3/a

[40/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/read.df.html -- diff --git a/site/docs/2.1.3/api/R/read.df.html b/site/docs/2.1.3/api/R/read.df.html new file mode 100644 index 000..2ab7

[28/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/Accumulable.html b/site/docs/2.1.3/api/java/or

[05/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/function/CoGroupFunction.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/function/CoGrou

[38/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/spark.gbt.html -- diff --git a/site/docs/2.1.3/api/R/spark.gbt.html b/site/docs/2.1.3/api/R/spark.gbt.html new file mode 100644 index 000

[22/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/JobExecutionStatus.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/JobExecutionStatus.html b/site/docs/2.1

[26/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/CleanAccum.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/CleanAccum.html b/site/docs/2.1.3/api/java/org/

[45/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/date_format.html -- diff --git a/site/docs/2.1.3/api/R/date_format.html b/site/docs/2.1.3/api/R/date_format.html new file mode 100644 index 0

[49/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/R/00Index.html -- diff --git a/site/docs/2.1.3/api/R/00Index.html b/site/docs/2.1.3/api/R/00Index.html new file mode 100644 index 000..8cd1

[31/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/index-all.html -- diff --git a/site/docs/2.1.3/api/java/index-all.html b/site/docs/2.1.3/api/java/index-all.html new file mode 100644 inde

[30/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/index.html -- diff --git a/site/docs/2.1.3/api/java/index.html b/site/docs/2.1.3/api/java/index.html new file mode 100644 index 000..f

[09/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaRDD.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaRDD.html b/site/docs/2.1.3/a

[02/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/r/BaseRRDD.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/r/BaseRRDD.html b/site/docs/2.1.3/api/j

[10/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaPairRDD.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaPairRDD.html b/site/doc

[18/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/SparkEnv.html b/site/docs/2.1.3/api/java/org/apac

[04/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/function/Function0.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/function/Function0.ht

[01/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
Repository: spark-website Updated Branches: refs/heads/asf-site ac6ba355d -> 3a6349595 http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/r/RRDD.html -- diff --git a

[06/51] [partial] spark-website git commit: Update website for 2.1.3 release.

2018-07-01 Thread holden
http://git-wip-us.apache.org/repos/asf/spark-website/blob/3a634959/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaSparkStatusTracker.html -- diff --git a/site/docs/2.1.3/api/java/org/apache/spark/api/java/JavaSparkStatusTr