spark git commit: [SPARK-17880][DOC] The url linking to `AccumulatorV2` in the document is incorrect.

2016-10-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 e68e95e94 -> f3d82b53c [SPARK-17880][DOC] The url linking to `AccumulatorV2` in the document is incorrect. ## What changes were proposed in this pull request? In `programming-guide.md`, the url which links to `AccumulatorV2` says

spark git commit: [SPARK-17880][DOC] The url linking to `AccumulatorV2` in the document is incorrect.

2016-10-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master 299eb04ba -> b512f04f8 [SPARK-17880][DOC] The url linking to `AccumulatorV2` in the document is incorrect. ## What changes were proposed in this pull request? In `programming-guide.md`, the url which links to `AccumulatorV2` says

spark git commit: Fix hadoop.version in building-spark.md

2016-10-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 5ec3e6680 -> e68e95e94 Fix hadoop.version in building-spark.md Couple of mvn build examples use `-Dhadoop.version=VERSION` instead of actual version number Author: Alexander Pivovarov Closes #15440 from

spark git commit: Fix hadoop.version in building-spark.md

2016-10-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master b9a147181 -> 299eb04ba Fix hadoop.version in building-spark.md Couple of mvn build examples use `-Dhadoop.version=VERSION` instead of actual version number Author: Alexander Pivovarov Closes #15440 from

spark git commit: [SPARK-17720][SQL] introduce static SQL conf

2016-10-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 5b77e66dd -> b9a147181 [SPARK-17720][SQL] introduce static SQL conf ## What changes were proposed in this pull request? SQLConf is session-scoped and mutable. However, we do have the requirement for a static SQL conf, which is global and

spark git commit: [SPARK-17387][PYSPARK] Creating SparkContext() from python without spark-submit ignores user conf

2016-10-11 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 23405f324 -> 5b77e66dd [SPARK-17387][PYSPARK] Creating SparkContext() from python without spark-submit ignores user conf ## What changes were proposed in this pull request? The root cause that we would ignore SparkConf when launching JVM

spark git commit: [SPARK-17816][CORE][BRANCH-2.0] Fix ConcurrentModificationException issue in BlockStatusesAccumulator

2016-10-11 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 a6b5e1dcc -> 5ec3e6680 [SPARK-17816][CORE][BRANCH-2.0] Fix ConcurrentModificationException issue in BlockStatusesAccumulator ## What changes were proposed in this pull request? Replaced `BlockStatusesAccumulator` with

spark git commit: [SPARK-15153][ML][SPARKR] Fix SparkR spark.naiveBayes error when label is numeric type

2016-10-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 07508bd01 -> 23405f324 [SPARK-15153][ML][SPARKR] Fix SparkR spark.naiveBayes error when label is numeric type ## What changes were proposed in this pull request? Fix SparkR ```spark.naiveBayes``` error when response variable of dataset is

spark git commit: [SPARK-17817][PYSPARK] PySpark RDD Repartitioning Results in Highly Skewed Partition Sizes

2016-10-11 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 75b9e3514 -> 07508bd01 [SPARK-17817][PYSPARK] PySpark RDD Repartitioning Results in Highly Skewed Partition Sizes ## What changes were proposed in this pull request? Quoted from JIRA description: Calling repartition on a PySpark RDD to

spark git commit: [SPARK-17346][SQL][TESTS] Fix the flaky topic deletion in KafkaSourceStressSuite

2016-10-11 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.0 ff9f5bbf1 -> a6b5e1dcc [SPARK-17346][SQL][TESTS] Fix the flaky topic deletion in KafkaSourceStressSuite ## What changes were proposed in this pull request? A follow up Pr for SPARK-17346 to fix flaky

spark git commit: [SPARK-17346][SQL][TESTS] Fix the flaky topic deletion in KafkaSourceStressSuite

2016-10-11 Thread tdas
Repository: spark Updated Branches: refs/heads/master c8c090640 -> 75b9e3514 [SPARK-17346][SQL][TESTS] Fix the flaky topic deletion in KafkaSourceStressSuite ## What changes were proposed in this pull request? A follow up Pr for SPARK-17346 to fix flaky

spark git commit: [SPARK-17821][SQL] Support And and Or in Expression Canonicalize

2016-10-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 3694ba48f -> c8c090640 [SPARK-17821][SQL] Support And and Or in Expression Canonicalize ## What changes were proposed in this pull request? Currently `Canonicalize` object doesn't support `And` and `Or`. So we can compare canonicalized

spark git commit: [SPARK-17864][SQL] Mark data type APIs as stable (not DeveloperApi)

2016-10-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 7388ad94d -> 3694ba48f [SPARK-17864][SQL] Mark data type APIs as stable (not DeveloperApi) ## What changes were proposed in this pull request? The data type API has not been changed since Spark 1.3.0, and is ready for graduation. This

spark git commit: [SPARK-17338][SQL][FOLLOW-UP] add global temp view

2016-10-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 658c7147f -> 7388ad94d [SPARK-17338][SQL][FOLLOW-UP] add global temp view ## What changes were proposed in this pull request? address post hoc review comments for https://github.com/apache/spark/pull/14897 ## How was this patch tested?

spark git commit: [SPARK-17808][PYSPARK] Upgraded version of Pyrolite to 4.13

2016-10-11 Thread srowen
Repository: spark Updated Branches: refs/heads/master 19401a203 -> 658c7147f [SPARK-17808][PYSPARK] Upgraded version of Pyrolite to 4.13 ## What changes were proposed in this pull request? Upgraded to a newer version of Pyrolite which supports serialization of a BinaryType StructField for