spark git commit: [SPARK-23466][SQL] Remove redundant null checks in generated Java code by GenerateUnsafeProjection

2018-08-31 Thread ueshin
Repository: spark Updated Branches: refs/heads/master e1d72f2c0 -> c5583fdcd [SPARK-23466][SQL] Remove redundant null checks in generated Java code by GenerateUnsafeProjection ## What changes were proposed in this pull request? This PR works for one of TODOs in `GenerateUnsafeProjection`

svn commit: r29075 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_31_16_02-e1d72f2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-31 Thread pwendell
Author: pwendell Date: Fri Aug 31 23:16:05 2018 New Revision: 29075 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_31_16_02-e1d72f2 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25264][K8S] Fix comma-delineated arguments passed into PythonRunner and RRunner

2018-08-31 Thread mcheah
Repository: spark Updated Branches: refs/heads/master 32da87dfa -> e1d72f2c0 [SPARK-25264][K8S] Fix comma-delineated arguments passed into PythonRunner and RRunner ## What changes were proposed in this pull request? Fixes the issue brought up in

svn commit: r29067 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_31_12_02-32da87d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-31 Thread pwendell
Author: pwendell Date: Fri Aug 31 19:16:27 2018 New Revision: 29067 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_31_12_02-32da87d docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25286][CORE] Removing the dangerous parmap

2018-08-31 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 7fc8881b0 -> 32da87dfa [SPARK-25286][CORE] Removing the dangerous parmap ## What changes were proposed in this pull request? I propose to remove one of `parmap` methods which accepts an execution context as a parameter. The method should

spark git commit: [SPARK-25296][SQL][TEST] Create ExplainSuite

2018-08-31 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 339859c4e -> 7fc8881b0 [SPARK-25296][SQL][TEST] Create ExplainSuite ## What changes were proposed in this pull request? Move the output verification of Explain test cases to a new suite ExplainSuite. ## How was this patch tested? N/A

svn commit: r29060 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_31_08_02-339859c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-31 Thread pwendell
Author: pwendell Date: Fri Aug 31 15:17:20 2018 New Revision: 29060 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_31_08_02-339859c docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25261][MINOR][DOC] update the description for spark.executor|driver.memory in configuration.md

2018-08-31 Thread srowen
Repository: spark Updated Branches: refs/heads/master 8d9495a8f -> 339859c4e [SPARK-25261][MINOR][DOC] update the description for spark.executor|driver.memory in configuration.md ## What changes were proposed in this pull request? As described in

spark git commit: [SPARK-25207][SQL] Case-insensitve field resolution for filter pushdown when reading Parquet

2018-08-31 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 515708d5f -> 8d9495a8f [SPARK-25207][SQL] Case-insensitve field resolution for filter pushdown when reading Parquet ## What changes were proposed in this pull request? Currently, filter pushdown will not work if Parquet schema and Hive

spark git commit: [SPARK-25183][SQL] Spark HiveServer2 to use Spark ShutdownHookManager

2018-08-31 Thread jshao
Repository: spark Updated Branches: refs/heads/master aa70a0a1a -> 515708d5f [SPARK-25183][SQL] Spark HiveServer2 to use Spark ShutdownHookManager ## What changes were proposed in this pull request? Switch `org.apache.hive.service.server.HiveServer2` to register its shutdown callback with

spark git commit: [SPARK-25288][TESTS] Fix flaky Kafka transaction tests

2018-08-31 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master f29c2b528 -> aa70a0a1a [SPARK-25288][TESTS] Fix flaky Kafka transaction tests ## What changes were proposed in this pull request? Here are the failures: