spark git commit: [SPARK-25256][SQL][TEST] Plan mismatch errors in Hive tests in Scala 2.12

2018-08-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master bb3e6ed92 -> f29c2b528 [SPARK-25256][SQL][TEST] Plan mismatch errors in Hive tests in Scala 2.12 ## What changes were proposed in this pull request? ### For `SPARK-5775 read array from partitioned_parquet_with_key_and_complextypes`:

spark-website git commit: Add Dongjoon Hyun to the list of committers

2018-08-30 Thread dongjoon
Repository: spark-website Updated Branches: refs/heads/asf-site 7c294769a -> 92a85c6c2 Add Dongjoon Hyun to the list of committers Author: Dongjoon Hyun Closes #140 from dongjoon-hyun/add_dongjoon. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit:

svn commit: r29049 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_30_16_01-bb3e6ed-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-30 Thread pwendell
Author: pwendell Date: Thu Aug 30 23:15:53 2018 New Revision: 29049 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_30_16_01-bb3e6ed docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25287][INFRA] Add up-front check for JIRA_USERNAME and JIRA_PASSWORD

2018-08-30 Thread eje
Repository: spark Updated Branches: refs/heads/master d6d1224ff -> bb3e6ed92 [SPARK-25287][INFRA] Add up-front check for JIRA_USERNAME and JIRA_PASSWORD ## What changes were proposed in this pull request? Add an up-front check that `JIRA_USERNAME` and `JIRA_PASSWORD` have been set. If they

spark git commit: [SPARK-25275][K8S] require memberhip in wheel to run 'su' in dockerfiles

2018-08-30 Thread eje
Repository: spark Updated Branches: refs/heads/master a5fb5b62c -> d6d1224ff [SPARK-25275][K8S] require memberhip in wheel to run 'su' in dockerfiles ## What changes were proposed in this pull request? Add a PAM configuration in k8s dockerfile to require authentication into wheel to run as

spark git commit: [SPARK-25235][BUILD][SHELL][FOLLOWUP] Fix repl compile for 2.12

2018-08-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master c685b5f56 -> a5fb5b62c [SPARK-25235][BUILD][SHELL][FOLLOWUP] Fix repl compile for 2.12 ## What changes were proposed in this pull request? Error messages from

spark git commit: [SPARK-24411][SQL] Adding native Java tests for 'isInCollection'

2018-08-30 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 135ff16a3 -> c685b5f56 [SPARK-24411][SQL] Adding native Java tests for 'isInCollection' ## What changes were proposed in this pull request? `JavaColumnExpressionSuite.java` was added and

svn commit: r29045 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_30_12_01-135ff16-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-30 Thread pwendell
Author: pwendell Date: Thu Aug 30 19:16:13 2018 New Revision: 29045 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_30_12_01-135ff16 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25233][STREAMING] Give the user the option of specifying a minimum message per partition per batch when using kafka direct API with backpressure

2018-08-30 Thread koeninger
Repository: spark Updated Branches: refs/heads/master 9e0f9591a -> 135ff16a3 [SPARK-25233][STREAMING] Give the user the option of specifying a minimum message per partition per batch when using kafka direct API with backpressure After SPARK-18371, it is guaranteed that there would be at

svn commit: r29041 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_30_10_01-dbf0b93-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-30 Thread pwendell
Author: pwendell Date: Thu Aug 30 17:15:26 2018 New Revision: 29041 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_30_10_01-dbf0b93 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23997][SQL][FOLLOWUP] Update exception message

2018-08-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3c67cb0b5 -> 9e0f9591a [SPARK-23997][SQL][FOLLOWUP] Update exception message ## What changes were proposed in this pull request? This PR is an follow-up PR of #21087 based on [a discussion

svn commit: r29040 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_30_08_02-3c67cb0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-30 Thread pwendell
Author: pwendell Date: Thu Aug 30 15:19:24 2018 New Revision: 29040 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_30_08_02-3c67cb0 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24909][CORE] Always unregister pending partition on task completion.

2018-08-30 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.3 b072717b3 -> dbf0b9340 [SPARK-24909][CORE] Always unregister pending partition on task completion. Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts. To fix this we

svn commit: r29037 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_30_06_01-b072717-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-30 Thread pwendell
Author: pwendell Date: Thu Aug 30 13:15:51 2018 New Revision: 29037 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_30_06_01-b072717 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25273][DOC] How to install testthat 1.0.2

2018-08-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 306e881b6 -> b072717b3 [SPARK-25273][DOC] How to install testthat 1.0.2 ## What changes were proposed in this pull request? R tests require `testthat` v1.0.2. In the PR, I described how to install the version in the section

spark git commit: [SPARK-25273][DOC] How to install testthat 1.0.2

2018-08-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master e9fce2a4c -> 3c67cb0b5 [SPARK-25273][DOC] How to install testthat 1.0.2 ## What changes were proposed in this pull request? R tests require `testthat` v1.0.2. In the PR, I described how to install the version in the section

svn commit: r29036 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_30_04_02-e9fce2a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-30 Thread pwendell
Author: pwendell Date: Thu Aug 30 11:18:09 2018 New Revision: 29036 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_30_04_02-e9fce2a docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24716][TESTS][FOLLOW-UP] Test Hive metastore schema and parquet schema are in different letter cases

2018-08-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 56bc70047 -> e9fce2a4c [SPARK-24716][TESTS][FOLLOW-UP] Test Hive metastore schema and parquet schema are in different letter cases ## What changes were proposed in this pull request? Since https://github.com/apache/spark/pull/21696.

spark git commit: [SQL][MINOR] Fix compiling for scala 2.12

2018-08-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 3a66a7fca -> 56bc70047 [SQL][MINOR] Fix compiling for scala 2.12 ## What changes were proposed in this pull request? Introduced by #21320 and #11744 ``` $ sbt > ++2.12.6 > project sql > compile ... [error] [warn]