svn commit: r28192 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_17_20_01-fc2e189-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-17 Thread pwendell
Author: pwendell Date: Wed Jul 18 03:16:43 2018 New Revision: 28192 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_17_20_01-fc2e189 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24529][BUILD][TEST-MAVEN][FOLLOW-UP] Set spotbugs-maven-plugin's fork to true

2018-07-17 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 681845fd6 -> fc2e18963 [SPARK-24529][BUILD][TEST-MAVEN][FOLLOW-UP] Set spotbugs-maven-plugin's fork to true ## What changes were proposed in this pull request? Set `spotbugs-maven-plugin`'s fork to `true`, otherwise will throw exception

spark git commit: [SPARK-24402][SQL] Optimize `In` expression when only one element in the collection or collection is empty

2018-07-17 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 2a4dd6f06 -> 681845fd6 [SPARK-24402][SQL] Optimize `In` expression when only one element in the collection or collection is empty ## What changes were proposed in this pull request? Two new rules in the logical plan optimizers are added.

svn commit: r28188 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_17_16_01-2a4dd6f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-17 Thread pwendell
Author: pwendell Date: Tue Jul 17 23:16:14 2018 New Revision: 28188 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_17_16_01-2a4dd6f docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24681][SQL] Verify nested column names in Hive metastore

2018-07-17 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 912634b00 -> 2a4dd6f06 [SPARK-24681][SQL] Verify nested column names in Hive metastore ## What changes were proposed in this pull request? This pr added code to check if nested column names do not include ',', ':', and ';' because Hive

spark git commit: [SPARK-24747][ML] Make Instrumentation class more flexible

2018-07-17 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 7688ce88b -> 912634b00 [SPARK-24747][ML] Make Instrumentation class more flexible ## What changes were proposed in this pull request? This PR updates the Instrumentation class to make it more flexible and a little bit easier to use. When

svn commit: r28181 - in /dev/spark/2.3.3-SNAPSHOT-2018_07_17_10_01-e31b476-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-17 Thread pwendell
Author: pwendell Date: Tue Jul 17 17:16:23 2018 New Revision: 28181 Log: Apache Spark 2.3.3-SNAPSHOT-2018_07_17_10_01-e31b476 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-21590][SS] Window start time should support negative values

2018-07-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 5215344de -> 7688ce88b [SPARK-21590][SS] Window start time should support negative values ## What changes were proposed in this pull request? Remove the non-negative checks of window start time to make window support negative start time,

spark git commit: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 dae352a29 -> e31b4766b [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive ## What changes were proposed in this pull request? Test HiveExternalCatalogVersionsSuite vs

spark git commit: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4cf1bec4d -> 5215344de [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive ## What changes were proposed in this pull request? Test HiveExternalCatalogVersionsSuite vs only

spark git commit: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of private fields in collection expressions.

2018-07-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 0ca16f6e1 -> 4cf1bec4d [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of private fields in collection expressions. ## What changes were proposed in this pull request? The PR tries to avoid serialization of private fields of already

svn commit: r28168 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_17_00_01-0ca16f6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-17 Thread pwendell
Author: pwendell Date: Tue Jul 17 07:16:44 2018 New Revision: 28168 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_17_00_01-0ca16f6 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]