svn commit: r26122 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_03_20_02-5cfd5fa-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-03 Thread pwendell
Author: pwendell Date: Wed Apr 4 03:17:28 2018 New Revision: 26122 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_03_20_02-5cfd5fa docs [This commit notification would consist of 1452 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26120 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_03_18_01-28c9adb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-03 Thread pwendell
Author: pwendell Date: Wed Apr 4 01:16:07 2018 New Revision: 26120 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_03_18_01-28c9adb docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23802][SQL] PropagateEmptyRelation can leave query plan in unresolved state

2018-04-03 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 f36bdb401 -> 28c9adbd6 [SPARK-23802][SQL] PropagateEmptyRelation can leave query plan in unresolved state ## What changes were proposed in this pull request? Add cast to nulls introduced by PropagateEmptyRelation so in cases they're

spark git commit: [SPARK-23802][SQL] PropagateEmptyRelation can leave query plan in unresolved state

2018-04-03 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 359375eff -> 5cfd5fabc [SPARK-23802][SQL] PropagateEmptyRelation can leave query plan in unresolved state ## What changes were proposed in this pull request? Add cast to nulls introduced by PropagateEmptyRelation so in cases they're part

spark git commit: [SPARK-23809][SQL] Active SparkSession should be set by getOrCreate

2018-04-03 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 1035aaa61 -> 359375eff [SPARK-23809][SQL] Active SparkSession should be set by getOrCreate ## What changes were proposed in this pull request? Currently, the active spark session is set inconsistently (e.g., in createDataFrame, prior to

spark git commit: [SPARK-23587][SQL] Add interpreted execution for MapObjects expression

2018-04-03 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 66a3a5a2d -> 1035aaa61 [SPARK-23587][SQL] Add interpreted execution for MapObjects expression ## What changes were proposed in this pull request? Add interpreted execution for `MapObjects` expression. ## How was this patch tested? Added

svn commit: r26110 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_03_12_01-66a3a5a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-03 Thread pwendell
Author: pwendell Date: Tue Apr 3 19:17:01 2018 New Revision: 26110 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_03_12_01-66a3a5a docs [This commit notification would consist of 1452 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23099][SS] Migrate foreach sink to DataSourceV2

2018-04-03 Thread tdas
Repository: spark Updated Branches: refs/heads/master 7cf9fab33 -> 66a3a5a2d [SPARK-23099][SS] Migrate foreach sink to DataSourceV2 ## What changes were proposed in this pull request? Migrate foreach sink to DataSourceV2. Since the previous attempt at this PR #20552, we've changed and

svn commit: r26109 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_03_10_01-f36bdb4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-03 Thread pwendell
Author: pwendell Date: Tue Apr 3 17:16:43 2018 New Revision: 26109 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_03_10_01-f36bdb4 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [MINOR][CORE] Show block manager id when remove RDD/Broadcast fails.

2018-04-03 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 ce1565115 -> f36bdb401 [MINOR][CORE] Show block manager id when remove RDD/Broadcast fails. ## What changes were proposed in this pull request? Address https://github.com/apache/spark/pull/20924#discussion_r177987175, show block

spark git commit: [MINOR][CORE] Show block manager id when remove RDD/Broadcast fails.

2018-04-03 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 8020f66fc -> 7cf9fab33 [MINOR][CORE] Show block manager id when remove RDD/Broadcast fails. ## What changes were proposed in this pull request? Address https://github.com/apache/spark/pull/20924#discussion_r177987175, show block manager