spark git commit: [SPARK-17712][SQL] Fix invalid pushdown of data-independent filters beneath aggregates

2016-09-28 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 7dfad4b13 -> 37eb9184f [SPARK-17712][SQL] Fix invalid pushdown of data-independent filters beneath aggregates ## What changes were proposed in this pull request? This patch fixes a minor correctness issue impacting the pushdown of

spark git commit: [SPARK-17710][HOTFIX] Fix ClassCircularityError in ReplSuite tests in Maven build: use 'Class.forName' instead of 'Utils.classForName'

2016-09-28 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 7d0923202 -> 7dfad4b13 [SPARK-17710][HOTFIX] Fix ClassCircularityError in ReplSuite tests in Maven build: use 'Class.forName' instead of 'Utils.classForName' ## What changes were proposed in this pull request? Fix ClassCircularityError in

[1/2] spark git commit: Preparing Spark release v2.0.1-rc4

2016-09-28 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.0 0a69477a1 -> 7d612a7d5 Preparing Spark release v2.0.1-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/933d2c1e Tree:

[2/2] spark git commit: Preparing development version 2.0.2-SNAPSHOT

2016-09-28 Thread pwendell
Preparing development version 2.0.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7d612a7d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7d612a7d Diff:

[spark] Git Push Summary

2016-09-28 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.0.1-rc4 [created] 933d2c1ea - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-17641][SQL] Collect_list/Collect_set should not collect null values.

2016-09-28 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 d358298f1 -> 0a69477a1 [SPARK-17641][SQL] Collect_list/Collect_set should not collect null values. ## What changes were proposed in this pull request? We added native versions of `collect_set` and `collect_list` in Spark 2.0. These

spark git commit: [SPARK-17641][SQL] Collect_list/Collect_set should not collect null values.

2016-09-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 557d6e322 -> 7d0923202 [SPARK-17641][SQL] Collect_list/Collect_set should not collect null values. ## What changes were proposed in this pull request? We added native versions of `collect_set` and `collect_list` in Spark 2.0. These

spark git commit: [SPARK-17713][SQL] Move row-datasource related tests out of JDBCSuite

2016-09-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master a6cfa3f38 -> 557d6e322 [SPARK-17713][SQL] Move row-datasource related tests out of JDBCSuite ## What changes were proposed in this pull request? As a followup for https://github.com/apache/spark/pull/15273 we should move non-JDBC

spark git commit: [SPARK-17673][SQL] Incorrect exchange reuse with RowDataSourceScan (backport)

2016-09-28 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 4c694e452 -> d358298f1 [SPARK-17673][SQL] Incorrect exchange reuse with RowDataSourceScan (backport) This backports https://github.com/apache/spark/pull/15273 to branch-2.0 Also verified the test passes after the patch was applied.

spark git commit: [SPARK-17696][SPARK-12330][CORE] Partial backport of to branch-1.6.

2016-09-28 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-1.6 e2ce0caed -> b999fa43e [SPARK-17696][SPARK-12330][CORE] Partial backport of to branch-1.6. >From the original commit message: This PR also fixes a regression caused by [SPARK-10987] whereby submitting a shutdown causes a race between

spark git commit: [SPARK-17673][SQL] Incorrect exchange reuse with RowDataSourceScan

2016-09-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 46d1203bf -> a6cfa3f38 [SPARK-17673][SQL] Incorrect exchange reuse with RowDataSourceScan ## What changes were proposed in this pull request? It seems the equality check for reuse of `RowDataSourceScanExec` nodes doesn't respect the

spark git commit: [SPARK-17644][CORE] Do not add failedStages when abortStage for fetch failure

2016-09-28 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 4d73d5cd8 -> 4c694e452 [SPARK-17644][CORE] Do not add failedStages when abortStage for fetch failure | Time|Thread 1 , Job1 | Thread 2 , Job2 | |:-:|:-:|:-:| | 1 | abort stage due to

spark git commit: [SPARK-17644][CORE] Do not add failedStages when abortStage for fetch failure

2016-09-28 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 219003775 -> 46d1203bf [SPARK-17644][CORE] Do not add failedStages when abortStage for fetch failure ## What changes were proposed in this pull request? | Time|Thread 1 , Job1 | Thread 2 , Job2 |

spark git commit: [MINOR][PYSPARK][DOCS] Fix examples in PySpark documentation

2016-09-28 Thread srowen
Repository: spark Updated Branches: refs/heads/master b2a7eedcd -> 219003775 [MINOR][PYSPARK][DOCS] Fix examples in PySpark documentation ## What changes were proposed in this pull request? This PR proposes to fix wrongly indented examples in PySpark documentation ``` ->>> json_sdf

spark git commit: [MINOR][PYSPARK][DOCS] Fix examples in PySpark documentation

2016-09-28 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 1b02f8820 -> 4d73d5cd8 [MINOR][PYSPARK][DOCS] Fix examples in PySpark documentation ## What changes were proposed in this pull request? This PR proposes to fix wrongly indented examples in PySpark documentation ``` ->>>

spark git commit: [SPARK-17017][ML][MLLIB][ML][DOC] Updated the ml/mllib feature selection docs for ChiSqSelector

2016-09-28 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4a8339568 -> b2a7eedcd [SPARK-17017][ML][MLLIB][ML][DOC] Updated the ml/mllib feature selection docs for ChiSqSelector ## What changes were proposed in this pull request? A follow up for #14597 to update feature selection docs about

spark git commit: [SPARK-17666] Ensure that RecordReaders are closed by data source file scans (backport)

2016-09-28 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 2cd327ef5 -> 1b02f8820 [SPARK-17666] Ensure that RecordReaders are closed by data source file scans (backport) This is a branch-2.0 backport of #15245. ## What changes were proposed in this pull request? This patch addresses a