spark git commit: [SPARK-22895][SQL] Push down the deterministic predicates that are after the first non-deterministic

2017-12-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ee3af15fe -> cfbe11e81 [SPARK-22895][SQL] Push down the deterministic predicates that are after the first non-deterministic ## What changes were proposed in this pull request? Currently, we do not guarantee an order evaluation of

spark git commit: [SPARK-22363][SQL][TEST] Add unit test for Window spilling

2017-12-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ea0a5eef2 -> ee3af15fe [SPARK-22363][SQL][TEST] Add unit test for Window spilling ## What changes were proposed in this pull request? There is already test using window spilling, but the test coverage is not ideal. In this PR the already

svn commit: r23963 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_30_12_01-ea0a5ee-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-30 Thread pwendell
Author: pwendell Date: Sat Dec 30 20:14:59 2017 New Revision: 23963 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_30_12_01-ea0a5ee docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22924][SPARKR] R API for sortWithinPartitions

2017-12-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master fd7d141d8 -> ea0a5eef2 [SPARK-22924][SPARKR] R API for sortWithinPartitions ## What changes were proposed in this pull request? Add to `arrange` the option to sort only within partition ## How was this patch tested? manual, unit tests

spark git commit: [SPARK-22919] Bump httpclient versions

2017-12-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 234d9435d -> fd7d141d8 [SPARK-22919] Bump httpclient versions Hi all, I would like to bump the PATCH versions of both the Apache httpclient Apache httpcore. I use the SparkTC Stocator library for connecting to an object store, and I

svn commit: r23962 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_30_08_01-234d943-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-30 Thread pwendell
Author: pwendell Date: Sat Dec 30 16:15:07 2017 New Revision: 23962 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_30_08_01-234d943 docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [TEST][MINOR] remove redundant `EliminateSubqueryAliases` in test code

2017-12-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 14c4a62c1 -> 234d9435d [TEST][MINOR] remove redundant `EliminateSubqueryAliases` in test code ## What changes were proposed in this pull request? The `analyze` method in `implicit class DslLogicalPlan` already includes

svn commit: r23959 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_30_00_01-14c4a62-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-30 Thread pwendell
Author: pwendell Date: Sat Dec 30 08:16:06 2017 New Revision: 23959 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_30_00_01-14c4a62 docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]