spark git commit: [SPARK-18256] Improve the performance of event log replay in HistoryServer

2016-11-04 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 4cee2ce25 -> 0e3312ee7 [SPARK-18256] Improve the performance of event log replay in HistoryServer ## What changes were proposed in this pull request? This patch significantly improves the performance of event log replay in the

spark git commit: [SPARK-18167] Re-enable the non-flaky parts of SQLQuerySuite

2016-11-04 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.1 e51978c3d -> 0a303a694 [SPARK-18167] Re-enable the non-flaky parts of SQLQuerySuite ## What changes were proposed in this pull request? It seems the proximate cause of the test failures is that `cast(str as decimal)` in derby will

spark git commit: [SPARK-17337][SPARK-16804][SQL][BRANCH-2.0] Backport subquery related PRs

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 c864e8a80 -> 399597b04 [SPARK-17337][SPARK-16804][SQL][BRANCH-2.0] Backport subquery related PRs ## What changes were proposed in this pull request? This PR backports two subquery related PRs to branch-2.0: -

spark git commit: [SPARK-18167] Re-enable the non-flaky parts of SQLQuerySuite

2016-11-04 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 550cd56e8 -> 4cee2ce25 [SPARK-18167] Re-enable the non-flaky parts of SQLQuerySuite ## What changes were proposed in this pull request? It seems the proximate cause of the test failures is that `cast(str as decimal)` in derby will raise

spark git commit: [SPARK-17337][SQL] Do not pushdown predicates through filters with predicate subqueries

2016-11-04 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 a2d7e25e7 -> e51978c3d [SPARK-17337][SQL] Do not pushdown predicates through filters with predicate subqueries ## What changes were proposed in this pull request? The `PushDownPredicate` rule can create a wrong result if we try to

spark git commit: [SPARK-17337][SQL] Do not pushdown predicates through filters with predicate subqueries

2016-11-04 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master a42d738c5 -> 550cd56e8 [SPARK-17337][SQL] Do not pushdown predicates through filters with predicate subqueries ## What changes were proposed in this pull request? The `PushDownPredicate` rule can create a wrong result if we try to push a

spark git commit: [SPARK-18197][CORE] Optimise AppendOnlyMap implementation

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 cfe76028b -> a2d7e25e7 [SPARK-18197][CORE] Optimise AppendOnlyMap implementation ## What changes were proposed in this pull request? This improvement works by using the fastest comparison test first and we observed a 1% throughput

spark git commit: [SPARK-18197][CORE] Optimise AppendOnlyMap implementation

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master 14f235d56 -> a42d738c5 [SPARK-18197][CORE] Optimise AppendOnlyMap implementation ## What changes were proposed in this pull request? This improvement works by using the fastest comparison test first and we observed a 1% throughput

spark git commit: Closing some stale/invalid pull requests

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master 27602c337 -> 14f235d56 Closing some stale/invalid pull requests Closes #15758 Closes #15753 Closes #12708 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/14f235d5

spark git commit: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 dae1581d9 -> c864e8a80 [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet ## What changes were proposed in this pull request? This is a follow-up PR of #15741 in order to keep `nextPowerOf2`

spark git commit: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 8e145a94b -> cfe76028b [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet ## What changes were proposed in this pull request? This is a follow-up PR of #15741 in order to keep `nextPowerOf2`

spark git commit: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master a08463b1d -> 27602c337 [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet ## What changes were proposed in this pull request? This is a follow-up PR of #15741 in order to keep `nextPowerOf2` consistent.