spark git commit: [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook

2015-12-13 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 8af2f8c61 -> 2aecda284 [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook 1. Make sure workers and masters exit so that no worker or master will still be running when triggering the shutdown hook. 2

spark git commit: [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook

2015-12-13 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-1.6 d7e3bfd7d -> fbf16da2e [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook 1. Make sure workers and masters exit so that no worker or master will still be running when triggering the shutdown hoo

[2/2] spark git commit: [SPARK-12213][SQL] use multiple partitions for single distinct query

2015-12-13 Thread yhuai
[SPARK-12213][SQL] use multiple partitions for single distinct query Currently, we could generate different plans for query with single distinct (depends on spark.sql.specializeSingleDistinctAggPlanning), one works better on low cardinality columns, the other works better for high cardinality co

[1/2] spark git commit: [SPARK-12213][SQL] use multiple partitions for single distinct query

2015-12-13 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 2aecda284 -> 834e71489 http://git-wip-us.apache.org/repos/asf/spark/blob/834e7148/sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/utils.scala -- diff --git

spark git commit: [SPARK-12275][SQL] No plan for BroadcastHint in some condition

2015-12-13 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 834e71489 -> ed87f6d3b [SPARK-12275][SQL] No plan for BroadcastHint in some condition When SparkStrategies.BasicOperators's "case BroadcastHint(child) => apply(child)" is hit, it only recursively invokes BasicOperators.apply with this "ch

spark git commit: [SPARK-12275][SQL] No plan for BroadcastHint in some condition

2015-12-13 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.6 fbf16da2e -> 94ce5025f [SPARK-12275][SQL] No plan for BroadcastHint in some condition When SparkStrategies.BasicOperators's "case BroadcastHint(child) => apply(child)" is hit, it only recursively invokes BasicOperators.apply with this