spark git commit: [SPARK-13974][SQL] sub-query names do not need to be globally unique while generate SQL

2016-03-18 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 1614485fd -> 453455c47 [SPARK-13974][SQL] sub-query names do not need to be globally unique while generate SQL ## What changes were proposed in this pull request? We only need to make sub-query names unique every time we generate a SQL

spark git commit: [SPARK-14001][SQL] support multi-children Union in SQLBuilder

2016-03-18 Thread lian
Repository: spark Updated Branches: refs/heads/master 7783b6f38 -> 0f1015ffd [SPARK-14001][SQL] support multi-children Union in SQLBuilder ## What changes were proposed in this pull request? The fix is simple, use the existing `CombineUnions` rule to combine adjacent Unions before build SQL

spark git commit: [SPARK-13403][SQL] Pass hadoopConfiguration to HiveConf constructors.

2016-03-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master de1a84e56 -> 5faba9fac [SPARK-13403][SQL] Pass hadoopConfiguration to HiveConf constructors. This commit updates the HiveContext so that sc.hadoopConfiguration is used to instantiate its internal instances of HiveConf. I tested this by

spark git commit: [MINOR][DOCS] Update build descriptions and commands

2016-03-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master f43a26ef9 -> c11ea2e41 [MINOR][DOCS] Update build descriptions and commands ## What changes were proposed in this pull request? This PR updates Scala and Hadoop versions in the build description and commands in `Building Spark`

spark git commit: [SPARK-13958] Executor OOM due to unbounded growth of pointer array in…

2016-03-18 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.6 1fcd17f84 -> 022e06d18 [SPARK-13958] Executor OOM due to unbounded growth of pointer array in… ## What changes were proposed in this pull request? This change fixes the executor OOM which was recently introduced in PR

[3/5] spark git commit: [SPARK-13928] Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2016-03-18 Thread wenchen
http://git-wip-us.apache.org/repos/asf/spark/blob/8ef3399a/core/src/test/scala/org/apache/spark/ThreadingSuite.scala -- diff --git a/core/src/test/scala/org/apache/spark/ThreadingSuite.scala

spark git commit: [SPARK-13972][SQ] hive tests should fail if SQL generation failed

2016-03-18 Thread lian
Repository: spark Updated Branches: refs/heads/master 53f32a22d -> 0acb32a3f [SPARK-13972][SQ] hive tests should fail if SQL generation failed ## What changes were proposed in this pull request? Now we should be able to convert all logical plans to SQL string, if they are parsed from hive

spark git commit: [SPARK-12855][MINOR][SQL][DOC][TEST] remove spark.sql.dialect from doc and test

2016-03-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master c890c359b -> d1c193a2f [SPARK-12855][MINOR][SQL][DOC][TEST] remove spark.sql.dialect from doc and test ## What changes were proposed in this pull request? Since developer API of plug-able parser has been removed in #10801 , docs should

spark git commit: [SPARK-13629][ML] Add binary toggle Param to CountVectorizer

2016-03-18 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 54794113a -> f43a26ef9 [SPARK-13629][ML] Add binary toggle Param to CountVectorizer ## What changes were proposed in this pull request? This is a continued work for https://github.com/apache/spark/pull/11536#issuecomment-198511013,