git commit: Add echo Run streaming tests ...

2014-10-13 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master b4a7fa7a6 - d8b8c2107 Add echo Run streaming tests ... Author: Ken Takagiwa ugw.gi.wo...@gmail.com Closes #2778 from giwa/patch-2 and squashes the following commits: a59f9a1 [Ken Takagiwa] Add echo Run streaming tests ... Project:

git commit: Bug Fix: without unpersist method in RandomForest.scala

2014-10-13 Thread meng
Repository: spark Updated Branches: refs/heads/master 92e017fb8 - 942847fd9 Bug Fix: without unpersist method in RandomForest.scala During trainning Gradient Boosting Decision Tree on large-scale sparse data, spark spill hundreds of data onto disk. And find the bug below: In version

git commit: [SPARK-3861][SQL] Avoid rebuilding hash tables for broadcast joins on each partition

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 942847fd9 - 39ccabacf [SPARK-3861][SQL] Avoid rebuilding hash tables for broadcast joins on each partition Author: Reynold Xin r...@apache.org Closes #2727 from rxin/SPARK-3861-broadcast-hash-2 and squashes the following commits:

git commit: [SPARK-3892][SQL] remove redundant type name

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 49bbdcb66 - 46db277cc [SPARK-3892][SQL] remove redundant type name Author: Daoyuan Wang daoyuan.w...@intel.com Closes #2747 from adrian-wang/typename and squashes the following commits: 2824216 [Daoyuan Wang] remove redundant typeName

[2/2] git commit: [SPARK-3407][SQL]Add Date type support

2014-10-13 Thread marmbrus
[SPARK-3407][SQL]Add Date type support Author: Daoyuan Wang daoyuan.w...@intel.com Closes #2344 from adrian-wang/date and squashes the following commits: f15074a [Daoyuan Wang] remove outdated lines 2038085 [Daoyuan Wang] update return type 00fe81f [Daoyuan Wang] address lian cheng's comments

[1/2] [SPARK-3407][SQL]Add Date type support

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 46db277cc - 2ac40da3f http://git-wip-us.apache.org/repos/asf/spark/blob/2ac40da3/sql/hive/src/test/resources/golden/date_comparison-6-5606505a92bad10023ad9a3ef77eacc9 --

git commit: [SPARK-2066][SQL] Adds checks for non-aggregate attributes with aggregation

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 2ac40da3f - 56102dc2d [SPARK-2066][SQL] Adds checks for non-aggregate attributes with aggregation This PR adds a new rule `CheckAggregation` to the analyzer to provide better error message for non-aggregate attributes with aggregation.

git commit: [SPARK-3529] [SQL] Delete the temp files after test exit

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 56102dc2d - d3cdf9128 [SPARK-3529] [SQL] Delete the temp files after test exit There are lots of temporal files created by TestHive under the /tmp by default, which may cause potential performance issue for testing. This PR will

git commit: [SPARK-3771][SQL] AppendingParquetOutputFormat should use reflection to prevent from breaking binary-compatibility.

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master d3cdf9128 - 73da9c26b [SPARK-3771][SQL] AppendingParquetOutputFormat should use reflection to prevent from breaking binary-compatibility. Original problem is [SPARK-3764](https://issues.apache.org/jira/browse/SPARK-3764).

git commit: [SQL] Add type checking debugging functions

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master e10d71e7e - 371321cad [SQL] Add type checking debugging functions Adds some functions that were very useful when trying to track down the bug from #2656. This change also changes the tree output for query plans to include the `'` prefix

git commit: SPARK-3807: SparkSql does not work for tables created using custom serde

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 4fc66380f - 925e22d31 SPARK-3807: SparkSql does not work for tables created using custom serde SparkSql crashes on selecting tables using custom serde. Example: CREATE EXTERNAL TABLE table_name PARTITIONED BY ( a

git commit: [SPARK-3809][SQL] Fixes test suites in hive-thriftserver

2014-10-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 9d9ca91fe - 9eb49d413 [SPARK-3809][SQL] Fixes test suites in hive-thriftserver As scwf pointed out, `HiveThriftServer2Suite` isn't effective anymore after the Thrift server was made a daemon. On the other hand, these test suites were

git commit: [SPARK-3912][Streaming] Fixed flakyFlumeStreamSuite

2014-10-13 Thread tdas
Repository: spark Updated Branches: refs/heads/master 9eb49d413 - 4d26aca77 [SPARK-3912][Streaming] Fixed flakyFlumeStreamSuite @harishreedharan @pwendell See JIRA for diagnosis of the problem https://issues.apache.org/jira/browse/SPARK-3912 The solution was to reimplement it. 1. Find a free