spark git commit: [SPARK-7669] Builds against Hadoop 2.6+ get inconsistent curator depend…

2015-05-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 898be6248 - 0feb3ded2 [SPARK-7669] Builds against Hadoop 2.6+ get inconsistent curator depend… This adds a new profile, `hadoop-2.6`, copying over the hadoop-2.4 properties, updating ZK to 3.4.6 and making the curator version a

spark git commit: [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug

2015-05-17 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.2 5505a0d07 - 6c41e1cb9 [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug This patch wraps `SnappyOutputStream` to ensure that `close()` is idempotent and to guard against write-after-`close()` bugs. This is a

spark git commit: [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug

2015-05-17 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 50217667c - f2cc6b5bc [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug This patch wraps `SnappyOutputStream` to ensure that `close()` is idempotent and to guard against write-after-`close()` bugs. This is a workaround

spark git commit: [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug

2015-05-17 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.4 0feb3ded2 - 6df71eb8c [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug This patch wraps `SnappyOutputStream` to ensure that `close()` is idempotent and to guard against write-after-`close()` bugs. This is a

spark git commit: [SPARK-6514] [SPARK-5960] [SPARK-6656] [SPARK-7679] [STREAMING] [KINESIS] Updates to the Kinesis API

2015-05-17 Thread tdas
Repository: spark Updated Branches: refs/heads/master 2ca60ace8 - ca4257aec [SPARK-6514] [SPARK-5960] [SPARK-6656] [SPARK-7679] [STREAMING] [KINESIS] Updates to the Kinesis API SPARK-6514 - Use correct region SPARK-5960 - Allow AWS Credentials to be directly passed SPARK-6656 - Specify

spark git commit: [SPARK-7693][Core] Remove import scala.concurrent.ExecutionContext.Implicits.global

2015-05-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2f22424e9 - ff71d34e0 [SPARK-7693][Core] Remove import scala.concurrent.ExecutionContext.Implicits.global Learnt a lesson from SPARK-7655: Spark should avoid to use `scala.concurrent.ExecutionContext.Implicits.global` because the user

spark git commit: [SQL] [MINOR] use catalyst type converter in ScalaUdf

2015-05-17 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 e0632ffaf - be66d1924 [SQL] [MINOR] use catalyst type converter in ScalaUdf It's a follow-up of https://github.com/apache/spark/pull/5154, we can speed up scala udf evaluation by create type converter in advance. Author: Wenchen Fan

spark git commit: [SPARK-6514] [SPARK-5960] [SPARK-6656] [SPARK-7679] [STREAMING] [KINESIS] Updates to the Kinesis API

2015-05-17 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.4 a8556086d - e0632ffaf [SPARK-6514] [SPARK-5960] [SPARK-6656] [SPARK-7679] [STREAMING] [KINESIS] Updates to the Kinesis API SPARK-6514 - Use correct region SPARK-5960 - Allow AWS Credentials to be directly passed SPARK-6656 - Specify

spark git commit: [SQL] [MINOR] use catalyst type converter in ScalaUdf

2015-05-17 Thread yhuai
Repository: spark Updated Branches: refs/heads/master ca4257aec - 2f22424e9 [SQL] [MINOR] use catalyst type converter in ScalaUdf It's a follow-up of https://github.com/apache/spark/pull/5154, we can speed up scala udf evaluation by create type converter in advance. Author: Wenchen Fan

spark git commit: [SPARK-7694] [MLLIB] Use getOrElse for getting the threshold of LR model

2015-05-17 Thread meng
Repository: spark Updated Branches: refs/heads/master ff71d34e0 - 775e6f990 [SPARK-7694] [MLLIB] Use getOrElse for getting the threshold of LR model The `toString` method of `LogisticRegressionModel` calls `get` method on an Option (threshold) without a safeguard. In spark-shell, the

spark git commit: [SPARK-7694] [MLLIB] Use getOrElse for getting the threshold of LR model

2015-05-17 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 2a42d2d8f - 0b6bc8a23 [SPARK-7694] [MLLIB] Use getOrElse for getting the threshold of LR model The `toString` method of `LogisticRegressionModel` calls `get` method on an Option (threshold) without a safeguard. In spark-shell, the

spark git commit: [SPARK-7693][Core] Remove import scala.concurrent.ExecutionContext.Implicits.global

2015-05-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 be66d1924 - 2a42d2d8f [SPARK-7693][Core] Remove import scala.concurrent.ExecutionContext.Implicits.global Learnt a lesson from SPARK-7655: Spark should avoid to use `scala.concurrent.ExecutionContext.Implicits.global` because the

spark git commit: [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug

2015-05-17 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.3 91442fdfc - 0a6310373 [SPARK-7660] Wrap SnappyOutputStream to work around snappy-java bug This patch wraps `SnappyOutputStream` to ensure that `close()` is idempotent and to guard against write-after-`close()` bugs. This is a

spark git commit: [SPARK-7686] [SQL] DescribeCommand is assigned wrong output attributes in SparkStrategies

2015-05-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 6df71eb8c - 53d6ab51b [SPARK-7686] [SQL] DescribeCommand is assigned wrong output attributes in SparkStrategies In `SparkStrategies`, `RunnableDescribeCommand` is called with the output attributes of the table being described rather

spark git commit: [SPARK-7686] [SQL] DescribeCommand is assigned wrong output attributes in SparkStrategies

2015-05-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master f2cc6b5bc - 564562874 [SPARK-7686] [SQL] DescribeCommand is assigned wrong output attributes in SparkStrategies In `SparkStrategies`, `RunnableDescribeCommand` is called with the output attributes of the table being described rather than

spark git commit: [SPARK-7491] [SQL] Allow configuration of classloader isolation for hive

2015-05-17 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 564562874 - 2ca60ace8 [SPARK-7491] [SQL] Allow configuration of classloader isolation for hive Author: Michael Armbrust mich...@databricks.com Closes #6167 from marmbrus/configureIsolation and squashes the following commits: 6147cbe

spark git commit: [SPARK-7491] [SQL] Allow configuration of classloader isolation for hive

2015-05-17 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.4 53d6ab51b - a8556086d [SPARK-7491] [SQL] Allow configuration of classloader isolation for hive Author: Michael Armbrust mich...@databricks.com Closes #6167 from marmbrus/configureIsolation and squashes the following commits: 6147cbe

spark git commit: [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts

2015-05-17 Thread shivaram
Repository: spark Updated Branches: refs/heads/master ba4f8ca0d - 1a7b9ce80 [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts cc pwendell P.S: I can't believe this was outdated all along ? Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6215 from shivaram/update-ec2-map

spark git commit: [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts

2015-05-17 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.4 671a6bca5 - 0ed376afa [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts cc pwendell P.S: I can't believe this was outdated all along ? Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6215 from

spark git commit: [MINOR] [SQL] Removes an unreachable case clause

2015-05-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 517eb37a8 - ba4f8ca0d [MINOR] [SQL] Removes an unreachable case clause This case clause is already covered by the one above, and generates a compilation warning. Author: Cheng Lian l...@databricks.com Closes #6214 from

spark git commit: [MINOR] [SQL] Removes an unreachable case clause

2015-05-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 17e078671 - 671a6bca5 [MINOR] [SQL] Removes an unreachable case clause This case clause is already covered by the one above, and generates a compilation warning. Author: Cheng Lian l...@databricks.com Closes #6214 from

spark git commit: [SQL] [MINOR] Skip unresolved expression for InConversion

2015-05-17 Thread lian
Repository: spark Updated Branches: refs/heads/master 1a7b9ce80 - edf09ea1b [SQL] [MINOR] Skip unresolved expression for InConversion Author: scwf wangf...@huawei.com Closes #6145 from scwf/InConversion and squashes the following commits: 5c8ac6b [scwf] minir fix for InConversion Project:

spark git commit: [SPARK-7447] [SQL] Don't re-merge Parquet schema when the relation is deserialized

2015-05-17 Thread lian
Repository: spark Updated Branches: refs/heads/master edf09ea1b - 339905578 [SPARK-7447] [SQL] Don't re-merge Parquet schema when the relation is deserialized JIRA: https://issues.apache.org/jira/browse/SPARK-7447 `MetadataCache` in `ParquetRelation2` is annotated as `transient`. When

spark git commit: [SPARK-7447] [SQL] Don't re-merge Parquet schema when the relation is deserialized

2015-05-17 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.4 0ed376afa - 898be6248 [SPARK-7447] [SQL] Don't re-merge Parquet schema when the relation is deserialized JIRA: https://issues.apache.org/jira/browse/SPARK-7447 `MetadataCache` in `ParquetRelation2` is annotated as `transient`. When