spark git commit: [MINOR] [SQL] Removes an unreachable case clause

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 17e078671 -> 671a6bca5 [MINOR] [SQL] Removes an unreachable case clause This case clause is already covered by the one above, and generates a compilation warning. Author: Cheng Lian Closes #6214 from liancheng/remove-unreachable-cod

spark git commit: [MINOR] [SQL] Removes an unreachable case clause

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master 517eb37a8 -> ba4f8ca0d [MINOR] [SQL] Removes an unreachable case clause This case clause is already covered by the one above, and generates a compilation warning. Author: Cheng Lian Closes #6214 from liancheng/remove-unreachable-code an

[1/2] spark git commit: [SPARK-7654][SQL] Move JDBC into DataFrame's reader/writer interface.

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3b6ef2c53 -> 517eb37a8 http://git-wip-us.apache.org/repos/asf/spark/blob/517eb37a/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveResolutionSuite.scala -- di

[2/2] spark git commit: [SPARK-7654][SQL] Move JDBC into DataFrame's reader/writer interface.

2015-05-16 Thread rxin
[SPARK-7654][SQL] Move JDBC into DataFrame's reader/writer interface. Also moved all the deprecated functions into one place for SQLContext and DataFrame, and updated tests to use the new API. Author: Reynold Xin Closes #6210 from rxin/df-writer-reader-jdbc and squashes the following commits:

[1/2] spark git commit: [SPARK-7654][SQL] Move JDBC into DataFrame's reader/writer interface.

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 84949104c -> 17e078671 http://git-wip-us.apache.org/repos/asf/spark/blob/17e07867/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveResolutionSuite.scala -

[2/2] spark git commit: [SPARK-7654][SQL] Move JDBC into DataFrame's reader/writer interface.

2015-05-16 Thread rxin
[SPARK-7654][SQL] Move JDBC into DataFrame's reader/writer interface. Also moved all the deprecated functions into one place for SQLContext and DataFrame, and updated tests to use the new API. Author: Reynold Xin Closes #6210 from rxin/df-writer-reader-jdbc and squashes the following commits:

spark git commit: [SPARK-7655][Core] Deserializing value should not hold the TaskSchedulerImpl lock

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 bd057f8b5 -> 84949104c [SPARK-7655][Core] Deserializing value should not hold the TaskSchedulerImpl lock We should not call `DirectTaskResult.value` when holding the `TaskSchedulerImpl` lock. It may cost dozens of seconds to deseriali

spark git commit: [SPARK-7655][Core] Deserializing value should not hold the TaskSchedulerImpl lock

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master 161d0b4a4 -> 3b6ef2c53 [SPARK-7655][Core] Deserializing value should not hold the TaskSchedulerImpl lock We should not call `DirectTaskResult.value` when holding the `TaskSchedulerImpl` lock. It may cost dozens of seconds to deserialize a

spark git commit: [SPARK-7654][MLlib] Migrate MLlib to the DataFrame reader/writer API.

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 8bde352bd -> bd057f8b5 [SPARK-7654][MLlib] Migrate MLlib to the DataFrame reader/writer API. Author: Reynold Xin Closes #6211 from rxin/mllib-reader and squashes the following commits: 79a2cb9 [Reynold Xin] [SPARK-7654][MLlib] Migrat

spark git commit: [SPARK-7654][MLlib] Migrate MLlib to the DataFrame reader/writer API.

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1b4e710e5 -> 161d0b4a4 [SPARK-7654][MLlib] Migrate MLlib to the DataFrame reader/writer API. Author: Reynold Xin Closes #6211 from rxin/mllib-reader and squashes the following commits: 79a2cb9 [Reynold Xin] [SPARK-7654][MLlib] Migrate ML

spark git commit: [BUILD] update jblas dependency version to 1.2.4

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 856619d48 -> 8bde352bd [BUILD] update jblas dependency version to 1.2.4 jblas 1.2.4 includes native library support for PPC64LE. Author: Matthew Brandyberry Closes #6199 from mtbrandy/jblas-1.2.4 and squashes the following commits:

spark git commit: [BUILD] update jblas dependency version to 1.2.4

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master ce6391296 -> 1b4e710e5 [BUILD] update jblas dependency version to 1.2.4 jblas 1.2.4 includes native library support for PPC64LE. Author: Matthew Brandyberry Closes #6199 from mtbrandy/jblas-1.2.4 and squashes the following commits: 9df9

spark git commit: [HOTFIX] [SQL] Fixes DataFrameWriter.mode(String)

2015-05-16 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.4 ad5b0b1ce -> 856619d48 [HOTFIX] [SQL] Fixes DataFrameWriter.mode(String) We forgot an assignment there. /cc rxin Author: Cheng Lian Closes #6212 from liancheng/fix-df-writer and squashes the following commits: 711fbb0 [Cheng Lian]

spark git commit: [HOTFIX] [SQL] Fixes DataFrameWriter.mode(String)

2015-05-16 Thread lian
Repository: spark Updated Branches: refs/heads/master 47e7ffe36 -> ce6391296 [HOTFIX] [SQL] Fixes DataFrameWriter.mode(String) We forgot an assignment there. /cc rxin Author: Cheng Lian Closes #6212 from liancheng/fix-df-writer and squashes the following commits: 711fbb0 [Cheng Lian] Adds

spark git commit: [SPARK-6197][CORE] handle json exception when hisotry file not finished writing

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 d618df273 -> 91442fdfc [SPARK-6197][CORE] handle json exception when hisotry file not finished writing For details, please refer to [SPARK-6197](https://issues.apache.org/jira/browse/SPARK-6197) Author: Zhang, Liye Closes #4927 from

spark git commit: [SPARK-7655][Core][SQL] Remove 'scala.concurrent.ExecutionContext.Implicits.global' in 'ask' and 'BroadcastHashJoin'

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0ac8b01a0 -> 47e7ffe36 [SPARK-7655][Core][SQL] Remove 'scala.concurrent.ExecutionContext.Implicits.global' in 'ask' and 'BroadcastHashJoin' Because both `AkkaRpcEndpointRef.ask` and `BroadcastHashJoin` uses `scala.concurrent.ExecutionCon

spark git commit: [SPARK-7655][Core][SQL] Remove 'scala.concurrent.ExecutionContext.Implicits.global' in 'ask' and 'BroadcastHashJoin'

2015-05-16 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 e7607e5cb -> ad5b0b1ce [SPARK-7655][Core][SQL] Remove 'scala.concurrent.ExecutionContext.Implicits.global' in 'ask' and 'BroadcastHashJoin' Because both `AkkaRpcEndpointRef.ask` and `BroadcastHashJoin` uses `scala.concurrent.Executio

spark git commit: [SPARK-7672] [CORE] Use int conversion in translating kryoserializer.buffer.mb to kryoserializer.buffer

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 1fc35607d -> e7607e5cb [SPARK-7672] [CORE] Use int conversion in translating kryoserializer.buffer.mb to kryoserializer.buffer In translating spark.kryoserializer.buffer.mb to spark.kryoserializer.buffer, use of toDouble will lead to

spark git commit: [SPARK-7672] [CORE] Use int conversion in translating kryoserializer.buffer.mb to kryoserializer.buffer

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1fd33815f -> 0ac8b01a0 [SPARK-7672] [CORE] Use int conversion in translating kryoserializer.buffer.mb to kryoserializer.buffer In translating spark.kryoserializer.buffer.mb to spark.kryoserializer.buffer, use of toDouble will lead to "Fra

spark git commit: [SPARK-4556] [BUILD] binary distribution assembly can't run in local mode

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 7e3f9fea6 -> 1fc35607d [SPARK-4556] [BUILD] binary distribution assembly can't run in local mode Add note on building a runnable distribution with make-distribution.sh Author: Sean Owen Closes #6186 from srowen/SPARK-4556 and squashe

spark git commit: [SPARK-4556] [BUILD] binary distribution assembly can't run in local mode

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master d41ae4344 -> 1fd33815f [SPARK-4556] [BUILD] binary distribution assembly can't run in local mode Add note on building a runnable distribution with make-distribution.sh Author: Sean Owen Closes #6186 from srowen/SPARK-4556 and squashes th

spark git commit: [SPARK-7671] Fix wrong URLs in MLlib Data Types Documentation

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 578bfeeff -> d41ae4344 [SPARK-7671] Fix wrong URLs in MLlib Data Types Documentation There is a mistake in the URL of Matrices in the MLlib Data Types documentation (Local matrix scala section), the URL points to https://spark.apache.org/

spark git commit: [SPARK-7671] Fix wrong URLs in MLlib Data Types Documentation

2015-05-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 9da55b570 -> 7e3f9fea6 [SPARK-7671] Fix wrong URLs in MLlib Data Types Documentation There is a mistake in the URL of Matrices in the MLlib Data Types documentation (Local matrix scala section), the URL points to https://spark.apache.