spark git commit: [SPARK-5297][Streaming] Fix Java file stream type erasure problem

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master ec5b0f2ce -> 424d8c6ff [SPARK-5297][Streaming] Fix Java file stream type erasure problem Current Java file stream doesn't support custom key/value type because of loss of type information, details can be seen in [SPARK-5297](https://issue

spark git commit: [HOTFIX] Update pom.xml to pull MapR's Hadoop version 2.4.1.

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.2 410b908cd -> fd6266f45 [HOTFIX] Update pom.xml to pull MapR's Hadoop version 2.4.1. Author: Kannan Rajah Closes #4108 from rkannan82/master and squashes the following commits: eca095b [Kannan Rajah] Update pom.xml to pull MapR's Hado

spark git commit: [HOTFIX] Update pom.xml to pull MapR's Hadoop version 2.4.1.

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master bad6c5721 -> ec5b0f2ce [HOTFIX] Update pom.xml to pull MapR's Hadoop version 2.4.1. Author: Kannan Rajah Closes #4108 from rkannan82/master and squashes the following commits: eca095b [Kannan Rajah] Update pom.xml to pull MapR's Hadoop v

spark git commit: [SPARK-5275] [Streaming] include python source code

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.2 92c238c19 -> 410b908cd [SPARK-5275] [Streaming] include python source code Include the python source code into assembly jar. cc mengxr pwendell Author: Davies Liu Closes #4128 from davies/build_streaming2 and squashes the following

spark git commit: [SPARK-5275] [Streaming] include python source code

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 9a151ce58 -> bad6c5721 [SPARK-5275] [Streaming] include python source code Include the python source code into assembly jar. cc mengxr pwendell Author: Davies Liu Closes #4128 from davies/build_streaming2 and squashes the following comm

spark git commit: [SPARK-4959][SQL] Attributes are case sensitive when using a select query from a projection(Backport to Spark-1.2)

2015-01-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.2 692dc5b66 -> 92c238c19 [SPARK-4959][SQL] Attributes are case sensitive when using a select query from a projection(Backport to Spark-1.2) This is a follow up of #3796 , which can not be merged back to Spark-1.2. Manually merge it. Au

spark git commit: [SPARK-5294][WebUI] Hide tables in AllStagePages for "Active Stages, Completed Stages and Failed Stages" when they are empty

2015-01-20 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 2f82c841f -> 9a151ce58 [SPARK-5294][WebUI] Hide tables in AllStagePages for "Active Stages, Completed Stages and Failed Stages" when they are empty Related to SPARK-5228 and #4028, `AllStagesPage` also should hide the table for `ActiveSt

spark git commit: [SPARK-5186] [MLLIB] Vector.equals and Vector.hashCode are very inefficient

2015-01-20 Thread meng
Repository: spark Updated Branches: refs/heads/master d181c2a1f -> 2f82c841f [SPARK-5186] [MLLIB] Vector.equals and Vector.hashCode are very inefficient JIRA Issue: https://issues.apache.org/jira/browse/SPARK-5186 Currently SparseVector is using the inherited equals from Vector, which will

[2/3] spark git commit: [SPARK-5323][SQL] Remove Row's Seq inheritance.

2015-01-20 Thread marmbrus
http://git-wip-us.apache.org/repos/asf/spark/blob/d181c2a1/sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala -- diff --git a/sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala b/sql/core/src/test/scala

[1/3] spark git commit: [SPARK-5323][SQL] Remove Row's Seq inheritance.

2015-01-20 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master bc20a52b3 -> d181c2a1f http://git-wip-us.apache.org/repos/asf/spark/blob/d181c2a1/sql/hive/src/test/scala/org/apache/spark/sql/QueryTest.scala -- diff --git a/sql/hive/src/t

[3/3] spark git commit: [SPARK-5323][SQL] Remove Row's Seq inheritance.

2015-01-20 Thread marmbrus
[SPARK-5323][SQL] Remove Row's Seq inheritance. Author: Reynold Xin Closes #4115 from rxin/row-seq and squashes the following commits: e33abd8 [Reynold Xin] Fixed compilation error. cceb650 [Reynold Xin] Python test fixes, and removal of WrapDynamic. 0334a52 [Reynold Xin] mkString. 9cdeb7d [Rey

spark git commit: [SPARK-5287][SQL] Add defaultSizeOf to every data type.

2015-01-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master 23e25543b -> bc20a52b3 [SPARK-5287][SQL] Add defaultSizeOf to every data type. JIRA: https://issues.apache.org/jira/browse/SPARK-5287 This PR only add `defaultSizeOf` to data types and make those internal type classes `protected[sql]`. I

spark git commit: SPARK-5019 [MLlib] - GaussianMixtureModel exposes instances of MultivariateGauss...

2015-01-20 Thread meng
Repository: spark Updated Branches: refs/heads/master 769aced9e -> 23e25543b SPARK-5019 [MLlib] - GaussianMixtureModel exposes instances of MultivariateGauss... This PR modifies GaussianMixtureModel to expose instances of MutlivariateGaussian rather than separate mean and covariance arrays.

spark git commit: [SPARK-5329][WebUI] UIWorkloadGenerator should stop SparkContext.

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c93a57f0d -> 769aced9e [SPARK-5329][WebUI] UIWorkloadGenerator should stop SparkContext. UIWorkloadGenerator don't stop SparkContext. I ran UIWorkloadGenerator and try to watch the result at WebUI but Jobs are marked as finished. It's beca

spark git commit: SPARK-4660: Use correct class loader in JavaSerializer (copy of PR #3840...

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 814080278 -> c93a57f0d SPARK-4660: Use correct class loader in JavaSerializer (copy of PR #3840... ... by Piotr Kolaczkowski) Author: Jacek Lewandowski Closes #4113 from jacek-lewandowski/SPARK-4660-master and squashes the following com

spark git commit: SPARK-4660: Use correct class loader in JavaSerializer (copy of PR #3840...

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 3ee5c1711 -> ecdeca038 SPARK-4660: Use correct class loader in JavaSerializer (copy of PR #3840... ... by Piotr Kolaczkowski) Author: Jacek Lewandowski Closes #4113 from jacek-lewandowski/SPARK-4660-master and squashes the following

spark git commit: SPARK-4660: Use correct class loader in JavaSerializer (copy of PR #3840...

2015-01-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.2 228bf6cef -> 692dc5b66 SPARK-4660: Use correct class loader in JavaSerializer (copy of PR #3840... ... by Piotr Kolaczkowski) Author: Jacek Lewandowski Closes #4113 from jacek-lewandowski/SPARK-4660-master and squashes the following

spark git commit: [SQL][Minor] Refactors deeply nested FP style code in BooleanSimplification

2015-01-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9d9294aeb -> 814080278 [SQL][Minor] Refactors deeply nested FP style code in BooleanSimplification This is a follow-up of #4090. The original deeply nested `reduceOption` code is hard to grasp. [https://reviewable.io/review_button.png";

spark git commit: [SPARK-5333][Mesos] MesosTaskLaunchData occurs BufferUnderflowException

2015-01-20 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 4afad9c77 -> 9d9294aeb [SPARK-5333][Mesos] MesosTaskLaunchData occurs BufferUnderflowException - Rewind ByteBuffer before making ByteString (This fixes a bug introduced in #3849 / SPARK-4014) Author: Jongyoul Lee Closes #4119 from jongy

spark git commit: [SPARK-4803] [streaming] Remove duplicate RegisterReceiver message

2015-01-20 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.2 6599f50db -> 228bf6cef [SPARK-4803] [streaming] Remove duplicate RegisterReceiver message - The ReceiverTracker receivers `RegisterReceiver` messages two times 1) When the actor at `ReceiverSupervisorImpl`'s preStart is invoked

spark git commit: [SPARK-4803] [streaming] Remove duplicate RegisterReceiver message

2015-01-20 Thread tdas
Repository: spark Updated Branches: refs/heads/master debc03195 -> 4afad9c77 [SPARK-4803] [streaming] Remove duplicate RegisterReceiver message - The ReceiverTracker receivers `RegisterReceiver` messages two times 1) When the actor at `ReceiverSupervisorImpl`'s preStart is invoked

spark git commit: [SQL][minor] Add a log4j file for catalyst test.

2015-01-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master 306ff187a -> debc03195 [SQL][minor] Add a log4j file for catalyst test. Author: Reynold Xin Closes #4117 from rxin/catalyst-test-log4j and squashes the following commits: 8ad610b [Reynold Xin] [SQL][minor] Add a log4j file for catalyst t