[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-04 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61605293 Thanks, I kept fixing the conflicts, but missed this one. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61552399 [Test build #22826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22826/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61555332 [Test build #22827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22827/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61567627 [Test build #22826 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22826/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61567632 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61569440 [Test build #22827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22827/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61569447 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61588212 I'm going to merge this into 1.2 in order to avoid merge conflicts when backporting future bugfixes to that branch. Thanks! --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2920 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-03 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61605039 There was a minor conflict with an MLlib change (it added two new lines of additional code before your change to `sql.py`), but I fixed it up myself on merge and ran

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/2920#discussion_r19714030 --- Diff: python/pyspark/mllib/regression.py --- @@ -122,7 +122,6 @@ class LinearRegressionModel(LinearRegressionModelBase): # train_func should

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-02 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/2920#discussion_r19715173 --- Diff: python/pyspark/rdd.py --- @@ -449,12 +445,11 @@ def intersection(self, other): def _reserialize(self, serializer=None):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-02 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/2920#discussion_r19715186 --- Diff: python/pyspark/tests.py --- @@ -1216,51 +1216,6 @@ def test_reserialization(self): result5 = sorted(self.sc.sequenceFile(basepath +

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-02 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61442032 Could you fix up the merge conflicts here? Barring that, this LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-11-02 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/2920#discussion_r19719423 --- Diff: python/pyspark/tests.py --- @@ -1216,51 +1216,6 @@ def test_reserialization(self): result5 = sorted(self.sc.sequenceFile(basepath +

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61313322 [Test build #22625 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22625/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/2920#discussion_r19687663 --- Diff: python/pyspark/mllib/regression.py --- @@ -122,7 +122,6 @@ class LinearRegressionModel(LinearRegressionModelBase): # train_func should

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/2920#discussion_r19687879 --- Diff: python/pyspark/rdd.py --- @@ -449,12 +445,11 @@ def intersection(self, other): def _reserialize(self, serializer=None):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61317728 This is a really nice change. With this change, we'll end up wrapping individual objects in `Batch` wrappers when batching is disabled, but I don't think this will

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/2920#discussion_r19688764 --- Diff: python/pyspark/tests.py --- @@ -1216,51 +1216,6 @@ def test_reserialization(self): result5 = sorted(self.sc.sequenceFile(basepath +

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61331876 **[Test build #22625 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22625/consoleFull)** for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61340488 [Test build #22655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22655/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61346579 [Test build #22655 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22655/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61346583 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61350038 [Test build #22668 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22668/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61354458 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61354455 [Test build #22668 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22668/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61356801 [Test build #502 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/502/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61358467 [Test build #502 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/502/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61026401 [Test build #22495 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22495/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61033560 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-61033556 [Test build #22495 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22495/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60842962 [Test build #22384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22384/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60843352 @JoshRosen Do you have time to look at this one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60853899 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60853893 [Test build #22384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22384/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60474199 [Test build #22200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22200/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60474201 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60474496 [Test build #22203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22203/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60474608 **[Test build #426 timed out](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/426/consoleFull)** for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60474657 **[Test build #428 timed out](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/428/consoleFull)** for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60476034 [Test build #22203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22203/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60476035 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60487083 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60487317 [Test build #22217 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22217/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60490565 [Test build #22217 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22217/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60490568 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60351167 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60351159 [Test build #22117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22117/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60353573 [Test build #22129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22129/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60354054 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60354049 [Test build #22120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22120/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60360411 [Test build #22129 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22129/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60360419 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60437321 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60437879 [Test build #22156 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22156/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60446626 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60446619 [Test build #22156 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22156/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60469206 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60469302 [Test build #22187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22187/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60471543 **[Test build #22187 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22187/consoleFull)** for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60471545 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60472391 [Test build #426 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/426/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60472430 [Test build #428 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/428/consoleFull) for PR 2920 at commit

[GitHub] spark pull request: [SPARK-3886] [PySpark] simplify serializer, us...

2014-10-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2920#issuecomment-60472725 [Test build #22200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22200/consoleFull) for PR 2920 at commit