[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[coderfi]

Github user coderfi commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-140974800
  
FYI, this works for us @ [NinthDecimal](http://www.ninthdecimal.com). 
Thanks for the fix, it was a stumper!

Python 2.7.5
Spark-1.5 Branch @ 
[4c4a9ba28d9052fad45caca9a1eba9ef9db309d5](https://github.com/apache/spark/tree/4c4a9ba28d9052fad45caca9a1eba9ef9db309d5)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/8707


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[davies]

Github user davies commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-140261303
  
I tried to find the root cause, but it seems hard to work in all Python 
versions (you can see them in the older commit), finally switch to current 
approach. merging this into master and 1.5 branch, thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[JoshRosen]

Github user JoshRosen commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-140257880
  
Empirically, this seems to work, so unless you think that we should 
investigate the root cause any further I'm fine with giving this an LGTM and 
merging to 1.5. Feel free to merge yourself, or I can do it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[JoshRosen]

Github user JoshRosen commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139612356
  
Over at https://issues.apache.org/jira/browse/SPARK-10544, someone 
commented to mention that other types of built-in types do not seem to be 
pickleable in 1.5.  For instance, here's the example that they gave:

```python
sc.parallelize(["the red", "Fox Runs", "FAST"]).map(str.lower).count()
```

However, this specific example also seems to fail in 1.3.1, so I don't 
think that this is a regression. Just wanted to mention this discussion here to 
make sure you were aware of it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[JoshRosen]

Github user JoshRosen commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139612469
  
Do you have any intuition for why this worked prior to 1.5 without the 
changes implemented here?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[JoshRosen]

Github user JoshRosen commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139618711
  
Actually, one point of confusion: it looks like 
`python/pyspark/serializers.py` had some methods for serializing namedtuple 
classes with its `_restore` and `_hack_namedtuple(cls)` methods, but this patch 
also adds logic to `cloudpickle.py` to handle pickling of these instances. Do 
we need both of these methods? Are some only needed by certain versions of 
Python? It would be good to add some comments to explain some of this stuff, 
since it's not obvious from reading the code.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[davies]

Github user davies commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139631359
  
The HACK in serializers.py is used for cPickler, not cloudpickle. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[davies]

Github user davies commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139666998
  
@JoshRosen BTW, this patch introduce a special case for namedtuple, it 
should be safe to merge into branch-1.5. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[davies]

Github user davies commented on a diff in the pull request:

https://github.com/apache/spark/pull/8707#discussion_r39320041
  
--- Diff: python/pyspark/tests.py ---
@@ -218,6 +218,11 @@ def test_namedtuple(self):
 p2 = loads(dumps(p1, 2))
 self.assertEqual(p1, p2)
 
+from pyspark.cloudpickle import dumps
+P2 = loads(dumps(P))
+p3 = P2(1, 3)
+self.assertEqual(p1, p3)
--- End diff --

These instances should become to difference classes. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[davies]

Github user davies commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139666459
  
Before 1.5, the old way work in CPython, but not PyPy (we don't have a unit 
test for it). 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[JoshRosen]

Github user JoshRosen commented on a diff in the pull request:

https://github.com/apache/spark/pull/8707#discussion_r39297676
  
--- Diff: python/pyspark/tests.py ---
@@ -218,6 +218,11 @@ def test_namedtuple(self):
 p2 = loads(dumps(p1, 2))
 self.assertEqual(p1, p2)
 
+from pyspark.cloudpickle import dumps
+P2 = loads(dumps(P))
+p3 = P2(1, 3)
+self.assertEqual(p1, p3)
--- End diff --

Ah, interesting: presumably `P` and `P2` are different classes but 
instances created from them are still comparable for equality. Do we also need 
to check that those instances claim to belong to the same class? It seems way 
less likely that users could rely on the class comparison behavior, so probably 
not a huge priority to look at.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139386347
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139415557
  
  [Test build #42304 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42304/consoleFull)
 for   PR 8707 at commit 
[`9326697`](https://github.com/apache/spark/commit/93266970c7e890e54b0842a108d99612ff53443f).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139386317
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139393142
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139418771
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42304/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139418710
  
  [Test build #42304 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42304/console)
 for   PR 8707 at commit 
[`9326697`](https://github.com/apache/spark/commit/93266970c7e890e54b0842a108d99612ff53443f).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139418770
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139393045
  
  [Test build #42298 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42298/console)
 for   PR 8707 at commit 
[`a2f9f36`](https://github.com/apache/spark/commit/a2f9f36d87fb3bf31020bf07aa00bd8c86077c4a).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139393145
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42298/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139402688
  
  [Test build #1739 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1739/consoleFull)
 for   PR 8707 at commit 
[`a2f9f36`](https://github.com/apache/spark/commit/a2f9f36d87fb3bf31020bf07aa00bd8c86077c4a).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139407232
  
  [Test build #1739 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1739/console)
 for   PR 8707 at commit 
[`a2f9f36`](https://github.com/apache/spark/commit/a2f9f36d87fb3bf31020bf07aa00bd8c86077c4a).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `class SparkHadoopWriter(jobConf: JobConf)`
  * `class BlockRDD[T: ClassTag](sc: SparkContext, @transient val blockIds: 
Array[BlockId])`
  * `class ZippedWithIndexRDD[T: ClassTag](prev: RDD[T]) extends RDD[(T, 
Long)](prev) `
  * `  case class Instance(w: Double, a: Vector, b: Double) `
  * `class DefaultSource extends RelationProvider with DataSourceRegister `
  * `class WeibullGenerator(`
  * `class IndexToString(JavaTransformer, HasInputCol, HasOutputCol):`
  * `class Checkpoint(ssc: StreamingContext, val checkpointTime: Time)`
  * `abstract class InputDStream[T: ClassTag] (ssc_ : StreamingContext)`
  * `abstract class ReceiverInputDStream[T: ClassTag](ssc_ : 
StreamingContext)`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139386779
  
  [Test build #42298 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42298/consoleFull)
 for   PR 8707 at commit 
[`a2f9f36`](https://github.com/apache/spark/commit/a2f9f36d87fb3bf31020bf07aa00bd8c86077c4a).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139414810
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139414834
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[davies]

GitHub user davies opened a pull request:

https://github.com/apache/spark/pull/8707

[SPARK-10542] [PYSPARK] fix serialize namedtuple



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davies/spark fix_namedtuple

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/8707.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #8707


commit d7ef6ce57c4878d4e04ed132fff74df3956447a4
Author: Davies Liu 
Date:   2015-09-10T19:50:01Z

fix serialize namedtuple




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139361699
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139361755
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139363730
  
  [Test build #42289 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42289/consoleFull)
 for   PR 8707 at commit 
[`d7ef6ce`](https://github.com/apache/spark/commit/d7ef6ce57c4878d4e04ed132fff74df3956447a4).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139367578
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42289/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139374384
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139374429
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139378275
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139378212
  
  [Test build #42293 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42293/console)
 for   PR 8707 at commit 
[`6b9095b`](https://github.com/apache/spark/commit/6b9095bda14e03863506d293712183e6b580707e).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139378278
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42293/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139367530
  
  [Test build #42289 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42289/console)
 for   PR 8707 at commit 
[`d7ef6ce`](https://github.com/apache/spark/commit/d7ef6ce57c4878d4e04ed132fff74df3956447a4).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139367574
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139374624
  
  [Test build #42293 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42293/consoleFull)
 for   PR 8707 at commit 
[`6b9095b`](https://github.com/apache/spark/commit/6b9095bda14e03863506d293712183e6b580707e).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139375491
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139375520
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139376155
  
  [Test build #42295 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42295/consoleFull)
 for   PR 8707 at commit 
[`1d766aa`](https://github.com/apache/spark/commit/1d766aa050f5824747f61567292067f123ed019c).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[SparkQA]

Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139381359
  
  [Test build #42295 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42295/console)
 for   PR 8707 at commit 
[`1d766aa`](https://github.com/apache/spark/commit/1d766aa050f5824747f61567292067f123ed019c).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139381403
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42295/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [SPARK-10542] [PYSPARK] fix serialize namedtup...

[AmplabJenkins]

Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/8707#issuecomment-139381398
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org