[
https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonas Amrich updated SPARK-22674:
-
Affects Version/s: 2.3.0
> PySpark breaks serialization of namedtuple subclasses
>
[
https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398842#comment-16398842
]
Jonas Amrich commented on SPARK-22674:
--
[~lebedev] I completely agree, removing it is IMHO the
[
https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278185#comment-16278185
]
Jonas Amrich commented on SPARK-22674:
--
No worries, I'm glad we're on the same page now. However the
[
https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16277424#comment-16277424
]
Jonas Amrich commented on SPARK-22674:
--
Sure, you're right that pickle won't unpickle it without
[
https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276375#comment-16276375
]
Jonas Amrich commented on SPARK-22674:
--
I don't think that this cloudpickle fix would solve the
Jonas Amrich created SPARK-22674:
Summary: PySpark breaks serialization of namedtuple subclasses
Key: SPARK-22674
URL: https://issues.apache.org/jira/browse/SPARK-22674
Project: Spark
Issue
Jonas Amrich created SPARK-18274:
Summary: Memory leak in PySpark StringIndexer
Key: SPARK-18274
URL: https://issues.apache.org/jira/browse/SPARK-18274
Project: Spark
Issue Type: Bug
