[
https://issues.apache.org/jira/browse/CRUNCH-462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093166#comment-14093166
]
Gabriel Reid commented on CRUNCH-462:
-------------------------------------
+1
I definitely think this is a good idea (and not too aggressive). The only
reason I can imagine for not wanting to have this is if you're using
MemPipeline exclusively, without having the intention to ever run in a MR or
Spark context. That doesn't make much sense, so I think the advantages of doing
this far outweigh the (almost non-existent) drawback.
> MemPipeline should verify that DoFns are Serializable
> -----------------------------------------------------
>
> Key: CRUNCH-462
> URL: https://issues.apache.org/jira/browse/CRUNCH-462
> Project: Crunch
> Issue Type: Improvement
> Components: Core
> Reporter: Josh Wills
> Assignee: Josh Wills
> Attachments: CRUNCH-462.patch
>
>
> Pretty straightforward: we should add a check to verify that the DoFns are
> serializable when we pass them to MemCollection.parallelDo.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
