[ 
https://issues.apache.org/jira/browse/CRUNCH-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451814#comment-13451814
 ] 

Josh Wills commented on CRUNCH-59:
----------------------------------

@Vinod not necessarily. Since a single Pipeline could map to multiple MR jobs, 
we might want to have some settings apply to only one of those jobs but not 
others. An example would be a DoFn that wrote records to an external data 
store, and thus might want to disable speculative task execution on the MR job 
that it was a part of, but we wouldn't necessarily want to disable speculative 
task execution in other MR jobs that ran as part of the overall pipeline and 
did not involve that DoFn.
                
> DoFn doesnt' need both configure and initialize methods
> -------------------------------------------------------
>
>                 Key: CRUNCH-59
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-59
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Vinod Kumar Vavilapalli
>
> DoFN doesn't seem to need both {{public void configure(Configuration conf)}} 
> and {{public void initialize()}}. We can do with a single API like 
> {{initialize(Configuration)}}.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to