[
https://issues.apache.org/jira/browse/CRUNCH-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314526#comment-14314526
]
Tom White commented on CRUNCH-481:
----------------------------------
Thanks for the patch Ryan. I verified it for the Hadoop 2 Crunch tests (and the
Kite tests), but it fails for Hadoop 1 Crunch tests. I haven't looked in
detail, but it's probably to do with the difference in behaviour I mentioned
above. I think it would be OK to decorate the JT identifier only for Hadoop 2.
> Support independent output committers for multiple outputs
> ----------------------------------------------------------
>
> Key: CRUNCH-481
> URL: https://issues.apache.org/jira/browse/CRUNCH-481
> Project: Crunch
> Issue Type: Bug
> Components: Core
> Reporter: Aniket Kulkarni
> Assignee: Josh Wills
> Priority: Minor
> Fix For: 0.12.0
>
> Attachments: CRUNCH-481-hadoop-2-compat.patch, CRUNCH-481.patch,
> CRUNCH-481.patch, CRUNCH-481.patch, CRUNCH-481c.patch
>
>
> I faced this issue while trying to write to Kite and HDFS in the same
> pipeline. A similar issue was logged for Kite[1][2].
> I was attempting to write a PCollection to Kite and a different PTable to
> HDFS as a text file. The write to Kite succeeded, however the write to HDFS
> only produced a _SUCCESS file with no text file.
> Commenting out the write to Kite seems to solve the issue and I can see the
> text file being written.
> [1] - https://issues.cloudera.org/browse/CDK-756
> [2] -
> http://mail-archives.apache.org/mod_mbox/crunch-dev/201401.mbox/%3ccaf-wd4qcue0toh3qewpdnnom3u786pvjlgh7t6go_abctpl...@mail.gmail.com%3E
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
