Aniket Kulkarni created CRUNCH-481:
--------------------------------------
Summary: Crunch PCollection cannot be written to both kite and hdfs
Key: CRUNCH-481
URL: https://issues.apache.org/jira/browse/CRUNCH-481
Project: Crunch
Issue Type: Bug
Components: Core
Reporter: Aniket Kulkarni
Assignee: Josh Wills
Priority: Minor
I faced this issue while trying to write to Kite and HDFS in the same pipeline.
A similar issue was logged for Kite[1][2].
I was attempting to write a PCollection to Kite and a different PTable to HDFS
as a text file. The write to Kite succeeded, however the write to HDFS only
produced a _SUCCESS file with no text file.
Commenting out the write to Kite seems to solve the issue and I can see the
text file being written.
[1] - https://issues.cloudera.org/browse/CDK-756
[2] -
http://mail-archives.apache.org/mod_mbox/crunch-dev/201401.mbox/%3ccaf-wd4qcue0toh3qewpdnnom3u786pvjlgh7t6go_abctpl...@mail.gmail.com%3E
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
