[
https://issues.apache.org/jira/browse/HIVE-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13775848#comment-13775848
]
Eugene Koifman commented on HIVE-4773:
--------------------------------------
[~shuainie] OK, I misread your code. You only use CustomFilterOutputStream to
wrap System.out/System.err but not when 'out' = statusdir. I get it now, so
your changes do the same thing as I was suggesting in previous comment.
I would suggest calling this wrapper class NonClosableStream, and making
close() method in it do nothing. (also make class private). I think this will
make it easier to understand.
> Templeton intermittently fail to commit output to file system
> -------------------------------------------------------------
>
> Key: HIVE-4773
> URL: https://issues.apache.org/jira/browse/HIVE-4773
> Project: Hive
> Issue Type: Bug
> Components: WebHCat
> Reporter: Shuaishuai Nie
> Assignee: Shuaishuai Nie
> Attachments: HIVE-4773.1.patch, HIVE-4773.2.patch
>
>
> With ASV as a default FS, we saw instances where output is not fully flushed
> to storage before the Templeton controller process exits. This results in
> stdout and stderr being empty even though the job completed successfully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira