[ https://issues.apache.org/jira/browse/HIVE-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13775848#comment-13775848 ]
Eugene Koifman commented on HIVE-4773: -------------------------------------- [~shuainie] OK, I misread your code. You only use CustomFilterOutputStream to wrap System.out/System.err but not when 'out' = statusdir. I get it now, so your changes do the same thing as I was suggesting in previous comment. I would suggest calling this wrapper class NonClosableStream, and making close() method in it do nothing. (also make class private). I think this will make it easier to understand. > Templeton intermittently fail to commit output to file system > ------------------------------------------------------------- > > Key: HIVE-4773 > URL: https://issues.apache.org/jira/browse/HIVE-4773 > Project: Hive > Issue Type: Bug > Components: WebHCat > Reporter: Shuaishuai Nie > Assignee: Shuaishuai Nie > Attachments: HIVE-4773.1.patch, HIVE-4773.2.patch > > > With ASV as a default FS, we saw instances where output is not fully flushed > to storage before the Templeton controller process exits. This results in > stdout and stderr being empty even though the job completed successfully. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira