[
https://issues.apache.org/jira/browse/HIVE-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773284#comment-13773284
]
Eugene Koifman commented on HIVE-4773:
--------------------------------------
Here is a possible compromise
the c'tor of Watcher first assigns stderr/stdout to 'out' but then it reassigns
'out' to point to 'statusdir' file (assuming that parameter is set).
So we could add a flag that says
if(out uses a user specified file) {
then call writer.close() as this is the only entity writing to it
}
else {
just call writer.flush() as before and hope for the best
}
> Templeton intermittently fail to commit output to file system
> -------------------------------------------------------------
>
> Key: HIVE-4773
> URL: https://issues.apache.org/jira/browse/HIVE-4773
> Project: Hive
> Issue Type: Bug
> Components: WebHCat
> Reporter: Shuaishuai Nie
> Assignee: Shuaishuai Nie
> Attachments: HIVE-4773.1.patch, HIVE-4773.2.patch
>
>
> With ASV as a default FS, we saw instances where output is not fully flushed
> to storage before the Templeton controller process exits. This results in
> stdout and stderr being empty even though the job completed successfully.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
