listing of an output directory shortly after job completion fails
-----------------------------------------------------------------
Key: HADOOP-1612
URL: https://issues.apache.org/jira/browse/HADOOP-1612
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.14.0
Reporter: Christian Kunz
Sometimes, after a job finishes, and another application wants to rename dfs
files created by that job, listing of the output directory containing the newly
created files fails. File creation and directory listing is done via libhdfs,
but it is unlikely that this makes any difference, therefore, I add this to the
mapred component.
It might be a race condition: does the job complete before the files in the
output directory are promoted?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.