[
https://issues.apache.org/jira/browse/FALCON-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882727#comment-13882727
]
Shaik Idris Ali commented on FALCON-221:
----------------------------------------
Actually it is a bug in CDH3u5 where logs are deleted sometimes.
132_/2013/11/22/001766/jt.red.ua2.inmobi.com_1385215464132_job_201311231404_1766965_conf.xml.
blk_8846523743133279013_654249081
2013-12-22 18:26:24,920 INFO org.apache.hadoop.hdfs.StateChange: Removing lease
on file
/user/mapred/history/done/jt.red.ua2.inmobi.com_1385215464132_/2013/11/22/001766/jt.red.ua2.inmobi.com_1385215464132_job_201311231404_1766965_conf.xml
from client DFSClient_-1348455228
2013-12-22 18:26:24,920 INFO org.apache.hadoop.hdfs.StateChange: DIR*
NameSystem.completeFile: file
/user/mapred/history/done/jt.red.ua2.inmobi.com_1385215464132_/2013/11/22/001766/jt.red.ua2.inmobi.com_1385215464132_job_201311231404_1766965_conf.xml
is closed by DFSClient_-1348455228
First error :
2013-12-22 18:26:28,546 ERROR org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:mapred (auth:SIMPLE)
cause:org.apache.hadoop.security.AccessControlException: Permission denied:
user=mapred, access=WRITE,
inode="/user/mapred/history/done/jt.red.ua2.inmobi.com_1385215464132_/2013/11/22/001766":mapred:user:dr-xr-xr-x
2013-12-22 18:26:28,546 INFO org.apach
this happens because the current log dir rolled forward to 001767 and 001766
became read only @ 18:26 but the audit log shows a write request at 18:38
which obviously would not get written since it was chmod to dr-xr-x-r-x
> Logmover is not copying all action level logs
> ---------------------------------------------
>
> Key: FALCON-221
> URL: https://issues.apache.org/jira/browse/FALCON-221
> Project: Falcon
> Issue Type: Bug
> Components: archival
> Affects Versions: 0.3
> Reporter: Pracheer Agarwal
> Priority: Minor
>
> Log mover copies the action level logs and oozie logs of a worklfow to hdfs.
> My workflow has 6 actions. Logs of 2-3 actions are getting copied to hdfs.
> Logs for all the actions are not available at hdfs.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
