[
https://issues.apache.org/jira/browse/FALCON-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14009942#comment-14009942
]
Venkatesh Seetharam commented on FALCON-446:
--------------------------------------------
I do have a patch to move this to the logs dir which is setup with 777 perms.
The good thing is that the data is not visible to all but the user and hence
secure. But, this introduces an issue with log clean up service since this is
not owned by falcon but the user and clean up needs to move into the workflow
post processing instead.
> Hive Replications fail because of permissions issue
> ---------------------------------------------------
>
> Key: FALCON-446
> URL: https://issues.apache.org/jira/browse/FALCON-446
> Project: Falcon
> Issue Type: Bug
> Components: replication
> Affects Versions: 0.5
> Reporter: Venkatesh Seetharam
>
> {code}
> 3782 [main] INFO org.apache.hadoop.hive.ql.exec.Task - Copying data from
> file:/grid/0/hdp/yarn/local/usercache/hrt_qa/appcache/application_1400833228766_0501/container_1400833228766_0501_01_000002/tmp/yarn/hive_2014-05-23_12-29-47_090_1701018059611451226-1/-local-10000/_metadata
> to
> hdfs://hor3n25.gq1.ygridcore.net:8020/projects/ivory/staging/FALCON_FEED_REPLICATION_raaw-logs16-f80d8f5d-406e-49f8-8e2b-4caa58e53639_corp-6ce8cdf0-ce74-40fd-9601-143971a93eb9/default/HCatReplication_oneSourceOneTarget_hyphen/dt=2010-01-01-20/2010-01-01-20-00/corp-2a555e7f-1c65-4ac0-b3ef-1edd2c7fdd4b/data
> 3800 [main] ERROR org.apache.hadoop.hive.ql.exec.Task - Failed with
> exception Permission denied: user=hrt_qa, access=WRITE,
> inode="/projects/ivory/staging":falcon:hdfs:drwxr-xr-x
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:232)
> at
> org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:176)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5509)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5491)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:5465)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:3608)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:3578)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3552)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:760)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:558)
> at
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
