Hi Doug,
I have use CDH 5.2.1
Disable ACLs on Name Nodes
Set Enable Access Control Lists = False
Save Changes
Restart Hadoop Cluster
Stack trace:
2015-05-04 10:38:18,820 INFO [main]: exec.Task
(SessionState.java:printInfo(537)) - Moving data to:
hdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-37-43_010_529731467724830376-1/-ext-10000
from
hdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-37-43_010_529731467724830376-1/-ext-10002
2015-05-04 10:38:18,857 ERROR [main]: exec.Task
(SessionState.java:printError(546)) - Failed with exception Unable to move
sourcehdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-37-43_010_529731467724830376-1/-ext-10002
to destination
hdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-37-43_010_529731467724830376-1/-ext-10000
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to move
sourcehdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-37-43_010_529731467724830376-1/-ext-10002
to destination
hdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-37-43_010_529731467724830376-1/-ext-10000
at
org.apache.hadoop.hive.ql.metadata.Hive.renameFile(Hive.java:2269)
at
org.apache.hadoop.hive.ql.exec.MoveTask.moveFile(MoveTask.java:89)
at
org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:200)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1516)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1283)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1101)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:924)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:914)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:221)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:431)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:367)
at
org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:464)
at
org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:474)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:756)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:694)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:633)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: org.apache.hadoop.hdfs.protocol.AclException: The ACL operation
has been rejected. Support for ACLs has been disabled by setting
dfs.namenode.acls.enabled to false.
at
org.apache.hadoop.hdfs.server.namenode.NNConf.checkAclsConfigFlag(NNConf.java:85)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:8553)
After rolling those same changes out, the problem resolved itself.
On Tue, May 5, 2015 at 4:28 AM, Moore, Douglas <
[email protected]> wrote:
> Hi Amit,
>
> We've seen the same error on MoveTask with Hive 0.14 / HDP 2.2 release.
> There are lots of reasons for this though.
> Can you provide more details about the stack trace and version so we can
> compare?
>
> For our problem we've seen some relief with SET
> hive.metastore.client.socket.timeout=60s
> but the problem still happens from time to time.
>
> Thanks,
> Douglas
>
> From: amit kumar <[email protected]>
> Reply-To: <[email protected]>
> Date: Tue, 5 May 2015 03:12:15 +0530
> To: <[email protected]>
> Subject: Unable to move files on Hive/Hdfs
>
> While moving the data from hive/hdfs we get below error,
>
> Please suggest on this.
>
> Moving data to:
> hdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-02-39_841_5305383954203911235-1/-ext-10000
> Failed with exception Unable to move
> sourcehdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-02-39_841_5305383954203911\
> 235-1/-ext-10002 to destination
> hdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-02-39_841_5305383954203911235-1/-ext-\
> 10000
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask
> MapReduce Jobs Launched:
> Stage-Stage-1: Map: 1 Cumulative CPU: 5.83 sec HDFS Read: 553081 HDFS
> Write: 489704 SUCCESS
> Total MapReduce CPU Time Spent: 5 seconds 830 msec
> Error (1). Execution Failed.
> 2015-05-04 10:03:13 ERROR (1) in run_hive
>
> Thanks,
>
