[
https://issues.apache.org/jira/browse/TEZ-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan resolved TEZ-4406.
-----------------------------------
Fix Version/s: 0.10.2
Resolution: Fixed
Thanks for the contribution [~gupta.nikhil0007]. I have merged the PR.
> Wrong FS Exception when warehouse and scratchdir are on different FS
> --------------------------------------------------------------------
>
> Key: TEZ-4406
> URL: https://issues.apache.org/jira/browse/TEZ-4406
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Nikhil Gupta
> Assignee: Nikhil Gupta
> Priority: Minor
> Fix For: 0.10.2
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
>
> {noformat}
> tez.TezTask: Failed to execute tez graph.
> java.lang.IllegalArgumentException: Wrong FS:
> hdfs://mycluster/tmp/hive/hive/<redacted>/tez-dag.pb1, expected:
> wasb://<redacted>@<redacted>.blob.core.windows.net
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:743)
> ~[hadoop-common-3.1.1.jar:?]
> at
> org.apache.hadoop.fs.azure.NativeAzureFileSystem.checkPath(NativeAzureFileSystem.java:1393)
> ~[hadoop-azure-3.1.1.jar:?]
> at org.apache.hadoop.fs.FileSystem.resolvePath(FileSystem.java:893)
> ~[hadoop-common-3.1.1.jar:?]
> at
> org.apache.tez.client.TezClient.submitDAGSession(TezClient.java:676)
> ~[tez-api-0.9.1.4.1.8.29.jar:0.9.1.4.1.8.29]
> at org.apache.tez.client.TezClient.submitDAG(TezClient.java:588)
> ~[tez-api-0.9.1.4.1.8.29.jar:0.9.1.4.1.8.29]
> at
> org.apache.hadoop.hive.ql.exec.tez.TezTask.submit(TezTask.java:557)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at
> org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:220)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2707)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2378)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2051)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1751)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1745)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157)
> ~[hive-exec-3.1.0.jar:3.1.0]
> at
> org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:226)
> ~[hive-service-3.1.0.jar:3.1.0]
> at
> org.apache.hive.service.cli.operation.SQLOperation.access$600(SQLOperation.java:87)
> ~[hive-service-3.1.0.jar:3.1.0]
> at
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:323)
> ~[hive-service-3.1.0.jar:3.1.0]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_312]
> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_312]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1732)
> ~[hadoop-common-3.1.1.jar:?]
> at
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:341)
> ~[hive-service-3.1.0.jar:3.1.0]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> ~[?:1.8.0_312]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ~[?:1.8.0_312]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> ~[?:1.8.0_312]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ~[?:1.8.0_312]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> ~[?:1.8.0_312]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> ~[?:1.8.0_312]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_312]{noformat}
>
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
