[
https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120604#comment-14120604
]
Chen He commented on TEZ-1538:
------------------------------
[~sseth], we find this error when we are testing local mode. I think it is not
related to input and output. Here is how we find this problem.
We set "fs.defaultFS" in tez-site.xml but leave "fs.defaultFS" as
"hdfs://localhost:8020" in core-site.xml. DAGAppMaster always tries to talk to
localhost:8020 because it can not find fs.defaultFS from tez-conf.pb which is
created by TezClient.
This is a quick fix for Local Mode. General fix should be TEZ-1534.
> Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in
> core-site.xml
> ------------------------------------------------------------------------------------
>
> Key: TEZ-1538
> URL: https://issues.apache.org/jira/browse/TEZ-1538
> Project: Apache Tez
> Issue Type: Sub-task
> Affects Versions: 0.5.0
> Reporter: Chen He
> Attachments: TEZ-1538.patch
>
>
> When users submit their DAG, TezClient will create a submission context. It
> also create a tez-conf.pb file in staging directory. Once DAGAppMaster starts,
> it reads user's configuration from tez-conf.pb file. However, tez-conf.pb file
> is created by TezClientUtils.createFinalTezConfForApp() which will filter
> configurations that are not starting with "tez.".
> Then "fs.defaultFS" will be filtered even user sets it in tez-site.xml and
> user source code. And DAGAppMaster can not pick this configuration from
> tez-conf.pb file. Then it always contacts localhost:8020 and fails.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
