[
https://issues.apache.org/jira/browse/YARN-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shilun Fan updated YARN-10261:
------------------------------
Fix Version/s: (was: 3.4.0)
> DistributedShell client incorrectly names uploaded script file
> --------------------------------------------------------------
>
> Key: YARN-10261
> URL: https://issues.apache.org/jira/browse/YARN-10261
> Project: Hadoop YARN
> Issue Type: Bug
> Components: distributed-shell
> Affects Versions: 3.2.0
> Reporter: Markus Jelsma
> Priority: Major
> Attachments: YARN-10261.patch
>
>
> When running the DistributedShell using a custom script, it is uploaded to
> HDFS as ExecScript by the Client. The ApplicationMaster cannot find the
> script because it tries to download ExecScript.sh.
>
> {code:java}
> java.io.FileNotFoundException: File does not exist:
> hdfs://prod-grunn/user/systems/trainer/application_1584528941904_30608/ExecScript.sh
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1573)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1588){code}
>
> I have patched the DistributedShell subproject so as the Client uploads it as
> ExecScript.sh (and ExecScript.bat in case of Windows).
>
> With the change, the ApplicationMaster now correctly runs my custom script.
>
> I'll attach a patch.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
