[
https://issues.apache.org/jira/browse/APEXCORE-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vlad Rozov updated APEXCORE-683:
--------------------------------
Description:
apex client supports only local file system, it is natural for native yarn
application to support hdfs and other dfs file systems:
{noformat}
hdfs dfs -ls hdfs:///user/vrozov
Found 4 items
drwx------ - vrozov supergroup 0 2016-12-24 16:00
hdfs:///user/vrozov/.Trash
drwxrwxrwx - vrozov supergroup 0 2017-02-28 19:20
hdfs:///user/vrozov/.flink
-rw-r--r-- 3 vrozov supergroup 18862977 2017-03-25 09:20
hdfs:///user/vrozov/appPackage.apa
drwxrwxrwx - vrozov supergroup 0 2016-10-25 21:49
hdfs:///user/vrozov/datatorrent
[vrozov@node0 apex]$ apex
Apex CLI 3.6.0-SNAPSHOT 25.03.2017 @ 09:17:45 PDT rev: b4a4e05 branch: master
apex> get-app-package-info hdfs:///user/vrozov/appPackage.apa
java.io.FileNotFoundException: hdfs:/user/vrozov/appPackage.apa (No such file
or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:118)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:185)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:258)
at
com.datatorrent.stram.cli.ApexCli.newAppPackageInstance(ApexCli.java:467)
at
com.datatorrent.stram.cli.ApexCli$GetAppPackageInfoCommand.execute(ApexCli.java:3502)
at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1520)
{noformat}
was:
apex client supports only local file system:
{noformat}
hdfs dfs -ls hdfs:///user/vrozov
Found 4 items
drwx------ - vrozov supergroup 0 2016-12-24 16:00
hdfs:///user/vrozov/.Trash
drwxrwxrwx - vrozov supergroup 0 2017-02-28 19:20
hdfs:///user/vrozov/.flink
-rw-r--r-- 3 vrozov supergroup 18862977 2017-03-25 09:20
hdfs:///user/vrozov/appPackage.apa
drwxrwxrwx - vrozov supergroup 0 2016-10-25 21:49
hdfs:///user/vrozov/datatorrent
[vrozov@node0 apex]$ apex
Apex CLI 3.6.0-SNAPSHOT 25.03.2017 @ 09:17:45 PDT rev: b4a4e05 branch: master
apex> get-app-package-info hdfs:///user/vrozov/appPackage.apa
java.io.FileNotFoundException: hdfs:/user/vrozov/appPackage.apa (No such file
or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:118)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:185)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:258)
at
com.datatorrent.stram.cli.ApexCli.newAppPackageInstance(ApexCli.java:467)
at
com.datatorrent.stram.cli.ApexCli$GetAppPackageInfoCommand.execute(ApexCli.java:3502)
at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1520)
{noformat}
> Apex client should support application packages on HDFS
> -------------------------------------------------------
>
> Key: APEXCORE-683
> URL: https://issues.apache.org/jira/browse/APEXCORE-683
> Project: Apache Apex Core
> Issue Type: Improvement
> Reporter: Vlad Rozov
> Assignee: Vlad Rozov
>
> apex client supports only local file system, it is natural for native yarn
> application to support hdfs and other dfs file systems:
> {noformat}
> hdfs dfs -ls hdfs:///user/vrozov
> Found 4 items
> drwx------ - vrozov supergroup 0 2016-12-24 16:00
> hdfs:///user/vrozov/.Trash
> drwxrwxrwx - vrozov supergroup 0 2017-02-28 19:20
> hdfs:///user/vrozov/.flink
> -rw-r--r-- 3 vrozov supergroup 18862977 2017-03-25 09:20
> hdfs:///user/vrozov/appPackage.apa
> drwxrwxrwx - vrozov supergroup 0 2016-10-25 21:49
> hdfs:///user/vrozov/datatorrent
> [vrozov@node0 apex]$ apex
> Apex CLI 3.6.0-SNAPSHOT 25.03.2017 @ 09:17:45 PDT rev: b4a4e05 branch: master
> apex> get-app-package-info hdfs:///user/vrozov/appPackage.apa
> java.io.FileNotFoundException: hdfs:/user/vrozov/appPackage.apa (No such file
> or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:215)
> at java.util.zip.ZipFile.<init>(ZipFile.java:145)
> at java.util.jar.JarFile.<init>(JarFile.java:154)
> at java.util.jar.JarFile.<init>(JarFile.java:118)
> at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:185)
> at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:258)
> at
> com.datatorrent.stram.cli.ApexCli.newAppPackageInstance(ApexCli.java:467)
> at
> com.datatorrent.stram.cli.ApexCli$GetAppPackageInfoCommand.execute(ApexCli.java:3502)
> at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1520)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
