[
https://issues.apache.org/jira/browse/YARN-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xun Liu updated YARN-8968:
--------------------------
Description:
Now the submarine project can only execute the algorithm files in the docker
image.
Need support for executing tensorflow algorithm files on HDFS.
1. The user uploads the algorithm file to the HDFS directory manually or via
zeppelin.
2. In the base image provided by submarine, Increase the path parameters
according to the specified algorithm, Download the algorithm file from HDFS to
the `/tmp/` directory.
{code:java}
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/main/docker/base/ubuntu-16.04/Dockerfile.cpu.tf_1.8.0
and
hadoop-yarn-project/hadoop
-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/main/docker/base/ubuntu-16.04/Dockerfile.gpu.tf_1.8.0{code}
3. Add parameters to the algorithm file path in submarine project.
was:
Now the submarine project can only execute the algorithm files in the docker
image.
Need support for executing tensorflow algorithm files on HDFS.
# The user uploads the algorithm file to the HDFS directory manually or via
zeppelin.
# In the base image provided by submarine, Increase the path parameters
according to the specified algorithm, Download the algorithm file from HDFS to
the `/tmp/` directory.
{code:java}
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/main/docker/base/ubuntu-16.04/Dockerfile.cpu.tf_1.8.0
and
hadoop-yarn-project/hadoop
-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/main/docker/base/ubuntu-16.04/Dockerfile.gpu.tf_1.8.0{code}
# Add parameters to the algorithm file path in submarine project.
> [Submarine] Support for executing tensorflow algorithm files on hdfs
> --------------------------------------------------------------------
>
> Key: YARN-8968
> URL: https://issues.apache.org/jira/browse/YARN-8968
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Xun Liu
> Assignee: Xun Liu
> Priority: Major
>
> Now the submarine project can only execute the algorithm files in the docker
> image.
> Need support for executing tensorflow algorithm files on HDFS.
> 1. The user uploads the algorithm file to the HDFS directory manually or via
> zeppelin.
> 2. In the base image provided by submarine, Increase the path parameters
> according to the specified algorithm, Download the algorithm file from HDFS
> to the `/tmp/` directory.
> {code:java}
> hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/main/docker/base/ubuntu-16.04/Dockerfile.cpu.tf_1.8.0
>
> and
> hadoop-yarn-project/hadoop
> -yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/main/docker/base/ubuntu-16.04/Dockerfile.gpu.tf_1.8.0{code}
> 3. Add parameters to the algorithm file path in submarine project.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
