[
https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17256472#comment-17256472
]
Nicholas Jiang edited comment on FLINK-20811 at 12/30/20, 11:32 AM:
--------------------------------------------------------------------
[~xintongsong],[~fly_in_gis],[~zoucao], IMO, the changes could be adding the
YarnRemoteResourceDescriptor which describe the remote path for yarn ship
files/archives and enable to download contents from various paths like HTTP,
HDFS etc to the Yarn cluster.
was (Author: nicholasjiang):
[~xintongsong][~fly_in_gis][~zoucao], IMO, the changes could be adding the
YarnRemoteResourceDescriptor which describe the remote path for yarn ship
files/archives and enable to download contents from various paths like HTTP,
HDFS etc to the Yarn cluster.
> Support HTTP paths for yarn ship files/archives
> -----------------------------------------------
>
> Key: FLINK-20811
> URL: https://issues.apache.org/jira/browse/FLINK-20811
> Project: Flink
> Issue Type: New Feature
> Components: Deployment / YARN
> Reporter: Xintong Song
> Priority: Major
>
> Flink's Yarn integration supports shipping workload-specific local
> files/directories/archives to the Yarn cluster.
> As discussed in FLINK-20505, it would be helpful to support directly
> downloading contents from HTTP paths to the Yarn cluster, so that users won't
> need to first download the contents locally and then upload it to the Yarn
> cluster.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
