[
https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461703#comment-16461703
]
Eugene Kirpichov commented on BEAM-4147:
----------------------------------------
This covers an ArtifactStagingService and ArtifactRetrievalService that work by
placing the artifacts onto a distributed filesystem, e.g. HDFS or GCS.
This is needed for pretty much all distributed runners, even Flink (since its
DistributedCache doesn't do this yet).
> Abstractions for artifact delivery via arbitrary storage backends
> -----------------------------------------------------------------
>
> Key: BEAM-4147
> URL: https://issues.apache.org/jira/browse/BEAM-4147
> Project: Beam
> Issue Type: New Feature
> Components: runner-core
> Reporter: Ben Sidhom
> Assignee: Axel Magnuson
> Priority: Major
>
> We need a way to wire in arbitrary runner artifact storage backends into the
> job server and through to artifact staging on workers. This requires some new
> abstractions in front of the job service.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
