[
https://issues.apache.org/jira/browse/FLINK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15769592#comment-15769592
]
ASF GitHub Bot commented on FLINK-5129:
---------------------------------------
Github user NicoK commented on the issue:
https://github.com/apache/flink/pull/2891
despite the tests completing successfully, I do still need to check a few
things:
- `BlobService#getURL()` may now return a URL for a distributed file
system, however:
- related code, e.g. `java.io.File,` may not know how to handle HDFS URLs,
for example :(
> make the BlobServer use a distributed file system
> -------------------------------------------------
>
> Key: FLINK-5129
> URL: https://issues.apache.org/jira/browse/FLINK-5129
> Project: Flink
> Issue Type: Improvement
> Components: Network
> Reporter: Nico Kruber
> Assignee: Nico Kruber
>
> Currently, the BlobServer uses a local storage and, in addition when the HA
> mode is set, a distributed file system, e.g. hdfs. This, however, is only
> used by the JobManager and all TaskManager instances request blobs from the
> JobManager. By using the distributed file system there as well, we would
> lower the load on the JobManager and increase scalability.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)