[
https://issues.apache.org/jira/browse/STORM-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992137#comment-14992137
]
ASF GitHub Bot commented on STORM-876:
--------------------------------------
Github user ptgoetz commented on the pull request:
https://github.com/apache/storm/pull/845#issuecomment-154140434
Please disregard my earlier statement that this PR requires IP Clearance.
After further discussion and research, I'm now of the opinion that it doesn't.
I also feel that I could have phrased things better in my initial comment.
When I said:
> "Based on the associated JIRA and from looking at the commits this pull
request contains, this needs to go through the IP Clearance process."
It would have been better to say:
> "Based on the associated JIRA and from looking at the commits this pull
request contains, *I think this might* need to go through the IP Clearance
process."
My intent was to initiate a discussion, not block anything or impose
unnecessary process, which is why didn't cast a -1 vote.
> Dist Cache: Basic Functionality
> -------------------------------
>
> Key: STORM-876
> URL: https://issues.apache.org/jira/browse/STORM-876
> Project: Apache Storm
> Issue Type: Improvement
> Components: storm-core
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: DISTCACHE.md, DistributedCacheDesignDocument.pdf
>
>
> Basic functionality for the Dist Cache feature.
> As part of this a new API should be added to support uploading and
> downloading dist cache items. storm-core.ser, storm-conf.ser and storm.jar
> should be written into the blob store instead of residing locally. We need a
> default implementation of the blob store that does essentially what nimbus
> currently does and does not need anything extra. But having an HDFS backend
> too would be great for scalability and HA.
> The supervisor should provide a way to download and manage these blobs and
> provide a working directory for the worker process with symlinks to the
> blobs. It should also allow the blobs to be updated and switch the symlink
> atomically to point to the new blob once it is downloaded.
> All of this is already done by code internal to Yahoo! we are in the process
> of getting it ready to push back to open source shortly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
