Robert Joseph Evans created STORM-2122:
------------------------------------------
Summary: Supervisor V2 can use a lot more memory
Key: STORM-2122
URL: https://issues.apache.org/jira/browse/STORM-2122
Project: Apache Storm
Issue Type: Bug
Components: storm-core
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
When launching a worker the supervisor will read in the complete topology to
get a small amount of data out of it. This can be very large. In the past we
would launch the workers one at a time, so we only needed enough memory to read
it in once, now we are doing it in parallel, and lots of these tend to show up
very close to one another. We need to find a way to make it so that we read
the data one, and ideally cache it someplace that everyone can share.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
