[
https://issues.apache.org/jira/browse/SAMZA-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jakob Homan updated SAMZA-123:
------------------------------
Attachment: SAMZA-123-draft.patch
Attaching draft patch.
* Having [lots of
trouble|http://stackoverflow.com/questions/23897405/successfully-implement-maplike-in-scala]
getting Scala to like my TaskNameToSSPs map, so may need to jettison that even
though it makes the code much cleaner.
* Working on merging in SAMZA-253, which is a big change on top of this. Will
upload a merged in version by EOD, hopefully.
* All tests pass except TestStatefulTask, which I believe is connected to the
Scala map problems.
* Holding off on re-writing the Offset tool until the overall approach has been
checked.
> Move topic partition grouping to the AM and generalize
> ------------------------------------------------------
>
> Key: SAMZA-123
> URL: https://issues.apache.org/jira/browse/SAMZA-123
> Project: Samza
> Issue Type: Sub-task
> Components: container
> Affects Versions: 0.6.0
> Reporter: Jakob Homan
> Assignee: Jakob Homan
> Attachments: SAMZA-123-design-doc.md, SAMZA-123-design-doc.pdf,
> SAMZA-123-draft.patch
>
>
> Currently the AM sends a set of all the topics and partitions to the
> container, which then groups them by partition and assigns each set to a task
> instance. By moving the grouping to the AM, we can assign arbitrary groups to
> task instances, which will allow more partitioning strategies, as discussed
> in SAMZA-71.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
