GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/1576
KAFKA-3914: Global discovery of state stores
@guozhangwang @enothereska @mjsax @miguno please take a look. A few things
that need to be clarified
1. I've added StreamsConfig.USER_ENDPOINT_CONFIG, but should we have
separate configs for host and port or is this one config ok?
2. `HostState` in the KIP has a byte[] field - not sure why and what it
would be populated with
3. I've changed the API to return `List<KafkaStreamsInstance>` as opposed
to `Map<HostInfo, Set<TaskMetadata>>` as i find this far more intuitive to work
with.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka kafka-3914v2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/1576.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1576
----
commit f22ca0e680063d42240d8ceebe140ecd9e3fab48
Author: Damian Guy <[email protected]>
Date: 2016-06-29T07:40:11Z
Connect stateStores to source topics.
Add user endpoint config to StreamsConfig.
Collect Map<HostState, Set<TopicPartition>> in StreamPartitionAssignor
API for retrieving Map<HostState, TaskMetadata>
commit 2030da06a22b4160760a2d29a7afd394bd29972b
Author: Damian Guy <[email protected]>
Date: 2016-06-30T09:09:50Z
change api to use List and KafkaStreamsInstance rather than Map..
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---