walterddr opened a new pull request, #10461:
URL: https://github.com/apache/pinot/pull/10461
This is a follow up on #10455
Previous PR
===
- previous PR #10455 adds `SegmentZkMetadataFetcher` and
`SegmentZkMetadataFetcherListener`
This PR
===
- [x] Create PartitionDataManager which similar to
SinglePartitionColumnSegmentPruner but kept a very different view of the map
- [x] create `Map<PartitionID, List<Server>> partitionToServerMapping`
to indicate whole-partition-on-a-single-server
- [x] create `Map<PartitionID, List<Segment>> partitionToSegmentMapping`
to indicate partition and segment relationship
- [x] ~~TimeBoundaryManager to SegmentZkMetadataFetcher management~~
Follow Up
===
due to the complexity of TimeBoundaryManager which needs to coordinate
between REALTIME and OFFLINE table loading, we will leaf this one out from
SegmentZkMetadataFetcher; to summarize
- all `SegmentPruners` and `SegmentPartitionMetadataManager` will extend
`SegmentZkMetadataFetchListener` and will no longer individually pull and cache
from ZK
- `TimeBoundaryManager` will remain on its own cycle to pull and cache
data from ZK
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
