lucliu1108 commented on code in PR #21558:
URL: https://github.com/apache/kafka/pull/21558#discussion_r2891514825
##########
group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java:
##########
@@ -201,17 +231,68 @@ public static
List<ConsumerGroupHeartbeatRequestData.TopicPartitions> toTopicPar
}
/**
- * Creates a map of topic id and partition set from a list of consumer
group TopicPartitions.
+ * Creates a map of topic id and partition with assignment epochs from a
list of consumer group TopicPartitions.
*
- * @param topicPartitionsList The list of TopicPartitions.
- * @return a map of topic id and partition set.
+ * @param topicPartitions The list of TopicPartitions.
+ * @param defaultEpoch The default epoch to use when the epoch information
is not available for a partition.
+ * @return a map of topic id and partitions with assignment epochs.
*/
- public static Map<Uuid, Set<Integer>> assignmentFromTopicPartitions(
- List<ConsumerGroupCurrentMemberAssignmentValue.TopicPartitions>
topicPartitionsList
+ public static Map<Uuid, Map<Integer, Integer>>
assignmentFromTopicPartitions(
+ List<ConsumerGroupCurrentMemberAssignmentValue.TopicPartitions>
topicPartitions,
+ int defaultEpoch
) {
- return topicPartitionsList.stream().collect(Collectors.toMap(
- ConsumerGroupCurrentMemberAssignmentValue.TopicPartitions::topicId,
- topicPartitions -> Collections.unmodifiableSet(new
HashSet<>(topicPartitions.partitions()))));
+ // For legacy static member, the defaultEpoch could be -2
(LEAVE_GROUP_STATIC_MEMBER_EPOCH).
+ // But we want to ensure the default memberEpoch assigned is
non-negative.
+ int adjustedDefaultEpoch = Math.max(defaultEpoch, 0);
+ Map<Uuid, Map<Integer, Integer>> assignmentWithEpochs = new
HashMap<>();
+ for (ConsumerGroupCurrentMemberAssignmentValue.TopicPartitions tp :
topicPartitions) {
+ Map<Integer, Integer> partitionEpochs = new HashMap<>();
+ List<Integer> partitions = tp.partitions();
+ List<Integer> epochs = tp.assignmentEpochs();
+ if (epochs != null && !epochs.isEmpty() && epochs.size() !=
partitions.size()) {
Review Comment:
Thanks for the input! @lucasbru @squah-confluent
I revised the log to:
- allow for null epoch array, fallback to default epoch
- allow for empty epoch array, fallback to default epoch, but leave an ERROR
level log
- don't allow for not-empty unequal length array, throw an exception
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
