[
https://issues.apache.org/jira/browse/KAFKA-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16042147#comment-16042147
]
ASF GitHub Bot commented on KAFKA-5403:
---------------------------------------
GitHub user apurvam opened a pull request:
https://github.com/apache/kafka/pull/3266
KAFKA-5403: Transaction system test consumer should dedup messages by offset
Since the consumer can consume duplicate offsets due to rebalances, we
should dedup consumed messages by offset in order to ensure that the test
doesn't fail spuriously.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apurvam/kafka
KAFKA-5403-dedup-consumed-messages-transactions-system-test
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/3266.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3266
----
commit f4ba943358aad08950e0952f60eb98843efd42f2
Author: Apurva Mehta <[email protected]>
Date: 2017-06-08T01:40:40Z
WIP
commit 5a6ac9dcc83c5bb0f62a5c387923612c5a9f1212
Author: Apurva Mehta <[email protected]>
Date: 2017-06-08T02:51:48Z
WIP commit
----
> Transactions system test should dedup consumed messages by offset
> -----------------------------------------------------------------
>
> Key: KAFKA-5403
> URL: https://issues.apache.org/jira/browse/KAFKA-5403
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.11.0.0
> Reporter: Apurva Mehta
> Assignee: Apurva Mehta
> Fix For: 0.11.0.1
>
>
> In KAFKA-5396, we saw that the consumers which verify the data in multiple
> topics could read the same offsets multiple times, for instance when a
> rebalance happens.
> This would detect spurious duplicates, causing the test to fail. We should
> dedup the consumed messages by offset and only fail the test if we have
> duplicate values for a if for a unique set of offsets.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
