[jira] [Assigned] (KAFKA-9617) Replica Fetcher can mark partition as failed when max.message.bytes is changed

2020-05-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-9617: Assignee: Chia-Ping Tsai > Replica Fetcher can mark partition as failed when max.message.b

[jira] [Commented] (KAFKA-9617) Replica Fetcher can mark partition as failed when max.message.bytes is changed

2020-05-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104946#comment-17104946 ] Guozhang Wang commented on KAFKA-9617: -- [~chia7712] sure! I've just assigned the tic

[jira] [Commented] (KAFKA-9909) Kafka Streams : offset control to Streams API

2020-05-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104937#comment-17104937 ] Guozhang Wang commented on KAFKA-9909: -- [~gopikrishna.chaga...@target.com] We do hav

[jira] [Commented] (KAFKA-9953) support multiple consumerGroupCoordinators in TransactionManager

2020-05-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104893#comment-17104893 ] Guozhang Wang commented on KAFKA-9953: -- [~jwijgerd] I'm curious to learn your scenar

[jira] [Commented] (KAFKA-9972) Corrupted standby task could be committed

2020-05-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104766#comment-17104766 ] Guozhang Wang commented on KAFKA-9972: -- Since at least for now the task-manager (and

[jira] [Commented] (KAFKA-9798) Flaky test: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-05-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103645#comment-17103645 ] Guozhang Wang commented on KAFKA-9798: -- Haha, fair point. I think the original motiv

[jira] [Commented] (KAFKA-9798) Flaky test: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-05-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17102823#comment-17102823 ] Guozhang Wang commented on KAFKA-9798: -- Sigh... it was after my hotfix indeed, I thi

[jira] [Commented] (KAFKA-9929) Support reverse iterator on WindowStore

2020-05-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17102113#comment-17102113 ] Guozhang Wang commented on KAFKA-9929: -- Thanks [~jeqo], could you add more tests to

[jira] [Commented] (KAFKA-9929) Support reverse iterator on WindowStore

2020-05-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101306#comment-17101306 ] Guozhang Wang commented on KAFKA-9929: -- I looked at the RocksIterator iterator, and

[jira] [Commented] (KAFKA-9909) Kafka Streams : offset control to Streams API

2020-05-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17100186#comment-17100186 ] Guozhang Wang commented on KAFKA-9909: -- I think the reason here is that you catch th

[jira] [Commented] (KAFKA-9798) Flaky test: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-05-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17100179#comment-17100179 ] Guozhang Wang commented on KAFKA-9798: -- This is due to a known issue which is fixed

[jira] [Commented] (KAFKA-9859) kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation

2020-05-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099190#comment-17099190 ] Guozhang Wang commented on KAFKA-9859: -- [~lkokhreidze] Do you want to send a PR to r

[jira] [Comment Edited] (KAFKA-9929) Support reverse iterator on WindowStore

2020-05-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099187#comment-17099187 ] Guozhang Wang edited comment on KAFKA-9929 at 5/4/20, 5:59 PM:

[jira] [Commented] (KAFKA-9929) Support reverse iterator on WindowStore

2020-05-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099187#comment-17099187 ] Guozhang Wang commented on KAFKA-9929: -- Hi [~jeqo], thanks for reporting this reques

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-05-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097539#comment-17097539 ] Guozhang Wang commented on KAFKA-8803: -- [~waykarp] It's a bit tricky to reproduce si

[jira] [Commented] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

2020-04-29 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096070#comment-17096070 ] Guozhang Wang commented on KAFKA-2419: -- Hello [~IceChen], I just noticed you are usi

[jira] [Commented] (KAFKA-9928) Flaky GlobalKTableEOSIntegrationTest#shouldKStreamGlobalKTableLeftJoin[exactly_once_beta]

2020-04-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094902#comment-17094902 ] Guozhang Wang commented on KAFKA-9928: -- I found that for the failed run, around the

[jira] [Created] (KAFKA-9928) Flaky GlobalKTableEOSIntegrationTest#shouldKStreamGlobalKTableLeftJoin[exactly_once_beta]

2020-04-28 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9928: Summary: Flaky GlobalKTableEOSIntegrationTest#shouldKStreamGlobalKTableLeftJoin[exactly_once_beta] Key: KAFKA-9928 URL: https://issues.apache.org/jira/browse/KAFKA-9928

[jira] [Commented] (KAFKA-9925) Non-key KTable Joining may result in duplicate schema name in confluence schema registry

2020-04-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094805#comment-17094805 ] Guozhang Wang commented on KAFKA-9925: -- Ah yes!! Hope we can get KIP-591 by 2.6 :)

[jira] [Commented] (KAFKA-9925) Non-key KTable Joining may result in duplicate schema name in confluence schema registry

2020-04-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094772#comment-17094772 ] Guozhang Wang commented on KAFKA-9925: -- [~vvcephei] Thanks for getting a look into t

[jira] [Commented] (KAFKA-9798) Flaky test: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-04-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093941#comment-17093941 ] Guozhang Wang commented on KAFKA-9798: -- One more try to fix this: https://github.com

[jira] [Assigned] (KAFKA-9798) Flaky test: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-04-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-9798: Assignee: Guozhang Wang > Flaky test: > org.apache.kafka.streams.integration.QueryableSta

[jira] [Commented] (KAFKA-9909) Kafka Streams : offset control to Streams API

2020-04-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093757#comment-17093757 ] Guozhang Wang commented on KAFKA-9909: -- Not sure I can follow here: if you set the c

[jira] [Commented] (KAFKA-9603) Number of open files keeps increasing in Streams application

2020-04-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093749#comment-17093749 ] Guozhang Wang commented on KAFKA-9603: -- Thanks for uploading the reproduction repo g

[jira] [Commented] (KAFKA-9906) Is bytesSinceLastIndexEntry updated correctly in LogSegment.append()?

2020-04-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092429#comment-17092429 ] Guozhang Wang commented on KAFKA-9906: -- Note that the index is updated on `physicalP

[jira] [Commented] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

2020-04-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092427#comment-17092427 ] Guozhang Wang commented on KAFKA-2419: -- Client-side metrics are mostly created when

[jira] [Commented] (KAFKA-9909) Kafka Streams : offset control to Streams API

2020-04-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092420#comment-17092420 ] Guozhang Wang commented on KAFKA-9909: -- Hello [~gopikrishna.chaga...@target.com] If

[jira] [Comment Edited] (KAFKA-9916) Materialize Table-Table Join Result to Avoid Performing Same Join Twice

2020-04-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091963#comment-17091963 ] Guozhang Wang edited comment on KAFKA-9916 at 4/24/20, 11:15 PM: --

[jira] [Commented] (KAFKA-9916) Materialize Table-Table Join Result to Avoid Performing Same Join Twice

2020-04-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091963#comment-17091963 ] Guozhang Wang commented on KAFKA-9916: -- Thanks [~cadonna] for filing the JIRA! I'd l

[jira] [Commented] (KAFKA-9450) Decouple inner state flushing from committing

2020-04-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091899#comment-17091899 ] Guozhang Wang commented on KAFKA-9450: -- We had some more discussion with [~desai.p.r

[jira] [Comment Edited] (KAFKA-9913) TopologyDescription should expose all topic name progrematically

2020-04-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091168#comment-17091168 ] Guozhang Wang edited comment on KAFKA-9913 at 4/24/20, 4:32 AM: ---

[jira] [Commented] (KAFKA-9913) TopologyDescription should expose all topic name progrematically

2020-04-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091168#comment-17091168 ] Guozhang Wang commented on KAFKA-9913: -- [~mjsax] I will incorporate this ticket as p

[jira] [Resolved] (KAFKA-9823) Consumer should check equality of the generation for coordinator requests

2020-04-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9823. -- Fix Version/s: 2.6.0 Resolution: Fixed > Consumer should check equality of the generatio

[jira] [Resolved] (KAFKA-9388) Flaky Test StandbyTaskCreationIntegrationTest.shouldCreateStandByTasksForMaterializedAndOptimizedSourceTables

2020-04-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9388. -- Fix Version/s: 2.6.0 Assignee: Guozhang Wang Resolution: Fixed > Flaky Test >

[jira] [Commented] (KAFKA-9903) kafka ShutdownableThread judge thread isRuning status has some bug

2020-04-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089926#comment-17089926 ] Guozhang Wang commented on KAFKA-9903: -- Hello Shilin, Thanks for the report, and I

[jira] [Commented] (KAFKA-9224) State store should not see uncommitted transaction result

2020-04-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087270#comment-17087270 ] Guozhang Wang commented on KAFKA-9224: -- Hi [~mjsax], I think we are talking about th

[jira] [Commented] (KAFKA-9224) State store should not see uncommitted transaction result

2020-04-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087152#comment-17087152 ] Guozhang Wang commented on KAFKA-9224: -- I think there are two issues here: 1) If th

[jira] [Resolved] (KAFKA-8895) Flaky org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromDateTimeAfterResetWithoutIntermediateUserTopic

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8895. -- Resolution: Fixed https://github.com/apache/kafka/pull/8208 > Flaky > org.apache.kafka.stream

[jira] [Resolved] (KAFKA-8894) Flaky org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromFileAfterResetWithoutIntermediateUserTopic

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8894. -- Fix Version/s: 2.5.0 Resolution: Fixed https://github.com/apache/kafka/pull/8208 > Flak

[jira] [Resolved] (KAFKA-8893) Flaky ResetIntegrationTest. testReprocessingFromScratchAfterResetWithIntermediateUserTopic

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8893. -- Fix Version/s: 2.5.0 Resolution: Fixed https://github.com/apache/kafka/pull/8208 > Flak

[jira] [Commented] (KAFKA-9889) Flaky RocksDBTimestampedStoreTest.shouldVerifyThatMetricsGetMeasurementsFromRocksDB

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086607#comment-17086607 ] Guozhang Wang commented on KAFKA-9889: -- Assigning to [~ableegoldman] since she's sta

[jira] [Assigned] (KAFKA-9889) Flaky RocksDBTimestampedStoreTest.shouldVerifyThatMetricsGetMeasurementsFromRocksDB

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-9889: Assignee: Sophie Blee-Goldman > Flaky > RocksDBTimestampedStoreTest.shouldVerifyThatMetri

[jira] [Resolved] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8803. -- Fix Version/s: 2.5.0 Assignee: Guozhang Wang (was: Sophie Blee-Goldman) Resolut

[jira] [Commented] (KAFKA-9880) Error while range compacting during bulk loading of FIFO compacted RocksDB Store

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086589#comment-17086589 ] Guozhang Wang commented on KAFKA-9880: -- Thanks for reporting this [~Dealus]. I think

[jira] [Created] (KAFKA-9889) Flaky RocksDBTimestampedStoreTest.shouldVerifyThatMetricsGetMeasurementsFromRocksDB

2020-04-18 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9889: Summary: Flaky RocksDBTimestampedStoreTest.shouldVerifyThatMetricsGetMeasurementsFromRocksDB Key: KAFKA-9889 URL: https://issues.apache.org/jira/browse/KAFKA-9889 Pro

[jira] [Commented] (KAFKA-9798) Flaky test: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086535#comment-17086535 ] Guozhang Wang commented on KAFKA-9798: -- I looked through the recent traces up to 180

[jira] [Resolved] (KAFKA-9798) Flaky test: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-04-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9798. -- Resolution: Fixed > Flaky test: > org.apache.kafka.streams.integration.QueryableStateIntegrati

[jira] [Commented] (KAFKA-9224) State store should not see uncommitted transaction result

2020-04-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085311#comment-17085311 ] Guozhang Wang commented on KAFKA-9224: -- My understanding for this JIRA is more relat

[jira] [Commented] (KAFKA-9878) Block EndTxn call until the txn markers are committed

2020-04-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085171#comment-17085171 ] Guozhang Wang commented on KAFKA-9878: -- The original rationale is that if after comm

[jira] [Commented] (KAFKA-9860) Transactional Producer could pre-add partitions

2020-04-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085166#comment-17085166 ] Guozhang Wang commented on KAFKA-9860: -- I think this is a good idea. Probably we sho

[jira] [Commented] (KAFKA-9224) State store should not see uncommitted transaction result

2020-04-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085141#comment-17085141 ] Guozhang Wang commented on KAFKA-9224: -- Since it is considered targeting the same is

[jira] [Commented] (KAFKA-9858) CVE-2016-3189 Use-after-free vulnerability in bzip2recover in bzip2 1.0.6 allows remote attackers to cause a denial of service (crash) via a crafted bzip2 file, relate

2020-04-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083482#comment-17083482 ] Guozhang Wang commented on KAFKA-9858: -- For rocksdbjni, I saw that at the moment eve

[jira] [Commented] (KAFKA-9840) Consumer should not use OffsetForLeaderEpoch without current epoch validation

2020-04-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082472#comment-17082472 ] Guozhang Wang commented on KAFKA-9840: -- What I'm thinking is that, if we treat it as

[jira] [Commented] (KAFKA-9765) Could not add partitions to transaction due to errors

2020-04-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081060#comment-17081060 ] Guozhang Wang commented on KAFKA-9765: -- Hello [~waykarp] I looked your uploaded stac

[jira] [Commented] (KAFKA-9603) Number of open files keeps increasing in Streams application

2020-04-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080887#comment-17080887 ] Guozhang Wang commented on KAFKA-9603: -- Great, thanks! I'd be waiting for you to sha

[jira] [Commented] (KAFKA-9592) Safely abort Producer transactions during application shutdown

2020-04-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080875#comment-17080875 ] Guozhang Wang commented on KAFKA-9592: -- I would think so: the current javadoc of abo

[jira] [Commented] (KAFKA-9823) Consumer should check equality of the generation for coordinator requests

2020-04-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080224#comment-17080224 ] Guozhang Wang commented on KAFKA-9823: -- https://issues.apache.org/jira/browse/KAFKA-

[jira] [Commented] (KAFKA-9592) Safely abort Producer transactions during application shutdown

2020-04-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080072#comment-17080072 ] Guozhang Wang commented on KAFKA-9592: -- I'd like to add some context about this prop

[jira] [Commented] (KAFKA-9603) Number of open files keeps increasing in Streams application

2020-04-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079588#comment-17079588 ] Guozhang Wang commented on KAFKA-9603: -- [~lpandzic] Thanks for the update, we will t

[jira] [Commented] (KAFKA-9840) Consumer should not use OffsetForLeaderEpoch without current epoch validation

2020-04-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079583#comment-17079583 ] Guozhang Wang commented on KAFKA-9840: -- For the second case, when the returned offse

[jira] [Commented] (KAFKA-9831) Failing test: EosIntegrationTest.shouldNotViolateEosIfOneTaskFailsWithState[exactly_once_beta]

2020-04-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17078896#comment-17078896 ] Guozhang Wang commented on KAFKA-9831: -- Thanks for the report Matthias. > Failing t

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-04-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077638#comment-17077638 ] Guozhang Wang commented on KAFKA-8803: -- Great to hear! Please let us know if there's

[jira] [Updated] (KAFKA-9811) TransactionMetadata state and pendingState are non-volatile and read outside the metadata lock

2020-04-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9811: - Component/s: core > TransactionMetadata state and pendingState are non-volatile and read outside

[jira] [Created] (KAFKA-9823) Consumer should check equality of the generation for coordinator requests

2020-04-05 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9823: Summary: Consumer should check equality of the generation for coordinator requests Key: KAFKA-9823 URL: https://issues.apache.org/jira/browse/KAFKA-9823 Project: Kafk

[jira] [Commented] (KAFKA-9821) Partition may skip assignment with static members and incremental rebalances

2020-04-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075220#comment-17075220 ] Guozhang Wang commented on KAFKA-9821: -- Yup I totally agree with the logging improve

[jira] [Created] (KAFKA-9821) Partition may skip assignment with static members and incremental rebalances

2020-04-03 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9821: Summary: Partition may skip assignment with static members and incremental rebalances Key: KAFKA-9821 URL: https://issues.apache.org/jira/browse/KAFKA-9821 Project: K

[jira] [Created] (KAFKA-9816) Group Coordinator should be stricter about leader returned assignment

2020-04-03 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9816: Summary: Group Coordinator should be stricter about leader returned assignment Key: KAFKA-9816 URL: https://issues.apache.org/jira/browse/KAFKA-9816 Project: Kafka

[jira] [Updated] (KAFKA-9803) Allow producers to recover gracefully from transaction timeouts

2020-04-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9803: - Component/s: streams consumer > Allow producers to recover gracefully from trans

[jira] [Updated] (KAFKA-9803) Allow producers to recover gracefully from transaction timeouts

2020-04-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9803: - Component/s: (was: consumer) producer > Allow producers to recover graceful

[jira] [Updated] (KAFKA-9801) Static member could get empty assignment unexpectedly

2020-04-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9801: - Description: Take the following example trace where static members are joining the group: 1. Sta

[jira] [Commented] (KAFKA-9798) org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-04-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17073240#comment-17073240 ] Guozhang Wang commented on KAFKA-9798: -- I pushed a hotfix commit into trunk, let's s

[jira] [Commented] (KAFKA-9798) org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-04-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17073232#comment-17073232 ] Guozhang Wang commented on KAFKA-9798: -- {code} java.lang.AssertionError: Did not rec

[jira] [Created] (KAFKA-9801) Static member could get empty assignment unexpectedly

2020-04-01 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9801: Summary: Static member could get empty assignment unexpectedly Key: KAFKA-9801 URL: https://issues.apache.org/jira/browse/KAFKA-9801 Project: Kafka Issue Typ

[jira] [Resolved] (KAFKA-9783) Flaky Test QueryableStateIntegrationTest#concurrentAccesses

2020-03-31 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9783. -- Fix Version/s: 2.6.0 Resolution: Fixed I think https://github.com/apache/kafka/pull/8370

[jira] [Resolved] (KAFKA-5842) QueryableStateIntegrationTest may fail with JDK 7

2020-03-31 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5842. -- Resolution: Fixed Hopefully it has fixed via https://github.com/apache/kafka/pull/8370 > Query

[jira] [Resolved] (KAFKA-9753) Add task-level active-process-ratio to Streams metrics

2020-03-31 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9753. -- Fix Version/s: 2.6.0 Resolution: Fixed > Add task-level active-process-ratio to Streams

[jira] [Comment Edited] (KAFKA-8677) Flakey test GroupEndToEndAuthorizationTest#testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl

2020-03-30 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071383#comment-17071383 ] Guozhang Wang edited comment on KAFKA-8677 at 3/31/20, 1:49 AM: ---

[jira] [Commented] (KAFKA-8677) Flakey test GroupEndToEndAuthorizationTest#testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl

2020-03-30 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071383#comment-17071383 ] Guozhang Wang commented on KAFKA-8677: -- I'm going to investigate the newly reported

[jira] [Resolved] (KAFKA-8937) Flaky Test SaslPlainSslEndToEndAuthorizationTest#testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl

2020-03-30 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8937. -- Resolution: Fixed > Flaky Test > SaslPlainSslEndToEndAuthorizationTest#testNoDescribeProduceOr

[jira] [Resolved] (KAFKA-9756) Refactor the main loop to process more than one record of one task at a time

2020-03-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9756. -- Fix Version/s: 2.6.0 Resolution: Fixed > Refactor the main loop to process more than one

[jira] [Commented] (KAFKA-9749) TransactionMarkerRequestCompletionHandler should treat storage exceptions as retriable

2020-03-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066382#comment-17066382 ] Guozhang Wang commented on KAFKA-9749: -- Thanks! > TransactionMarkerRequestCompletio

[jira] [Commented] (KAFKA-9749) TransactionMarkerRequestCompletionHandler should treat storage exceptions as retriable

2020-03-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066372#comment-17066372 ] Guozhang Wang commented on KAFKA-9749: -- [~bob-barrett] [~hachikuji] Just for my own

[jira] [Created] (KAFKA-9756) Refactor the main loop to process more than one record of one task at a time

2020-03-24 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9756: Summary: Refactor the main loop to process more than one record of one task at a time Key: KAFKA-9756 URL: https://issues.apache.org/jira/browse/KAFKA-9756 Project: K

[jira] [Created] (KAFKA-9753) Add task-level active-process-ratio to Streams metrics

2020-03-24 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9753: Summary: Add task-level active-process-ratio to Streams metrics Key: KAFKA-9753 URL: https://issues.apache.org/jira/browse/KAFKA-9753 Project: Kafka Issue Ty

[jira] [Resolved] (KAFKA-6820) Improve on StreamsMetrics Public APIs

2020-03-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6820. -- Resolution: Fixed > Improve on StreamsMetrics Public APIs > ---

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17065190#comment-17065190 ] Guozhang Wang commented on KAFKA-8803: -- [~rocketraman] We found another cause that c

[jira] [Resolved] (KAFKA-9701) Consumer could catch InconsistentGroupProtocolException during rebalance

2020-03-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9701. -- Fix Version/s: 2.5.0 Resolution: Fixed > Consumer could catch InconsistentGroupProtocolE

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062874#comment-17062874 ] Guozhang Wang commented on KAFKA-8803: -- I guess what I tried to convey is that it's

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062200#comment-17062200 ] Guozhang Wang commented on KAFKA-8803: -- [~rocketraman] Here's my current investigati

[jira] [Commented] (KAFKA-8858) Kafka Streams - Failed to Rebalance Error and stream consumer stuck for some reason

2020-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062178#comment-17062178 ] Guozhang Wang commented on KAFKA-8858: -- [~ableegoldman] I'm not sure I followed your

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062177#comment-17062177 ] Guozhang Wang commented on KAFKA-8803: -- [~ableegoldman] I think 8858 and 8803 are re

[jira] [Resolved] (KAFKA-5604) All producer methods should raise `ProducerFencedException` after the first time.

2020-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5604. -- Fix Version/s: 2.3.0 Assignee: Guozhang Wang (was: Apurva Mehta) Resolution: Fi

[jira] [Commented] (KAFKA-5604) All producer methods should raise `ProducerFencedException` after the first time.

2020-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062064#comment-17062064 ] Guozhang Wang commented on KAFKA-5604: -- Verified that I've fixed the producer as in

[jira] [Commented] (KAFKA-5604) All producer methods should raise `ProducerFencedException` after the first time.

2020-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062006#comment-17062006 ] Guozhang Wang commented on KAFKA-5604: -- [~iamabug] There are some context missing fr

[jira] [Assigned] (KAFKA-9659) Kafka Streams / Consumer configured for static membership fails on "fatal exception: group.instance.id gets fenced"

2020-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-9659: Assignee: Guozhang Wang > Kafka Streams / Consumer configured for static membership fails

[jira] [Resolved] (KAFKA-6647) KafkaStreams.cleanUp creates .lock file in directory its trying to clean (Windows OS)

2020-03-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6647. -- Fix Version/s: 2.5.1 2.6.0 Assignee: Guozhang Wang Resolution

[jira] [Commented] (KAFKA-6647) KafkaStreams.cleanUp creates .lock file in directory its trying to clean (Windows OS)

2020-03-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059488#comment-17059488 ] Guozhang Wang commented on KAFKA-6647: -- I've pushed the fix to trunk / 2.5 which is

[jira] [Commented] (KAFKA-5604) All producer methods should raise `ProducerFencedException` after the first time.

2020-03-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059481#comment-17059481 ] Guozhang Wang commented on KAFKA-5604: -- Thank you for looking into this, and I think

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-12 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058444#comment-17058444 ] Guozhang Wang commented on KAFKA-8803: -- [~rocketraman] I took some time on the logs,

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057296#comment-17057296 ] Guozhang Wang commented on KAFKA-8803: -- Raman, could you share the broker-side logs

<    4   5   6   7   8   9   10   11   12   13   >