[GitHub] [kafka] chia7712 edited a comment on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-24 Thread GitBox
chia7712 edited a comment on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-663818439 @junrao I have rebased this PR to include fix of ```group_mode_transactions_test```. Could you run system tests again? Except for ```streams_eos_test```, ```stream

[GitHub] [kafka] chia7712 edited a comment on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-24 Thread GitBox
chia7712 edited a comment on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-663818439 @junrao I have rebased this PR to include fix of ```group_mode_transactions_test```. Could you run system tests again? Except for ```streams_eos_test```, ```stream

[GitHub] [kafka] chia7712 commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-24 Thread GitBox
chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-663818439 @junrao I have rebased this PR to include fix of ```group_mode_transactions_test```. Could you run system tests again? Except for ```streams_eos_test``` and transaction t

[GitHub] [kafka] abbccdda commented on pull request #8907: MINOR: code cleanup for `VOut` inconsistent naming

2020-07-24 Thread GitBox
abbccdda commented on pull request #8907: URL: https://github.com/apache/kafka/pull/8907#issuecomment-663817294 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[jira] [Updated] (KAFKA-10307) Topology cycles in KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

2020-07-24 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-10307: Priority: Major (was: Minor) > Topology cycles in > KTableKTableForeignKeyInnerJoinMultiIntegrat

[jira] [Updated] (KAFKA-10307) Topology cycles in KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

2020-07-24 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-10307: Component/s: streams > Topology cycles in > KTableKTableForeignKeyInnerJoinMultiIntegrationTest#s

[jira] [Updated] (KAFKA-10307) Topology cycles in KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

2020-07-24 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-10307: Affects Version/s: 2.6.0 2.4.0 2.5.0 > Topology cycl

[jira] [Commented] (KAFKA-10307) Topology cycles in KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

2020-07-24 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164760#comment-17164760 ] Boyang Chen commented on KAFKA-10307: - [~vvcephei] Could you take a look? [~feyman] 

[jira] [Created] (KAFKA-10307) Topology cycles in KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

2020-07-24 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10307: --- Summary: Topology cycles in KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable Key: KAFKA-10307 URL: https://issues.apache.org/jira/browse/KA

[GitHub] [kafka] abbccdda commented on a change in pull request #9068: MINOR: INFO log4j when request re-join

2020-07-24 Thread GitBox
abbccdda commented on a change in pull request #9068: URL: https://github.com/apache/kafka/pull/9068#discussion_r460368003 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java ## @@ -770,12 +770,18 @@ public boolean rejoinNee

[GitHub] [kafka] abbccdda commented on pull request #9034: KAFKA-10246 : AbstractProcessorContext topic() throws NPE

2020-07-24 Thread GitBox
abbccdda commented on pull request #9034: URL: https://github.com/apache/kafka/pull/9034#issuecomment-663812415 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] chia7712 commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
chia7712 commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663806553 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] abbccdda commented on a change in pull request #9004: KAFKA-10261: Introduce the KIP-478 apis with shims

2020-07-24 Thread GitBox
abbccdda commented on a change in pull request #9004: URL: https://github.com/apache/kafka/pull/9004#discussion_r460341215 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/api/ProcessorContext.java ## @@ -0,0 +1,240 @@ +/* + * Licensed to the Apache Softw

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460341454 ## File path: streams/src/main/java/org/apache/kafka/streams/internals/QuietStreamsConfig.java ## @@ -1,33 +0,0 @@ -/* - * Licensed to the Apache Software Fo

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460341186 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] vvcephei commented on pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
vvcephei commented on pull request #9047: URL: https://github.com/apache/kafka/pull/9047#issuecomment-663782524 I left one more comment about using the request timeout config, but I'm really fine with whatever you decide. LGTM! Thanks again. ---

[GitHub] [kafka] vvcephei commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
vvcephei commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460338747 ## File path: streams/src/main/java/org/apache/kafka/streams/internals/QuietStreamsConfig.java ## @@ -1,33 +0,0 @@ -/* - * Licensed to the Apache Software

[GitHub] [kafka] vvcephei commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
vvcephei commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460338414 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restore

[GitHub] [kafka] mjsax merged pull request #9061: MINOR: removed incorrect deprecation annotations

2020-07-24 Thread GitBox
mjsax merged pull request #9061: URL: https://github.com/apache/kafka/pull/9061 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460324591 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] mjsax commented on pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on pull request #9047: URL: https://github.com/apache/kafka/pull/9047#issuecomment-663766278 Thanks for the review @abbccdda @vvcephei -- updated the PR. This is an automated message from the Apache Git Servic

[GitHub] [kafka] lbradstreet commented on a change in pull request #9067: MINOR: Streams integration tests should not call exit

2020-07-24 Thread GitBox
lbradstreet commented on a change in pull request #9067: URL: https://github.com/apache/kafka/pull/9067#discussion_r460322318 ## File path: checkstyle/checkstyle.xml ## @@ -103,6 +103,13 @@ + + + + + Review comment: Thank you

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460320506 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -299,7 +318,17 @@ private void restoreStat

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460320303 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460308959 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -318,6 +341,72 @@ private void restoreStat

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460319742 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] dhruvilshah3 commented on a change in pull request #9054: KAFKA-10282: Remove Log metrics immediately when deleting log

2020-07-24 Thread GitBox
dhruvilshah3 commented on a change in pull request #9054: URL: https://github.com/apache/kafka/pull/9054#discussion_r460317793 ## File path: core/src/main/scala/kafka/log/LogManager.scala ## @@ -932,6 +927,7 @@ class LogManager(logDirs: Seq[File], val logsToCheckpoint

[GitHub] [kafka] mjsax commented on a change in pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9075: URL: https://github.com/apache/kafka/pull/9075#discussion_r460315914 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStreamThread.java ## @@ -331,17 +336,36 @@ private StateConsumer initi

[GitHub] [kafka] vvcephei commented on pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
vvcephei commented on pull request #9075: URL: https://github.com/apache/kafka/pull/9075#issuecomment-663754855 Otherwise, it LGTM. Feel free to merge whether or not you like my suggestions ;) This is an automated message f

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460309750 ## File path: streams/src/test/java/org/apache/kafka/test/NoOpReadOnlyStore.java ## @@ -78,6 +78,7 @@ public void init(final ProcessorContext context, final

[GitHub] [kafka] vvcephei commented on a change in pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
vvcephei commented on a change in pull request #9075: URL: https://github.com/apache/kafka/pull/9075#discussion_r460307479 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateUpdateTask.java ## @@ -114,8 +118,16 @@ public void flushState

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460308797 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460308959 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -318,6 +341,72 @@ private void restoreStat

[jira] [Comment Edited] (KAFKA-9731) Increased fetch request rate with leader selector due to HW propagation

2020-07-24 Thread Shane (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163061#comment-17163061 ] Shane edited comment on KAFKA-9731 at 7/24/20, 10:07 PM: - Hey Kaf

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460308601 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -299,7 +318,17 @@ private void restoreStat

[GitHub] [kafka] ijuma commented on pull request #9054: KAFKA-10282: Remove Log metrics immediately when deleting log

2020-07-24 Thread GitBox
ijuma commented on pull request #9054: URL: https://github.com/apache/kafka/pull/9054#issuecomment-663753175 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460307083 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460305945 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460305033 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -185,32 +200,16 @@ public void registerSto

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460304324 ## File path: streams/src/main/java/org/apache/kafka/streams/internals/QuietStreamsConfig.java ## @@ -1,33 +0,0 @@ -/* - * Licensed to the Apache Software Fo

[GitHub] [kafka] vvcephei commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
vvcephei commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460287991 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restore

[GitHub] [kafka] mjsax commented on a change in pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9075: URL: https://github.com/apache/kafka/pull/9075#discussion_r460303491 ## File path: streams/src/test/java/org/apache/kafka/streams/processor/internals/GlobalStreamThreadTest.java ## @@ -128,10 +130,9 @@ public void shouldThrow

[GitHub] [kafka] mjsax commented on a change in pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9075: URL: https://github.com/apache/kafka/pull/9075#discussion_r460303342 ## File path: streams/src/test/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImplTest.java ## @@ -323,21 +322,6 @@ public void shouldRe

[GitHub] [kafka] mjsax commented on a change in pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9075: URL: https://github.com/apache/kafka/pull/9075#discussion_r460302576 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStreamThread.java ## @@ -234,24 +234,18 @@ void initialize() {

[GitHub] [kafka] mjsax commented on a change in pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9075: URL: https://github.com/apache/kafka/pull/9075#discussion_r460302228 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateMaintainer.java ## @@ -31,7 +31,7 @@ void flushState();

[GitHub] [kafka] vvcephei commented on pull request #9067: MINOR: Streams integration tests should not call exit

2020-07-24 Thread GitBox
vvcephei commented on pull request #9067: URL: https://github.com/apache/kafka/pull/9067#issuecomment-663746926 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] mjsax commented on a change in pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9075: URL: https://github.com/apache/kafka/pull/9075#discussion_r460300664 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -291,27 +290,17 @@ private void restoreSta

[GitHub] [kafka] mjsax opened a new pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-24 Thread GitBox
mjsax opened a new pull request #9075: URL: https://github.com/apache/kafka/pull/9075 Fix for `2.6` blocker bug. Call for review @guozhangwang @vvcephei (\cc @rhauch) This is an automated message from the Apache Git Se

[GitHub] [kafka] mjsax commented on a change in pull request #9067: MINOR: Streams integration tests should not call exit

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9067: URL: https://github.com/apache/kafka/pull/9067#discussion_r460282952 ## File path: checkstyle/checkstyle.xml ## @@ -103,6 +103,13 @@ + + + + + Review comment: Nice one! --

[GitHub] [kafka] mjsax commented on a change in pull request #9073: MINOR: add task ':streams:testAll'

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9073: URL: https://github.com/apache/kafka/pull/9073#discussion_r460282610 ## File path: build.gradle ## @@ -1266,6 +1266,27 @@ project(':streams') { if( !generatedDocsDir.exists() ) { generatedDocsDir.mkdirs() } standardOu

[GitHub] [kafka] mjsax commented on a change in pull request #9073: MINOR: add task ':streams:testAll'

2020-07-24 Thread GitBox
mjsax commented on a change in pull request #9073: URL: https://github.com/apache/kafka/pull/9073#discussion_r460282456 ## File path: build.gradle ## @@ -1266,6 +1266,27 @@ project(':streams') { if( !generatedDocsDir.exists() ) { generatedDocsDir.mkdirs() } standardOu

[GitHub] [kafka] vvcephei commented on pull request #9052: MINOR: TopologyTestDriver should not require dummy parameters

2020-07-24 Thread GitBox
vvcephei commented on pull request #9052: URL: https://github.com/apache/kafka/pull/9052#issuecomment-663728382 Thanks @mjsax . Your suggestions sound good to me. I'll circle back on this PR in a bit. This is an automated me

[GitHub] [kafka] vvcephei merged pull request #9070: MINOR: speed up release script

2020-07-24 Thread GitBox
vvcephei merged pull request #9070: URL: https://github.com/apache/kafka/pull/9070 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] vvcephei merged pull request #9073: MINOR: add task ':streams:testAll'

2020-07-24 Thread GitBox
vvcephei merged pull request #9073: URL: https://github.com/apache/kafka/pull/9073 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] vvcephei commented on pull request #9073: MINOR: add task ':streams:testAll'

2020-07-24 Thread GitBox
vvcephei commented on pull request #9073: URL: https://github.com/apache/kafka/pull/9073#issuecomment-663721003 Thanks @abbccdda ! There was only one flaky test, and the last change was only to the README, so I'll merge now.

[GitHub] [kafka] vvcephei commented on pull request #9074: KAFKA-10287: PROPOSAL: safe offset tracking

2020-07-24 Thread GitBox
vvcephei commented on pull request #9074: URL: https://github.com/apache/kafka/pull/9074#issuecomment-663719873 Hey @cadonna , I was reflecting on your fix for KAFKA-10287, and it seems like dealing with those sentinel values is quite risky. We've had several bugs in the past, I don't feel

[GitHub] [kafka] vvcephei opened a new pull request #9074: KAFKA-10287: PROPOSAL: safe offset tracking

2020-07-24 Thread GitBox
vvcephei opened a new pull request #9074: URL: https://github.com/apache/kafka/pull/9074 This PR should be targeted to trunk, but it's not a trivial task. I just wanted to propose this approach. ### Committer Checklist (excluded from commit message) - [ ] Verify design and impleme

[GitHub] [kafka] vvcephei commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
vvcephei commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663710503 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] vvcephei commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
vvcephei commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663710405 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] cadonna commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
cadonna commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663702921 @vvcephei Thanks for checking! Given your finding, I will change `UNKNOWN_OFFSET` to `-4L`. Actually, we do not to change `UNKNOWN_OFFSET` at all, because we now never write it in

[GitHub] [kafka] ableegoldman commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
ableegoldman commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663701977 @vvcephei I don't think there should be any issue there, since the checkpointed `OFFSET_UNKNOWN` is just ignored on read (or should be) and will never make it into the subsc

[GitHub] [kafka] abbccdda commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-24 Thread GitBox
abbccdda commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460165601 ## File path: docs/streams/developer-guide/config-streams.html ## @@ -326,13 +321,18 @@ bootstrap.serversstate.cleanup.delay.ms Low

[GitHub] [kafka] lbradstreet commented on pull request #9067: MINOR: Streams integration tests should not call exit

2020-07-24 Thread GitBox
lbradstreet commented on pull request #9067: URL: https://github.com/apache/kafka/pull/9067#issuecomment-663689440 > Hey @mjsax , > > I double-checked, and it does seem to be the right fix. I confirmed that no matter whether you run the test with IDEA or gradle, there's nothing to a

[GitHub] [kafka] ijuma merged pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma merged pull request #9065: URL: https://github.com/apache/kafka/pull/9065 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] ijuma commented on pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma commented on pull request #9065: URL: https://github.com/apache/kafka/pull/9065#issuecomment-663687037 One build passed, one failed due to environmental reasons, one had a single flaky failure: `org.apache.kafka.connect.mirror.MirrorConnectorsIntegrationTest.testOneWayReplicat

[jira] [Commented] (KAFKA-10260) Streams could recover stores in a task independently

2020-07-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164585#comment-17164585 ] Matthias J. Sax commented on KAFKA-10260: - Note: this issue applies for global t

[GitHub] [kafka] ableegoldman commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-24 Thread GitBox
ableegoldman commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460214147 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StandbyTask.java ## @@ -93,8 +93,8 @@ public boolean isActive() {

[GitHub] [kafka] ableegoldman commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-24 Thread GitBox
ableegoldman commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460212719 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractTask.java ## @@ -49,6 +61,31 @@ this.stateDirectory

[GitHub] [kafka] ableegoldman commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-24 Thread GitBox
ableegoldman commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460212084 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/ProcessorStateManager.java ## @@ -454,6 +456,41 @@ public void flush(

[GitHub] [kafka] ableegoldman commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-24 Thread GitBox
ableegoldman commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460211291 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateManagerUtil.java ## @@ -38,13 +41,39 @@ */ final class StateM

[GitHub] [kafka] heritamas commented on a change in pull request #8730: KAFKA-10048: Possible data gap for a consumer after a failover when u…

2020-07-24 Thread GitBox
heritamas commented on a change in pull request #8730: URL: https://github.com/apache/kafka/pull/8730#discussion_r460197007 ## File path: connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorCheckpointTask.java ## @@ -132,7 +132,7 @@ public String version() {

[GitHub] [kafka] abbccdda commented on pull request #9073: MINOR: add task ':streams:testAll'

2020-07-24 Thread GitBox
abbccdda commented on pull request #9073: URL: https://github.com/apache/kafka/pull/9073#issuecomment-663652859 One more thought, it might be useful to add this to the repo `README` if a user is only doing stream side changes and want to test it out on local @vvcephei. --

[GitHub] [kafka] ableegoldman commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-24 Thread GitBox
ableegoldman commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460194062 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -243,18 +242,24 @@ public void handleAssignmen

[jira] [Commented] (KAFKA-8359) Reconsider default for leader imbalance percentage

2020-07-24 Thread Romain Hardouin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164538#comment-17164538 ] Romain Hardouin commented on KAFKA-8359: {quote}[...] there is no major downside 

[jira] [Created] (KAFKA-10306) GlobalThread might loop forever

2020-07-24 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-10306: --- Summary: GlobalThread might loop forever Key: KAFKA-10306 URL: https://issues.apache.org/jira/browse/KAFKA-10306 Project: Kafka Issue Type: Bug

[jira] [Assigned] (KAFKA-10306) GlobalThread might loop forever

2020-07-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-10306: --- Assignee: Matthias J. Sax > GlobalThread might loop forever > -

[GitHub] [kafka] vvcephei opened a new pull request #9073: MINOR: add task ':streams:testAll'

2020-07-24 Thread GitBox
vvcephei opened a new pull request #9073: URL: https://github.com/apache/kafka/pull/9073 Adds a new task to Streams to run all the tests for all sub-projects. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverag

[jira] [Commented] (KAFKA-10284) Group membership update due to static member rejoin should be persisted

2020-07-24 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164531#comment-17164531 ] Sophie Blee-Goldman commented on KAFKA-10284: - Nope, it just spun in a loop

[GitHub] [kafka] vvcephei commented on pull request #9067: MINOR: Streams integration tests should not call exit

2020-07-24 Thread GitBox
vvcephei commented on pull request #9067: URL: https://github.com/apache/kafka/pull/9067#issuecomment-663631102 Hey @mjsax , Since Streams accounted for almost all of the `System.exit` calls, and since `Exit.exit` is available almost everywhere in AK, I'm proposing to add a checksty

[GitHub] [kafka] chia7712 commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-24 Thread GitBox
chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-663618045 @junrao thanks for the reports. Unfortunately, the failed tests are totally different in both results :( This PR has been rebased so the fix for ```group_mode_transac

[GitHub] [kafka] vvcephei commented on pull request #9067: MINOR: Streams integration tests should not call exit

2020-07-24 Thread GitBox
vvcephei commented on pull request #9067: URL: https://github.com/apache/kafka/pull/9067#issuecomment-663599523 Hey @mjsax , I double-checked, and it does seem to be the right fix. I confirmed that no matter whether you run the test with IDEA or gradle, there's nothing to automatica

[GitHub] [kafka] junrao commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-07-24 Thread GitBox
junrao commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-663597341 3 system test failures with trunk. http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2020-07-23--001.1595551051--apache--trunk--0b181fdde/report.html -

[GitHub] [kafka] vvcephei commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
vvcephei commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663587337 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] vvcephei commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
vvcephei commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663587201 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] ijuma commented on pull request #9051: KAFKA-10268: dynamic config like "--delete-config log.retention.ms" doesn't work

2020-07-24 Thread GitBox
ijuma commented on pull request #9051: URL: https://github.com/apache/kafka/pull/9051#issuecomment-663547862 @huxihx Note that we usually include the reviewer(s) in the commit message. For example: https://github.com/apache/kafka/commit/0d5c967073e78e2a50ffa5bb860bff9ff43086d5 ---

[GitHub] [kafka] dajac commented on a change in pull request #9060: KAFKA-9274: Remove `retries` from InternalTopicManager

2020-07-24 Thread GitBox
dajac commented on a change in pull request #9060: URL: https://github.com/apache/kafka/pull/9060#discussion_r460053049 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopicManager.java ## @@ -96,13 +104,15 @@ public InternalTopicManage

[GitHub] [kafka] ijuma edited a comment on pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma edited a comment on pull request #9065: URL: https://github.com/apache/kafka/pull/9065#issuecomment-663537509 Looks like the last message somehow made the Jenkins status to be updated in the PR again. This is an automa

[GitHub] [kafka] ijuma commented on pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma commented on pull request #9065: URL: https://github.com/apache/kafka/pull/9065#issuecomment-663537509 Looks like the last message somehow made Jenkins start working again. This is an automated message from the Apache G

[GitHub] [kafka] ijuma commented on pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma commented on pull request #9065: URL: https://github.com/apache/kafka/pull/9065#issuecomment-663537187 One PR build was started here: https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/3515/ This is an automat

[GitHub] [kafka] ijuma commented on pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma commented on pull request #9065: URL: https://github.com/apache/kafka/pull/9065#issuecomment-663534611 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [kafka] ijuma commented on pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma commented on pull request #9065: URL: https://github.com/apache/kafka/pull/9065#issuecomment-663534471 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [kafka] ijuma commented on pull request #9065: KAFKA-10301: Do not clear Partition#remoteReplicasMap during partition assignment updates

2020-07-24 Thread GitBox
ijuma commented on pull request #9065: URL: https://github.com/apache/kafka/pull/9065#issuecomment-663532890 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [kafka] cadonna edited a comment on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
cadonna edited a comment on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663513384 @ableegoldman I agree that having the extra protection you propose makes sense. I will open a follow-up PR on trunk. --

[GitHub] [kafka] cadonna commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
cadonna commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663513384 @ableegoldman I agree that having the extra protection you propose makes sense. I will open a follow-up PR. This

[GitHub] [kafka] cadonna commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
cadonna commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663512974 @ableegoldman I agree it should be a blocker. This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] cadonna commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
cadonna commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663512735 @mjsax I thought this fix is most urgently needed on 2.6 to unblock the release. I will open a new PR for trunk.

[GitHub] [kafka] cadonna commented on pull request #9066: KAFKA-10287: Skip unknown offsets when computing sum of changelog offsets

2020-07-24 Thread GitBox
cadonna commented on pull request #9066: URL: https://github.com/apache/kafka/pull/9066#issuecomment-663512173 I started a run of Streams system tests: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4077/ ---

[jira] [Commented] (KAFKA-9924) Add RocksDB Memory Consumption to RocksDB Metrics

2020-07-24 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164402#comment-17164402 ] Bruno Cadonna commented on KAFKA-9924: -- The scope of this ticket was extended to not

[jira] [Commented] (KAFKA-6764) ConsoleConsumer behavior inconsistent when specifying --partition with --from-beginning

2020-07-24 Thread Pardhu Madipalli (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164370#comment-17164370 ] Pardhu Madipalli commented on KAFKA-6764: - I am observing this behavior with kafk

[GitHub] [kafka] dajac opened a new pull request #9072: KAFKA-10162; Make the rate based quota behave more like a Token Bucket (KIP-599, Part III)

2020-07-24 Thread GitBox
dajac opened a new pull request #9072: URL: https://github.com/apache/kafka/pull/9072 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade notes

  1   2   >