[jira] [Assigned] (KAFKA-8412) Still a nullpointer exception thrown on shutdown while flushing before closing producers

[ https://issues.apache.org/jira/browse/KAFKA-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt reassigned KAFKA-8412: Assignee: Chris Pettitt (was: Matthias J. Sax) > Still a nullpointer exception thrown on

[jira] [Commented] (KAFKA-8412) Still a nullpointer exception thrown on shutdown while flushing before closing producers

[ https://issues.apache.org/jira/browse/KAFKA-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899196#comment-16899196 ] Chris Pettitt commented on KAFKA-8412: -- Matthias, Guozhang proposed I pick up this t

[jira] [Commented] (KAFKA-8412) Still a nullpointer exception thrown on shutdown while flushing before closing producers

[ https://issues.apache.org/jira/browse/KAFKA-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905459#comment-16905459 ] Chris Pettitt commented on KAFKA-8412: -- I'm able to repro this and [~mjsax]'s soluti

[jira] [Commented] (KAFKA-8412) Still a nullpointer exception thrown on shutdown while flushing before closing producers

[ https://issues.apache.org/jira/browse/KAFKA-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905598#comment-16905598 ] Chris Pettitt commented on KAFKA-8412: -- Having played with this a bit more I think i

[jira] [Assigned] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt reassigned KAFKA-8755: Assignee: Chris Pettitt > Stand-by Task of an Optimized Source Table Does Not Write Anythi

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909242#comment-16909242 ] Chris Pettitt commented on KAFKA-8755: -- Digging into this a bit. One initial observa

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909249#comment-16909249 ] Chris Pettitt commented on KAFKA-8755: -- Also, I'll fix up the test a bit. It fails i

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909398#comment-16909398 ] Chris Pettitt commented on KAFKA-8755: -- [~guozhang] Finding what looks to be a few o

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909401#comment-16909401 ] Chris Pettitt commented on KAFKA-8755: -- Fixing the above bug, we at least are gettin

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909450#comment-16909450 ] Chris Pettitt commented on KAFKA-8755: -- Wrapping up for today. I suspect this is du

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909457#comment-16909457 ] Chris Pettitt commented on KAFKA-8755: -- One last note: A huge thanks to [~cadonna] w

[jira] [Created] (KAFKA-8816) RecordCollector offsets updated indirectly by StreamTask

Chris Pettitt created KAFKA-8816: Summary: RecordCollector offsets updated indirectly by StreamTask Key: KAFKA-8816 URL: https://issues.apache.org/jira/browse/KAFKA-8816 Project: Kafka Issue

[jira] [Created] (KAFKA-8817) Flaky Test KafkaProducerTest.testCloseIsForcedOnPendingAddOffsetRequest

Chris Pettitt created KAFKA-8817: Summary: Flaky Test KafkaProducerTest.testCloseIsForcedOnPendingAddOffsetRequest Key: KAFKA-8817 URL: https://issues.apache.org/jira/browse/KAFKA-8817 Project: Kafka

[jira] [Updated] (KAFKA-8817) Flaky Test KafkaProducerTest.testCloseIsForcedOnPendingAddOffsetRequest

[ https://issues.apache.org/jira/browse/KAFKA-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-8817: - Description: Error: {code:java} org.junit.runners.model.TestTimedOutException: test timed out aft

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912529#comment-16912529 ] Chris Pettitt commented on KAFKA-8755: -- Quick update (for my own sanity): # Kafka S

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912565#comment-16912565 ] Chris Pettitt commented on KAFKA-8755: -- BUG 3 was caused by a call to `StandbyTask.u

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912566#comment-16912566 ] Chris Pettitt commented on KAFKA-8755: -- I forgot to mention that with BUG 3 fixed th

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912586#comment-16912586 ] Chris Pettitt commented on KAFKA-8755: -- BUG 5 and BUG 4 are related. There is an ass

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912642#comment-16912642 ] Chris Pettitt commented on KAFKA-8755: -- BUG 2: not a bug. It was updating at the com

[jira] [Comment Edited] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912642#comment-16912642 ] Chris Pettitt edited comment on KAFKA-8755 at 8/21/19 8:00 PM:

[jira] [Comment Edited] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912642#comment-16912642 ] Chris Pettitt edited comment on KAFKA-8755 at 8/21/19 8:05 PM:

[jira] [Commented] (KAFKA-8755) Stand-by Task of an Optimized Source Table Does Not Write Anything to its State Store

[ https://issues.apache.org/jira/browse/KAFKA-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912669#comment-16912669 ] Chris Pettitt commented on KAFKA-8755: -- BUG 1 is interesting. The state restorer act

[jira] [Created] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

Chris Pettitt created KAFKA-8831: Summary: Joining a new instance sometimes does not cause rebalancing Key: KAFKA-8831 URL: https://issues.apache.org/jira/browse/KAFKA-8831 Project: Kafka Is

[jira] [Updated] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-8831: - Description: See attached log. The second instance joins a bit after the first instance (~250ms)

[jira] [Updated] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-8831: - Attachment: fail.log > Joining a new instance sometimes does not cause rebalancing >

[jira] [Updated] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-8831: - Description: See attached log. The application is in a REBALANCING state. The second instance jo

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914709#comment-16914709 ] Chris Pettitt commented on KAFKA-8831: -- Thanks Vinoth! > Joining a new instance som

[jira] [Updated] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-8831: - Attachment: fail.log > Joining a new instance sometimes does not cause rebalancing >

[jira] [Updated] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-8831: - Attachment: (was: fail.log) > Joining a new instance sometimes does not cause rebalancing > -

[jira] [Updated] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-8831: - Component/s: streams > Joining a new instance sometimes does not cause rebalancing >

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914740#comment-16914740 ] Chris Pettitt commented on KAFKA-8831: -- [~vinoth]:   Here's Sophie's guess: {code:

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915957#comment-16915957 ] Chris Pettitt commented on KAFKA-8831: -- I'm doing state restore too. I happen to be

[jira] [Created] (KAFKA-8888) Possible to get null IQ value if partition migrates

Chris Pettitt created KAFKA-: Summary: Possible to get null IQ value if partition migrates Key: KAFKA- URL: https://issues.apache.org/jira/browse/KAFKA- Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-8888) Possible to get null IQ value if reading from wrong instance

[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-: - Description: Currently if you try to read a key from the wrong instance (i.e. the partition that

[jira] [Commented] (KAFKA-8888) Possible to get null IQ value if reading from wrong instance

[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926006#comment-16926006 ] Chris Pettitt commented on KAFKA-: -- Changing priority and correcting the descrip

[jira] [Created] (KAFKA-8928) Logged producer config does not always match actual config values

Chris Pettitt created KAFKA-8928: Summary: Logged producer config does not always match actual config values Key: KAFKA-8928 URL: https://issues.apache.org/jira/browse/KAFKA-8928 Project: Kafka

[jira] [Updated] (KAFKA-9061) StreamStreamJoinIntegrationTest flaky test failures

[ https://issues.apache.org/jira/browse/KAFKA-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-9061: - Attachment: stacktraces-3269.txt > StreamStreamJoinIntegrationTest flaky test failures >

[jira] [Created] (KAFKA-9061) StreamStreamJoinIntegrationTest flaky test failures

Chris Pettitt created KAFKA-9061: Summary: StreamStreamJoinIntegrationTest flaky test failures Key: KAFKA-9061 URL: https://issues.apache.org/jira/browse/KAFKA-9061 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-6108) Synchronizing on commits and StandbyTasks can be improved

[ https://issues.apache.org/jira/browse/KAFKA-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954869#comment-16954869 ] Chris Pettitt commented on KAFKA-6108: -- I didn't change anything w.r.t. how polling

[jira] [Commented] (KAFKA-6108) Synchronizing on commits and StandbyTasks can be improved

[ https://issues.apache.org/jira/browse/KAFKA-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956201#comment-16956201 ] Chris Pettitt commented on KAFKA-6108: -- That's right. My change reduced the committe

[jira] [Resolved] (KAFKA-8700) Flaky Test QueryableStateIntegrationTest#queryOnRebalance

[ https://issues.apache.org/jira/browse/KAFKA-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt resolved KAFKA-8700. -- Resolution: Fixed Checked in a fix for this which may reduce flakiness. Also improved instrume

[jira] [Created] (KAFKA-9191) Kafka throughput suffers substantially when scaling topic partitions with small messages

Chris Pettitt created KAFKA-9191: Summary: Kafka throughput suffers substantially when scaling topic partitions with small messages Key: KAFKA-9191 URL: https://issues.apache.org/jira/browse/KAFKA-9191

[jira] [Updated] (KAFKA-9191) Kafka throughput suffers substantially when scaling topic partitions with small messages

[ https://issues.apache.org/jira/browse/KAFKA-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-9191: - Description: We have observed, using two entirely different tools, that a simple Kafka applicati

[jira] [Updated] (KAFKA-9191) Kafka throughput suffers substantially when scaling topic partitions with small messages

[ https://issues.apache.org/jira/browse/KAFKA-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Pettitt updated KAFKA-9191: - Description: We have observed, using two entirely different tools, that a simple Kafka applicati

[jira] [Commented] (KAFKA-9191) Kafka throughput suffers substantially when scaling topic partitions with small messages

[ https://issues.apache.org/jira/browse/KAFKA-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974615#comment-16974615 ] Chris Pettitt commented on KAFKA-9191: -- We have not teased that apart. We do have th