[jira] [Commented] (KAFKA-9543) Consumer offset reset after new segment rolling

2020-08-14 Thread Andrey Klochkov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178099#comment-17178099 ] Andrey Klochkov commented on KAFKA-9543: This issue is marked as fixed in 2.4.2 a

[GitHub] [kafka] ijuma commented on pull request #9180: MINOR: corrected unit tests

2020-08-14 Thread GitBox
ijuma commented on pull request #9180: URL: https://github.com/apache/kafka/pull/9180#issuecomment-674304221 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[jira] [Commented] (KAFKA-9263) Reocurrence: Transient failure in kafka.api.PlaintextAdminIntegrationTest.testLogStartOffsetCheckpoint and kafka.api.PlaintextAdminIntegrationTest.testAlterReplicaLogDi

2020-08-14 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178021#comment-17178021 ] Bill Bejeck commented on KAFKA-9263:   Test failure  [https://builds.apache.org/job/

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-14 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-674229113 Java 8 passed Java 14 failed with `org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState` Java 11 failed with `kafka.api.PlaintextAdmi

[jira] [Created] (KAFKA-10405) Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState

2020-08-14 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-10405: --- Summary: Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState Key: KAFKA-10405 URL: https://issues.apache.org/jira/browse/KAFKA-10

[jira] [Commented] (KAFKA-10158) Fix flaky kafka.admin.TopicCommandWithAdminClientTest#testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177995#comment-17177995 ] Rajini Sivaram commented on KAFKA-10158: [~bbyrne] We can close this now, right?

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177994#comment-17177994 ] Vagesh Mathapati commented on KAFKA-10396: -- In my microservice i am using globa

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177982#comment-17177982 ] Vagesh Mathapati commented on KAFKA-10396: -- [~desai.p.rohan] Thanks a lot . Loo

[GitHub] [kafka] rajinisivaram opened a new pull request #9184: KAFKA-8033; Wait for NoOffsetForPartitionException in testFetchInvalidOffset

2020-08-14 Thread GitBox
rajinisivaram opened a new pull request #9184: URL: https://github.com/apache/kafka/pull/9184 We wait only 50ms in consumer.poll() and expect NoOffsetForPartitionException, but the exception is thrown only when initializing partition offsets after coordinator is known. Increased poll time

[jira] [Updated] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vagesh Mathapati updated KAFKA-10396: - Attachment: CustomRocksDBConfig.java > Overall memory of container keep on growing due t

[jira] [Commented] (KAFKA-5896) Kafka Connect task threads never interrupted

2020-08-14 Thread Ewen Cheslack-Postava (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177973#comment-17177973 ] Ewen Cheslack-Postava commented on KAFKA-5896: -- [~yazgoo] It looks like this

[jira] [Assigned] (KAFKA-8033) Flaky Test PlaintextConsumerTest#testFetchInvalidOffset

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reassigned KAFKA-8033: - Assignee: Rajini Sivaram > Flaky Test PlaintextConsumerTest#testFetchInvalidOffset > ---

[GitHub] [kafka] ijuma commented on pull request #9067: MINOR: Streams integration tests should not call exit

2020-08-14 Thread GitBox
ijuma commented on pull request #9067: URL: https://github.com/apache/kafka/pull/9067#issuecomment-674193106 @mjsax did you run checkstyle and spotBugs before pushing the 2.6 change? It seems like it broke the build: https://ci-builds.apache.org/job/Kafka/job/kafka-2.6-jdk8/3/console

[GitHub] [kafka] rajinisivaram opened a new pull request #9183: KAFKA-10404; Use higher poll timeout to avoid rebalance in testCoordinatorFailover

2020-08-14 Thread GitBox
rajinisivaram opened a new pull request #9183: URL: https://github.com/apache/kafka/pull/9183 Tests use 6s poll timeout, which isn't sufficient to ensure that clients don't leave the group due to poll timeout. The PR increases poll timeout to 15s. Session timeout of 5s is also low, but lea

[jira] [Assigned] (KAFKA-10404) Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFailover

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reassigned KAFKA-10404: -- Assignee: Rajini Sivaram > Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFa

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-14 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-674162578 Java 8 failed on an unrelated test `kafka.api.SaslSslConsumerTest.testCoordinatorFailover` created a Jira ticket. retest this please --

[jira] [Created] (KAFKA-10404) Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFailover

2020-08-14 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-10404: --- Summary: Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFailover Key: KAFKA-10404 URL: https://issues.apache.org/jira/browse/KAFKA-10404 Project: Kafka

[GitHub] [kafka] ijuma commented on pull request #9182: KAFKA-10403 Replace scala collection by java collection in generating…

2020-08-14 Thread GitBox
ijuma commented on pull request #9182: URL: https://github.com/apache/kafka/pull/9182#issuecomment-674160788 Can you please include more detail on how it fails currently? I assume it's some kind of deserialization error? Thi

[GitHub] [kafka] chia7712 opened a new pull request #9182: KAFKA-10403 Replace scala collection by java collection in generating…

2020-08-14 Thread GitBox
chia7712 opened a new pull request #9182: URL: https://github.com/apache/kafka/pull/9182 issue: https://issues.apache.org/jira/browse/KAFKA-10403 It seems to me the metrics is a "kind" of public interface so users should be able to access metrics of kafka server without scala library

[jira] [Created] (KAFKA-10403) Replace scala collection by java collection in generating MBeans attributes

2020-08-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-10403: -- Summary: Replace scala collection by java collection in generating MBeans attributes Key: KAFKA-10403 URL: https://issues.apache.org/jira/browse/KAFKA-10403 Proje

[jira] [Comment Edited] (KAFKA-5896) Kafka Connect task threads never interrupted

2020-08-14 Thread yazgoo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177821#comment-17177821 ] yazgoo edited comment on KAFKA-5896 at 8/14/20, 3:11 PM: - I still

[jira] [Commented] (KAFKA-5896) Kafka Connect task threads never interrupted

2020-08-14 Thread yazgoo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177821#comment-17177821 ] yazgoo commented on KAFKA-5896: --- I still encountered this exception in CP 2.5, shouldn't th

[GitHub] [kafka] rajinisivaram opened a new pull request #9181: KAFKA-9516; Increase timeout in testNonBlockingProducer to make it more reliable

2020-08-14 Thread GitBox
rajinisivaram opened a new pull request #9181: URL: https://github.com/apache/kafka/pull/9181 The test has been timing out occasionally and it is on the first send on a producer, so increasing timeout to 30s similar to some of the other timeouts in BaseProducerSendTest. ### Committe

[jira] [Assigned] (KAFKA-9516) Flaky Test PlaintextProducerSendTest#testNonBlockingProducer

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reassigned KAFKA-9516: - Assignee: Rajini Sivaram > Flaky Test PlaintextProducerSendTest#testNonBlockingProducer

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-14 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470678123 ## File path: core/src/main/scala/kafka/cluster/Partition.scala ## @@ -255,6 +255,10 @@ class Partition(val topicPartition: TopicPartition, def isAdding

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-14 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470675300 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-14 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470673412 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[jira] [Created] (KAFKA-10402) Upgrade python version in system tests

2020-08-14 Thread Nikolay Izhikov (Jira)
Nikolay Izhikov created KAFKA-10402: --- Summary: Upgrade python version in system tests Key: KAFKA-10402 URL: https://issues.apache.org/jira/browse/KAFKA-10402 Project: Kafka Issue Type: Impr

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-14 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-674091814 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] sanketfajage opened a new pull request #9180: MINOR: corrected unit tests

2020-08-14 Thread GitBox
sanketfajage opened a new pull request #9180: URL: https://github.com/apache/kafka/pull/9180 Corrected unit tests. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] jeqo commented on a change in pull request #9137: KAFKA-9929: Support reverse iterator on KeyValueStore

2020-08-14 Thread GitBox
jeqo commented on a change in pull request #9137: URL: https://github.com/apache/kafka/pull/9137#discussion_r470536034 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/AbstractKeyValueStoreTest.java ## @@ -188,7 +188,55 @@ public void testPutGetRang

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177610#comment-17177610 ] Rohan Desai commented on KAFKA-10396: - In addition to configuring the write buffer m

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177579#comment-17177579 ] Vagesh Mathapati commented on KAFKA-10396: -- I can see below output for pmap -X

[GitHub] [kafka] chia7712 commented on pull request #9162: MINOR: refactor Log to get rid of "return" in nested anonymous function

2020-08-14 Thread GitBox
chia7712 commented on pull request #9162: URL: https://github.com/apache/kafka/pull/9162#issuecomment-673942147 only ```shouldUpgradeFromEosAlphaToEosBeta``` fails. retest this please This is an automated message from the Apa

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177577#comment-17177577 ] Rohan Desai commented on KAFKA-10396: - It may also be a different problem. Something

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177574#comment-17177574 ] Rohan Desai commented on KAFKA-10396: - [~vmathapati] it should show up on your pmap.

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177573#comment-17177573 ] Vagesh Mathapati commented on KAFKA-10396: -- Is there anything which i can check

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177566#comment-17177566 ] Vagesh Mathapati commented on KAFKA-10396: -- i tried with  [https://centos.pkgs.

[jira] [Commented] (KAFKA-6585) Consolidate duplicated logic on reset tools

2020-08-14 Thread Francesco Nobilia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177563#comment-17177563 ] Francesco Nobilia commented on KAFKA-6585: -- [~Samuel Hawker] are you still worki

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek updated KAFKA-10401: -- Description: While reading group metadata information from ByteBuffer GroupMetadataManager reads current_stat

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek updated KAFKA-10401: -- Description: While reading group metadata information from ByteBuffer GroupMetadataManager reads current_stat

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek updated KAFKA-10401: -- Description: While reading group metadata information from ByteBuffer GroupMetadataManager reads current_stat

[jira] [Created] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
Marek created KAFKA-10401: - Summary: GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3 Key: KAFKA-10401 URL: https://issues.apache.org/jira/browse/KAFKA-10401 Proje