[jira] [Commented] (KAFKA-10101) recovery point is advanced without flushing the data after recovery

2020-06-04 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126023#comment-17126023 ] Jun Rao commented on KAFKA-10101: - [~ijuma] : Could you double check if this is an issue

[jira] [Commented] (KAFKA-10101) recovery point is advanced without flushing the data after recovery

2020-06-04 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126036#comment-17126036 ] Jun Rao commented on KAFKA-10101: - If this is an issue, one way to fix that is to simply

[jira] [Resolved] (KAFKA-10106) log time taken to handle LeaderAndIsr request

2020-06-08 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-10106. - Fix Version/s: 2.7.0 Assignee: NIKHIL Resolution: Fixed Merged the PR to trunk. > log t

[jira] [Resolved] (KAFKA-10027) Implement read path for feature versioning scheme

2020-06-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-10027. - Fix Version/s: 2.7.0 Assignee: Kowshik Prakasam Resolution: Fixed merged the PR to trunk

[jira] [Resolved] (KAFKA-12552) Extract segments map out of Log class into separate class

2021-03-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12552. - Fix Version/s: 3.0.0 Resolution: Fixed Merged the PR to trunk. > Extract segments map out of Log

[jira] [Resolved] (KAFKA-12571) Eliminate LeaderEpochFileCache constructor dependency on LogEndOffset

2021-03-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12571. - Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > Eliminate LeaderEpochFileCache c

[jira] [Resolved] (KAFKA-12575) Eliminate Log.isLogDirOffline boolean attribute

2021-03-31 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12575. - Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > Eliminate Log.isLogDirOffline bo

[jira] [Resolved] (KAFKA-3968) fsync() is not called on parent directory when new FileMessageSet is flushed to disk

2021-04-02 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3968. Fix Version/s: 3.0.0 Assignee: Cong Ding Resolution: Fixed Merged to trunk. Thanks Cong for

[jira] [Resolved] (KAFKA-12368) Inmemory implementation of RSM and RLMM.

2021-04-13 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12368. - Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > Inmemory implementation of RSM a

[jira] [Resolved] (KAFKA-12553) Refactor Log layer recovery logic

2021-04-20 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12553. - Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > Refactor Log layer recovery logi

[jira] [Resolved] (KAFKA-12429) Serdes for all message types in internal topic which is used in default implementation for RLMM.

2021-05-05 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12429. - Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > Serdes for all message types in

[jira] [Commented] (KAFKA-12757) Move server related common and public classes into separate module(s).

2021-05-10 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342023#comment-17342023 ] Jun Rao commented on KAFKA-12757: - [~satish.duggana]: The implementation of server side

[jira] [Resolved] (KAFKA-12758) Create a new `server-common` module and move ApiMessageAndVersion, RecordSerde, AbstractApiMessageSerde, and BytesApiMessageSerde to that module.

2021-05-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12758. - Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > Create a new `server-common` mod

[jira] [Commented] (KAFKA-9826) Log cleaning repeatedly picks same segment with no effect when first dirty offset is past start of active segment

2021-05-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342904#comment-17342904 ] Jun Rao commented on KAFKA-9826: [~zhangzs] : The issue was fixed in 2.4.2. Could you try

[jira] [Commented] (KAFKA-3968) fsync() is not called on parent directory when new FileMessageSet is flushed to disk

2021-05-14 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344701#comment-17344701 ] Jun Rao commented on KAFKA-3968: Merged the reworked PR [https://github.com/apache/kafka/

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

2021-05-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350551#comment-17350551 ] Jun Rao commented on KAFKA-8522: latest PR link > Tombstones can survive forever > -

[jira] [Commented] (KAFKA-10734) Speedup the processing of LeaderAndIsr request

2020-11-18 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234891#comment-17234891 ] Jun Rao commented on KAFKA-10734: - [~luwang], thanks for the jira. In practice, if n is

[jira] [Resolved] (KAFKA-10723) LogManager leaks internal thread pool activity during shutdown

2020-11-19 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-10723. - Fix Version/s: 2.8.0 Resolution: Fixed merged to trunk > LogManager leaks internal thread pool a

[jira] [Resolved] (KAFKA-10832) Recovery logic is using incorrect ProducerStateManager instance when updating producers

2020-12-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-10832. - Fix Version/s: 2.8.0 Resolution: Fixed Merged the PR to trunk. > Recovery logic is using incorre

[jira] [Commented] (KAFKA-10760) In compacted topic with max.compaction.lag.ms, the segments are not rolled until new messages arrive

2020-12-14 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249409#comment-17249409 ] Jun Rao commented on KAFKA-10760: - [~kbrajesh176]: For max.compaction.lag.ms, we simply

[jira] [Updated] (KAFKA-9393) DeleteRecords may cause extreme lock contention for large partition directories

2020-12-15 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-9393: --- Fix Version/s: (was: 2.7.0) 2.8.0 > DeleteRecords may cause extreme lock contention fo

[jira] [Commented] (KAFKA-9087) ReplicaAlterLogDirs stuck and restart fails with java.lang.IllegalStateException: Offset mismatch for the future replica

2020-12-15 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249973#comment-17249973 ] Jun Rao commented on KAFKA-9087: Not sure if this is exactly the reason, but we did fix a

[jira] [Commented] (KAFKA-10759) ARM support for Kafka

2020-12-16 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250438#comment-17250438 ] Jun Rao commented on KAFKA-10759: - [~xiaopenglei]: Thanks for the jira. Perhaps we can f

[jira] [Commented] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-16 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250568#comment-17250568 ] Jun Rao commented on KAFKA-10853: - [~ambroff] : Thanks for reporting this. I agree that

[jira] [Commented] (KAFKA-10888) Sticky partition leads to uneven product msg, resulting in abnormal delays in some partations

2020-12-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254596#comment-17254596 ] Jun Rao commented on KAFKA-10888: - [~jr981008]: Thanks for reporting this. There are a c

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2021-01-05 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259314#comment-17259314 ] Jun Rao commented on KAFKA-2729: If you still see this issue, it would be useful to confi

[jira] [Created] (KAFKA-12153) follower can hit OffsetOutOfRangeException during truncation

2021-01-06 Thread Jun Rao (Jira)
Jun Rao created KAFKA-12153: --- Summary: follower can hit OffsetOutOfRangeException during truncation Key: KAFKA-12153 URL: https://issues.apache.org/jira/browse/KAFKA-12153 Project: Kafka Issue Typ

[jira] [Commented] (KAFKA-10759) ARM support for Kafka

2021-01-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262814#comment-17262814 ] Jun Rao commented on KAFKA-10759: - [~xiaopenglei] : Thanks for your help. Perhaps you co

[jira] [Commented] (KAFKA-12176) Consider changing default log.message.timestamp.difference.max.ms

2021-01-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263020#comment-17263020 ] Jun Rao commented on KAFKA-12176: - Another complication in the previous discussion was w

[jira] [Assigned] (KAFKA-8018) Flaky Test SaslSslAdminClientIntegrationTest#testLegacyAclOpsNeverAffectOrReturnPrefixed

2019-03-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-8018: -- Assignee: Jun Rao > Flaky Test > SaslSslAdminClientIntegrationTest#testLegacyAclOpsNeverAffectOrRetur

[jira] [Commented] (KAFKA-8018) Flaky Test SaslSslAdminClientIntegrationTest#testLegacyAclOpsNeverAffectOrReturnPrefixed

2019-03-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782210#comment-16782210 ] Jun Rao commented on KAFKA-8018: Created a PR: https://github.com/apache/kafka/pull/6354

[jira] [Commented] (KAFKA-7977) Flaky Test ReassignPartitionsClusterTest#shouldOnlyThrottleMovingReplicas

2019-03-01 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782211#comment-16782211 ] Jun Rao commented on KAFKA-7977: The PR in https://issues.apache.org/jira/browse/KAFKA-80

[jira] [Assigned] (KAFKA-8022) Flaky Test RequestQuotaTest#testExemptRequestTime

2019-03-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-8022: -- Assignee: Jun Rao > Flaky Test RequestQuotaTest#testExemptRequestTime > --

[jira] [Commented] (KAFKA-8022) Flaky Test RequestQuotaTest#testExemptRequestTime

2019-03-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783838#comment-16783838 ] Jun Rao commented on KAFKA-8022: The fsync to ZK txn log can take 10+ secs. Filed [https

[jira] [Resolved] (KAFKA-8022) Flaky Test RequestQuotaTest#testExemptRequestTime

2019-03-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-8022. Resolution: Fixed Fix Version/s: (was: 0.11.0.4) 2.2.1 2.3.

[jira] [Resolved] (KAFKA-7977) Flaky Test ReassignPartitionsClusterTest#shouldOnlyThrottleMovingReplicas

2019-03-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-7977. Resolution: Fixed The PR in KAFKA-8018 is merged, which should reduce the chance for ZK session expiration

[jira] [Commented] (KAFKA-6029) Controller should wait for the leader migration to finish before ack a ControlledShutdownRequest

2019-03-13 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791910#comment-16791910 ] Jun Rao commented on KAFKA-6029: [~hzxa21], do you still plan to work on this? Thanks. >

[jira] [Commented] (KAFKA-7504) Broker performance degradation caused by call of sendfile reading disk in network thread

2019-03-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795523#comment-16795523 ] Jun Rao commented on KAFKA-7504: [~cwaldrop], thanks for helping test this out. It would

[jira] [Commented] (KAFKA-7504) Broker performance degradation caused by call of sendfile reading disk in network thread

2019-03-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802074#comment-16802074 ] Jun Rao commented on KAFKA-7504: [~cwaldrop], thanks for the results. It does seem to be

[jira] [Commented] (KAFKA-8106) Remove unnecessary decompression operation when logValidator do validation.

2019-03-29 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805539#comment-16805539 ] Jun Rao commented on KAFKA-8106: [~Flower.min], one of the validation that the broker has

[jira] [Commented] (KAFKA-7983) supporting replication.throttled.replicas in dynamic broker configuration

2019-04-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16810370#comment-16810370 ] Jun Rao commented on KAFKA-7983: [~huxi_2b], leader.replication.throttled.replicas and  f

[jira] [Commented] (KAFKA-7983) supporting replication.throttled.replicas in dynamic broker configuration

2019-04-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16811005#comment-16811005 ] Jun Rao commented on KAFKA-7983: Probably. But I think the common broker level setting wi

[jira] [Assigned] (KAFKA-7983) supporting replication.throttled.replicas in dynamic broker configuration

2019-04-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-7983: -- Assignee: Rahul Agarwal > supporting replication.throttled.replicas in dynamic broker configuration >

[jira] [Commented] (KAFKA-7983) supporting replication.throttled.replicas in dynamic broker configuration

2019-04-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812556#comment-16812556 ] Jun Rao commented on KAFKA-7983: [~rahul.mnit], just added you to the contributor list an

[jira] [Commented] (KAFKA-7504) Broker performance degradation caused by call of sendfile reading disk in network thread

2019-06-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856233#comment-16856233 ] Jun Rao commented on KAFKA-7504: [~allenxwang], there is a PR attached to the jira. I gue

[jira] [Commented] (KAFKA-7504) Broker performance degradation caused by call of sendfile reading disk in network thread

2019-06-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859031#comment-16859031 ] Jun Rao commented on KAFKA-7504: [~allenxwang], thanks for doing the test and sharing the

[jira] [Commented] (KAFKA-7504) Broker performance degradation caused by call of sendfile reading disk in network thread

2019-06-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862569#comment-16862569 ] Jun Rao commented on KAFKA-7504: [~allenxwang], thanks for the update. A couple of more t

[jira] [Commented] (KAFKA-8532) controller-event-thread deadlock with zk-session-expiry-handler0

2019-06-13 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863468#comment-16863468 ] Jun Rao commented on KAFKA-8532: [~lbdai3190], thanks for reporting the issue. From the s

[jira] [Commented] (KAFKA-8532) controller-event-thread deadlock with zk-session-expiry-handler0

2019-06-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864184#comment-16864184 ] Jun Rao commented on KAFKA-8532: [~lbdai3190], expiryScheduler.shutdown() is probably not

[jira] [Commented] (KAFKA-8532) controller-event-thread deadlock with zk-session-expiry-handler0

2019-06-17 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865744#comment-16865744 ] Jun Rao commented on KAFKA-8532: [~lbdai3190], if this issue happens again, it would be u

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

2019-06-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874578#comment-16874578 ] Jun Rao commented on KAFKA-8522: [~EeveeB], thanks for reporting this. This is related to

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

2019-07-02 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877341#comment-16877341 ] Jun Rao commented on KAFKA-8522: [~dhruvilshah] mentioned that the original timestamp of

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

2019-07-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878247#comment-16878247 ] Jun Rao commented on KAFKA-8522: Since we are returning the tombstone to the consumer, it

[jira] [Commented] (KAFKA-5413) Log cleaner fails due to large offset in segment file

2017-06-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051273#comment-16051273 ] Jun Rao commented on KAFKA-5413: [~Kelvinrutt], yes, getting the last offset from the inde

[jira] [Commented] (KAFKA-5007) Kafka Replica Fetcher Thread- Resource Leak

2017-06-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051289#comment-16051289 ] Jun Rao commented on KAFKA-5007: [~huxi_2b], that's a good thought. If we hit an unhandled

[jira] [Commented] (KAFKA-5431) LogCleaner stopped due to org.apache.kafka.common.errors.CorruptRecordException

2017-06-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054686#comment-16054686 ] Jun Rao commented on KAFKA-5431: [~crietz], in Log.roll(), we call LogSegment.trim() to re

[jira] [Created] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-06-19 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-5473: -- Summary: handle ZK session expiration properly when a new session can't be established Key: KAFKA-5473 URL: https://issues.apache.org/jira/browse/KAFKA-5473 Project: Kafka

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-06-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054757#comment-16054757 ] Jun Rao commented on KAFKA-5473: The simplest solution is to just fail the broker if the n

[jira] [Commented] (KAFKA-2405) KafkaHealthCheck kills the JVM in handleSessionEstablishmentError

2017-06-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054764#comment-16054764 ] Jun Rao commented on KAFKA-2405: Just realized this change. This seems to cause the ZK ses

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-06-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054781#comment-16054781 ] Jun Rao commented on KAFKA-5473: One thing to note is that the construction of the ZooKeep

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-06-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054960#comment-16054960 ] Jun Rao commented on KAFKA-5473: Yes, the issue is there since KAFKA-2405 was committed. S

[jira] [Commented] (KAFKA-1561) Data Loss for Incremented Replica Factor and Leader Election

2017-06-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055846#comment-16055846 ] Jun Rao commented on KAFKA-1561: [~vinayak10], currently, duplicates can be introduced dur

[jira] [Commented] (KAFKA-5480) Partition Leader may not be elected although there is one live replica in ISR

2017-06-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056172#comment-16056172 ] Jun Rao commented on KAFKA-5480: [~pengwei], thanks for reporting this. The issue seems to

[jira] [Assigned] (KAFKA-5413) Log cleaner fails due to large offset in segment file

2017-06-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-5413: -- Assignee: Kelvin Rutt > Log cleaner fails due to large offset in segment file > ---

[jira] [Resolved] (KAFKA-5491) The ProducerPerformance tool should support transactions

2017-06-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5491. Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 3400 [https://github.com/apa

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2017-06-22 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060110#comment-16060110 ] Jun Rao commented on KAFKA-2729: [~timoha], we are trying to address the ZK session expira

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-06-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060973#comment-16060973 ] Jun Rao commented on KAFKA-5473: [~prasincs], yes, the simplest solution is for the broker

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-06-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061578#comment-16061578 ] Jun Rao commented on KAFKA-5473: We could retry up to zk.connection.time.ms and then give

[jira] [Commented] (KAFKA-5413) Log cleaner fails due to large offset in segment file

2017-06-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063228#comment-16063228 ] Jun Rao commented on KAFKA-5413: Merged https://github.com/apache/kafka/pull/3397 to 0.10.

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-06-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063437#comment-16063437 ] Jun Rao commented on KAFKA-5473: [~prasincs], there are a couple cases to consider. (1) Th

[jira] [Commented] (KAFKA-3806) Adjust default values of log.retention.hours and offsets.retention.minutes

2017-06-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063579#comment-16063579 ] Jun Rao commented on KAFKA-3806: [~shangdi], good point on the issue with mirrormaker. I h

[jira] [Commented] (KAFKA-5542) Improve Java doc for LeaderEpochFileCache.endOffsetFor()

2017-06-29 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069126#comment-16069126 ] Jun Rao commented on KAFKA-5542: We can clarify the following. "During the upgrade phase

[jira] [Resolved] (KAFKA-5542) Improve Java doc for LeaderEpochFileCache.endOffsetFor()

2017-06-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5542. Resolution: Fixed Fix Version/s: 0.11.1.0 Issue resolved by pull request 3468 [https://github.com/apa

[jira] [Commented] (KAFKA-1120) Controller could miss a broker state change

2017-07-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16078619#comment-16078619 ] Jun Rao commented on KAFKA-1120: [~wushujames], it seems that problem that you reproduced

[jira] [Resolved] (KAFKA-5431) LogCleaner stopped due to org.apache.kafka.common.errors.CorruptRecordException

2017-07-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5431. Resolution: Fixed Fix Version/s: 0.11.1.0 Issue resolved by pull request 3525 [https://github.com/apa

[jira] [Resolved] (KAFKA-5501) use async zookeeper apis everywhere

2017-07-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5501. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3427 [https://github.com/apache

[jira] [Created] (KAFKA-5706) log the name of the error instead of the error code in response objects

2017-08-04 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-5706: -- Summary: log the name of the error instead of the error code in response objects Key: KAFKA-5706 URL: https://issues.apache.org/jira/browse/KAFKA-5706 Project: Kafka Is

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125827#comment-16125827 ] Jun Rao commented on KAFKA-5473: [~braedon], yes, this is the same issue as described in K

[jira] [Resolved] (KAFKA-3984) Broker doesn't retry reconnecting to an expired Zookeeper connection

2017-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3984. Resolution: Duplicate Marking this as duplicate. The fix will be done in KAFKA-5473. > Broker doesn't retry

[jira] [Created] (KAFKA-5745) Partition.makeLeader() should convert HW to OffsetMetadata before becoming the leader

2017-08-16 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-5745: -- Summary: Partition.makeLeader() should convert HW to OffsetMetadata before becoming the leader Key: KAFKA-5745 URL: https://issues.apache.org/jira/browse/KAFKA-5745 Project: Kafk

[jira] [Commented] (KAFKA-5745) Partition.makeLeader() should convert HW to OffsetMetadata before becoming the leader

2017-08-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129725#comment-16129725 ] Jun Rao commented on KAFKA-5745: The HW in the follower only includes the offset, but not

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

2017-08-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140278#comment-16140278 ] Jun Rao commented on KAFKA-5781: It would also be useful to know the producer latency brea

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

2017-08-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140402#comment-16140402 ] Jun Rao commented on KAFKA-5781: The metrics are described in http://kafka.apache.org/docu

[jira] [Commented] (KAFKA-1120) Controller could miss a broker state change

2017-08-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16142338#comment-16142338 ] Jun Rao commented on KAFKA-1120: [~wushujames], just increasing controlled.shutdown.retry.

[jira] [Commented] (KAFKA-1120) Controller could miss a broker state change

2017-08-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16142400#comment-16142400 ] Jun Rao commented on KAFKA-1120: Yes, that's the right metric. The only down side of incre

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2017-09-06 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156120#comment-16156120 ] Jun Rao commented on KAFKA-2729: [~davispw], the issue due to ZK session expiration will b

[jira] [Commented] (KAFKA-3039) Temporary loss of leader resulted in log being completely truncated

2017-09-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157087#comment-16157087 ] Jun Rao commented on KAFKA-3039: Hmm, interesting. Not sure why this is happening. Current

[jira] [Created] (KAFKA-5858) consumer.poll() shouldn't throw exception due to deserialization error

2017-09-07 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-5858: -- Summary: consumer.poll() shouldn't throw exception due to deserialization error Key: KAFKA-5858 URL: https://issues.apache.org/jira/browse/KAFKA-5858 Project: Kafka Iss

[jira] [Commented] (KAFKA-5858) consumer.poll() shouldn't throw exception due to deserialization error

2017-09-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157902#comment-16157902 ] Jun Rao commented on KAFKA-5858: [~hachikuji], any caveats for doing this? > consumer.pol

[jira] [Created] (KAFKA-5871) bound the throttle time in byte rate quota

2017-09-11 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-5871: -- Summary: bound the throttle time in byte rate quota Key: KAFKA-5871 URL: https://issues.apache.org/jira/browse/KAFKA-5871 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-5758) Reassigning a topic's partitions can adversely impact other topics

2017-09-29 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186792#comment-16186792 ] Jun Rao commented on KAFKA-5758: [~dwvangeest], the problem you described could happen tra

[jira] [Commented] (KAFKA-5758) Reassigning a topic's partitions can adversely impact other topics

2017-10-02 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16188465#comment-16188465 ] Jun Rao commented on KAFKA-5758: [~dwvangeest], thanks for the info. I agree that it's bet

[jira] [Resolved] (KAFKA-5995) Rename AlterReplicaDir to AlterReplicaDirs

2017-10-02 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5995. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3993 [https://github.com/apache

[jira] [Commented] (KAFKA-5758) Reassigning a topic's partitions can adversely impact other topics

2017-10-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190609#comment-16190609 ] Jun Rao commented on KAFKA-5758: [~dwvangeest], thanks for the info. > Reassigning a topi

[jira] [Resolved] (KAFKA-5767) Kafka server should halt if IBP < 1.0.0 and there is log directory failure

2017-10-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5767. Resolution: Fixed Issue resolved by pull request 3718 [https://github.com/apache/kafka/pull/3718] > Kafka s

[jira] [Commented] (KAFKA-5473) handle ZK session expiration properly when a new session can't be established

2017-10-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192247#comment-16192247 ] Jun Rao commented on KAFKA-5473: The PR is in https://github.com/apache/kafka/pull/3990. W

[jira] [Commented] (KAFKA-5140) Flaky ResetIntegrationTest

2017-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16198036#comment-16198036 ] Jun Rao commented on KAFKA-5140: Saw the following transient failures in a recent PR build

[jira] [Commented] (KAFKA-6029) Controller should wait for the leader migration to finish before ack a ControlledShutdownRequest

2017-10-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199314#comment-16199314 ] Jun Rao commented on KAFKA-6029: One of the issues that can lead to this is that the follo

[jira] [Commented] (KAFKA-6028) Improve the quota throttle communication.

2017-10-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199316#comment-16199316 ] Jun Rao commented on KAFKA-6028: Another way to address this is what's described in https

[jira] [Commented] (KAFKA-6028) Improve the quota throttle communication.

2017-10-10 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199792#comment-16199792 ] Jun Rao commented on KAFKA-6028: [~becket_qin], the window size is configurable and we can

<    1   2   3   4   5   6   >