Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #649

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove unnecessary suppress (#10434) -- [...truncated 3.70 MB...] LogValidatorTest >

[jira] [Created] (KAFKA-12587) Remove KafkaPrincipal#fromString

2021-03-30 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-12587: -- Summary: Remove KafkaPrincipal#fromString Key: KAFKA-12587 URL: https://issues.apache.org/jira/browse/KAFKA-12587 Project: Kafka Issue Type: Task

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #86

2021-03-30 Thread Apache Jenkins Server
See Changes: [A. Sophie Blee-Goldman] HOTFIX: move rebalanceInProgress check to skip commit during handleCorrupted (#10444) -- [...truncated 7.26 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #680

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] HOTFIX: move rebalanceInProgress check to skip commit during handleCorrupted (#10444) -- [...truncated 3.69 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #648

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] HOTFIX: move rebalanceInProgress check to skip commit during handleCorrupted (#10444) -- [...truncated 3.69 MB...] KafkaZkClientTest

Re: [DISCUSS] KIP-726: Make the CooperativeStickyAssignor as the default assignor

2021-03-30 Thread Sophie Blee-Goldman
Ok I'm still fleshing out all the details of KAFKA-12477 but I think we can simplify some things a bit, and avoid any kind of "fail-fast" which will require user intervention. In fact I think we can avoid requiring the user to make any changes at all for KIP-726, so we don't have to worry about

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #109

2021-03-30 Thread Apache Jenkins Server
See Changes: -- [...truncated 3.18 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldThrowIfPersistentBuiltInStoreIsAccessedWithUntypedMethod[Eos enabled =

Re: Re: [DISCUSS] KIP-706: Add method "Producer#produce" to return CompletionStage instead of Future

2021-03-30 Thread Chia-Ping Tsai
hi, I have updated KIP according to my latest response. I will start vote thread next week if there is no more comments :) Best Regards, Chia-Ping On 2021/01/31 05:39:17, Chia-Ping Tsai wrote: > It seems to me changing the input type might make complicate the migration > from deprecated

Re: [VOTE] KIP-707: The future of KafkaFuture

2021-03-30 Thread Chia-Ping Tsai
Thanks for this KIP. +1 (binding) On 2021/03/29 15:34:55, Tom Bentley wrote: > Hi, > > I'd like to start a vote on KIP-707, which proposes to add > KafkaFuture.toCompletionStage(), deprecate KafkaFuture.Function and make a > couple of other minor cosmetic changes. > >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #619

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12288: remove task-level filesystem locks (#10342) [github] KAFKA-12571: Eliminate LeaderEpochFileCache constructor dependency on logEndOffset (#10426)

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #647

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12288: remove task-level filesystem locks (#10342) [github] KAFKA-12571: Eliminate LeaderEpochFileCache constructor dependency on logEndOffset (#10426)

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #679

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12288: remove task-level filesystem locks (#10342) [github] KAFKA-12571: Eliminate LeaderEpochFileCache constructor dependency on logEndOffset (#10426)

[jira] [Created] (KAFKA-12586) Admin API for DescribeTransactions

2021-03-30 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12586: --- Summary: Admin API for DescribeTransactions Key: KAFKA-12586 URL: https://issues.apache.org/jira/browse/KAFKA-12586 Project: Kafka Issue Type:

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #618

2021-03-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #646

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix newly added client side timeout tests in `KafkaAdminClientTest` (#10398) -- [...truncated 3.69 MB...] KafkaZkClientTest >

[jira] [Resolved] (KAFKA-12571) Eliminate LeaderEpochFileCache constructor dependency on LogEndOffset

2021-03-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12571. - Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > Eliminate LeaderEpochFileCache

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #678

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix newly added client side timeout tests in `KafkaAdminClientTest` (#10398) -- [...truncated 3.69 MB...]

[jira] [Created] (KAFKA-12585) FencedInstanceIdException can cause heartbeat thread to never be closed

2021-03-30 Thread Brian Hawkins (Jira)
Brian Hawkins created KAFKA-12585: - Summary: FencedInstanceIdException can cause heartbeat thread to never be closed Key: KAFKA-12585 URL: https://issues.apache.org/jira/browse/KAFKA-12585 Project:

Re: [VOTE] 2.8.0 RC0

2021-03-30 Thread John Roesler
Hello again, all, I just wanted to mention that I am aware of Justin's concerns in the 2.6.2 thread: https://lists.apache.org/thread.html/r2df54c11c10d3d38443054998bc7dd92d34362641733c2fb7c579b50%40%3Cdev.kafka.apache.org%3E I plan to make sure we address these concerns before the actual 2.8.0

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #645

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12557: Fix hanging KafkaAdminClientTest (#10404) [github] KAFKA-12552: Introduce LogSegments class abstracting the segments map (#10401) [github] KAFKA-12509 Tighten

Re: [VOTE] KIP-516: Topic Identifiers

2021-03-30 Thread Justine Olshan
Hi all, Another quick update. After some offline discussion with KIP-500 folks, I'm making a small tweak to one of the configs in KIP-516. Instead of delete.stale.topics.ms, KIP-516 will introduce delete.topic.delay.ms which is defined as *"**The minimum amount of time to wait before removing a

[VOTE] 2.8.0 RC0

2021-03-30 Thread John Roesler
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 2.8.0. This is a major release that includes many new features, including: * Early-access release of replacing Zookeeper with a self- managed quorum * Add Describe Cluster API * Support

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #677

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12557: Fix hanging KafkaAdminClientTest (#10404) [github] KAFKA-12552: Introduce LogSegments class abstracting the segments map (#10401) [github] KAFKA-12509 Tighten

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #617

2021-03-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12557: Fix hanging KafkaAdminClientTest (#10404) [github] KAFKA-12552: Introduce LogSegments class abstracting the segments map (#10401) [github] KAFKA-12509 Tighten up

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #85

2021-03-30 Thread Apache Jenkins Server
See Changes: [John Roesler] KAFKA-12557: Fix hanging KafkaAdminClientTest (#10404) -- [...truncated 3.61 MB...] PasswordEncoderTest >

Re: [DISCUSS] KIP-712: Shallow Mirroring

2021-03-30 Thread Henry Cai
Tom, Thanks for your comments. Yes it's a bit clumsy to use the existing consumer and producer API to carry the underlying record batch, but creating a new set of API would also mean other use cases (e.g. MM2) wouldn't be able to use that feature easily. We can throw exceptions if we see

Re: [DISCUSS] KIP-712: Shallow Mirroring

2021-03-30 Thread Henry Cai
Ismael, On the network performance side, the issue is on the throughput. For networking purposes, you gain throughout by combining data into bigger batch otherwise you pay higher overhead on network handshaking/roudtrip-delay and wastage on the underlying network packet buffer. On mirrormaker,

[jira] [Resolved] (KAFKA-12509) Tighten up StateDirectory thread locking

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-12509. Resolution: Fixed > Tighten up StateDirectory thread locking >

Re: [DISCUSS] KIP-690 Add additional configuration to control MirrorMaker 2 internal topics naming convention

2021-03-30 Thread Omnia Ibrahim
*(sorry forgot to Replay to All) * Hi Ryanne, It's a valid concern, I was trying to separate the concerns of internal and replicated policy away from each other and to make the code readable as extending ReplicationPolicy to manage both internal and replicated topic is a bit odd. Am not against

Re: [DISCUSS] KIP-726: Make the CooperativeStickyAssignor as the default assignor

2021-03-30 Thread Guozhang Wang
Hi Sophie, My question is more related to KAFKA-12477, but since your latest replies are on this thread I figured we can follow-up on the same venue. Just so I understand your latest comments above about the approach: * I think, we would need to persist this decision so that the group would

Re: [DISCUSS] KIP-690 Add additional configuration to control MirrorMaker 2 internal topics naming convention

2021-03-30 Thread Omnia Ibrahim
Hi Mickael, > - I'm still a bit uneasy with the overlap between these 2 methods as currently `ReplicationPolicy.isInternalTopic` already handles MM2 internal topics. Should we make it only handle Kafka internal topics and `isMM2InternalTopic()` only handle MM2 topics? We can clear the overlap by

[jira] [Resolved] (KAFKA-12552) Extract segments map out of Log class into separate class

2021-03-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12552. - Fix Version/s: 3.0.0 Resolution: Fixed Merged the PR to trunk. > Extract segments map out of

[jira] [Resolved] (KAFKA-12557) org.apache.kafka.clients.admin.KafkaAdminClientTest#testClientSideTimeoutAfterFailureToReceiveResponse intermittently hangs indefinitely

2021-03-30 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-12557. -- Resolution: Fixed >

[jira] [Resolved] (KAFKA-12435) Several streams-test-utils classes missing from javadoc

2021-03-30 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-12435. -- Resolution: Fixed > Several streams-test-utils classes missing from javadoc >

[jira] [Created] (KAFKA-12584) Remove deprecated `Sum` and `Total` classes

2021-03-30 Thread David Jacot (Jira)
David Jacot created KAFKA-12584: --- Summary: Remove deprecated `Sum` and `Total` classes Key: KAFKA-12584 URL: https://issues.apache.org/jira/browse/KAFKA-12584 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-12583) Upgrade of netty-codec due to CVE-2021-21295

2021-03-30 Thread Dominique Mongelli (Jira)
Dominique Mongelli created KAFKA-12583: -- Summary: Upgrade of netty-codec due to CVE-2021-21295 Key: KAFKA-12583 URL: https://issues.apache.org/jira/browse/KAFKA-12583 Project: Kafka

Re: [VOTE] KIP-707: The future of KafkaFuture

2021-03-30 Thread David Jacot
Thanks for the KIP, Tom. I agree that this is a good step forward. +1 (binding) David On Mon, Mar 29, 2021 at 5:58 PM Ryanne Dolan wrote: > +1, thanks! > > On Mon, Mar 29, 2021, 10:54 AM Ismael Juma wrote: > > > Thanks for the KIP, +1 (binding). > > > > Ismael > > > > On Mon, Mar 29, 2021 at

[jira] [Created] (KAFKA-12582) Remove deprecated `ConfigEntry` constructor

2021-03-30 Thread David Jacot (Jira)
David Jacot created KAFKA-12582: --- Summary: Remove deprecated `ConfigEntry` constructor Key: KAFKA-12582 URL: https://issues.apache.org/jira/browse/KAFKA-12582 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-712: Shallow Mirroring

2021-03-30 Thread Tom Bentley
Hi Henry and Ryanne, Related to Ismael's point about the producer & consumer configs being dangerous, I can see two parts to this: 2a. Both the proposed configs seem to be fundamentally incompatible with the Producer's existing key.serializer, value.serializer and compression.type configs,

Re: [DISCUSS] KIP-727 Add --under-preferred-replica-partitions option to describe topics command

2021-03-30 Thread Tom Bentley
Hi Wenbing, Thanks for the KIP, I can see this being useful. 1. Could you include an example command line and sample output of the command in the KIP? 2. I think a better name for the option would be --non-preferred-leader rather than --under-preferred-replica-partitions 3. One of the things a

[jira] [Created] (KAFKA-12581) Remove deprecated Admin.electPreferredLeaders

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12581: --- Summary: Remove deprecated Admin.electPreferredLeaders Key: KAFKA-12581 URL: https://issues.apache.org/jira/browse/KAFKA-12581 Project: Kafka Issue Type: Task

[jira] [Resolved] (KAFKA-12580) Remove deprecated close(long, TimeUnit)

2021-03-30 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-12580. - Fix Version/s: (was: 3.0.0) Resolution: Duplicate Duplicate of KAFKA-12579. >

[jira] [Created] (KAFKA-12580) Remove deprecated close(long, TimeUnit)

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12580: --- Summary: Remove deprecated close(long, TimeUnit) Key: KAFKA-12580 URL: https://issues.apache.org/jira/browse/KAFKA-12580 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-12579) Remove deprecated ExtendedSerializer/Deserializer

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12579: --- Summary: Remove deprecated ExtendedSerializer/Deserializer Key: KAFKA-12579 URL: https://issues.apache.org/jira/browse/KAFKA-12579 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-12578) Remove deprecated PrincipalBuilder

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12578: --- Summary: Remove deprecated PrincipalBuilder Key: KAFKA-12578 URL: https://issues.apache.org/jira/browse/KAFKA-12578 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-12577) Remove deprecated `quota.producer.default` and `quota.consumer.default` configurations

2021-03-30 Thread David Jacot (Jira)
David Jacot created KAFKA-12577: --- Summary: Remove deprecated `quota.producer.default` and `quota.consumer.default` configurations Key: KAFKA-12577 URL: https://issues.apache.org/jira/browse/KAFKA-12577

Re: [DISCUSS] KIP-712: Shallow Mirroring

2021-03-30 Thread Ismael Juma
Hi Henry, Can you clarify why this "network performance" issue is only related to shallow mirroring? Generally, we want the protocol to be generic and not have a number of special cases. The more special cases you have, the tougher it becomes to test all the edge cases. Ismael On Mon, Mar 29,

[jira] [Resolved] (KAFKA-12573) Removed deprecated `Metric#value`

2021-03-30 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-12573. - Fix Version/s: 3.0.0 Reviewer: Ismael Juma Resolution: Fixed > Removed