[jira] [Created] (KAFKA-13503) Validate broker configs for KRaft

2021-12-02 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-13503: Summary: Validate broker configs for KRaft Key: KAFKA-13503 URL: https://issues.apache.org/jira/browse/KAFKA-13503 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-12682) Kraft MetadataPartitionsBuilder _localChanged and _localRemoved out of order

2021-12-02 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12682. -- Fix Version/s: 3.0.0 Assignee: Colin McCabe (was: Justine Olshan) Resolution:

[jira] [Resolved] (KAFKA-12712) KRaft: Missing controller.quorom.voters config not properly handled

2021-12-02 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12712. -- Fix Version/s: 3.0.0 (was: 3.2.0) Assignee: Jason Gustafson

[jira] [Resolved] (KAFKA-13019) Add MetadataImage and MetadataDelta classes for KRaft Snapshots

2021-12-02 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13019. -- Resolution: Fixed > Add MetadataImage and MetadataDelta classes for KRaft Snapshots >

[jira] [Resolved] (KAFKA-12853) Implement broker-side KRaft snapshots

2021-12-02 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12853. -- Resolution: Fixed > Implement broker-side KRaft snapshots >

[jira] [Resolved] (KAFKA-13415) Track topic deletion state without ZK

2021-12-02 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13415. -- Resolution: Not A Problem > Track topic deletion state without ZK >

[jira] [Created] (KAFKA-13502) Support configuring BROKER_LOGGER on controller-only KRaft nodes

2021-12-02 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-13502: Summary: Support configuring BROKER_LOGGER on controller-only KRaft nodes Key: KAFKA-13502 URL: https://issues.apache.org/jira/browse/KAFKA-13502 Project: Kafka

Jenkins build became unstable: Kafka » Kafka Branch Builder » 3.0 #160

2021-12-02 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #28

2021-12-02 Thread Apache Jenkins Server
See Changes: -- [...truncated 501866 lines...] [2021-12-03T00:28:03.935Z] > Task :raft:testClasses UP-TO-DATE [2021-12-03T00:28:03.935Z] > Task :connect:json:testJar

[jira] [Created] (KAFKA-13501) Avoid state restore via rebalance if standbys are enabled

2021-12-02 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-13501: --- Summary: Avoid state restore via rebalance if standbys are enabled Key: KAFKA-13501 URL: https://issues.apache.org/jira/browse/KAFKA-13501 Project: Kafka

[jira] [Created] (KAFKA-13500) Consider adding a dedicated standby consumer

2021-12-02 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-13500: --- Summary: Consider adding a dedicated standby consumer Key: KAFKA-13500 URL: https://issues.apache.org/jira/browse/KAFKA-13500 Project: Kafka Issue

Re: [DISCUSS] Apache Kafka 3.1.0 release

2021-12-02 Thread Colin McCabe
Hi David, We'd like to include "KAFKA-13490: Fix createTopics and incrementalAlterConfigs for KRaft mode #11416" in the upcoming release. This fixes some bugs in how createTopics and incrementalAlterConfigs are handled by the controller. It is specific to KRaft, so will not affect ZK mode.

Re: [DISCUSS] KIP-785 Automatic storage formatting

2021-12-02 Thread Colin McCabe
Hi Igor, It is common for databases, filesystems, and other similar programs to require a formatting step before they are used. For example, postgres requires you to run initdb. Linux requires you to run mkfs before using a filesystem. Windows requires you to run "format c:/", or something

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

2021-12-02 Thread Colin McCabe
How are we going to avoid the situation where the broker restarts, and the same generation number is reused? best, Colin On Tue, Nov 30, 2021, at 16:36, Luke Chen wrote: > Hi all, > > I'd like to start the vote for KIP-792: Add "generation" field into > consumer protocol. > > The goal of this

[jira] [Resolved] (KAFKA-13461) KafkaController stops functioning as active controller after ZooKeeperClient auth failure

2021-12-02 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-13461. Fix Version/s: 3.1.0 3.0.1 Reviewer: Jun Rao

[jira] [Created] (KAFKA-13499) Avoid restoring outdated records

2021-12-02 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-13499: --- Summary: Avoid restoring outdated records Key: KAFKA-13499 URL: https://issues.apache.org/jira/browse/KAFKA-13499 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-729 Custom validation of records on the broker prior to log append

2021-12-02 Thread Nikolay Izhikov
Dear Kafka commiters. Let’s have this API in Kafka! > 2 дек. 2021 г., в 17:19, Christopher Shannon > написал(а): > > Revisiting this as this has come up for my use case again. Specifically for > validation I need to be able to validate headers including compressed > messages. It looks like in

Re: [DISCUSS] KIP-729 Custom validation of records on the broker prior to log append

2021-12-02 Thread Christopher Shannon
Revisiting this as this has come up for my use case again. Specifically for validation I need to be able to validate headers including compressed messages. It looks like in LogValidator the messages are already decompressed to validate records but the headers get skipped when loaded into a partial