[DISCUSS] KIP-558: Track the set of actively used topics by connectors in Kafka Connect

Hi all. I just posted KIP-558: Track the set of actively used topics by connectors in Kafka Connect Wiki link here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-558%3A+Track+the+set+of+actively+used+topics+by+connectors+in+Kafka+Connect I think it's a nice extension to follow up on KIP-

[jira] [Created] (KAFKA-9422) Track the set of topics a connector is using

Konstantine Karantasis created KAFKA-9422: - Summary: Track the set of topics a connector is using Key: KAFKA-9422 URL: https://issues.apache.org/jira/browse/KAFKA-9422 Project: Kafka

[jira] [Resolved] (KAFKA-9159) Consumer.endOffsets Throw TimeoutException: Failed to get offsets by times in 30000ms after a leader change

[ https://issues.apache.org/jira/browse/KAFKA-9159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9159. -- Fix Version/s: 2.5.0 Resolution: Fixed This has been fixed and would be included in the

Build failed in Jenkins: kafka-trunk-jdk8 #4156

See Changes: [github] MINOR: Add upgrade guide for KAFKA-8421 (#7925) -- [...truncated 2.19 MB...] org.apache.kafka.streams.processor.internals.StateDirectoryTest > sho

Build failed in Jenkins: kafka-trunk-jdk11 #1078

See Changes: [github] MINOR: Add upgrade guide for KAFKA-8421 (#7925) -- [...truncated 1.71 MB...] kafka.server.AbstractFetcherThreadTest > testFollowerFetchOutOfRangeH

[jira] [Created] (KAFKA-9421) Restricting access of commit for consumer member

Boyang Chen created KAFKA-9421: -- Summary: Restricting access of commit for consumer member Key: KAFKA-9421 URL: https://issues.apache.org/jira/browse/KAFKA-9421 Project: Kafka Issue Type: Improv

[jira] [Created] (KAFKA-9420) Bump APIs to enable flexible versions

Jason Gustafson created KAFKA-9420: -- Summary: Bump APIs to enable flexible versions Key: KAFKA-9420 URL: https://issues.apache.org/jira/browse/KAFKA-9420 Project: Kafka Issue Type: Improveme

[jira] [Created] (KAFKA-9419) Integer Overflow Possible with CircularIterator

David Mollitor created KAFKA-9419: - Summary: Integer Overflow Possible with CircularIterator Key: KAFKA-9419 URL: https://issues.apache.org/jira/browse/KAFKA-9419 Project: Kafka Issue Type: I

Build failed in Jenkins: kafka-trunk-jdk11 #1077

See Changes: [mimaison] KAFKA-9352: Use 'roundrobin' to assign topic-partitions to mirroring -- [...truncated 2.82 MB...] org.apache.kafka.streams.TopologyTestDriverTest

CVE-2019-12399: Apache Kafka Connect REST API may expose plaintext secrets in tasks endpoint

CVE-2019-12399: Apache Kafka Connect REST API may expose plaintext secrets in tasks endpoint Severity: Medium Vendor: The Apache Software Foundation Versions Affected: Apache Kafka 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.2.0, 2.2.1, 2.3.0 Description: When Connect workers in Apache Kafka 2.0.0, 2.0.1,

Build failed in Jenkins: kafka-trunk-jdk8 #4155

See Changes: [mimaison] KAFKA-9352: Use 'roundrobin' to assign topic-partitions to mirroring -- [...truncated 2.80 MB...] org.apache.kafka.streams.TopologyTestDriverTest

[jira] [Created] (KAFKA-9418) Add new sendOffsets API to include consumer group metadata

Boyang Chen created KAFKA-9418: -- Summary: Add new sendOffsets API to include consumer group metadata Key: KAFKA-9418 URL: https://issues.apache.org/jira/browse/KAFKA-9418 Project: Kafka Issue Ty

[jira] [Created] (KAFKA-9417) Add extension to the TransactionsTest.transactions_test for new EOS model

Boyang Chen created KAFKA-9417: -- Summary: Add extension to the TransactionsTest.transactions_test for new EOS model Key: KAFKA-9417 URL: https://issues.apache.org/jira/browse/KAFKA-9417 Project: Kafka

Re: [DISCUSS] Apache Kafka 2.5.0 release

+1. Thanks for volunteering, David. best, Colin On Fri, Dec 20, 2019, at 10:59, David Arthur wrote: > Greetings! > > I'd like to volunteer to be release manager for the next time-based feature > release which will be 2.5. If there are no objections, I'll send out the > release plan in the next

[jira] [Created] (KAFKA-9416) Streams get stuck in `PENDING_SHUTDOWN` is underlying topics deleted.

Andy Coates created KAFKA-9416: -- Summary: Streams get stuck in `PENDING_SHUTDOWN` is underlying topics deleted. Key: KAFKA-9416 URL: https://issues.apache.org/jira/browse/KAFKA-9416 Project: Kafka

[jira] [Resolved] (KAFKA-9352) unbalanced assignment of topic-partition to tasks

[ https://issues.apache.org/jira/browse/KAFKA-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-9352. --- Resolution: Fixed > unbalanced assignment of topic-partition to tasks > -

[jira] [Created] (KAFKA-9415) Review Thread Interrupt Usage

David Mollitor created KAFKA-9415: - Summary: Review Thread Interrupt Usage Key: KAFKA-9415 URL: https://issues.apache.org/jira/browse/KAFKA-9415 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits

bumping for any additional feedback. I'll open a vote thread in the next couple days if there aren't any additional comments. On Wed, Nov 20, 2019 at 10:45 PM Eric Azama wrote: > Hi Deng, > > It's similar to Record Headers in that the metadata isn't used within > Kafka itself. The intended purpo

[VOTE] On the new KIP-158: Kafka Connect allows source connectors to set topic settings when creating new topics

Hi everyone. I hope y'all had a nice break. The discussion on KIP-158 seems to have wrapped up since last year, so I'd like to open the vote on this KIP. A reminder that this is an updated KIP-158 (that had also been approved in its earlier version) and it seems to be a highly anticipated feature

[jira] [Created] (KAFKA-9414) sink-task-metrics.sink-record-lag-max metric is not exposed

Aidar Makhmutov created KAFKA-9414: -- Summary: sink-task-metrics.sink-record-lag-max metric is not exposed Key: KAFKA-9414 URL: https://issues.apache.org/jira/browse/KAFKA-9414 Project: Kafka

Re: [VOTE] KIP-518: Allow listing consumer groups per state

+1 (non-binding). Thanks for the KIP. On Mon, Jan 13, 2020 at 2:15 PM Dongjin Lee wrote: > +1 (non-binding) > > On Mon, Jan 13, 2020 at 7:16 PM Mickael Maison > wrote: > > > Hi all. > > > > With 2.5.0 approaching, bumping this thread once more as feedback or > > votes would be nice. > > > > Tha

Re: [VOTE] KIP-518: Allow listing consumer groups per state

+1 (non-binding) On Mon, Jan 13, 2020 at 7:16 PM Mickael Maison wrote: > Hi all. > > With 2.5.0 approaching, bumping this thread once more as feedback or > votes would be nice. > > Thanks > > On Thu, Dec 12, 2019 at 9:45 PM Ryanne Dolan > wrote: > > > > +1 non-binding, thx > > > > On Thu, Dec 1

Re: [DISCUSS] KIP-550: Mechanism to Delete Stray Partitions on Broker

Hi Nikhil, Thanks for looking at the KIP. The kind of race condition you mention is not possible as stray partition detection is done synchronously while handling the LeaderAndIsrRequest. In other words, we atomically evaluate the partitions the broker must host and the extra partitions it is host

Jenkins build is back to normal : kafka-trunk-jdk11 #1076

See

Re: [VOTE] KIP-409: Allow creating under-replicated topics and partitions

Hi Mikael, Apologies for last minute question, as I just caught up with it. Thanks for your work on the KIP. Just trying to get your thoughts on one thing (I might have misunderstood it) - currently it's possible (even though I am strongly against it) to create Kafka topics which are under-replic

Re: [DISCUSS] KIP-518: Allow listing consumer groups per state

Hi Michael, Please, excuse me for my late feedback. I've got a few questions/comments while reviewing the KIP. 1. I would suggest to clearly state in the documentation of the state field that omitting it or providing an empty list means "all". 2. Have you considered including the state in the re

Build failed in Jenkins: kafka-trunk-jdk8 #4154

See Changes: [github] KAFKA-7639: Read one request at a time from socket to avoid OOM (#5920) -- [...truncated 2.81 MB...] org.apache.kafka.streams.MockTimeTest > shouldN

[jira] [Created] (KAFKA-9413) Add audit of Kafka cluster

Igor Martemyanov created KAFKA-9413: --- Summary: Add audit of Kafka cluster Key: KAFKA-9413 URL: https://issues.apache.org/jira/browse/KAFKA-9413 Project: Kafka Issue Type: New Feature

Re: [VOTE] KIP-518: Allow listing consumer groups per state

Hi all. With 2.5.0 approaching, bumping this thread once more as feedback or votes would be nice. Thanks On Thu, Dec 12, 2019 at 9:45 PM Ryanne Dolan wrote: > > +1 non-binding, thx > > On Thu, Dec 12, 2019 at 6:09 AM Mickael Maison > wrote: > > > Bumping this thread > > > > On Tue, Nov 19, 201

Re: [VOTE] KIP-409: Allow creating under-replicated topics and partitions

Hi all. With 2.5.0 approaching, bumping this thread once more as feedback or votes would be nice. Thanks On Wed, Dec 18, 2019 at 1:59 PM Tom Bentley wrote: > > +1 non-binding. Thanks! > > On Wed, Dec 18, 2019 at 1:05 PM Sönke Liebau > wrote: > > > Hi Mickael, > > > > thanks for your response!

[jira] [Resolved] (KAFKA-7639) Read one request at a time from socket to reduce broker memory usage

[ https://issues.apache.org/jira/browse/KAFKA-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7639. --- Fix Version/s: 2.5.0 Reviewer: Jun Rao Resolution: Fixed > Read one request a

[jira] [Created] (KAFKA-9412) LogCleaner stopped for NoSuchElementException

evan einst created KAFKA-9412: - Summary: LogCleaner stopped for NoSuchElementException Key: KAFKA-9412 URL: https://issues.apache.org/jira/browse/KAFKA-9412 Project: Kafka Issue Type: Bug