Re: [DISCUSS] KIP-587 Suppress detailed responses for handled exceptions in security-sensitive environments

Hi Connor, Just a few more remarks! I noticed that you said "Kafka Connect was passing these exceptions without authentication." For what it's worth, the Connect REST API can be secured with TLS out-of-the-box by configuring the worker with the various ssl.* properties, but that doesn't provide

[jira] [Created] (KAFKA-9840) Consumer should not use OffsetForLeaderEpoch without current epoch validation

Jason Gustafson created KAFKA-9840: -- Summary: Consumer should not use OffsetForLeaderEpoch without current epoch validation Key: KAFKA-9840 URL: https://issues.apache.org/jira/browse/KAFKA-9840

[jira] [Created] (KAFKA-9839) IllegalStateException on metadata update when broker learns about its new epoch after the controller

Anna Povzner created KAFKA-9839: --- Summary: IllegalStateException on metadata update when broker learns about its new epoch after the controller Key: KAFKA-9839 URL: https://issues.apache.org/jira/browse/KAFKA-9839

Build failed in Jenkins: kafka-trunk-jdk11 #1337

See Changes: [github] KAFKA-6145: KIP-441 Move tasks with caught-up destination clients right -- [...truncated 3.01 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #4416

See Changes: [github] KAFKA-6145: KIP-441 Move tasks with caught-up destination clients right -- [...truncated 3.00 MB...]

Build failed in Jenkins: kafka-2.4-jdk8 #185

See Changes: [jason] KAFKA-9835; Protect `FileRecords.slice` from concurrent write (#8451) -- [...truncated 7.05 MB...] org.apache.kafka.connect.transforms.CastTest >

Build failed in Jenkins: kafka-trunk-jdk11 #1336

See Changes: [github] KAFKA-6145: KIP-441 Pt. 6 Trigger probing rebalances until group is [github] KAFKA-9835; Protect `FileRecords.slice` from concurrent write (#8451)

Build failed in Jenkins: kafka-trunk-jdk8 #4415

See Changes: [github] KAFKA-9835; Protect `FileRecords.slice` from concurrent write (#8451) -- [...truncated 3.00 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Thanks for the info Agam! Will add to the KIP. On Wed, Apr 8, 2020 at 4:26 PM Agam Brahma wrote: > Hi Boyang, > > The KIP already talks about incorporating changes for FindCoordinator > request routing, wanted to point out one additional case where internal > topics are created "as a side

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Hi Boyang, The KIP already talks about incorporating changes for FindCoordinator request routing, wanted to point out one additional case where internal topics are created "as a side effect": As part of handling metadata requests, if we are looking for metadata for an internal topic and

Re: [DISCUSS] KIP-578: Add configuration to limit number of partitions

Hi. Requesting you to take a look at this KIP and provide feedback. Thanks. Regards. On Wed, Apr 1, 2020 at 4:28 PM Gokul Ramanan Subramanian < gokul24...@gmail.com> wrote: > Hi. > > I have opened KIP-578, intended to provide a mechanism to limit the number > of partitions in a Kafka cluster.

Re: Want to be Part of Kafka Committer - Siva

Sure. Here is my user-id `3854148` Thanks, Siva On Wed, Apr 8, 2020 at 3:58 PM Matthias J. Sax wrote: > Yes, I meant JIRA. You can just create a JIRA account (self service) and > share you account ID here -- than we can add you to the JIRA contributor > list -- this allows you to self-assign

Re: Want to be Part of Kafka Committer - Siva

Yes, I meant JIRA. You can just create a JIRA account (self service) and share you account ID here -- than we can add you to the JIRA contributor list -- this allows you to self-assign tickets. -Matthias On 4/8/20 3:29 PM, siva deva wrote: > Sorry, which account ID you mean? can you please

Re: Want to be Part of Kafka Committer - Siva

Sorry, which account ID you mean? can you please guide here. Where should I create an account (in JIRA) ? On Wed, Apr 8, 2020 at 2:27 PM Matthias J. Sax wrote: > Did you create an account already? What is your account ID (we need it > to add you to the list of contributors). > > -Matthias > > >

Jira Cleanup - Kafka on Windows

All, I stumbled across a recent issue about Kafka crashing on Windows the other day, which keeps coming up on jira. So I went and had a look and found 16 unresolved tickets about this - some of them definitely are duplicates, some of them might be a variation. KAKFA-1194 - The kafka broker

Build failed in Jenkins: kafka-trunk-jdk8 #4414

See Changes: [github] KAFKA-6145: KIP-441 Pt. 6 Trigger probing rebalances until group is -- [...truncated 6.00 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-585: Conditional SMT

Hi Tom, With regards to the potential Transformation::validate method, I don't quite follow your objections. The AbstractHerder class, ConnectorConfig class, and embedding of ConfigDefs that happens with the two is all internal logic and we're allowed to modify it however we want, as long as it

Re: Want to be Part of Kafka Committer - Siva

Did you create an account already? What is your account ID (we need it to add you to the list of contributors). -Matthias On 4/8/20 9:41 AM, siva deva wrote: > It’s mentioned that I need to add to the contributor list for assigning a > JIRA. > > Please contact us to be added the contributor

Re: [DISCUSS] KIP-588: Allow producers to recover gracefully from transaction timeouts

That's a good suggestion Jason. Adding a dedicated PRODUCER_FENCED error should help distinguish exceptions and could safely mark INVALID_PRODUCER_EPOCH exception as non-fatal in the new code. Updated the KIP. Boyang On Wed, Apr 8, 2020 at 12:18 PM Jason Gustafson wrote: > Hey Boyang, > >

[jira] [Resolved] (KAFKA-2493) Add ability to fetch only keys in consumer

[ https://issues.apache.org/jira/browse/KAFKA-2493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-2493. - Resolution: Won't Fix As this has been dormant for a long time and no one reacted to my comment

[jira] [Resolved] (KAFKA-976) Order-Preserving Mirror Maker Testcase

[ https://issues.apache.org/jira/browse/KAFKA-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-976. Resolution: Won't Fix As this has been dormant for a long time and no one reacted to my comment

[jira] [Resolved] (KAFKA-2333) Add rename topic support

[ https://issues.apache.org/jira/browse/KAFKA-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-2333. - Resolution: Won't Fix As this has been dormant for a long time and no one reacted to my comment

[jira] [Resolved] (KAFKA-3925) Default log.dir=/tmp/kafka-logs is unsafe

[ https://issues.apache.org/jira/browse/KAFKA-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-3925. - Resolution: Won't Fix As this has been dormant for a long time and no one reacted to my comment

Re: [DISCUSS] KIP-588: Allow producers to recover gracefully from transaction timeouts

Hey Boyang, Thanks for the KIP. I think the main problem we've identified here is that the current errors conflate transaction timeouts with producer fencing. The first of these ought to be recoverable, but we cannot distinguish it. The suggestion to add a new error code makes sense to me, but it

[jira] [Created] (KAFKA-9838) Add additional log concurrency test cases

Jason Gustafson created KAFKA-9838: -- Summary: Add additional log concurrency test cases Key: KAFKA-9838 URL: https://issues.apache.org/jira/browse/KAFKA-9838 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-9835) Race condition with concurrent write allows reads above high watermark

[ https://issues.apache.org/jira/browse/KAFKA-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9835. Resolution: Fixed > Race condition with concurrent write allows reads above high watermark

Build failed in Jenkins: kafka-trunk-jdk8 #4413

See Changes: [github] KAFKA-8890: Make SSL context/engine configuration extensible (KIP-519) -- [...truncated 2.99 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Re: [DISCUSS] KIP-587 Suppress detailed responses for handled exceptions in security-sensitive environments

Hi All! Is there any additional feedback that the community can provide me on the KIP? Has anyone else run into requirements like this, or maybe my customer is the only one :)? If the scope looks good, is it time to call a vote? Or should I start porting my 2.0 code to 2.6 to show examples?

Jenkins build is back to normal : kafka-trunk-jdk11 #1334

See

Re: [DISCUSS] KIP-585: Conditional SMT

Since no one objected I've updated the KIP with the revised way to configure this transformation. On Mon, Apr 6, 2020 at 2:52 PM Tom Bentley wrote: > To come back about a point Chris made: > > 1. Instead of the new "ConfigDef config(Map props)" method, >> what would you think about adopting a

Re: Want to be Part of Kafka Committer - Siva

It’s mentioned that I need to add to the contributor list for assigning a JIRA. Please contact us to be added the contributor list. After that you can assign yourself to the JIRA ticket you have started working on so others will notice. On Wed, Apr 8, 2020 at 8:58 AM Boyang Chen wrote: > Have

Re: KIP Access

Hi, Jordan, Thanks for your interest. Just gave you the wiki permissions. Jun On Wed, Apr 8, 2020 at 8:22 AM Jordan Moore wrote: > To whom it may concern, > > I (Jordan Moore) would like to request access to create a KIP for > KAFKA-9774 > . >

Re: Want to be Part of Kafka Committer - Siva

Have you checked out https://kafka.apache.org/contributing.html? On Wed, Apr 8, 2020 at 8:14 AM siva deva wrote: > Hi, > > I am a newbie to Kafka Project. Can you please provide JIRA access to > starter/newbie tickets, so that I can start working on it. > > -- > Best, > Siva >

Build failed in Jenkins: kafka-trunk-jdk8 #4412

See Changes: [github] HOTFIX: exclude ConsumerCoordinator from NPathComplexity check (#8447) -- [...truncated 5.99 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Want to be Part of Kafka Committer - Siva

Hi, I am a newbie to Kafka Project. Can you please provide JIRA access to starter/newbie tickets, so that I can start working on it. -- Best, Siva

KIP Access

To whom it may concern, I (Jordan Moore) would like to request access to create a KIP for KAFKA-9774 . *wiki id: *cricket007 Regards, and stay well, Jordan M.

[jira] [Resolved] (KAFKA-8890) KIP-519: Make SSL context/engine configuration extensible

[ https://issues.apache.org/jira/browse/KAFKA-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-8890. --- Fix Version/s: 2.6.0 Resolution: Fixed > KIP-519: Make SSL context/engine

[jira] [Created] (KAFKA-9837) New RPC for notifying controller of failed replica

David Arthur created KAFKA-9837: --- Summary: New RPC for notifying controller of failed replica Key: KAFKA-9837 URL: https://issues.apache.org/jira/browse/KAFKA-9837 Project: Kafka Issue Type:

Re: [VOTE] 2.5.0 RC3

Passing Jenkins build on 2.5 branch: https://builds.apache.org/job/kafka-2.5-jdk8/90/ On Wed, Apr 8, 2020 at 12:03 AM David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the forth candidate for release of Apache Kafka 2.5.0. > > * TLS 1.3 support (1.2 is now

[jira] [Created] (KAFKA-9836) org.apache.zookeeper.KeeperException$SessionMovedException: KeeperErrorCode = Session moved for /controller_epoch

Jagadish created KAFKA-9836: --- Summary: org.apache.zookeeper.KeeperException$SessionMovedException: KeeperErrorCode = Session moved for /controller_epoch Key: KAFKA-9836 URL:

[jira] [Created] (KAFKA-9835) Race condition with concurrent write allows reads above high watermark

Jason Gustafson created KAFKA-9835: -- Summary: Race condition with concurrent write allows reads above high watermark Key: KAFKA-9835 URL: https://issues.apache.org/jira/browse/KAFKA-9835 Project:

Build failed in Jenkins: kafka-trunk-jdk11 #1333

See Changes: [wangguoz] KAFKA-9801: Still trigger rebalance when static member joins in -- [...truncated 1.62 MB...] org.apache.kafka.streams.test.TestRecordTest >

Build failed in Jenkins: kafka-trunk-jdk8 #4411

See Changes: [wangguoz] KAFKA-9801: Still trigger rebalance when static member joins in -- [...truncated 1.62 MB...]

回复：回复：回复：回复：回复：回复：[Vote] KIP-571: Add option to force remove members in StreamsResetter

Hi Boyang, Thanks for reminding me of that! I'm not sure about the convention, I thought it would need to re-collect votes if the KIP has changed~ Let's leave the vote thread here for 2 days, if no objection, I will take it as approved and update the PR accordingly. Thanks! Feyman

[jira] [Created] (KAFKA-9834) Add config to set ZSTD compresson level

jiamei xie created KAFKA-9834: - Summary: Add config to set ZSTD compresson level Key: KAFKA-9834 URL: https://issues.apache.org/jira/browse/KAFKA-9834 Project: Kafka Issue Type: Bug