Permission to contribute to Apache Kafka

2023-06-26 Thread kafka
Hi, I'd like to request permissions to contribute to Apache Kafka. My account details are as follows: # Wiki Email: gaurav_naru...@apple.com Username: gnarula # JIRA Email: gaurav_naru...@apple.com Username: gnarula

Re: [DISCUSS] KIP-941: Range queries to accept null lower and upper bounds

2023-06-26 Thread Lucia Cerchie
Thanks for asking for clarification, Sophie; that gives me guidance on improving the KIP! Here's the updated version, including the JIRA link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds On Thu, Jun 22, 2023 at 12:57 PM Sophie

[jira] [Created] (KAFKA-15126) Change range queries to accept null lower and upper bounds

2023-06-26 Thread Lucia Cerchie (Jira)
Lucia Cerchie created KAFKA-15126: - Summary: Change range queries to accept null lower and upper bounds Key: KAFKA-15126 URL: https://issues.apache.org/jira/browse/KAFKA-15126 Project: Kafka

[jira] [Created] (KAFKA-15125) Break down SocketServer classes into separate files

2023-06-26 Thread Jae Wie (Jira)
Jae Wie created KAFKA-15125: --- Summary: Break down SocketServer classes into separate files Key: KAFKA-15125 URL: https://issues.apache.org/jira/browse/KAFKA-15125 Project: Kafka Issue Type: Task

[GitHub] [kafka-site] divijvaidya commented on pull request #528: MINOR: Add statmenet about ZK deprecation to 3.5 release blog post

2023-06-26 Thread via GitHub
divijvaidya commented on PR #528: URL: https://github.com/apache/kafka-site/pull/528#issuecomment-1607874433 > I believe the most important points are the following: - update the blog post (with minimum information and link to the docs) - update the docs with ZK deprecation section

[GitHub] [kafka-site] mjsax commented on pull request #528: MINOR: Add statmenet about ZK deprecation to 3.5 release blog post

2023-06-26 Thread via GitHub
mjsax commented on PR #528: URL: https://github.com/apache/kafka-site/pull/528#issuecomment-1607861293 @mimaison @ijuma @divijvaidya -- any thoughts? Would not nice to move this forward. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Resolved] (KAFKA-15122) Moving partitions between log dirs leads to kafka.log:type=Log metrics being deleted

2023-06-26 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15122. Fix Version/s: 3.5.0 Resolution: Duplicate Duplicate of

Re: [DISCUSS] KIP-940: Broker extension point for validating record contents at produce time

2023-06-26 Thread Andrew Schofield
Hi Edo, Thanks for the KIP. Looks like a useful improvement. I have some comments/questions. 4) For a new interface, I wonder whether it would be better to use TopicIdPartition rather than TopicPartition. Topic IDs are gradually spreading across the public interfaces for Kafka. 5) The new

[jira] [Created] (KAFKA-15124) KRaft snapshot freeze should never perform copy

2023-06-26 Thread Jira
José Armando García Sancio created KAFKA-15124: -- Summary: KRaft snapshot freeze should never perform copy Key: KAFKA-15124 URL: https://issues.apache.org/jira/browse/KAFKA-15124 Project:

[jira] [Created] (KAFKA-15123) Add tests for ChunkedBytesStream

2023-06-26 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-15123: Summary: Add tests for ChunkedBytesStream Key: KAFKA-15123 URL: https://issues.apache.org/jira/browse/KAFKA-15123 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-15122) Moving partitions between log dirs leads to kafka.log:type=Log metrics being deleted

2023-06-26 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-15122: -- Summary: Moving partitions between log dirs leads to kafka.log:type=Log metrics being deleted Key: KAFKA-15122 URL: https://issues.apache.org/jira/browse/KAFKA-15122

Re: [DISCUSS] KIP-940: Broker extension point for validating record contents at produce time

2023-06-26 Thread Edoardo Comar
Hi Kirk, thanks for your comments. > 1. Does record.validation.policy.class.name support multiple classes, or just > one? I’m probably not wrapping my head around it, > but I’d imagine different policies for different families or groupings of > topics, thus the need for supporting multiple

Re: Permissions to contribute to Apache Kafka

2023-06-26 Thread Chris Egerton
Hi Erik, Thanks for contributing to Apache Kafka! You should be good to go now. I also took the liberty of assigning KAFKA-14972 to you; feel free to unassign if you do not plan to work on that ticket. Cheers, Chris On Mon, Jun 26, 2023 at 9:57 AM Erik van Oosten wrote: > Dear reader, > > I

Permissions to contribute to Apache Kafka

2023-06-26 Thread Erik van Oosten
Dear reader, I would like to create a KIP and understand I need to request permissions for that. my wiki username: e.vanoos...@chello.nl  (note, this is /not/ my email address) my Jira username: erikvanoosten Kind regards,     Erik. -- Erik van Oosten e.vanoos...@grons.nl

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-06-26 Thread Igor Soarez
Hi Colin, Thanks for your support with getting this over the line and that’s great re the preliminary pass! Thanks also for sharing your thoughts, I've had a careful look at each of these and sharing my comments below. I agree, it is important to avoid a perf hit on non-JBOD. I've opted for

[jira] [Created] (KAFKA-15121) FileStreamSourceConnector and FileStreamSinkConnector should implement KIP-875 APIs

2023-06-26 Thread Yash Mayya (Jira)
Yash Mayya created KAFKA-15121: -- Summary: FileStreamSourceConnector and FileStreamSinkConnector should implement KIP-875 APIs Key: KAFKA-15121 URL: https://issues.apache.org/jira/browse/KAFKA-15121

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Avani Panchal
Hi Sagar, Thank you for the information, you solved our confusion. I also saw lots of links for documentation on Kafka, but I am confused which document I should use. So can you share the proper link from where I can read the documents. Thanks, Avani Panchal On Mon, Jun 26, 2023 at 1:48 PM

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Avani Panchal
Hi Josep Prat, Thank you for your reply, I was wondering from so many days you solved my problem. So you are from "Aiven", your company is providing a demo for Kafka? Thanks, Avani Panchal On Mon, Jun 26, 2023 at 1:46 PM Josep Prat wrote: > Hi Avani, > > Thanks for taking interest in Apache

[jira] [Created] (KAFKA-15120) Optimizing Recovery Time for Non-Transactional and Idempotent Partitions in Kafka

2023-06-26 Thread weiguang liu (Jira)
weiguang liu created KAFKA-15120: Summary: Optimizing Recovery Time for Non-Transactional and Idempotent Partitions in Kafka Key: KAFKA-15120 URL: https://issues.apache.org/jira/browse/KAFKA-15120

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Sagar
Hey Avani, Kafka Connect is the tool to use when you want to stream data to/from Kafka via external systems. One would typically configure connectors which allow streaming data to/from Kafka. There are 2 types of connectors: 1) Source Connectors:

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Josep Prat
Hi Avani, Thanks for taking interest in Apache Kafka. Regarding the example code involving a MySQL database as a sink you can take a look at this blog post: https://aiven.io/developer/db-technology-migration-with-apache-kafka-and-kafka-connect The example in there contains more moving pieces, but

Review request for Java Kafka consumer

2023-06-26 Thread Erik van Oosten
Dear Kafka developers, I submitted https://github.com/apache/kafka/pull/13914 to fix a long standing problem that the Kafka consumer on the JVM is not usable from asynchronous runtimes such as Kotlin co-routines and ZIO. Your review is much appreciated. Kind regards,     Erik. -- Erik van

Re: [DISCUSS] KIP-714: Client metrics and observability

2023-06-26 Thread Andrew Schofield
Hi Kirk, Thanks for your comments. 1) I agree that this KIP is not aiming to create a new first-class construct of a unique, managed, per-client instance ID. I’ll add some clarifying words. 2) I can see what the KIP is trying to say about the Terminating flag, but it doesn’t quite do it for

How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Avani Panchal
Hi, In my application I want to sync my client's data to my SQL server. at client place the database is MYSQL. How can I achieve this using Kafka? I read a lot of documents but I don't understand which setup I need and how I can achieve it. I was also wondering about "Book a demo with Kafka"