Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-27 Thread Avani Panchal
thanks Roman. On Tue, Jun 27, 2023 at 3:15 PM Roman Schmitz wrote: > Hi Avani, > > not sure what you mean by creating your own code. Of course you can write > an own Connector but especially in Source Connectors offset handling can > challenging depending on the system. > There are hundreds of

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-27 Thread Roman Schmitz
Hi Avani, not sure what you mean by creating your own code. Of course you can write an own Connector but especially in Source Connectors offset handling can challenging depending on the system. There are hundreds of different Connectors out there that can connect to existing systems. If you find

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-27 Thread Avani Panchal
Hi Roman, Thanks for replying, I want to ask one question: can I create my own code to integrate data using Kafka connectors? Kind regards, Avani Panchal On Tue, Jun 27, 2023 at 12:29 PM Roman Schmitz wrote: > Hi Avani, > > totally agree - depending on the way you'd like to integrate your

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-27 Thread Roman Schmitz
Hi Avani, totally agree - depending on the way you'd like to integrate your source that would be probably Debezium for CDC or JDBC source that can be used either in a "full-load" as well as in an incremental way. As a sink JDBC sink with the corresponding driver for the DB. Kindly have a look at

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-27 Thread Avani Panchal
Hi Sagar, Thank you for your email. Thanks & Regards, Avani Panchal On Tue, Jun 27, 2023 at 12:15 PM Sagar wrote: > Hi Avani, > > I already shared the documentation link for Kafka Connect. Let me share it > again: https://kafka.apache.org/documentation/#connect > > Regarding the connector

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-27 Thread Sagar
Hi Avani, I already shared the documentation link for Kafka Connect. Let me share it again: https://kafka.apache.org/documentation/#connect Regarding the connector documentation, you should be able to find them by just searching for JDBC source connector, JDBC sink connector and Debezium

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Avani Panchal
Hi Sagar, Thank you for the information, you solved our confusion. I also saw lots of links for documentation on Kafka, but I am confused which document I should use. So can you share the proper link from where I can read the documents. Thanks, Avani Panchal On Mon, Jun 26, 2023 at 1:48 PM

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Avani Panchal
Hi Josep Prat, Thank you for your reply, I was wondering from so many days you solved my problem. So you are from "Aiven", your company is providing a demo for Kafka? Thanks, Avani Panchal On Mon, Jun 26, 2023 at 1:46 PM Josep Prat wrote: > Hi Avani, > > Thanks for taking interest in Apache

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Sagar
Hey Avani, Kafka Connect is the tool to use when you want to stream data to/from Kafka via external systems. One would typically configure connectors which allow streaming data to/from Kafka. There are 2 types of connectors: 1) Source Connectors:

Re: How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Josep Prat
Hi Avani, Thanks for taking interest in Apache Kafka. Regarding the example code involving a MySQL database as a sink you can take a look at this blog post: https://aiven.io/developer/db-technology-migration-with-apache-kafka-and-kafka-connect The example in there contains more moving pieces, but

How to Integrate MySQL database with Kafka? Need Demo

2023-06-26 Thread Avani Panchal
Hi, In my application I want to sync my client's data to my SQL server. at client place the database is MYSQL. How can I achieve this using Kafka? I read a lot of documents but I don't understand which setup I need and how I can achieve it. I was also wondering about "Book a demo with Kafka"