Hi Avani, totally agree - depending on the way you'd like to integrate your source that would be probably Debezium for CDC or JDBC source that can be used either in a "full-load" as well as in an incremental way. As a sink JDBC sink with the corresponding driver for the DB. Kindly have a look at the Connect Documentation and some examples. If you'd like to test with runnable Docker-based examples, you can have a look at this Docker Playground Repo: https://github.com/vdesabou/kafka-docker-playground/tree/master/connect
Kind regards, Roman Am Di., 27. Juni 2023 um 08:48 Uhr schrieb Avani Panchal <[email protected]>: > Hi Sagar, > > Thank you for your email. > > Thanks & Regards, > Avani Panchal > > > On Tue, Jun 27, 2023 at 12:15 PM Sagar <[email protected]> wrote: > > > Hi Avani, > > > > I already shared the documentation link for Kafka Connect. Let me share > it > > again: https://kafka.apache.org/documentation/#connect > > > > Regarding the connector documentation, you should be able to find them by > > just searching for JDBC source connector, JDBC sink connector and > Debezium > > connector for MySQL. > > > > Let me know if that works. > > > > Thanks! > > Sagar. > > > > > > > > On Mon, Jun 26, 2023 at 2:10 PM Avani Panchal > > <[email protected]> wrote: > > > > > Hi Sagar, > > > > > > Thank you for the information, you solved our confusion. > > > I also saw lots of links for documentation on Kafka, but I am confused > > > which document I should use. > > > So can you share the proper link from where I can read the documents. > > > > > > Thanks, > > > Avani Panchal > > > > > > > > > On Mon, Jun 26, 2023 at 1:48 PM Sagar <[email protected]> > wrote: > > > > > > > Hey Avani, > > > > > > > > Kafka Connect <https://kafka.apache.org/documentation/#connect> is > the > > > > tool > > > > to use when you want to stream data to/from Kafka via external > systems. > > > One > > > > would typically configure connectors which allow streaming data > to/from > > > > Kafka. There are 2 types of connectors: > > > > 1) Source Connectors: Which stream data from external systems like > > > > databases etc to Kafka and > > > > 2) Sink Connectors: Which stream data from Kafka to external systems. > > > > > > > > Since you want to stream data from MySQL to SQL Server, with Kafka > > > Connect > > > > it would be a 2 step process: > > > > > > > > 1) Capture changes from MySQL to Kafka using connectors like JDBC > > source > > > > connector or Debezium MySQL connector. > > > > 2) Once the data is in Kafka, you can use JDBC sink connectors to > > stream > > > > data from Kafka topics to the tables in SQL Server. > > > > > > > > Note that this is a very simplified view of how you can achieve your > > goal > > > > of streaming changes from MySQL to SQL Server and I would recommend > > > reading > > > > the documentation of the individual connectors and the Kafka Connect > > > > framework to understand how to make it work for your usecase. > > > > > > > > Thanks for your interest on Apache Kafka! > > > > > > > > Thanks! > > > > Sagar. > > > > > > > > > > > > On Mon, Jun 26, 2023 at 11:42 AM Avani Panchal > > > > <[email protected]> wrote: > > > > > > > > > Hi, > > > > > In my application I want to sync my client's data to my SQL > server. > > at > > > > > client place the database is MYSQL. > > > > > > > > > > How can I achieve this using Kafka? I read a lot of documents but I > > > don't > > > > > understand which setup I need and how I can achieve it. > > > > > > > > > > I was also wondering about "Book a demo with Kafka" but didn't find > > it. > > > > > > > > > > Please help me. > > > > > > > > > > Thank you, > > > > > Avani > > > > > > > > > > > > > > >
