Re: Connectors Information from Microsoft SQL Server to Kafka

You might find this connector useful for your use case: https://github.com/jcustenborder/kafka-connect-cdc-mssql Konstantine On Tue, Dec 12, 2017 at 9:29 PM, harish reddy m wrote: > Hi Team, > > We have a requirement of replicating the data from MSSQL Source database

Re: Kafka Producer HA - using Kafka Connect

If I understand correctly, and your question refers to general fault tolerance, the answer is yes, Kafka Connect offers fault tolerance in distributed mode. You may start several Connect workers and if a worker running one task with your single producer fails unexpectedly, then this task will be

Re: 1 to N transformers in Kafka Connect

Indeed, there is no flattening operator in Kafka Connect's SMTs at the moment. The 'apply' method in the Transformation interface accepts a single record and returns another - transformed - record or null. Konstantine. On Wed, Dec 27, 2017 at 8:25 PM, Ziliang Chen wrote:

what are common ways to convert info on a web site into a log entry?

Hi Kafka people, I am very new to kafka, so perhaps my question is naive. I spent some time searching around at resources of kafka but only became more confused. What are common ways to pull info from a web site and send to kafka to become a log entry? There is a web site that I want to pull a

one machine that have four network.....

hi guys, I have a linux(Centos7) that have four network interface, and i'm tryying to build a pseudo-cluster in this machine. Four cards correspond to four ip??101, 104,105,106), and three brokers config : listeners=xxx.xxx.xxx.104:9090. listeners=xxx.xxx.xxx.105:9091.

Re: what are common ways to convert info on a web site into a log entry?

thanks! I will write my reply into the mail group once I have fiddled with your suggestions. James. > On Jan 15, 2018, at 2:20 PM, Jacob Sheck wrote: > > You will need to find or create something to accomplish this. Topics in > Kafka primarily act as queues. If you

Re: what are common ways to convert info on a web site into a log entry?

You will need to find or create something to accomplish this. Topics in Kafka primarily act as queues. If you search the web for more information about "kafka connector http" you will find a few projects that do this. You could also take a look at the Confluent S3 Connector as an example of how

what are common ways to convert info on a web site into a log entry?

Hi Kafka people, I am very new to kafka, so perhaps my question is naive. I spent some time searching around at resources of kafka but only became more confused. What are common ways to pull info from a web site and send to kafka to become a log entry? There is a web site that I want to pull a

Re: Insanely long recovery time with Kafka 0.11.0.2

Hello again, I had the same problem again today. While stopping the broker it crashed, then after upgrading to 0.11.0.2 and restarting the broker it's again taking a really long time to recover. It's been almost 3 hours now and it's not done. I restarted the previous broker which crashed, but

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

Hi Matthias, I read the KIP and it will be very helpful thanks to the changes, I don't see though a part that handle topologies that use avro schemas, is it in the scope of the KIP ? I open an issue two month ago in the schema-registry repo :

Re: Insanely long recovery time with Kafka 0.11.0.2

Hi James, There was a bug in 0.11.0.0 that could cause all segments to be scanned during a restart. I believe that was fixed in subsequent 0.11.0.x releases. Ismael On Fri, Jan 12, 2018 at 6:49 AM, James Cheng wrote: > We saw this as well, when updating from 0.10.1.1 to