Kafka with EBS on AWS : Raid-0 striping or multiple dirs in log.dirs

2018-02-20 Thread Somasundaram Sekar
AWS confluent quickstart configures Kafka log.dirs with 4 - 512GB EBS block devices with RAID-0 striping for higher throughput and also helps bypass the 1TB limit of block devices without provisioned IOPS. I have just come across

Unable to start Sink connectors[Confluent Kafka]

2017-12-19 Thread Somasundaram Sekar
Starting Sink connector on Confluent Kafka setup throws up the below exception, understand that it is because of some configured interceptor, any advice on how to disable it? [2017-12-20 06:51:11,235] ERROR Task {} failed initialization and will not be started.

KStream: Error Reading and Writing Avro records

2017-12-07 Thread Somasundaram Sekar
I’m trying to write avro record that I read from a topic into another topic, intentions it to augment it with transformation after I get this routing working. I have used the KStream with avro code from one of the example with some modifications to connect to Schema Registry for retrieving the