RE: kafka connect stops consuming data when kafka broker goes down

2019-06-07 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
that is very nearly approved: https://github.com/apache/kafka/pull/6283 Paul > On Jun 5, 2019, at 1:26 AM, Srinivas, Kaushik (Nokia - IN/Bangalore) > wrote: > > Hello, > Anyone has any information on this issue. > Created a critical ticket for the same, since this is a maj

RE: kafka connect stops consuming data when kafka broker goes down

2019-06-05 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hello, Anyone has any information on this issue. Created a critical ticket for the same, since this is a major stability issue for connect framework. https://issues.apache.org/jira/browse/KAFKA-8485?filter=-2 Thanks. Kaushik, NOKIA From: Srinivas, Kaushik (Nokia - IN/Bangalore) Sent: Monday

kafka connect stops consuming data when kafka broker goes down

2019-06-03 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hello kafka dev, We are encountering an issue when kafka connect is running hdfs sink connector pulling data from kafka and writing to hdfs location. In between when the data is flowing in the pipeline from producer -> kafka topic -> kafka connect hdfs sink connector -> hdfs, If even one of the

Backup and Restore of kafka broker with zookeeper

2019-05-22 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi All, We are trying to do a backup of kafka + zookeeper data and restore the same back for one of our application's use case. We are taking below steps for the same, 1. Take folder contents back up of data and log directories for kafka and zookeeper. 2. Delete the kafka zookeepers and

kafka Build fail - jdk 8 - #18041

2018-11-29 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi All, Facing below build failure. 20:19:43 20:19:43 > Task :streams:test-utils:integrationTest 20:19:43 > Task :streams:upgrade-system-tests-0100:integrationTest 20:19:43 > Task :streams:upgrade-system-tests-0101:integrationTest 20:19:43 > Task

kafka jenkins build fail - JDK 8 and Scala 2.11

2018-11-29 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi All, Have created a pull request with changes to kafka performance producer java code. But Build has failed with below errors for JDK 8 and Scala 2.11, kafka.api.SaslSslAdminClientIntegrationTest > testMinimumRequestTimeouts FAILED 19:20:31 java.lang.AssertionError: Expected an

gradle build is failing with repo urls unable to resolve

2018-11-23 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi All, Am facing issue when trying to build with gradle kafka repo locally. Below is the error am hitting, > Could not GET 'http://dl.bintray.com/content/netflixoss/external-g radle-plugins/gradle/plugin/com/github/spotbugs/spotbugs-gradle-plugin/1.6.5/spo

RE: Kafka Performance Producer - Extension

2018-11-15 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi Colin, Did u get a chance to review the document. -kaushik -Original Message- From: Srinivas, Kaushik (Nokia - IN/Bangalore) Sent: Friday, November 09, 2018 11:48 AM To: 'dev@kafka.apache.org' ; 'cmcc...@apache.org' Subject: RE: Kafka Performance Producer - Extension Attaching

RE: Kafka Performance Producer - Extension

2018-11-08 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Attaching the pdf file with summary of features implemented in our kafka producer application. Kindly review and provide the feedback. -kaushik -Original Message- From: Srinivas, Kaushik (Nokia - IN/Bangalore) Sent: Friday, November 09, 2018 11:00 AM To: dev@kafka.apache.org; 'cmcc

RE: Kafka Performance Producer - Extension

2018-11-08 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
, Srinivas, Kaushik (Nokia - IN/Bangalore) wrote:> Hi All, > > This is in regard to extend few features support for java kafka > performance producer.> Hi Kaushik, Have you created a pull request against the Kafka repo at https://github.com/apache/kafka/ ? I also sugge

Kafka Performance Producer - Extension

2018-11-08 Thread Srinivas, Kaushik (Nokia - IN/Bangalore)
Hi All, This is in regard to extend few features support for java kafka performance producer. We have a kafka producer application written in java with maven build. Attaching the documentation which gives detailed description of features supported by this application as of now. Would like to