Offsets in Kafka producer start with -1 for new topic

2017-10-29 Thread Thakrar, Jayesh
I created a new Kafka topic with 1 partition and then sent 10 messages using the KafkaProducer API using the async callback. What I saw was that the offsets in the RecordMetadata for the first record was -1. Shouldn't it be 0 as offsets start with 0? Is it a bug or works as expected? Thanks, Ja

Kafka Connect

2017-10-29 Thread Alexander Atanasov
Hello, I am trying to consume JSON messages and save it to HDFS and ingest it to table in HIVE. I have no problems doing that with AVRO files but I have troubles with JSON. Is there any way to add schema to the JSON in the consumer or consume it without schema? Also I can do it with spark but I