Re: Link read avro from Kafka Connect Issue

2016-11-03 Thread Dayong
Confirmed. It is Magic byte ahead of each avro message. I am able to get it flink consumer work. Thanks you, Dave :) Thanks, Dayong > On Nov 3, 2016, at 8:01 AM, Dayong wrote: > > Not quite sure, will try to find out today. > > Thanks, > Dayong > >> On Nov 2, 2016, at 9:59 PM, "Tauzell, Dave

Re: Link read avro from Kafka Connect Issue

2016-11-03 Thread Dayong
Not quite sure, will try to find out today. Thanks, Dayong > On Nov 2, 2016, at 9:59 PM, "Tauzell, Dave" > wrote: > > Is Kafka connect adding some bytes to the beginning of the avro with the > scheme registry id? > > Dave > >> On Nov 2, 2016, at 18:43, Will Du wrote: >> >> By using the ka

Re: Link read avro from Kafka Connect Issue

2016-11-02 Thread Tauzell, Dave
Is Kafka connect adding some bytes to the beginning of the avro with the scheme registry id? Dave > On Nov 2, 2016, at 18:43, Will Du wrote: > > By using the kafka-avro-console-consumer I am able to get rich message from > kafka connect with AvroConvert, but it got no output except schema from

Re: Link read avro from Kafka Connect Issue

2016-11-02 Thread Will Du
By using the kafka-avro-console-consumer I am able to get rich message from kafka connect with AvroConvert, but it got no output except schema from Flink By using the producer with defaultEncoding, the kafka-avro-console-consumer throws exceptions show how. But Flink consumer works. But my targ

Link read avro from Kafka Connect Issue

2016-11-02 Thread Will Du
On Nov 2, 2016, at 7:31 PM, Will Du wrote: Hi folks, I am trying to consume avro data from Kafka in Flink. The data is produced by Kafka connect using AvroConverter. I have created a AvroDeserializationSchema.java used by