How to read AVRO data from Kafka using Flink
Hi All, I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38698721/how-to-read-avro-data-from-kafka-using-flink . Is there any mistake we can try to look into? Thanks & Regards Zeeshan Alam
How to read AVRO data from Kafka using Flink
Hi All, I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink . Is there any mistake we can try to look into or there a better way to read AVR data from Kafka using Flink? Thanks & Regards Zeeshan Alam
Re: How to read AVRO data from Kafka using Flink
I can tell you that we are reading Avro data from Kafka on Flink without problems. It seems like you have a mistake somewhere in your system. If I were you I would try your serialization & deserialization code in a simple program within the same JVM, then gradually add the other components in order to narrow down where the problem is coming from. Shannon From: "Alam, Zeeshan" mailto:zeeshan.a...@fmr.com>> Date: Tuesday, August 2, 2016 at 5:28 AM To: "user@flink.apache.org<mailto:user@flink.apache.org>" mailto:user@flink.apache.org>> Subject: How to read AVRO data from Kafka using Flink Hi All, I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink . Is there any mistake we can try to look into or there a better way to read AVR data from Kafka using Flink? Thanks & Regards Zeeshan Alam
RE: How to read AVRO data from Kafka using Flink
Hi Shannon, There was an issue with the data written in the Kafka topic, some were in JSON format and some in AVRO. I ran my code for a different Kafka topic where there was homogeneous data and my code worked fine. Thanks for your time. Thanks & Regards, Zeeshan Alam From: Shannon Carey [mailto:sca...@expedia.com] Sent: Tuesday, August 02, 2016 8:49 PM To: Alam, Zeeshan; user@flink.apache.org Subject: Re: How to read AVRO data from Kafka using Flink I can tell you that we are reading Avro data from Kafka on Flink without problems. It seems like you have a mistake somewhere in your system. If I were you I would try your serialization & deserialization code in a simple program within the same JVM, then gradually add the other components in order to narrow down where the problem is coming from. Shannon From: "Alam, Zeeshan" mailto:zeeshan.a...@fmr.com>> Date: Tuesday, August 2, 2016 at 5:28 AM To: "user@flink.apache.org<mailto:user@flink.apache.org>" mailto:user@flink.apache.org>> Subject: How to read AVRO data from Kafka using Flink Hi All, I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink . Is there any mistake we can try to look into or there a better way to read AVR data from Kafka using Flink? Thanks & Regards Zeeshan Alam