Hello, What version of Apache NiFi are you using?
Also, lets take Avro and kafka-avro-console-consumer out of the mix for a minute, what happens if you used PutKafka to send some plain text to Kafka, and then tried to consumer from that topic with GetKafka? You mentioned this didn't work, but what happened? was there an error message? did it just receive 0 messages from Kafka? Thanks, Bryan On Wed, Apr 6, 2016 at 6:10 AM, Ali Karray <c...@karray.net> wrote: > Hi, > > I'm exploring integration possibility of nifi processors with kafka. > I use PutKafka to puch avro generated flow from ExecuteSQL. > I verify that the topic created in Kafka is alimented with data using > kafka-console-consumer bash command. > Then I try to use getKafka processor to pull all the Data stored in > the kafka topic and store all that data in a local File using the > PutFile processor. I realize that the getKafka processor don't pull > the topic content. > > I verify if all is ok with kafka-avro-console-consumer (confluent > command), I get this exception : > org.apache.kafka.common.errors.SerializationException: Error > deserializing Avro message for id -1 > Caused by: org.apache.kafka.common.errors.SerializationException: > Unknown magic byte! > > I tested also getKafka from a basic topic format and it doesn't work for > me. > > So I have some questions : > How can I deal with avro format using getKafka anf putKafka processor ? > Any idea to resolve getKafka processor problem to pull content from a > kafka Topic ? > > > Thank you in advance > > A. Karray >
