Re: Reading avro encoded message key from kafka

2018-11-27 Thread Ashwin Konale
Hi, Thanks a lot for the suggestion. I didn’t know about jsonpath EL functions. I can easily implement that in my use case. - Ashwin On 2018/11/27 18:52:05, Bryan Bende wrote: > Unfortunately I don't think there is a good way to interpret the value> > of the key when it is Avro because we

Re: Reading avro encoded message key from kafka

2018-11-27 Thread Bryan Bende
Unfortunately I don't think there is a good way to interpret the value of the key when it is Avro because we don't have any expression language functions that understand Avro or record-oriented values. The main option would be to change how the data is being produced in some way... - Put the

Re: Reading avro encoded message key from kafka

2018-11-27 Thread Ashwin Konale
Hi, Its not encoding issue. I am not able to figure out how to read Kafka key itself. eg. Kafka key = {type: foo, meta: etc, etc } Kafka message = {Avro Payload} I want to use RouteOnAttribute processor based on type = foo or bar. For this to happen, I need to extract value foo from Kafka.key

Re: Reading avro encoded message key from kafka

2018-11-23 Thread Mike Thomsen
Configure the producer to encode the key with that, not the message contents. On Fri, Nov 23, 2018 at 10:14 AM Mike Thomsen wrote: > If you are having encoding-related issues with reading that attribute, try > switching to the Kafka string serializer in your producer. > > On Fri, Nov 23, 2018

Re: Reading avro encoded message key from kafka

2018-11-23 Thread Mike Thomsen
If you are having encoding-related issues with reading that attribute, try switching to the Kafka string serializer in your producer. On Fri, Nov 23, 2018 at 10:12 AM ashwin konale wrote: > Hi, > I have key-value pair of avro messages in kafka topic I want to consume > from. I can easily do

Reading avro encoded message key from kafka

2018-11-23 Thread ashwin konale
Hi, I have key-value pair of avro messages in kafka topic I want to consume from. I can easily do modifications on message value using nifi consumeKafkaRecord processor, but it doesnt show key of the message. ConsumeKafka processor has kafka.key attribute but I am not sure how to read its