*Kafka processors

2017-07-27 Thread Laurens Vets
Hi list, Simple question really, which Kafka processor should I use to stream items into Kafka, more specifically, Kafka as it is used in Apache Metron 0.4.0. The sources are very small (1KB) JSON messages.

Re: *Kafka processors

2017-07-27 Thread Joe Witt
Lauren, The PublishKafka processor series is where we really dug into the details of the Kafka API and build the processors in a manner far more aligned to the Kafka style. They work well. The PublishKafkaRecord processor though is *really* nice in terms of performance and it means it is part of

Use Kafka processors with MSK/IAM

2022-07-19 Thread LEZIER Maxime (ITNOVEM)
Hello, I have to consume an MSK (kafka from aws) wich use IAM assume role for authentication. this does not seem to be supported by NiFi. I see there is an pull request for this. : https://github.com/apache/nifi/pull/5291#discussion_r724428821 but it look to be closed and the feature not imple

Re: Use Kafka processors with MSK/IAM

2022-07-20 Thread Edward Armes
Hi Max, Having a quick look through the PR, it looks like it was closed due to inactivity. All that probably needs to happen is for someone to check that the change is still good and then re-open the PR. If someone can pick this up, the contributor guidelines, ( https://cwiki.apache.org/confluen