Koji Kawamura created NIFI-4008: ----------------------------------- Summary: ConsumeKafkaRecord_0_10 assumes there is always one Record in a message Key: NIFI-4008 URL: https://issues.apache.org/jira/browse/NIFI-4008 Project: Apache NiFi Issue Type: Bug Components: Extensions Affects Versions: 1.2.0 Reporter: Koji Kawamura
ConsumeKafkaRecord_0_10 uses ConsumerLease underneath, and it [assumes there is one Record available in a consumed message|https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-0-10-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/ConsumerLease.java#L434] retrieved from a Kafka topic. But in fact, a message can contain 0 or more records in it. For example, with a record schema shown below: {code} { "type": "record", "name": "temp", "fields" : [ {"name": "value", "type": "string"} ] } {code} Multiple records can be sent within a single message, e.g. using JSON: {code} [{"value": "a"}, {"value": "b"}, {"value": "c"}] {code} But ConsumeKafkaRecord only outputs the first record '[{"value": "a"}]'. Also, if a message doesn't contain any record in it, the processor fails with NullPointerException. -- This message was sent by Atlassian JIRA (v6.3.15#6346)