[
https://issues.apache.org/jira/browse/NIFI-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872024#comment-15872024
]
Joseph Witt commented on NIFI-3498:
-----------------------------------
[~peter_wilson] I feel like we've addressed this before but not seeing it right
at the moment. I would say that a great deal of refactoring and optimizing and
improvements in general have gone into all things Kafka both consume and
publish with NiFi in the 1.x line.
> PublishKafka processor incorrectly routing to success when it fails to write
> to kafka
> -------------------------------------------------------------------------------------
>
> Key: NIFI-3498
> URL: https://issues.apache.org/jira/browse/NIFI-3498
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Peter Wilson
>
> We were testing potential failure scenerios for our data ingestion process
> which contains NiFi writing to Kafka using the PublishKafka processor. One of
> our tests were to see how NiFi would respond if the Kafka brokers went down.
> We have implemented a failure loop to ensure data does not get dropped if
> they were unsuccessful in publishing. When we turned off the kafka broker, we
> noticed the messages weren't being routed to failure and were instead being
> treated as a successful message even though they weren't successful:
> e.g. log (Note, i've edited the ids):
> 2017-02-17 08:17:37,859 INFO [Timer-Driven Process Thread-4]
> o.a.n.p.kafka.pubsub.PublishKafka PublishKafka[id=id] Successfully sent
> StandardFlowFileRecord[uuid=uuid,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=id, container=default, section=19],
> offset=157241, length=23661],offset=0,name=filename,size=23661] to Kafka as 0
> message(s) in 30001 millis
> we would've expected this scenerio to be a failure. The NiFi processor's
> Delivery Guarantee is set to "Guarantee Replicated Delivery" so we don't
> expect to lose anything within the flow. Is there a fix for this?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
