[ https://issues.apache.org/jira/browse/NIFI-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Turcsanyi updated NIFI-12306: ----------------------------------- Status: Patch Available (was: Open) > ConsumeAzureEventHub should not log partition ownership changes at error level > ------------------------------------------------------------------------------ > > Key: NIFI-12306 > URL: https://issues.apache.org/jira/browse/NIFI-12306 > Project: Apache NiFi > Issue Type: Improvement > Reporter: Peter Turcsanyi > Assignee: Peter Turcsanyi > Priority: Minor > Fix For: 1.latest, 2.latest > > Time Spent: 10m > Remaining Estimate: 0h > > Azure Event Hub client instances run a load balancing algorithm which checks > the distribution of the partitions among the consumer group members and can > rebalance the partition assignments. > This algorithm runs independently on each client node and if the node owns > less partitions than the fair share (typically after start-up), it "steals" a > partition from another node. > The other node only recognizes it via the broken connection (2 consumers from > the same consumer group cannot consume the same partition at the same time) > so basically it is an error event on that side. It seems it is by design and > will not change in the Azure client lib. > However, we can handle this type of "error" differently on the NiFi side and > do not log it at error level but only info. The current error bulletin is > quite confusing for the user. > Error message: > {code:java} > 2023-11-01 13:19:46,613 ERROR [partition-pump-1-22] > o.a.n.p.a.eventhub.ConsumeAzureEventHub > ConsumeAzureEventHub[id=7d57cb75-018b-1000-0000-000042a1ec17] Receive Events > failed Namespace [turcsanyi-eventhub-ns.servicebus.windows.net] Event Hub > [turcsanyi-eventhub-2] Consumer Group [$default] Partition [1] > com.azure.core.amqp.exception.AmqpException: New receiver > '7661792b-acf1-49b8-9474-2ac06ebc22d9' with higher epoch of '0' is created > hence current receiver '8bec0a38-2d58-46d1-ac37-4cb80bd7ba29' with epoch '0' > is getting disconnected. If you are recreating the receiver, make sure a > higher epoch is used. > TrackingId:ddb15716000068bf0010179a6542425c_G13S3_B13S1, > SystemTracker:turcsanyi-eventhub-ns:eventhub:turcsanyi-eventhub-2~16383|$default, > Timestamp:2023-11-01T12:19:46, errorContext[NAMESPACE: > turcsanyi-eventhub-ns.servicebus.windows.net. ERROR CONTEXT: N/A, PATH: > turcsanyi-eventhub-2/ConsumerGroups/$default/Partitions/1, REFERENCE_ID: > 1_b1a39c_1698841180105, LINK_CREDIT: 300] > at > com.azure.core.amqp.implementation.ExceptionUtil.toException(ExceptionUtil.java:85) > at > com.azure.core.amqp.implementation.handler.LinkHandler.handleRemoteLinkClosed(LinkHandler.java:124) > ... > {code} > -- This message was sent by Atlassian Jira (v8.20.10#820010)