[
https://issues.apache.org/jira/browse/NIFI-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phil Lord updated NIFI-11322:
-----------------------------
Description:
Environment: Small 3-node cluster; 4GB Heap/4 Cores per node
See attachments referencing errors in both user.log and corresponding app.log.
I'm not sure if these errors might be resolved in some of the tickets being
addressed in 1.21.0? The only resolution was a restart of the node... attempts
to re-sync the node through a UI level connection request failed. Of note the
errors were seen within a Registry versioned ProcessGroup.
2023-03-21 02:43:16,574 INFO [Reconnect to Cluster]
o.a.nifi.controller.StandardFlowService Node disconnected due to Failed to
properly handle Reconnection request due to
org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed
to connect node to cluster because local flow controller partially updated.
Administrator should disconnect node and review flow for corruption.
2023-03-21 02:43:16,574 ERROR [Reconnect to Cluster]
o.a.nifi.controller.StandardFlowService Handling reconnection request failed
due to: org.apache.nifi.controller.serialization.FlowSynchronizationException:
Failed to connect node to cluster because local flow controller partially
updated. Administrator should disconnect node and review flow for corruption.
org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed
to connect node to cluster because local flow controller partially updated.
Administrator should disconnect node and review flow for corruption.
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1059)
at
org.apache.nifi.controller.StandardFlowService.handleReconnectionRequest(StandardFlowService.java:667)
at
org.apache.nifi.controller.StandardFlowService.access$200(StandardFlowService.java:107)
at
org.apache.nifi.controller.StandardFlowService$1.run(StandardFlowService.java:396)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by:
org.apache.nifi.controller.serialization.FlowSynchronizationException:
java.lang.IllegalStateException: Upstream component of Connection
(PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at
org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:447)
at
org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:205)
at
org.apache.nifi.controller.serialization.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:42)
at
org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1525)
at
org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:104)
at
org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:817)
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1028)
... 4 common frames omitted
Caused by: java.lang.IllegalStateException: Upstream component of Connection
(PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at
org.apache.nifi.connectable.StandardConnection.verifySourceStoppedOrFunnel(StandardConnection.java:529)
at
org.apache.nifi.connectable.StandardConnection.verifyCanDelete(StandardConnection.java:510)
at
org.apache.nifi.groups.StandardProcessGroup.removeConnection(StandardProcessGroup.java:1375)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.removeMissingConnections(StandardVersionedComponentSynchronizer.java:619)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:383)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronizeChildGroups(StandardVersionedComponentSynchronizer.java:537)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:411)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.lambda$synchronize$0(StandardVersionedComponentSynchronizer.java:255)
at
org.apache.nifi.controller.flow.AbstractFlowManager.withParameterContextResolution(AbstractFlowManager.java:550)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:253)
at
org.apache.nifi.groups.StandardProcessGroup.synchronizeFlow(StandardProcessGroup.java:3970)
at
org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:438)
... 10 common frames omitted
was:
Environment: Small 3-node cluster; 4GB Heap/4 Cores per node
See attachments referencing errors in both user.log and corresponding app.log.
I'm not sure if these errors might be resolved in some of the tickets being
addressed in 1.21.0? The only resolution was a restart of the node... attempts
to re-sync the node through a UI level connection request failed.
2023-03-21 02:43:16,574 INFO [Reconnect to Cluster]
o.a.nifi.controller.StandardFlowService Node disconnected due to Failed to
properly handle Reconnection request due to
org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed
to connect node to cluster because local flow controller partially updated.
Administrator should disconnect node and review flow for corruption.
2023-03-21 02:43:16,574 ERROR [Reconnect to Cluster]
o.a.nifi.controller.StandardFlowService Handling reconnection request failed
due to: org.apache.nifi.controller.serialization.FlowSynchronizationException:
Failed to connect node to cluster because local flow controller partially
updated. Administrator should disconnect node and review flow for corruption.
org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed
to connect node to cluster because local flow controller partially updated.
Administrator should disconnect node and review flow for corruption.
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1059)
at
org.apache.nifi.controller.StandardFlowService.handleReconnectionRequest(StandardFlowService.java:667)
at
org.apache.nifi.controller.StandardFlowService.access$200(StandardFlowService.java:107)
at
org.apache.nifi.controller.StandardFlowService$1.run(StandardFlowService.java:396)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by:
org.apache.nifi.controller.serialization.FlowSynchronizationException:
java.lang.IllegalStateException: Upstream component of Connection
(PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at
org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:447)
at
org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:205)
at
org.apache.nifi.controller.serialization.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:42)
at
org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1525)
at
org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:104)
at
org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:817)
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1028)
... 4 common frames omitted
Caused by: java.lang.IllegalStateException: Upstream component of Connection
(PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
at
org.apache.nifi.connectable.StandardConnection.verifySourceStoppedOrFunnel(StandardConnection.java:529)
at
org.apache.nifi.connectable.StandardConnection.verifyCanDelete(StandardConnection.java:510)
at
org.apache.nifi.groups.StandardProcessGroup.removeConnection(StandardProcessGroup.java:1375)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.removeMissingConnections(StandardVersionedComponentSynchronizer.java:619)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:383)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronizeChildGroups(StandardVersionedComponentSynchronizer.java:537)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:411)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.lambda$synchronize$0(StandardVersionedComponentSynchronizer.java:255)
at
org.apache.nifi.controller.flow.AbstractFlowManager.withParameterContextResolution(AbstractFlowManager.java:550)
at
org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:253)
at
org.apache.nifi.groups.StandardProcessGroup.synchronizeFlow(StandardProcessGroup.java:3970)
at
org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:438)
... 10 common frames omitted
> ClusterSynchronization errors
> -----------------------------
>
> Key: NIFI-11322
> URL: https://issues.apache.org/jira/browse/NIFI-11322
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.19.1
> Reporter: Phil Lord
> Priority: Major
> Attachments: CorrespondingApp.log, StackTraceFromUser.log
>
>
> Environment: Small 3-node cluster; 4GB Heap/4 Cores per node
> See attachments referencing errors in both user.log and corresponding
> app.log. I'm not sure if these errors might be resolved in some of the
> tickets being addressed in 1.21.0? The only resolution was a restart of the
> node... attempts to re-sync the node through a UI level connection request
> failed. Of note the errors were seen within a Registry versioned
> ProcessGroup.
> 2023-03-21 02:43:16,574 INFO [Reconnect to Cluster]
> o.a.nifi.controller.StandardFlowService Node disconnected due to Failed to
> properly handle Reconnection request due to
> org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed
> to connect node to cluster because local flow controller partially updated.
> Administrator should disconnect node and review flow for corruption.
> 2023-03-21 02:43:16,574 ERROR [Reconnect to Cluster]
> o.a.nifi.controller.StandardFlowService Handling reconnection request failed
> due to:
> org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed
> to connect node to cluster because local flow controller partially updated.
> Administrator should disconnect node and review flow for corruption.
> org.apache.nifi.controller.serialization.FlowSynchronizationException: Failed
> to connect node to cluster because local flow controller partially updated.
> Administrator should disconnect node and review flow for corruption.
> at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1059)
> at
> org.apache.nifi.controller.StandardFlowService.handleReconnectionRequest(StandardFlowService.java:667)
> at
> org.apache.nifi.controller.StandardFlowService.access$200(StandardFlowService.java:107)
> at
> org.apache.nifi.controller.StandardFlowService$1.run(StandardFlowService.java:396)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by:
> org.apache.nifi.controller.serialization.FlowSynchronizationException:
> java.lang.IllegalStateException: Upstream component of Connection
> (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
> at
> org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:447)
> at
> org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:205)
> at
> org.apache.nifi.controller.serialization.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:42)
> at
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1525)
> at
> org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:104)
> at
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:817)
> at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:1028)
> ... 4 common frames omitted
> Caused by: java.lang.IllegalStateException: Upstream component of Connection
> (PutS3Object[id=9fcf34ef-d59e-16bc-9e3c-7c619c5e40af]) is running
> at
> org.apache.nifi.connectable.StandardConnection.verifySourceStoppedOrFunnel(StandardConnection.java:529)
> at
> org.apache.nifi.connectable.StandardConnection.verifyCanDelete(StandardConnection.java:510)
> at
> org.apache.nifi.groups.StandardProcessGroup.removeConnection(StandardProcessGroup.java:1375)
> at
> org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.removeMissingConnections(StandardVersionedComponentSynchronizer.java:619)
> at
> org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:383)
> at
> org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronizeChildGroups(StandardVersionedComponentSynchronizer.java:537)
> at
> org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:411)
> at
> org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.lambda$synchronize$0(StandardVersionedComponentSynchronizer.java:255)
> at
> org.apache.nifi.controller.flow.AbstractFlowManager.withParameterContextResolution(AbstractFlowManager.java:550)
> at
> org.apache.nifi.flow.synchronization.StandardVersionedComponentSynchronizer.synchronize(StandardVersionedComponentSynchronizer.java:253)
> at
> org.apache.nifi.groups.StandardProcessGroup.synchronizeFlow(StandardProcessGroup.java:3970)
> at
> org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:438)
> ... 10 common frames omitted
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
