[
https://issues.apache.org/jira/browse/NIFI-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fabien Sarcel updated NIFI-10739:
---------------------------------
Description:
ConsumeAMQP was working fine until 1.15.2 ({_}centos 7 & openjdk 1.8.0{_}), but
it fails with 1.16.3 and 1.18.0 ({_}I tried openjdk 1.8.0 and 1.11.0{_}).
I suspect that's related to "Framework Level Retry" introduced with 1.16:
~2022-10-31 10:37:05,663 WARN [Timer-Driven Process Thread-8]
o.a.n.controller.tasks.ConnectableTask Processing halted: uncaught exception in
Component [ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142]]~
~org.apache.nifi.processor.exception.FlowFileHandlingException:
StandardFlowFileRecord[uuid=25233bf6-17c7-4829-a3bd-72bf10059687,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1667211444369-19, container=default,
section=19], offset=2910879,
length=654],offset=0,name=25233bf6-17c7-4829-a3bd-72bf10059687,size=654]
transfer relationship not specified. This FlowFile was created in this session
and was not transferred to any Relationship via ProcessSession.transfer()~
~at
org.apache.nifi.controller.repository.StandardProcessSession.validateCommitState(StandardProcessSession.java:259)~
~at
org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:274)~
~at
org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:556)~
~at
org.apache.nifi.controller.repository.StandardProcessSession.commitAsync(StandardProcessSession.java:510)~
~at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:28)~
~at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1354)~
~at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:246)~
~at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102)~
~at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)~
~at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)~
~at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)~
~at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)~
~at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)~
~at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)~
~at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)~
~at java.lang.Thread.run(Thread.java:750)~
~2022-10-31 10:37:06,827 INFO [Timer-Driven Process Thread-5]
o.a.nifi.amqp.processors.ConsumeAMQP
ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142] Successfully connected
AMQPConsumer to amqp://***{*}@{*}**** and '***' queue~
~2022-10-31 10:37:09,050 INFO [Timer-Driven Process Thread-1]
o.a.n.p.store.WriteAheadStorePartition Successfully rolled over Event Writer
for Provenance Event Store
Partition[directory=/opt/nifi/conf/provenance_repository] due to
MAX_TIME_REACHED. Event File was 156.19 KB and contained 99 events.~
~2022-10-31 10:37:10,687 INFO [Clustering Tasks Thread-2]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-10-31
10:37:10,588 and sent to sprint-nifi-3:9876 at 2022-10-31 10:37:10,687;
determining Cluster Coordinator took 1 millis; DNS lookup for coordinator took
0 millis; connecting to coordinator took 1 millis; sending heartbeat took 93
millis; receiving first byte from response took 2 millis; receiving full
response took 3 millis; total time was 99 millis~
~2022-10-31 10:37:11,650 INFO [Cleanup Archive for default]
o.a.n.c.repository.FileSystemRepository Successfully deleted 0 files (0 bytes)
from archive~
~2022-10-31 10:37:11,650 INFO [Cleanup Archive for default]
o.a.n.c.repository.FileSystemRepository Archive cleanup completed for container
default; will now allow writing to this container. Bytes used = 22.25 GB, bytes
free = 80.98 GB, capacity = 103.23 GB~
~2022-10-31 10:37:11,837 ERROR [Timer-Driven Process Thread-5]
o.a.nifi.amqp.processors.ConsumeAMQP
ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142] Processor failure~
~java.lang.NullPointerException: null~
was:
ConsumeAMQP was working fine until 1.15.2 ({_}centos 7 & openjdk 1.8.0{_}), but
it fails with 1.16.3 and 1.18.0 ({_}I tried openjdk 1.8.0 and 1.11.0{_}).
I suspect that's related to "Framework Level Retry" introduced with 1.16:
2022-10-31 10:37:05,663 WARN [Timer-Driven Process Thread-8]
o.a.n.controller.tasks.ConnectableTask Processing halted: uncaught exception in
Component [ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142]]
org.apache.nifi.processor.exception.FlowFileHandlingException:
StandardFlowFileRecord[uuid=25233bf6-17c7-4829-a3bd-72bf10059687,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1667211444369-19, container=default,
section=19], offset=2910879,
length=654],offset=0,name=25233bf6-17c7-4829-a3bd-72bf10059687,size=654]
transfer relationship not specified. This FlowFile was created in this session
and was not transferred to any Relationship via ProcessSession.transfer()
at
org.apache.nifi.controller.repository.StandardProcessSession.validateCommitState(StandardProcessSession.java:259)
at
org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:274)
at
org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:556)
at
org.apache.nifi.controller.repository.StandardProcessSession.commitAsync(StandardProcessSession.java:510)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:28)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1354)
at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:246)
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022-10-31 10:37:06,827 INFO [Timer-Driven Process Thread-5]
o.a.nifi.amqp.processors.ConsumeAMQP
ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142] Successfully connected
AMQPConsumer to amqp://****@***** and '***' queue
2022-10-31 10:37:09,050 INFO [Timer-Driven Process Thread-1]
o.a.n.p.store.WriteAheadStorePartition Successfully rolled over Event Writer
for Provenance Event Store
Partition[directory=/opt/nifi/conf/provenance_repository] due to
MAX_TIME_REACHED. Event File was 156.19 KB and contained 99 events.
2022-10-31 10:37:10,687 INFO [Clustering Tasks Thread-2]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-10-31
10:37:10,588 and sent to sprint-nifi-3:9876 at 2022-10-31 10:37:10,687;
determining Cluster Coordinator took 1 millis; DNS lookup for coordinator took
0 millis; connecting to coordinator took 1 millis; sending heartbeat took 93
millis; receiving first byte from response took 2 millis; receiving full
response took 3 millis; total time was 99 millis
2022-10-31 10:37:11,650 INFO [Cleanup Archive for default]
o.a.n.c.repository.FileSystemRepository Successfully deleted 0 files (0 bytes)
from archive
2022-10-31 10:37:11,650 INFO [Cleanup Archive for default]
o.a.n.c.repository.FileSystemRepository Archive cleanup completed for container
default; will now allow writing to this container. Bytes used = 22.25 GB, bytes
free = 80.98 GB, capacity = 103.23 GB
2022-10-31 10:37:11,837 ERROR [Timer-Driven Process Thread-5]
o.a.nifi.amqp.processors.ConsumeAMQP
ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142] Processor failure
java.lang.NullPointerException: null
> ConsumeAMQP fails
> -----------------
>
> Key: NIFI-10739
> URL: https://issues.apache.org/jira/browse/NIFI-10739
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.16.3, 1.18.0
> Environment: centos 7 - openjdk 1.8 & openjdk 1.11
> Reporter: Fabien Sarcel
> Priority: Major
>
> ConsumeAMQP was working fine until 1.15.2 ({_}centos 7 & openjdk 1.8.0{_}),
> but it fails with 1.16.3 and 1.18.0 ({_}I tried openjdk 1.8.0 and 1.11.0{_}).
> I suspect that's related to "Framework Level Retry" introduced with 1.16:
> ~2022-10-31 10:37:05,663 WARN [Timer-Driven Process Thread-8]
> o.a.n.controller.tasks.ConnectableTask Processing halted: uncaught exception
> in Component [ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142]]~
> ~org.apache.nifi.processor.exception.FlowFileHandlingException:
> StandardFlowFileRecord[uuid=25233bf6-17c7-4829-a3bd-72bf10059687,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=1667211444369-19, container=default,
> section=19], offset=2910879,
> length=654],offset=0,name=25233bf6-17c7-4829-a3bd-72bf10059687,size=654]
> transfer relationship not specified. This FlowFile was created in this
> session and was not transferred to any Relationship via
> ProcessSession.transfer()~
> ~at
> org.apache.nifi.controller.repository.StandardProcessSession.validateCommitState(StandardProcessSession.java:259)~
> ~at
> org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:274)~
> ~at
> org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:556)~
> ~at
> org.apache.nifi.controller.repository.StandardProcessSession.commitAsync(StandardProcessSession.java:510)~
> ~at
> org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:28)~
> ~at
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1354)~
> ~at
> org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:246)~
> ~at
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102)~
> ~at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)~
> ~at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)~
> ~at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)~
> ~at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)~
> ~at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)~
> ~at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)~
> ~at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)~
> ~at java.lang.Thread.run(Thread.java:750)~
> ~2022-10-31 10:37:06,827 INFO [Timer-Driven Process Thread-5]
> o.a.nifi.amqp.processors.ConsumeAMQP
> ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142] Successfully connected
> AMQPConsumer to amqp://***{*}@{*}**** and '***' queue~
> ~2022-10-31 10:37:09,050 INFO [Timer-Driven Process Thread-1]
> o.a.n.p.store.WriteAheadStorePartition Successfully rolled over Event Writer
> for Provenance Event Store
> Partition[directory=/opt/nifi/conf/provenance_repository] due to
> MAX_TIME_REACHED. Event File was 156.19 KB and contained 99 events.~
> ~2022-10-31 10:37:10,687 INFO [Clustering Tasks Thread-2]
> o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-10-31
> 10:37:10,588 and sent to sprint-nifi-3:9876 at 2022-10-31 10:37:10,687;
> determining Cluster Coordinator took 1 millis; DNS lookup for coordinator
> took 0 millis; connecting to coordinator took 1 millis; sending heartbeat
> took 93 millis; receiving first byte from response took 2 millis; receiving
> full response took 3 millis; total time was 99 millis~
> ~2022-10-31 10:37:11,650 INFO [Cleanup Archive for default]
> o.a.n.c.repository.FileSystemRepository Successfully deleted 0 files (0
> bytes) from archive~
> ~2022-10-31 10:37:11,650 INFO [Cleanup Archive for default]
> o.a.n.c.repository.FileSystemRepository Archive cleanup completed for
> container default; will now allow writing to this container. Bytes used =
> 22.25 GB, bytes free = 80.98 GB, capacity = 103.23 GB~
> ~2022-10-31 10:37:11,837 ERROR [Timer-Driven Process Thread-5]
> o.a.nifi.amqp.processors.ConsumeAMQP
> ConsumeAMQP[id=a64f32ba-04e6-19d9-8318-52f12cc6f142] Processor failure~
> ~java.lang.NullPointerException: null~
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
