Eric Wong created NIFI-10634: -------------------------------- Summary: ConsumeKinesisStream.java exception while connect/consume from AWS kinesis Key: NIFI-10634 URL: https://issues.apache.org/jira/browse/NIFI-10634 Project: Apache NiFi Issue Type: Bug Components: Extensions Environment: https://hub.docker.com/layers/apache/nifi/1.17.0/images Reporter: Eric Wong
Dear Nifi community, This is request for help and solution from apache nifi AWS Kinesis consumer. Following are info of official nifi version 1.17 from 2 month ago packaged in container docker pull apache/nifi:1.17.0 [https://hub.docker.com/layers/apache/nifi/1.17.0/images] Although similar Kinesis producer can always push message to AWS kinesis in same setup with correct configuration, when Kinesis consumer connect and pull from Kinesis, it always hit exception in nifi at {noformat} ConsumeKinesisStream.java{noformat} unable to identify the cause of this exception with following in the log: {code:java} 2022-09-23 22:07:50,498 ERROR [Timer-Driven Process Thread-7] o.a.n.p.a.k.stream.ConsumeKinesisStream ConsumeKinesisStream[id=5ca4f272-0183-1000-0000-000065d7aa17] Processing failed 2org.apache.nifi.processor.exception.ProcessException: Worker has shutdown unexpectedly, possibly due to a configuration issue; check logs for details 3 at org.apache.nifi.processors.aws.kinesis.stream.ConsumeKinesisStream.onTrigger(ConsumeKinesisStream.java:502) 4 at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1356) 5 at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:246) 6 at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102) 7 at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) 8 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 9 at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) 10 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) 11 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) 12 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 13 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 14 at java.lang.Thread.run(Thread.java:750) {code} And there is no other additional info from nifi logs inside container. Could you please help? Or best to work with support directly so I can reproduce all. thanks a lot! Eric -- This message was sent by Atlassian Jira (v8.20.10#820010)