Eric Wong created NIFI-10634:
--------------------------------

             Summary: ConsumeKinesisStream.java exception while connect/consume 
from AWS kinesis
                 Key: NIFI-10634
                 URL: https://issues.apache.org/jira/browse/NIFI-10634
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
         Environment: https://hub.docker.com/layers/apache/nifi/1.17.0/images
            Reporter: Eric Wong


Dear Nifi community,

This is request for help and solution from apache nifi AWS Kinesis consumer.  

Following are info of official nifi version 1.17 from 2 month ago packaged in 
container

docker pull apache/nifi:1.17.0

[https://hub.docker.com/layers/apache/nifi/1.17.0/images]

Although similar Kinesis producer can always push message to AWS kinesis in 
same setup with correct configuration, when Kinesis consumer connect and pull 
from Kinesis, it always hit exception in nifi at 
{noformat}
ConsumeKinesisStream.java{noformat}
 unable to identify the cause of this exception with following in the log:
{code:java}
2022-09-23 22:07:50,498 ERROR [Timer-Driven Process Thread-7] 
o.a.n.p.a.k.stream.ConsumeKinesisStream 
ConsumeKinesisStream[id=5ca4f272-0183-1000-0000-000065d7aa17] Processing failed
2org.apache.nifi.processor.exception.ProcessException: Worker has shutdown 
unexpectedly, possibly due to a configuration issue; check logs for details
3       at 
org.apache.nifi.processors.aws.kinesis.stream.ConsumeKinesisStream.onTrigger(ConsumeKinesisStream.java:502)
4       at 
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1356)
5       at 
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:246)
6       at 
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102)
7       at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
8       at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
9       at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
10      at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
11      at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
12      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
13      at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
14      at java.lang.Thread.run(Thread.java:750) {code}
And there is no other additional info from nifi logs inside container.

Could you please help?  Or best to work with support directly so I can 
reproduce all.

thanks a lot!

Eric



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to