[
https://issues.apache.org/jira/browse/NIFI-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18070907#comment-18070907
]
ASF subversion and git services commented on NIFI-15792:
--------------------------------------------------------
Commit 05ea8b959f8e2cf4d78f92942b8efb7fc163cddf in nifi's branch
refs/heads/main from Mark Payne
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=05ea8b959f8 ]
NIFI-15792 Added background message consumption in ConsumeKinesis (#11102)
Trigger background consumption of messages in ConsumeKinesis in such a way that
data is pulled immediately instead of waiting on session commit to complete;
when processor is stopped we also quickly bail out of our data gathering loop.
Also found in Stateless that ConsumeKinesis errors when needing to create the
DynamoDB table because stateless defaults to a 10 second timeout for
@OnScheduled while standard defaults to a 1 minute timeout so updated to 1 min
for stateless in order to make them consistent
Signed-off-by: David Handermann <[email protected]>
> ConsumeKinesis slow in stateless mode
> -------------------------------------
>
> Key: NIFI-15792
> URL: https://issues.apache.org/jira/browse/NIFI-15792
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Reporter: Mark Payne
> Assignee: Mark Payne
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> When ConsumeKinesis is run in stateless mode using Enhanced Fan-Out mode, I'm
> seeing it receive data very slowly - about 10% the rate at which it runs when
> in Standard / Stateful mode.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
