Dariusz Seweryn created NIFI-14360:
--------------------------------------
Summary: ConsumeKinesisStream enhanced fan-out
Key: NIFI-14360
URL: https://issues.apache.org/jira/browse/NIFI-14360
Project: Apache NiFi
Issue Type: Improvement
Components: Extensions
Affects Versions: 2.3.0
Reporter: Dariusz Seweryn
Kinesis Client Library (KCL) uses by default enhanced fan-out setting for
subscribing to streams. Currently ConsumeKinesisStream (CKS) overrides this
setting to polling strategy. To enhance throughput it should be possible to set
KCL to use enhanced fan-out for specific streams.
This change would need to specify streams by their ARN. Since this change would
add a new property it is advised to tackle after NIFI-14359 so it could
reference multiple streams right from the beginning.
Decision to make:
* make an implicit polling vs fan-out decision based on whether a stream name
(polling) or stream ARN (fan-out) was provided
* apart from stream ARN property add another one that would specify if for a
given stream polling or fan-out strategy should be used
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
