Xiangrui Meng created SPARK-11127:
-------------------------------------
Summary: Upgrade Kinesis Client Library to the latest stable
version
Key: SPARK-11127
URL: https://issues.apache.org/jira/browse/SPARK-11127
Project: Spark
Issue Type: Improvement
Components: Streaming
Affects Versions: 1.6.0
Reporter: Xiangrui Meng
We use KCL 1.3.0 in the current master. KCL 1.4.0 added integration with
Kinesis Producer Library (KPL) and support auto de-aggregation. It would be
great to upgrade KCL to the latest stable version.
Note that the latest version is 1.6.1 and 1.6.0 restored compatibility with
dynamodb-streams-kinesis-adapter, which was broken in 1.4.0. See
https://github.com/awslabs/amazon-kinesis-client#release-notes.
[~tdas] [~brkyvz] Please recommend a version for upgrade.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
