[
https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14985701#comment-14985701
]
Burak Yavuz commented on SPARK-11198:
-------------------------------------
Just tested this. It works during regular operation, but doesn't de-aggregate
during recovery. The PR I added should de-aggregate in recovery.
> Support record de-aggregation in KinesisReceiver
> ------------------------------------------------
>
> Key: SPARK-11198
> URL: https://issues.apache.org/jira/browse/SPARK-11198
> Project: Spark
> Issue Type: New Feature
> Components: Streaming
> Reporter: Xiangrui Meng
> Assignee: Burak Yavuz
>
> We need to check/implement the support for record de-aggregation and
> subsequence number. This is the documentation from AWS:
> http://docs.aws.amazon.com/kinesis/latest/dev/kinesis-kpl-consumer-deaggregation.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
