[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14985701#comment-14985701 ]
Burak Yavuz commented on SPARK-11198: ------------------------------------- Just tested this. It works during regular operation, but doesn't de-aggregate during recovery. The PR I added should de-aggregate in recovery. > Support record de-aggregation in KinesisReceiver > ------------------------------------------------ > > Key: SPARK-11198 > URL: https://issues.apache.org/jira/browse/SPARK-11198 > Project: Spark > Issue Type: New Feature > Components: Streaming > Reporter: Xiangrui Meng > Assignee: Burak Yavuz > > We need to check/implement the support for record de-aggregation and > subsequence number. This is the documentation from AWS: > http://docs.aws.amazon.com/kinesis/latest/dev/kinesis-kpl-consumer-deaggregation.html -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org