[
https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982554#comment-14982554
]
Brian ONeill commented on SPARK-11198:
--------------------------------------
Hey guys, we are running against streams with aggregation. (using master, and
KCL version 1.4.0) From what I can tell, the records are not being
de-aggregated. In fact, this was the root cause of SPARK-11406. I'm going to
explore a fix for this.
> Support record de-aggregation in KinesisReceiver
> ------------------------------------------------
>
> Key: SPARK-11198
> URL: https://issues.apache.org/jira/browse/SPARK-11198
> Project: Spark
> Issue Type: New Feature
> Components: Streaming
> Reporter: Xiangrui Meng
> Assignee: Burak Yavuz
>
> We need to check/implement the support for record de-aggregation and
> subsequence number. This is the documentation from AWS:
> http://docs.aws.amazon.com/kinesis/latest/dev/kinesis-kpl-consumer-deaggregation.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
