[
https://issues.apache.org/jira/browse/SAMZA-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15488373#comment-15488373
]
Navina Ramesh commented on SAMZA-967:
-------------------------------------
Let's say we do repartitioning for a job that reads from Kafka and writes to
Kafka, how do you guarantee consistent result, now?
>> You are right. The ordering is not guaranteed. But it is consistent
>> everytime a replay a partition. That's what is missing here.
I have to admit that I don't have a good solution to your question as of now
>> That's alright. I don't see a good solution here, without imposing some
>> assumption on ordering of files. However, this will affect how downstreams
>> processors behave and is worth calling out in the code and design doc.
>> Thanks!
> Add HDFS system consumer to Samza
> ---------------------------------
>
> Key: SAMZA-967
> URL: https://issues.apache.org/jira/browse/SAMZA-967
> Project: Samza
> Issue Type: Sub-task
> Reporter: Hai
> Assignee: Hai
> Fix For: 0.12.0
>
> Attachments: HDFSSystemConsumer.pdf
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
