[
https://issues.apache.org/jira/browse/IGNITE-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536755#comment-14536755
]
Dmitriy Setrakyan commented on IGNITE-536:
------------------------------------------
Keith,
Sorry for a bit of a late reply (somehow I missed your initial comment).
There is plenty of user-based documentation for streaming and caching on Ignite
website. There are also many examples in {{examples}} module. I would start
from there. Once you get familiar, please post your thoughts here with design
notes for Kinesis integration (it should be in line with other streaming work
handled under IGNITE-108).
Once we agree on the design notes, I will add you to Ignite contributors and
assign this ticket to you.
> Implement IgniteKinesisStreamer to stream data from Amazon Kinesis service
> --------------------------------------------------------------------------
>
> Key: IGNITE-536
> URL: https://issues.apache.org/jira/browse/IGNITE-536
> Project: Ignite
> Issue Type: Sub-task
> Components: streaming
> Reporter: Dmitriy Setrakyan
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under
> high load. It was previously named {{IgniteDataLoader}}, see ticket
> IGNITE-394.
> See [Amazon Kinesis|http://aws.amazon.com/kinesis/] site for more info.
> We should create {{IgniteKinesisStreamer}} which will consume messages from
> Amazon Kinesis and stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert Kinesis messages to Ignite data using an optional pluggable
> converter. If not provided, we should have some default mechanism.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
