[
https://issues.apache.org/jira/browse/IGNITE-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877229#comment-14877229
]
ASF GitHub Bot commented on IGNITE-530:
---------------------------------------
GitHub user sylentprayer opened a pull request:
https://github.com/apache/ignite/pull/102
IGNITE-530 development of Twitter data streamer
IGNITE-530 development of Twitter data streamer based on Twitter Streaming
API (public statuses).
This data streamer requires valid Twitter OAuth credentials, so tests are
skipped by default (in this module's pom.xml).
Need to set these OAuth keys in test/resources/twitter.properties and
enable tests.
Test covers only statuses filter API endpoint as firehose and site stream
requires special permissions.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sylentprayer/ignite ignite-530
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/ignite/pull/102.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #102
----
commit 8a4ef1419c2b8fd720be3a65b53f9a56a6eea524
Author: sylentprayer <un4given>
Date: 2015-09-19T17:41:49Z
IGNITE-530 development of Twitter data streamer based on Twitter Streaming
API (public statuses).
This data streamer requires valid Twitter OAuth credentials, so tests are
skipped by default (in this module's pom.xml).
Need to set these OAuth keys in test/resources/twitter.properties and
enable tests.
Test covers only statuses filter API endpoint as firehose and site stream
requires special permissions.
----
> Implement IgniteTwitterStreamer to stream data from Twitter feeds
> -----------------------------------------------------------------
>
> Key: IGNITE-530
> URL: https://issues.apache.org/jira/browse/IGNITE-530
> Project: Ignite
> Issue Type: Sub-task
> Components: streaming
> Reporter: Dmitriy Setrakyan
> Assignee: Lalit Kumar Jha
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under
> high load. It was previously named {{IgniteDataLoader}}, see ticket
> IGNITE-394.
> We should create {{IgniteTwitterStreamer}} which will consume messages from
> Twitter and stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert Twitter data to Ignite data using an optional pluggable converter.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
