Re: streamer documentation

[Raul Kripalani]

Done. Cheers.

*Raúl Kripalani*
PMC & Committer @ Apache Ignite, Apache Camel | Integration, Big Data and
Messaging Engineer
http://about.me/raulkripalani | http://www.linkedin.com/in/raulkripalani
Blog: raul.io | twitter: @raulvk 

On Thu, Feb 11, 2016 at 6:31 AM, Denis Magda  wrote:

> Thanks Raul!
>
> Please don't forget to add the doc to both 1.5 and 1.6 [1], that has been
> recently created.
>
> [1] https://apacheignite.readme.io/v1.6
>
> --
> Denis
>
>
> On 2/11/2016 1:34 AM, Raul Kripalani wrote:
>
>> Hey guys,
>>
>> I'll take care of Camel and MQTT this week(end).
>>
>> Thanks for the patience.
>>
>> Cheers,
>> Raúl.
>>
>> On Tue, 2 Feb 2016 08:49 Denis Magda  wrote:
>>
>> Dmitriy,
>>>
>>> Raul contributed both Camel and MQTT.
>>> Twitter streamer was implemented by Lalit Kumar Jha.
>>>
>>> Actually I tried reach out both Raul and Lalit Kumar Jha earlier
>>> regarding this topic but seems that they were too busy because I didn't
>>> get any response from them.
>>>
>>> Raul, Lalit Kumar Jha, do you have time to add the documentation or
>>> someone else from the community should take care of this?
>>>
>>> Regards,
>>> Denis
>>>
>>> On 2/2/2016 11:42 AM, Dmitriy Setrakyan wrote:
>>>
 Denis,

 Is there any chance you can mention the names of the contributors, so we
 could reach out to them personally and ask for help with the

>>> documentation?
>>>
 I know that Camel streamer was done by Raul, but not sure about the
 other
 two.

 D.

 On Tue, Feb 2, 2016 at 12:37 AM, Denis Magda 

>>> wrote:
>>>
 The tickets are already there
>
> Twitter: https://issues.apache.org/jira/browse/IGNITE-2413
> MQTT: https://issues.apache.org/jira/browse/IGNITE-2411
> Camel: https://issues.apache.org/jira/browse/IGNITE-2530
>
> It would be perfect if Igniters who contributed this functionality will
> add the documentation as well.
>
> --
> Denis
>
>
> On 2/2/2016 11:31 AM, Dmitriy Setrakyan wrote:
>
> Igniters,
>>
>> I have been trying to find documentation for the following streamers
>>
> but
>>>
 couldn’t:
>>
>> - Camel
>> - MQTT
>> - Twitter
>>
>> Can I ask the contributors to document these features on readme?
>>
>> Thanks,
>> D.
>>
>>
>>
>>>
>

Integration with Apache Apex (incubating)

[Thomas Weise]

Dear Ignite community,

Apache Apex (http://apex.incubator.apache.org/) is an in-memory stream
processing and analytics platform, built for scalability, low-latency
processing, high availability and operability. It has a pipeline processing
architecture can be used for real-time and batch processing. Apex runs
natively on YARN and HDFS.

Typical Apex applications integrate with external systems: ingestion, state
saving, lookup data for processing, land compute results for downstream
consumers etc. The Malhar library has a wide range of connectors and
compute functions readily available to assemble Apex applications.

I wanted to see if there is interest to develop Ignite integrations as part
of Malhar. Some ideas:

   - Checkpointing (
   https://www.datatorrent.com/blog/blog-introduction-to-checkpoint/) could
   use the IGFS (possibly with Ignite native integration of the storage agent
   interface).
   - Compute results could be stored in Ignite (example dimension
   computation
   
https://www.datatorrent.com/blog/blog-dimensions-computation-aggregate-navigator-part-1-intro/
)
   - Enrichment/lookup could be implemented with Ignite as storage layer.

Thanks,
Thomas