Hi Mich,
Yes, i managed to resolve this one. The issue was because the way described in
the docs
doesn't work properly as in order for the Flume part to be notified you need to
set the
storageLevel on the PollingStream like
JavaReceiverInputDStream<SparkFlumeEvent> flumeStream =
FlumeUtils.createPollingStream(ssc, addresses,
StorageLevel.MEMORY_AND_DISK_SER_2(), 100, 10);
After setting this, the data is correclty maked as processed by the SPARK
reveiver and the
Flume sink is notified.
-Ian
> Hi Ian,
>
> Has this been resolved?
>
> How about data to Flume and then Kafka and Kafka streaming into Spark?
>
> Thanks
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn *
> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABU
> rV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOAB
> UrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
