Thanks for the guidance. Looking forward to add kafka support into SAMOA. Regards, Tarush
On Mon, Feb 1, 2016 at 4:37 PM, Paris Carbone <[email protected]> wrote: > Here’s a pointer to Kafka consumers/producers in Apache Flink, in case it > helps > > https://github.com/apache/flink/tree/master/flink-streaming-connectors > > cheers > Paris > > On 31 Jan 2016, at 14:32, Gianmarco De Francisci Morales <[email protected] > <mailto:[email protected]>> wrote: > > Hi Tarush, > Indeed, we do not have support for Kafka yet. > It would be great to add it! > > For the reading part of the code itself, the best place to look into is > other projects that use Kafka, e.g., Flink. Or even Kafka's examples. > For the adaptation to SAMOA, the best place to start from is the code for > the HSDF and local files (HDFSFileStreamSource and LocalFileStreamSource). > > One tough design point is how to reuse the readers available in each > platform while keeping the API towards SAMOA unified, without needing to > rewrite all the code. > > Hope it helps! > > -- Gianmarco > > On 19 January 2016 at 21:05, tarush grover <[email protected] > <mailto:[email protected]>> wrote: > > Hi All, > > Needed guidelines for starting on this issue. I am not seeing any code for > Kafka in the master branch. > > Regards, > Tarush > > >
