Hi Inbasekaran,
welcome to our community.
Adding a Kafka channel would be of great value to the project. We are happy to
help you with that.
As Kaustubh mentioned get started with the basics of installing and running
some Wayang jobs.
Then, you could check how other channels are implemented, eg. the RDDchannel
for Spark that implements the abstract class Channel that Kaustubh mentioned
above.
Please let us know if you have any further questions.
Best
--
Zoi
Στις Τρίτη 12 Σεπτεμβρίου 2023 στις 03:55:55 π.μ. CEST, ο χρήστης Kaustubh
Beedkar <[email protected]> έγραψε:
Hi Inbasekaran,
That'd be great!
To get started with Wayang, I'd suggest getting familiar with the basics
following the readme/installation/getting started guide.
For getting your hands into the implementing Kafka-based channels,
https://github.com/apache/incubator-wayang/blob/main/wayang-commons/wayang-core/src/main/java/org/apache/wayang/core/plan/executionplan/Channel.java#L52
is a starting point.
Best
Kaustubh
On Tue, Sep 12, 2023 at 1:31 AM Inbasekaran Perumal <[email protected]>
wrote:
> Dear Apache Wayang Community,
>
> I'm a student studying ECE at NITK, and I'm enthusiastic about
> open-source software development. During my internship at Goldman
> Sachs, I had the chance to use Apache tools like Spark, AirFlow, and
> Kafka. I was impressed by their versatility and functionality.
>
> I'm keen to contribute to the Apache Software Foundation, and I find
> the Apache Wayang project particularly interesting and relevant to my
> skills and interests.
>
> I'd like to work on this feature request:
> https://issues.apache.org/jira/browse/GSOC-84, which involves
> implementing a new communication channel using Apache Kafka. I have
> some familiarity with Kafka APIs and have also reviewed the paper
> "RHEEMix in the Data Jungle" as mentioned.
>
> I kindly request the guidance of the community on how to proceed
> further. I'm eager to learn from the mentors and the community.
>
> Thank you for your time and attention.
>
> Sincerely,
> Inbasekaran Perumal
>
