[
https://issues.apache.org/jira/browse/BEAM-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17076287#comment-17076287
]
Kyle Winkelman commented on BEAM-2466:
--------------------------------------
You can take a look at [https://beam.apache.org/contribute/runner-guide/]. In
my branch you should look at PipelineTranslator as the main class that helps in
translating, then ParDoTransformTranslator, GroupByKeyTransformTranslator,
WindowTransformTranslator, FlattenTransformTranslator, and
ImpulseTransformTranslator from
[https://github.com/kyle-winkelman/beam/tree/kafka-streams/runners/kafka-streams/src/main/java/org/apache/beam/runners/kafkastreams/translation].
They are kind of the core pieces described in the Runner Authoring Guide.
After that you can dig into the state and sideinput directories as they are
some of the more advance things you can do in a ParDo. I have added some
JavaDocs to explain how they are implemented and there are some JavaDocs in
other areas too (if you're lucky).
If I remember correctly, I was able to get the testReadWrite and testGroupByKey
unit tests to run, but I stalled out trying to get testPCollectionView to work.
I think it would be valuable for you to pull in tests for example from
/sdks/java/testing/nexmark to see what I have working and what I don't.
> Add Kafka Streams runner
> ------------------------
>
> Key: BEAM-2466
> URL: https://issues.apache.org/jira/browse/BEAM-2466
> Project: Beam
> Issue Type: Wish
> Components: runner-ideas
> Reporter: Lorand Peter Kasler
> Assignee: Kyle Winkelman
> Priority: Minor
>
> Kafka Streams (https://kafka.apache.org/documentation/streams) has more and
> more features that could make it a viable candidate for a streaming runner.
> It uses DataFlow-like model
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
