duheng created COMDEV-342:
-----------------------------
Summary: Apache RocketMQ Connect Flink
Key: COMDEV-342
URL: https://issues.apache.org/jira/browse/COMDEV-342
Project: Community Development
Issue Type: Wish
Components: GSoC/Mentoring ideas
Reporter: duheng
h3. Context
There are many ways that Apache Flink and Apache RocketMQ can integrate to
provide elastic data processing at a large scale. RocketMQ can be used as a
streaming source and streaming sink in Flink DataStream applications, which is
the main implementation and popular usage in RocketMQ community. Developers can
ingest data from RocketMQ into a Flink job that makes computations and
processes real-time data, to then send the data back to a RocketMQ topic as a
streaming sink. More details you could see from
[https://github.com/apache/rocketmq-externals/tree/master/rocketmq-flink].
With more and more DW or OLAP engineers using RocketMQ for their data
processing work, another potential integration needs arose. Developers can take
advantage of as both a streaming source and a streaming table sink for Flink
SQL or Table API queries. Also, Flink 1.9.0 makes the Table API a first-class
citizen. It's time to support SQL in RocketMQ. This is the topic for Apache
RocketMQ connect Flink.
h3. You should learn before applying for this topic
Apache RocketMQ Flink Connector
Apache Flink Table API
h3. Extension
For some expertise students in the streaming field, you could continue to
implements and provides an exactly-once streaming source and at-least-once(or
exactly-once)streaming sink, like the issue
[#500|https://github.com/apache/rocketmq-externals/issues/500] said.
h3. Mentor
[[email protected]|mailto:[email protected]],
[[email protected]|mailto:[email protected]]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
