[ https://issues.apache.org/jira/browse/COMDEV-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
duheng updated COMDEV-342: -------------------------- Description: h3. Context There are many ways that Apache Flink and Apache RocketMQ can integrate to provide elastic data processing at a large scale. RocketMQ can be used as a streaming source and streaming sink in Flink DataStream applications, which is the main implementation and popular usage in RocketMQ community. Developers can ingest data from RocketMQ into a Flink job that makes computations and processes real-time data, to then send the data back to a RocketMQ topic as a streaming sink. More details you could see from [https://github.com/apache/rocketmq-externals/tree/master/rocketmq-flink]. With more and more DW or OLAP engineers using RocketMQ for their data processing work, another potential integration needs arose. Developers can take advantage of as both a streaming source and a streaming table sink for Flink SQL or Table API queries. Also, Flink 1.9.0 makes the Table API a first-class citizen. It's time to support SQL in RocketMQ. This is the topic for Apache RocketMQ connect Flink. h3. You should learn before applying for this topic Apache RocketMQ Flink Connector Apache Flink Table API h3. Extension For some expertise students in the streaming field, you could continue to implements and provides an exactly-once streaming source and at-least-once(or exactly-once)streaming sink, like the issue [#500|https://github.com/apache/rocketmq-externals/issues/500] said. h3. Mentor [nicholasji...@apache.org|mailto:nicholasji...@apache.org] [, duhengfore...@apache.org|mailto:duhengfore...@apache.org], [vongosl...@apache.org|mailto:vongosl...@apache.org] was: h3. Context There are many ways that Apache Flink and Apache RocketMQ can integrate to provide elastic data processing at a large scale. RocketMQ can be used as a streaming source and streaming sink in Flink DataStream applications, which is the main implementation and popular usage in RocketMQ community. Developers can ingest data from RocketMQ into a Flink job that makes computations and processes real-time data, to then send the data back to a RocketMQ topic as a streaming sink. More details you could see from [https://github.com/apache/rocketmq-externals/tree/master/rocketmq-flink]. With more and more DW or OLAP engineers using RocketMQ for their data processing work, another potential integration needs arose. Developers can take advantage of as both a streaming source and a streaming table sink for Flink SQL or Table API queries. Also, Flink 1.9.0 makes the Table API a first-class citizen. It's time to support SQL in RocketMQ. This is the topic for Apache RocketMQ connect Flink. h3. You should learn before applying for this topic Apache RocketMQ Flink Connector Apache Flink Table API h3. Extension For some expertise students in the streaming field, you could continue to implements and provides an exactly-once streaming source and at-least-once(or exactly-once)streaming sink, like the issue [#500|https://github.com/apache/rocketmq-externals/issues/500] said. h3. Mentor [|mailto:duhengfore...@apache.org] [nicholasji...@apache.org|mailto:nicholasji...@apache.org] [, duhengfore...@apache.org|mailto:duhengfore...@apache.org], [vongosl...@apache.org|mailto:vongosl...@apache.org] > Apache RocketMQ Connect Flink > ----------------------------- > > Key: COMDEV-342 > URL: https://issues.apache.org/jira/browse/COMDEV-342 > Project: Community Development > Issue Type: Wish > Components: GSoC/Mentoring ideas > Reporter: duheng > Priority: Major > Labels: RocketMQ, gsoc2020 > > h3. Context > There are many ways that Apache Flink and Apache RocketMQ can integrate to > provide elastic data processing at a large scale. RocketMQ can be used as a > streaming source and streaming sink in Flink DataStream applications, which > is the main implementation and popular usage in RocketMQ community. > Developers can ingest data from RocketMQ into a Flink job that makes > computations and processes real-time data, to then send the data back to a > RocketMQ topic as a streaming sink. More details you could see from > [https://github.com/apache/rocketmq-externals/tree/master/rocketmq-flink]. > With more and more DW or OLAP engineers using RocketMQ for their data > processing work, another potential integration needs arose. Developers can > take advantage of as both a streaming source and a streaming table sink for > Flink SQL or Table API queries. Also, Flink 1.9.0 makes the Table API a > first-class citizen. It's time to support SQL in RocketMQ. This is the topic > for Apache RocketMQ connect Flink. > h3. You should learn before applying for this topic > Apache RocketMQ Flink Connector > Apache Flink Table API > h3. Extension > For some expertise students in the streaming field, you could continue to > implements and provides an exactly-once streaming source and at-least-once(or > exactly-once)streaming sink, like the issue > [#500|https://github.com/apache/rocketmq-externals/issues/500] said. > h3. Mentor > [nicholasji...@apache.org|mailto:nicholasji...@apache.org] [, > duhengfore...@apache.org|mailto:duhengfore...@apache.org], > [vongosl...@apache.org|mailto:vongosl...@apache.org] -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org