Li Wei created COMDEV-457:
-----------------------------
Summary: GSOC : Support sink to Clickhouse in Apache RocketMQ
Streams
Key: COMDEV-457
URL: https://issues.apache.org/jira/browse/COMDEV-457
Project: Community Development
Issue Type: New Feature
Components: GSoC/Mentoring ideas
Reporter: Li Wei
Apache RocketMQ™ is a unified messaging engine, lightweight data processing
platform,
* [Apache RocketMQ | https://rocketmq.apache.org]
Apache RocketMQ Streams is a Lightweight Streaming Project for RocketMQ , which
can be deployed separately or in cluster mode.
Various types of data input and output: source supports RocketMQ while sink
supports databases and RocketMQ, etc.
* [Apache RocketMQ Streams | https://github.com/apache/rocketmq-streams]
ClickHouse® is a column-oriented database management system (DBMS) for online
analytical processing of queries (OLAP). built by the creators of the fastest
OLAP database on Earth
* [ClickHouse | https://clickhouse.com/docs/en/]
- True Column-Oriented Database Management System
- Data Compression¶
- Disk Storage of Data
- Parallel Processing on Multiple Cores
- Distributed Processing on Multiple Servers
- SQL Support
- Vector Computation Engine
- Real-time Data Updates
- Primary Index
- Secondary Indexes
- Suitable for Online Queries
- Support for Approximated Calculations
- Adaptive Join Algorithm
- Data Replication and Data Integrity Support
- Role-Based Access Control
- Features that Can Be Considered Disadvantages
The Clickhouse Sink in RocketMQ allows moving data from RocketMQ to Clickhouse.
It writes data from topics in RocketMQ to tables in Clickhouse.
So, in this project, you need to implement a sink based on RocketMQ Streams
API, and will executed on RocketMQ Streams runtime.
You should learn before applying for this topic
- [Apache RocketMQ |https://rocketmq.apache.org/]
- [Clickhouse Docs| https://clickhouse.com/docs/en/]
- [Clickhouse on Github | https://github.com/ClickHouse/ClickHouse/]
- [Apache RocketMQ Streams | https://github.com/apache/rocketmq-streams]
Mentor
- [[email protected] |mailto:[email protected]]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
