This is an automated email from the ASF dual-hosted git repository.
leonard pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-cdc.git
The following commit(s) were added to refs/heads/master by this push:
new 851c37e13 [FLINK-37654][docs][pipeline-connector/doris] Enhance Doris
connector docs with configuration details and type compatibility
851c37e13 is described below
commit 851c37e13d44181ffc3d06a7157972cb23401c4b
Author: Petrichor <[email protected]>
AuthorDate: Wed Apr 16 16:50:23 2025 +0800
[FLINK-37654][docs][pipeline-connector/doris] Enhance Doris connector docs
with configuration details and type compatibility
This closes #3987
---
.../docs/connectors/pipeline-connectors/doris.md | 28 +++++++++++++++++++++
.../connectors/pipeline-connectors/overview.md | 2 +-
.../docs/connectors/pipeline-connectors/doris.md | 29 ++++++++++++++++++++++
.../connectors/pipeline-connectors/overview.md | 4 +--
4 files changed, 60 insertions(+), 3 deletions(-)
diff --git a/docs/content.zh/docs/connectors/pipeline-connectors/doris.md
b/docs/content.zh/docs/connectors/pipeline-connectors/doris.md
index 4c442d814..98b9fb14f 100644
--- a/docs/content.zh/docs/connectors/pipeline-connectors/doris.md
+++ b/docs/content.zh/docs/connectors/pipeline-connectors/doris.md
@@ -133,6 +133,20 @@ pipeline:
<td>Boolean</td>
<td> 是否使用攒批方式写入Doris </td>
</tr>
+ <tr>
+ <td>sink.enable-delete</td>
+ <td>optional</td>
+ <td style="word-wrap: break-word;">true</td>
+ <td>Boolean</td>
+ <td>是否启用删除 </td>
+ </tr>
+ <tr>
+ <td>sink.max-retries</td>
+ <td>optional</td>
+ <td style="word-wrap: break-word;">3</td>
+ <td>Integer</td>
+ <td>写入失败后最大重试次数</td>
+ </tr>
<tr>
<td>sink.flush.queue-size</td>
<td>optional</td>
@@ -162,6 +176,13 @@ pipeline:
<td>String</td>
<td>Flush的间隔时长，超过这个时间，将异步Flush数据</td>
</tr>
+ <tr>
+ <td>sink.ignore.update-before</td>
+ <td>optional</td>
+ <td style="word-wrap: break-word;">true</td>
+ <td>Boolean</td>
+ <td>在CDC场景中，当上游的主键与下游的主键不一致时，需要将 update-before
数据作为已删除数据传递给下游，否则数据将无法被删除。默认设置为忽略，即执行 upsert 语义 </td>
+ </tr>
<tr>
<td>sink.properties.</td>
<td>optional</td>
@@ -279,6 +300,13 @@ pipeline:
<td>STRING</td>
<td></td>
</tr>
+ <tr>
+ <td>
+ TIME
+ </td>
+ <td>STRING</td>
+ <td> Doris 不支持 TIME 数据类型，需转换为 STRING 类型以兼容 </td>
+ </tr>
<tr>
<td>STRING</td>
<td>STRING</td>
diff --git a/docs/content.zh/docs/connectors/pipeline-connectors/overview.md
b/docs/content.zh/docs/connectors/pipeline-connectors/overview.md
index 92eeeb6e9..f06b5040e 100644
--- a/docs/content.zh/docs/connectors/pipeline-connectors/overview.md
+++ b/docs/content.zh/docs/connectors/pipeline-connectors/overview.md
@@ -32,7 +32,7 @@ Flink CDC 提供了可用于 YAML 作业的 Pipeline Source 和 Sink 连接器
| 连接器
| 类型 | 支持的外部系统
| 下载链接 [...]
|----------------------------------------------------------------------------------|--------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------
[...]
-| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}})
| Sink | <li> [Apache Doris](https://doris.apache.org/): 1.2.x, 2.x.x
| [3.3. [...]
+| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}})
| Sink | <li> [Apache Doris](https://doris.apache.org/): 1.2.x, 2.x.x,
3.x.x
| [3.3. [...]
| [Elasticsearch]({{< ref "docs/connectors/pipeline-connectors/elasticsearch"
>}}) | Sink | <li> [Elasticsearch](https://www.elastic.co/elasticsearch):
6.x, 7.x, 8.x
| [3.3. [...]
| [Kafka]({{< ref "docs/connectors/pipeline-connectors/kafka" >}})
| Sink | <li> [Kafka](https://kafka.apache.org/)
| [3.3. [...]
| [MySQL]({{< ref "docs/connectors/pipeline-connectors/mysql" >}})
| Source | <li> [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x <li>
[RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x <li>
[PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x <li>
[Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x <li>
[MariaDB](https://mariadb.org): 10.x <li> [PolarDB
X](https://github.com/ApsaraDB/galaxysql): 2.0.1 | [3.3. [...]
diff --git a/docs/content/docs/connectors/pipeline-connectors/doris.md
b/docs/content/docs/connectors/pipeline-connectors/doris.md
index ffa769da4..eaed1810e 100644
--- a/docs/content/docs/connectors/pipeline-connectors/doris.md
+++ b/docs/content/docs/connectors/pipeline-connectors/doris.md
@@ -133,6 +133,20 @@ pipeline:
<td>Boolean</td>
<td> Whether to use the batch method to write to Doris </td>
</tr>
+ <tr>
+ <td>sink.enable-delete</td>
+ <td>optional</td>
+ <td style="word-wrap: break-word;">true</td>
+ <td>Boolean</td>
+ <td>Whether to enable the delete function </td>
+ </tr>
+ <tr>
+ <td>sink.max-retries</td>
+ <td>optional</td>
+ <td style="word-wrap: break-word;">3</td>
+ <td>Integer</td>
+ <td>The max retry times if writing records to database failed. </td>
+ </tr>
<tr>
<td>sink.flush.queue-size</td>
<td>optional</td>
@@ -162,6 +176,14 @@ pipeline:
<td>String</td>
<td>Flush interval duration. If this time is exceeded, the data will be
flushed asynchronously</td>
</tr>
+ <tr>
+ <td>sink.ignore.update-before</td>
+ <td>optional</td>
+ <td style="word-wrap: break-word;">true</td>
+ <td>Boolean</td>
+ <td>In the CDC scenario, when the primary key of the upstream is
inconsistent with that of the downstream, the update-before data needs to be
passed to the downstream as deleted data, otherwise the data cannot be
deleted.\n"
+ + "The default is to ignore, that is,
perform upsert semantics.</td>
+ </tr>
<tr>
<td>sink.properties.</td>
<td>optional</td>
@@ -279,6 +301,13 @@ pipeline:
<td>STRING</td>
<td></td>
</tr>
+ <tr>
+ <td>
+ TIME
+ </td>
+ <td>STRING</td>
+ <td>Doris does not support the TIME data type, it needs to be converted
to STRING type for compatibility.</td>
+ </tr>
<tr>
<td>STRING</td>
<td>STRING</td>
diff --git a/docs/content/docs/connectors/pipeline-connectors/overview.md
b/docs/content/docs/connectors/pipeline-connectors/overview.md
index 839bb986b..29ff1902f 100644
--- a/docs/content/docs/connectors/pipeline-connectors/overview.md
+++ b/docs/content/docs/connectors/pipeline-connectors/overview.md
@@ -35,12 +35,12 @@ definition.
| Connector
| Supported Type | External System
[...]
|----------------------------------------------------------------------------------|----------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[...]
-| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}})
| Sink | <li> [Apache Doris](https://doris.apache.org/): 1.2.x,
2.x.x
[...]
+| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}})
| Sink | <li> [Apache Doris](https://doris.apache.org/): 1.2.x,
2.x.x, 3.x.x
[...]
| [Elasticsearch]({{< ref "docs/connectors/pipeline-connectors/elasticsearch"
>}}) | Sink | <li>
[Elasticsearch](https://www.elastic.co/elasticsearch): 6.x, 7.x, 8.x
[...]
| [Kafka]({{< ref "docs/connectors/pipeline-connectors/kafka" >}})
| Sink | <li> [Kafka](https://kafka.apache.org/)
[...]
| [MySQL]({{< ref "docs/connectors/pipeline-connectors/mysql" >}})
| Source | <li> [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x
<li> [RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x
<li> [PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x
<li> [Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x <li>
[MariaDB](https://mariadb.org): 10.x <li> [PolarDB
X](https://github.com/ApsaraDB/galaxysql): 2.0.1 [...]
| [OceanBase]({{< ref "docs/connectors/pipeline-connectors/oceanbase" >}})
| Sink | <li> [OceanBase](https://www.oceanbase.com/): 3.x, 4.x
[...]
-| [Paimon]({{< ref "docs/connectors/pipeline-connectors/paimon" >}})
| Sink | <li> [Paimon](https://paimon.apache.org/): 0.6, 0.7,
0.8, 0.9, 1.0
[...]
+| [Paimon]({{< ref "docs/connectors/pipeline-connectors/paimon" >}})
| Sink | <li> [Paimon](https://paimon.apache.org/): 0.6, 0.7,
0.8, 0.9, 1.0
[...]
| [StarRocks]({{< ref "docs/connectors/pipeline-connectors/starrocks" >}})
| Sink | <li> [StarRocks](https://www.starrocks.io/): 2.x, 3.x
[...]
| [MaxCompute]({{< ref "docs/connectors/pipeline-connectors/maxcompute" >}})
| Sink | <li>
[MaxCompute](https://www.aliyun.com/product/maxcompute)
[...]
