This is an automated email from the ASF dual-hosted git repository.
diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 2bec5485280 [fix](docs) Correct the parameter configuration errors in
the Flink connector documentation (#1200)
2bec5485280 is described below
commit 2bec5485280832768b8f617d37f40ab6eee971bf
Author: Petrichor <[email protected]>
AuthorDate: Thu Oct 31 10:50:15 2024 +0800
[fix](docs) Correct the parameter configuration errors in the Flink
connector documentation (#1200)
---
common_docs_zh/ecosystem/flink-doris-connector.md | 6 +++---
ecosystem/flink-doris-connector.md | 6 +++---
2 files changed, 6 insertions(+), 6 deletions(-)
diff --git a/common_docs_zh/ecosystem/flink-doris-connector.md
b/common_docs_zh/ecosystem/flink-doris-connector.md
index c16a821c6d5..1b21bdd8148 100644
--- a/common_docs_zh/ecosystem/flink-doris-connector.md
+++ b/common_docs_zh/ecosystem/flink-doris-connector.md
@@ -376,7 +376,7 @@ ON a.city = c.city
| Key | Default Value | Required | Comment
|
| --------------------------- | ------------- | --------
|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| sink.label-prefix | -- | Y | Stream load 导入使用的
label 前缀。2pc 场景下要求全局唯一,用来保证 Flink 的 EOS 语义。
|
-| sink.properties.* | -- | N | Stream Load
的导入参数。<br/>例如: 'sink.properties.column_separator' = ', ' 定义列分隔符,
'sink.properties.escape_delimiters' = 'true' 特殊字符作为分隔符,`\x01`会被转换为二进制的 0x01
<br/><br/>JSON 格式导入<br/>'sink.properties.format' = 'json'
'sink.properties.read_json_by_line' =
'true'<br/>详细参数参考[这里](../data-operate/import/stream-load-manual.md)。 |
+| sink.properties.* | -- | N | Stream Load
的导入参数。<br />例如: 'sink.properties.column_separator' = ', ' 定义列分隔符,
'sink.properties.escape_delimiters' = 'true' 特殊字符作为分隔符,`\x01`会被转换为二进制的 0x01 。
<br /><br />JSON 格式导入<br />'sink.properties.format' = 'json'
'sink.properties.read_json_by_line' = 'true'<br
/>详细参数参考[这里](../data-operate/import/stream-load-manual.md)。<br /><br />Group
Commit 模式 <br /> 例如:'sink.properties.group_commit' = 'sync_mode' 设置 group
commit 为同步模式。fl [...]
| sink.enable-delete | TRUE | N | 是否启用删除。此选项需要 Doris
表开启批量删除功能 (Doris0.15+ 版本默认开启),只支持 Unique 模型。
|
| sink.enable-2pc | TRUE | N | 是否开启两阶段提交 (2pc),默认为
true,保证 Exactly-Once
语义。关于两阶段提交可参考[这里](../data-operate/import/stream-load-manual.md)。
|
| sink.buffer-size | 1MB | N | 写数据缓存 buffer
大小,单位字节。不建议修改,默认配置即可
|
@@ -577,8 +577,8 @@ insert into doris_sink select id,name,bank,age from
cdc_mysql_source;
| --use-new-schema-change | 是否使用新的 schema change,支持同步 MySQL 多列变更、默认值,1.6.0
开始该参数默认为
true。参考[#167](https://github.com/apache/doris-flink-connector/pull/167)
|
| --schema-change-mode | 解析 schema change 的模式,支持
`debezium_structure`、`sql_parser` 两种解析模式,默认采用 `debezium_structure`
模式。<br/><br/> `debezium_structure` 解析上游 CDC 同步数据时所使用的数据结构,通过解析该结构判断 DDL 变更操作。
<br/> `sql_parser` 通过解析上游 CDC 同步数据时的 DDL 语句,从而判断 DDL 变更操作,因此该解析模式更加准确。<br/>
使用例子:`--schema-change-mode debezium_structure`<br/> 本功能将在 1.6.2.1 后的版本中提供
|
| --single-sink | 是否使用单个 Sink 同步所有表,开启后也可自动识别上游新创建的表,自动创建表。
|
-| --multi-to-one-origin |
将上游多张表写入同一张表时,源表的配置,比如:`--multi-to-one-origin="a\_.\*\|b_.\*"`,具体参考[#208](https://github.com/apache/doris-flink-connector/pull/208)
|
-| --multi-to-one-target | 与 multi-to-one-origin
搭配使用,目标表的配置,比如:`--multi-to-one-target="a\`|b"
|
+| --multi-to-one-origin | 将上游多张表写入同一张表时,源表的配置,比如:`--multi-to-one-origin
"a\_.\*\|b_.\*"`,具体参考[#208](https://github.com/apache/doris-flink-connector/pull/208)
|
+| --multi-to-one-target | 与 multi-to-one-origin
搭配使用,目标表的配置,比如:`--multi-to-one-target "a\`|b"
|
| --create-table-only | 是否只仅仅同步表的结构
|
:::info 备注
diff --git a/ecosystem/flink-doris-connector.md
b/ecosystem/flink-doris-connector.md
index 5e0fa9b5c2f..355a4a1ad42 100644
--- a/ecosystem/flink-doris-connector.md
+++ b/ecosystem/flink-doris-connector.md
@@ -368,7 +368,7 @@ ON a.city = c.city
| Key | Default Value | Required | Comment
|
| --------------------------- | ------------- | -------- |
------------------------------------------------------------ |
| sink.label-prefix | -- | Y | The label prefix
used by Stream load import. In the 2pc scenario, global uniqueness is required
to ensure Flink's EOS semantics. |
-| sink.properties.* | -- | N | Import parameters
for Stream Load. <br/>For example: 'sink.properties.column_separator' = ', '
defines column delimiters, 'sink.properties.escape_delimiters' = 'true' special
characters as delimiters, '\x01' will be converted to binary 0x01
<br/><br/>JSON format import<br/>'sink.properties.format' = 'json'
'sink.properties. read_json_by_line' = 'true'<br/>Detailed parameters refer to
[here](../data-operate/import/stream-load-manu [...]
+| sink.properties.* | -- | N | Import parameters
for Stream Load. <br />For example: 'sink.properties.column_separator' = ', '
defines column delimiters, 'sink.properties.escape_delimiters' = 'true' special
characters as delimiters, '\x01' will be converted to binary 0x01 <br /><br
/>JSON format import<br />'sink.properties.format' = 'json' 'sink.properties.
read_json_by_line' = 'true'<br />Detailed parameters refer to
[here](../data-operate/import/stream-load [...]
| sink.enable-delete | TRUE | N | Whether to enable
delete. This option requires the Doris table to enable the batch delete
function (Doris 0.15+ version is enabled by default), and only supports the
Unique model. |
| sink.enable-2pc | TRUE | N | Whether to enable
two-phase commit (2pc), the default is true, to ensure Exactly-Once semantics.
For two-phase commit, please refer to
[here](../data-operate/import/stream-load-manual.md). |
| sink.buffer-size | 1MB | N | The size of the
write data cache buffer, in bytes. It is not recommended to modify, the default
configuration is enough |
@@ -572,8 +572,8 @@ insert into doris_sink select id,name,bank,age from
cdc_mysql_source;
| --use-new-schema-change | Whether to use the new schema change to support
synchronization of MySQL multi-column changes and default values. since version
1.6.0, the default value has been set to true. Reference
[here](https://github.com/apache/doris-flink-connector/pull/167) |
| --schema-change-mode | The mode for parsing schema change supports two
parsing modes: `debezium_structure` and `sql_parser`. The default mode is
`debezium_structure`. <br/><br/> `debezium_structure` parses the data structure
used when upstream CDC synchronizes data, and determines DDL change operations
by parsing this structure. <br/> `sql_parser` determines the DDL change
operation by parsing the DDL statement when the upstream CDC synchronizes data,
so this parsing mode is more ac [...]
| --single-sink | Whether to use a single Sink to synchronize all
tables. When turned on, newly created tables in the upstream can also be
automatically recognized and tables automatically created. |
-| --multi-to-one-origin | When writing multiple upstream tables into the
same table, the configuration of the source table, for example:
--multi-to-one-origin="a\_.\*|b_.\*", Reference
[here](https://github.com/apache/doris-flink-connector/pull/208) |
-| --multi-to-one-target | Used with multi-to-one-origin, the configuration
of the target table, such as: --multi-to-one-target="a\|b" |
+| --multi-to-one-origin | When writing multiple upstream tables into the
same table, the configuration of the source table, for example:
--multi-to-one-origin "a\_.\*|b_.\*", Reference
[here](https://github.com/apache/doris-flink-connector/pull/208) |
+| --multi-to-one-target | Used with multi-to-one-origin, the configuration
of the target table, such as: --multi-to-one-target "a\|b" |
| --create-table-only | Whether only the table schema should be
synchronized |
:::info Note
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]