Re: [PR] [FLINK-34903][MySQL][Feature] Add mysql-pipeline-connector with table.exclude.list option to exclude unnecessary tables [flink-cdc]

[via GitHub]

shiyiky commented on code in PR #3186:
URL: https://github.com/apache/flink-cdc/pull/3186#discussion_r1560397213


##########
docs/content/docs/connectors/mysql.md:
##########
@@ -205,6 +205,16 @@ pipeline:
           <td>Integer</td>
           <td>The connection pool size.</td>
     </tr>
+    <tr>
+      <td>table.exclude.list</td>

Review Comment:
   
我赞同你的观点，但是大部分用户在进行整库通的过程中，他们用db.*来进行所有表数据的采集，然后希望排除部分表，用户希望的是简单复杂，用户写正则来匹配表，可能这对部分来说来说不如排除表来的简单。
   
我参考了部分基于cdc连接器的改造整库同步，他们都会有排除表这个选项，例如阿里云的cdas，doris的整库同步，paimon的整库同步，可能这个选项‘table.exclude.list’
 和debezium的参数保持太一致不太好，或许更名其他名字来区分二义性。
   
   
   doris's  link 
:https://doris.apache.org/docs/ecosystem/flink-doris-connector#use-flinkcdc-to-access-multiple-tables-or-the-entire-database-supports-mysql-oracle-postgresql-sqlserver
   
![image](https://github.com/apache/flink-cdc/assets/46524102/935eca97-a3af-4766-9ade-22092ab05fc3)
   
   paimon's link :https://paimon.apache.org/docs/0.7/cdc-ingestion/mysql-cdc/
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org