[ 
https://issues.apache.org/jira/browse/FLINK-36280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

HunterXHunter updated FLINK-36280:
----------------------------------
    Description: 
[https://github.com/apache/flink-cdc/pull/2901]

 

I've encountered a few problems.

premise : 
 -  Only 1 record in my mysql.
 -  Flink 1.8.1
 -  flink cdc 3.1 & 3.2

{code:java}
//代码占位符
CREATE TEMPORARY TABLE mysql_cdc (
     id STRING,
     name string,
     dt string,
     PRIMARY KEY(id) NOT ENFORCED
     ) WITH (
     'connector' = 'mysql-cdc',
     'hostname' = 'localhost',
     'port' = '3306',
     'username' = 'root',
     'password' = '123456789',
     'database-name' = 'tt',
     'table-name' = 'mysql_cdc_source',
     'scan.startup.mode'='snapshot'); {code}
 
 * Not supporting `BATCH` execution mode ?, Set execution.runtime-mode=BATCH 
will met error.

{code:java}
[ERROR] Could not execute SQL statement. Reason:
org.apache.flink.table.api.TableException: Querying a table in batch mode is 
currently only possible for INSERT-only table sources. But the source for table 
'default_catalog.default_database.mysql_cdc' produces other changelog messages 
than just INSERT. {code}
 * When i set execution.runtime-mode=STREAMING  and checkpoint is disable , 
then the job won't be never finish. 

 # 
 ## if set execution.checkpointing.interval=60s, then job will be finished 
after checkpoint had triggered (60s)
 ## if set execution.checkpointing.interval=5s, then the job will be finished 
soon. (As expected)

 

!image-2024-10-24-14-20-07-691.png!

  was:
[https://github.com/apache/flink-cdc/pull/2901]

 

I've encountered a few problems.

premise : 
 -  Only 1 record in my mysql.
 -  Flink 1.8.1
 -  flink cdc 3.1 & 3.2

{code:java}
//代码占位符
CREATE TEMPORARY TABLE mysql_cdc (
     id STRING,
     name string,
     dt string,
     PRIMARY KEY(id) NOT ENFORCED
     ) WITH (
     'connector' = 'mysql-cdc',
     'hostname' = 'localhost',
     'port' = '3306',
     'username' = 'root',
     'password' = '123456789',
     'database-name' = 'tt',
     'table-name' = 'mysql_cdc_source',
     'scan.startup.mode'='snapshot'); {code}
 
 * Not supporting `BATCH` execution mode ?, Set execution.runtime-mode=BATCH 
will met error.

{code:java}
[ERROR] Could not execute SQL statement. Reason:
org.apache.flink.table.api.TableException: Querying a table in batch mode is 
currently only possible for INSERT-only table sources. But the source for table 
'default_catalog.default_database.mysql_cdc' produces other changelog messages 
than just INSERT. {code}
 * When i set execution.runtime-mode=STREAMING  and checkpoint is disable , 
then the job won't be never finish. 

 # 
 ## if set execution.checkpointing.interval=60s, then job will be finished 
after checkpoint had triggered (60s)
 ## if set execution.checkpointing.interval=5s, then the job will be finished 
soon. (As expected)

 


> Snapshot scan mode do not support batch execution mode, and not as expected 
> in mode streaming
> ---------------------------------------------------------------------------------------------
>
>                 Key: FLINK-36280
>                 URL: https://issues.apache.org/jira/browse/FLINK-36280
>             Project: Flink
>          Issue Type: Bug
>            Reporter: HunterXHunter
>            Priority: Major
>         Attachments: image-2024-10-24-14-16-17-434.png, 
> image-2024-10-24-14-17-07-675.png, image-2024-10-24-14-20-07-691.png
>
>
> [https://github.com/apache/flink-cdc/pull/2901]
>  
> I've encountered a few problems.
> premise : 
>  -  Only 1 record in my mysql.
>  -  Flink 1.8.1
>  -  flink cdc 3.1 & 3.2
> {code:java}
> //代码占位符
> CREATE TEMPORARY TABLE mysql_cdc (
>      id STRING,
>      name string,
>      dt string,
>      PRIMARY KEY(id) NOT ENFORCED
>      ) WITH (
>      'connector' = 'mysql-cdc',
>      'hostname' = 'localhost',
>      'port' = '3306',
>      'username' = 'root',
>      'password' = '123456789',
>      'database-name' = 'tt',
>      'table-name' = 'mysql_cdc_source',
>      'scan.startup.mode'='snapshot'); {code}
>  
>  * Not supporting `BATCH` execution mode ?, Set execution.runtime-mode=BATCH 
> will met error.
> {code:java}
> [ERROR] Could not execute SQL statement. Reason:
> org.apache.flink.table.api.TableException: Querying a table in batch mode is 
> currently only possible for INSERT-only table sources. But the source for 
> table 'default_catalog.default_database.mysql_cdc' produces other changelog 
> messages than just INSERT. {code}
>  * When i set execution.runtime-mode=STREAMING  and checkpoint is disable , 
> then the job won't be never finish. 
>  # 
>  ## if set execution.checkpointing.interval=60s, then job will be finished 
> after checkpoint had triggered (60s)
>  ## if set execution.checkpointing.interval=5s, then the job will be finished 
> soon. (As expected)
>  
> !image-2024-10-24-14-20-07-691.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to