Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
shangeyao commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-2213317177 > 合并到哪个版本了呢 3.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
mdzz9527 commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-2182073190 合并到哪个版本了呢 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
stardustman commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-2003140858 > > SchemaChangeEventHandler，这个接口在哪个版本里，我找了一下，最新版的flink-cdc-base 3.0.0 没有看到相关代码。是需要自己修改源码自己编译吗 > > oracle 表结构变动报错，用到oracle-cdc 3.0包，我这边也报错，请问你这边解决了吗 你好，你是实现 DebeziumDeserializationSchema 接口自定义 Deserialization 来接收数据的么? 在这里是怎样区分 DDL 和实际表的数据的呢？有没有脱敏的 demo 可以发一下？谢谢！@Jetol @e-mhui -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
e-mhui commented on PR #2315:
URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-1999166980
> > ```sql
> > debezium.database.history.store.only.captured.tables.ddl
> > ```
>
> I read the doc
[docs/connectors/cdc-connectors/oracle-cdc/#connector-options](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.0/zh/docs/connectors/cdc-connectors/oracle-cdc/#connector-options).
is it the config belongs to `debezium` should be started with "debezium" when
using the flink cdc? but I find the demo code
[cdc-connectors/oracle-cdc/#datastream-source](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.0/zh/docs/connectors/cdc-connectors/oracle-cdc/#datastream-source)
this line `debeziumProperties.setProperty("log.mining.strategy",
"online_catalog");` of the main method, `log.mining.strategy` didn't start with
the `debezium`, after read the
[log.mining.strategy](https://debezium.io/documentation/reference/1.9/connectors/oracle.html#oracle-property-log-mining-strategy)
it seems the property is belongs to debezium, and the `log.mining.strategy`
also need to be set `redo_log_catalog` to capture the DDL?
>
> ```java
> public static void main(String[] args) throws Exception {
> Properties debeziumProperties = new Properties();
> debeziumProperties.setProperty("log.mining.strategy",
"online_catalog");
> ```
>
> will the "log.mining.strategy" need to start with "debezium"? thanks a lot
for bothering you many times😄. @e-mhui
It is a parameter of debezium, so you should add the prefix `debezium.`.
https://github.com/apache/flink-cdc/assets/111486498/bb8c4dd3-b080-4011-a3a4-cc9a8dc79f2c";>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
stardustman commented on PR #2315:
URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-1999131455
> ```sql
> debezium.database.history.store.only.captured.tables.ddl
> ```
I read the doc
[docs/connectors/cdc-connectors/oracle-cdc/#connector-options](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.0/zh/docs/connectors/cdc-connectors/oracle-cdc/#connector-options).
is it the config belongs to `debezium` should be started with "debezium" when
using the flink cdc? but I find the demo code
[cdc-connectors/oracle-cdc/#datastream-source](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.0/zh/docs/connectors/cdc-connectors/oracle-cdc/#datastream-source)
this line `debeziumProperties.setProperty("log.mining.strategy",
"online_catalog");` of the main method, `log.mining.strategy` didn't start
with the `debezium`, after read the
[log.mining.strategy](https://debezium.io/documentation/reference/1.9/connectors/oracle.html#oracle-property-log-mining-strategy)
it seems the property is belongs to debezium, and the `log.mining.strategy`
also need to be set `redo_log_catalog` to capture the DDL?
```java
public static void main(String[] args) throws Exception {
Properties debeziumProperties = new Properties();
debeziumProperties.setProperty("log.mining.strategy",
"online_catalog");
```
will the "log.mining.strategy" need to start with "debezium"? thanks a lot
for bothering you many times😄. @e-mhui
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
e-mhui commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-1999087958 > > @stardustman @Jetol The latest release 3.0.1 was packaged on Jan 22 and has not fixed this issue. If you want to use it in advance, you can build it yourself from the master branch. Otherwise, you will have to wait for the next release version. > > package command: > > ``` > > git clone https://github.com/ververica/flink-cdc-connectors.git > > cd flink-cdc-connectors > > mvn clean install -DskipTests > > ``` > > hello, I'm a new user of the `flink-cdc`, I have get latest package using master branch. and import the dependecyies. will the `OracleSchemaChangeEventHandler` work automatically or I need other configs to enable it? thanks a lot. @e-mhui @stardustmanYes, it will work automatically. However, you may need to configure some parameters to capture DDL events. ```sql debezium.database.history.store.only.captured.tables.ddl = true ``` You can also refer to: 1. https://nightlies.apache.org/flink/flink-cdc-docs-release-3.0/zh/docs/connectors/cdc-connectors/oracle-cdc/ 2. https://debezium.io/documentation/reference/1.9/connectors/oracle.html#oracle-property-database-history-store-only-captured-tables-ddl -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
stardustman commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-1999059803 > @stardustman @Jetol The latest release 3.0.1 was packaged on Jan 22 and has not fixed this issue. If you want to use it in advance, you can build it yourself from the master branch. Otherwise, you will have to wait for the next release version. > > package command: > > ``` > git clone https://github.com/ververica/flink-cdc-connectors.git > cd flink-cdc-connectors > mvn clean install -DskipTests > ``` hello, I'm a new user of the flink-cdc, I have get latest package using master branch. and import the dependecyies. will the `OracleSchemaChangeEventHandler` work automatically or I need other configs to enable it? thanks a lot. @e-mhui -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
e-mhui commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-1996980894 The latest release 3.0.1 was packaged on Jan 22 and has not fixed this issue. If you want to use it in advance, you can build it yourself from the master branch. Otherwise, you will have to wait for the next release version. package command: ``` git clone https://github.com/ververica/flink-cdc-connectors.git cd flink-cdc-connectors mvn clean install -DskipTests ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
stardustman commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-1996949048 > > > SchemaChangeEventHandler，这个接口在哪个版本里，我找了一下，最新版的flink-cdc-base 3.0.0 没有看到相关代码。是需要自己修改源码自己编译吗 > > > > > > oracle 表结构变动报错，用到oracle-cdc 3.0包，我这边也报错，请问你这边解决了吗 > > This PR will fix it. I did't find handler packages in the [/com/ververica/cdc/connectors/base/relational](https://github.com/apache/flink-cdc/tree/release-3.0/flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/com/ververica/cdc/connectors/base/relational) and the flink-connector-oracle-cdc-3.0.1 also not found, how to deal with the schema changes myself using the release-3.0? thanks a lot.@e-mhui -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [Oracle][MySQL][SqlServer][PostgresSQL] Fix Oracle/MySQL/SqlServer/PostgresSQL CDC parser schema change event failed [flink-cdc]
stardustman commented on PR #2315: URL: https://github.com/apache/flink-cdc/pull/2315#issuecomment-1996786864 > > > SchemaChangeEventHandler，这个接口在哪个版本里，我找了一下，最新版的flink-cdc-base 3.0.0 没有看到相关代码。是需要自己修改源码自己编译吗 > > > > > > oracle 表结构变动报错，用到oracle-cdc 3.0包，我这边也报错，请问你这边解决了吗 > > This PR will fix it. I also didn't find the SchemaChangeEventHandler in the flink-connector-base:1.18.1, so how to find and use it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
