[jira] [Created] (FLINK-35303) Support logical deletion of datax

2024-05-07 Thread melin (Jira)
melin created FLINK-35303: - Summary: Support logical deletion of datax Key: FLINK-35303 URL: https://issues.apache.org/jira/browse/FLINK-35303 Project: Flink Issue Type: New Feature Compon

[jira] [Updated] (FLINK-35303) Support logical deletion of data

2024-05-07 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35303: -- Summary: Support logical deletion of data (was: Support logical deletion of datax) > Support logical dele

[jira] [Created] (FLINK-35329) Support modify table/column comments

2024-05-09 Thread melin (Jira)
melin created FLINK-35329: - Summary: Support modify table/column comments Key: FLINK-35329 URL: https://issues.apache.org/jira/browse/FLINK-35329 Project: Flink Issue Type: New Feature Comp

[jira] [Updated] (FLINK-35303) Support logical deletion of data

2024-05-10 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35303: -- Affects Version/s: cdc-3.2.0 > Support logical deletion of data > - > >

[jira] [Created] (FLINK-35393) Support flink kafka catalog

2024-05-18 Thread melin (Jira)
melin created FLINK-35393: - Summary: Support flink kafka catalog Key: FLINK-35393 URL: https://issues.apache.org/jira/browse/FLINK-35393 Project: Flink Issue Type: New Feature Components: C

[jira] [Created] (FLINK-35394) paimon pipeline support dynamic bucket

2024-05-18 Thread melin (Jira)
melin created FLINK-35394: - Summary: paimon pipeline support dynamic bucket Key: FLINK-35394 URL: https://issues.apache.org/jira/browse/FLINK-35394 Project: Flink Issue Type: New Feature Co

[jira] [Created] (FLINK-35417) JobManager and TaskManager support merging and run in a single process

2024-05-21 Thread melin (Jira)
melin created FLINK-35417: - Summary: JobManager and TaskManager support merging and run in a single process Key: FLINK-35417 URL: https://issues.apache.org/jira/browse/FLINK-35417 Project: Flink Iss

[jira] [Commented] (FLINK-35417) JobManager and TaskManager support merging and run in a single process

2024-05-22 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848676#comment-17848676 ] melin commented on FLINK-35417: --- The current deployment model has encountered challenges i

[jira] [Updated] (FLINK-35417) JobManager and TaskManager support merging and run in a single process

2024-05-23 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35417: -- Description: Spark is used in data integration scenarios (such as reading data from mysql and writing data to

[jira] [Updated] (FLINK-35417) JobManager and TaskManager support merging and run in a single process

2024-05-23 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35417: -- Description: flink is widely used in data integration scenarios, where a single concurrency is not high, and

[jira] [Created] (FLINK-35478) Pipeline sink Unified primary.key parameter

2024-05-28 Thread melin (Jira)
melin created FLINK-35478: - Summary: Pipeline sink Unified primary.key parameter Key: FLINK-35478 URL: https://issues.apache.org/jira/browse/FLINK-35478 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35511) Enhance metrics. The incremental and full phases count the number of records separately

2024-06-03 Thread melin (Jira)
melin created FLINK-35511: - Summary: Enhance metrics. The incremental and full phases count the number of records separately Key: FLINK-35511 URL: https://issues.apache.org/jira/browse/FLINK-35511 Project: Fl

[jira] [Created] (FLINK-35538) pipeline sink support caseSensitive

2024-06-06 Thread melin (Jira)
melin created FLINK-35538: - Summary: pipeline sink support caseSensitive Key: FLINK-35538 URL: https://issues.apache.org/jira/browse/FLINK-35538 Project: Flink Issue Type: Improvement Compo

[jira] [Created] (FLINK-35664) Flink CDC pipeline transform supports mask function

2024-06-20 Thread melin (Jira)
melin created FLINK-35664: - Summary: Flink CDC pipeline transform supports mask function Key: FLINK-35664 URL: https://issues.apache.org/jira/browse/FLINK-35664 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-35664) Flink CDC pipeline transform supports mask function

2024-06-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856667#comment-17856667 ] melin commented on FLINK-35664: --- yes, see hive mask function: [https://cwiki.apache.org/c

[jira] [Created] (FLINK-35714) Flink CDC pipeline sink support Automatic create tag

2024-06-27 Thread melin (Jira)
melin created FLINK-35714: - Summary: Flink CDC pipeline sink support Automatic create tag Key: FLINK-35714 URL: https://issues.apache.org/jira/browse/FLINK-35714 Project: Flink Issue Type: Improvemen

[jira] [Commented] (FLINK-35714) Flink CDC pipeline sink support Automatic create tag

2024-06-29 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860933#comment-17860933 ] melin commented on FLINK-35714: --- cc [~kunni]  > Flink CDC pipeline sink support Automatic

[jira] [Created] (FLINK-36107) schema event support custom callback

2024-08-19 Thread melin (Jira)
melin created FLINK-36107: - Summary: schema event support custom callback Key: FLINK-36107 URL: https://issues.apache.org/jira/browse/FLINK-36107 Project: Flink Issue Type: Improvement Comp

[jira] [Updated] (FLINK-36107) schema event support custom callback

2024-08-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-36107: -- Description: User-defined callback is supported. sink obtains the schema event and invokes the callback imple

[jira] [Commented] (FLINK-36107) schema event support custom callback

2024-08-21 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875380#comment-17875380 ] melin commented on FLINK-36107: --- cc [~xiqian_yu]  > schema event support custom callback

[jira] [Updated] (FLINK-36107) schema event support custom callback

2024-08-21 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-36107: -- Description: User-defined callback is supported. sink obtains the schema event and invokes the callback imple

[jira] [Created] (FLINK-35099) Support for multiple datasources

2024-04-14 Thread melin (Jira)
melin created FLINK-35099: - Summary: Support for multiple datasources Key: FLINK-35099 URL: https://issues.apache.org/jira/browse/FLINK-35099 Project: Flink Issue Type: New Feature Componen

[jira] [Created] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
melin created FLINK-35104: - Summary: Add kafka pipeline data source connector Key: FLINK-35104 URL: https://issues.apache.org/jira/browse/FLINK-35104 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: First collect cdc data in real time and write it to kafka, then write it to multiple different d

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a [kafka pipeline data sink connector|[https://github.com/apache/flink-cdc/pull

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector : [https://github.com/apache/flink-cdc/pul

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector : [https://github.com/apache/flink-cdc/pul

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector, and there should also be a kafka pipeline

[jira] [Updated] (FLINK-35104) Add kafka pipeline data source connector

2024-04-15 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35104: -- Description: There is already a kafka pipeline data sink connector, and there should also be a kafka pipeline

[jira] [Created] (FLINK-35172) DDL statement is added to the Schema Change Event

2024-04-19 Thread melin (Jira)
melin created FLINK-35172: - Summary: DDL statement is added to the Schema Change Event Key: FLINK-35172 URL: https://issues.apache.org/jira/browse/FLINK-35172 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-35172) DDL statement is added to the Schema Change Event

2024-04-19 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-35172: -- Description: The current implementation of the [kafka pipeline data sink connector |https://github.com/apache

[jira] [Commented] (FLINK-35172) DDL statement is added to the Schema Change Event

2024-04-19 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17838924#comment-17838924 ] melin commented on FLINK-35172: --- cc [~1365976...@qq.com] > DDL statement is added to the

[jira] [Commented] (FLINK-35144) Support various sources sync for FlinkCDC in one pipeline

2024-04-19 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839198#comment-17839198 ] melin commented on FLINK-35144: --- Yes, the business system database consists of multiple da

[jira] [Created] (FLINK-35179) add postgres pipeline data sink connector

2024-04-20 Thread melin (Jira)
melin created FLINK-35179: - Summary: add postgres pipeline data sink connector Key: FLINK-35179 URL: https://issues.apache.org/jira/browse/FLINK-35179 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-35248) Support table/column comment to modify DDL

2024-04-26 Thread melin (Jira)
melin created FLINK-35248: - Summary: Support table/column comment to modify DDL Key: FLINK-35248 URL: https://issues.apache.org/jira/browse/FLINK-35248 Project: Flink Issue Type: New Feature

[jira] [Commented] (FLINK-25402) FLIP-198: Working directory for Flink processes

2023-02-05 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684429#comment-17684429 ] melin commented on FLINK-25402: --- When a job is submitted, can add files to the Working dir

[jira] [Commented] (FLINK-29734) Support authentication in the Flink SQL Gateway

2023-02-08 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686197#comment-17686197 ] melin commented on FLINK-29734: --- (?) > Support authentication in the Flink SQL Gateway >

[jira] [Created] (FLINK-30121) Support Stored procedures

2022-11-21 Thread melin (Jira)
melin created FLINK-30121: - Summary: Support Stored procedures Key: FLINK-30121 URL: https://issues.apache.org/jira/browse/FLINK-30121 Project: Flink Issue Type: New Feature Components: Tab

[jira] [Created] (FLINK-30123) Optimize ApplicationDeployer API design

2022-11-21 Thread melin (Jira)
melin created FLINK-30123: - Summary: Optimize ApplicationDeployer API design Key: FLINK-30123 URL: https://issues.apache.org/jira/browse/FLINK-30123 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-30123) Optimize ApplicationDeployer API design

2022-11-21 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-30123: -- Description: The task is submitted by ApplicationDeployer api, and the run is synchronous and waiting for the

[jira] [Created] (FLINK-30126) Delay registration of the catalog, register the catalog as needed

2022-11-21 Thread melin (Jira)
melin created FLINK-30126: - Summary: Delay registration of the catalog, register the catalog as needed Key: FLINK-30126 URL: https://issues.apache.org/jira/browse/FLINK-30126 Project: Flink Issue Ty

[jira] [Updated] (FLINK-30126) Delay registration of the catalog, register the catalog as needed

2022-11-21 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-30126: -- Description: Data platform has registered many relational database data sources such as mysql, data source cod

[jira] [Commented] (FLINK-30126) Delay registration of the catalog, register the catalog as needed

2022-11-24 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17638440#comment-17638440 ] melin commented on FLINK-30126: --- Spark also does not support dynamic catalog, which is cre

[jira] [Updated] (FLINK-30126) Delay registration of the catalog, register the catalog as needed

2022-11-24 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-30126: -- Attachment: image-2022-11-25-09-12-59-477.png > Delay registration of the catalog, register the catalog as nee

[jira] [Created] (FLINK-25760) Support for extended SQL syntax

2022-01-22 Thread melin (Jira)
melin created FLINK-25760: - Summary: Support for extended SQL syntax Key: FLINK-25760 URL: https://issues.apache.org/jira/browse/FLINK-25760 Project: Flink Issue Type: Improvement Reporte

[jira] [Updated] (FLINK-25760) Support custom SQL syntax

2022-01-23 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-25760: -- Summary: Support custom SQL syntax (was: Support for extended SQL syntax) > Support custom SQL syntax > -

[jira] [Updated] (FLINK-25760) Support custom SQL syntax

2022-01-23 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-25760: -- Description: Supports custom SQL syntax, similar to Spark Extensions Feature. Custom SQL syntax can be implem

[jira] [Created] (FLINK-32125) Support Unified job submission API

2023-05-17 Thread melin (Jira)
melin created FLINK-32125: - Summary: Support Unified job submission API Key: FLINK-32125 URL: https://issues.apache.org/jira/browse/FLINK-32125 Project: Flink Issue Type: New Feature Repo

[jira] [Created] (FLINK-32163) Support the same application run multiple jobs in HA mode

2023-05-23 Thread melin (Jira)
melin created FLINK-32163: - Summary: Support the same application run multiple jobs in HA mode Key: FLINK-32163 URL: https://issues.apache.org/jira/browse/FLINK-32163 Project: Flink Issue Type: New F

[jira] [Created] (FLINK-32251) flink jdbc catalog cannot add parameters to url

2023-06-04 Thread melin (Jira)
melin created FLINK-32251: - Summary: flink jdbc catalog cannot add parameters to url Key: FLINK-32251 URL: https://issues.apache.org/jira/browse/FLINK-32251 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-32766) Support kafka catalog

2023-08-06 Thread melin (Jira)
melin created FLINK-32766: - Summary: Support kafka catalog Key: FLINK-32766 URL: https://issues.apache.org/jira/browse/FLINK-32766 Project: Flink Issue Type: New Feature Reporter: melin

[jira] [Updated] (FLINK-34257) Update Flink YAML Parser to Support YAML 1.2 Specification

2024-08-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-34257: -- Attachment: image-2024-08-26-19-53-40-349.png > Update Flink YAML Parser to Support YAML 1.2 Specification >

[jira] [Updated] (FLINK-34257) Update Flink YAML Parser to Support YAML 1.2 Specification

2024-08-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated FLINK-34257: -- Attachment: image-2024-08-26-19-55-06-927.png > Update Flink YAML Parser to Support YAML 1.2 Specification >

[jira] [Commented] (FLINK-34257) Update Flink YAML Parser to Support YAML 1.2 Specification

2024-08-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876695#comment-17876695 ] melin commented on FLINK-34257: --- 添加  -Dkubernetes.container.image.pull-secrets=docker-reg-

[jira] [Commented] (FLINK-34257) Update Flink YAML Parser to Support YAML 1.2 Specification

2024-08-26 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876896#comment-17876896 ] melin commented on FLINK-34257: --- Thank you! The input format problem has been solved, it i