[jira] [Created] (FLINK-35894) Add Elasticsearch Sink Connector for Flink CDC Pipeline

2024-07-24 Thread wuzexian (Jira)
wuzexian created FLINK-35894: Summary: Add Elasticsearch Sink Connector for Flink CDC Pipeline Key: FLINK-35894 URL: https://issues.apache.org/jira/browse/FLINK-35894 Project: Flink Issue Type: I

[jira] [Created] (FLINK-35893) Add state compatibility for Serializer of TableChangeInfo

2024-07-24 Thread LvYanquan (Jira)
LvYanquan created FLINK-35893: - Summary: Add state compatibility for Serializer of TableChangeInfo Key: FLINK-35893 URL: https://issues.apache.org/jira/browse/FLINK-35893 Project: Flink Issue Ty

Re: [DISCUSS]: Flink code generation porting to Calcite

2024-07-24 Thread James Duong
This is really helpful. The JavaCodeSplitter looks fairly easy to use. Thanks Jark! Right now I’m trying to work out the best way to integrate this module from an architecture perspective. It looks like there aren’t very many Flink dependencies within the module. We really want to avoid having

Re: [DISCUSS] FLIP-471: Fixing watermark idleness timeout accounting

2024-07-24 Thread Arvid Heise
Hi Piotr, thank you very much for addressing this issue. I'm convinced that the approach is the right solution also in contrast to the alternatives. Ultimately, only WatermarkGenratorWithIdleness needs to be adjusted with this change. My only concerns are regarding the actual code. 1. `RelativeCl

Re: [DISCUSS] FLIP-471: Fixing watermark idleness timeout accounting

2024-07-24 Thread Martijn Visser
Hi Piotr, We've talked offline about this proposal and I think it would be beneficial for users to get this fixed. +1 overall, and thanks for writing it down. Best regards, Martijn On Tue, Jul 23, 2024 at 5:45 PM Piotr Nowojski wrote: > Hi All, > > A bit unusual FLIP [1], as this is a bug fix

Re: [EXTERNAL] - Re: Discussion on Vertica-Flink Connector

2024-07-24 Thread Vikas Garg
Hello Yanquan, Flink-connector-jdbc can also be used for connecting to Vertica with Flink. For added functionalities, we have created a Vertica specific connector. This connector will support all the Vertica functionalities. Vikas Garg General Engineering | General Engineering Mobile: (+91)

Re: [DISCUSS] FLIP-XXX: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-07-24 Thread Zdenek Tison
Hi Gyula, Thank you for reviewing the document and providing feedback. 1. I agree that we need two separate parameters for stabilization intervals in different states. I will update the FLIP document accordingly. 2. That's correct. We reached the same conclusion while prototyping the

[jira] [Created] (FLINK-35892) Flink Kubernetes Operator docs lacks info on FlinkSessionJob submission

2024-07-24 Thread Sergey Kononov (Jira)
Sergey Kononov created FLINK-35892: -- Summary: Flink Kubernetes Operator docs lacks info on FlinkSessionJob submission Key: FLINK-35892 URL: https://issues.apache.org/jira/browse/FLINK-35892 Project:

[jira] [Created] (FLINK-35891) Support writing dynamic bucket table of Paimon

2024-07-24 Thread LvYanquan (Jira)
LvYanquan created FLINK-35891: - Summary: Support writing dynamic bucket table of Paimon Key: FLINK-35891 URL: https://issues.apache.org/jira/browse/FLINK-35891 Project: Flink Issue Type: Technic

[jira] [Created] (FLINK-35890) Select only the increment but still enter the SNAPSHOT,lead

2024-07-24 Thread sanqingleo (Jira)
sanqingleo created FLINK-35890: -- Summary: Select only the increment but still enter the SNAPSHOT,lead Key: FLINK-35890 URL: https://issues.apache.org/jira/browse/FLINK-35890 Project: Flink Iss

[jira] [Created] (FLINK-35889) mongo cdc restore from expired resume token and job status still running but expect failed

2024-07-24 Thread Darren_Han (Jira)
Darren_Han created FLINK-35889: -- Summary: mongo cdc restore from expired resume token and job status still running but expect failed Key: FLINK-35889 URL: https://issues.apache.org/jira/browse/FLINK-35889

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-24 Thread Junrui Lee
Hi all, Thank you for all the feedback and suggestions so far. If there are no further comments, we will open the voting thread on Friday, July 26, 2024. Best regards, Junrui Ron Liu 于2024年7月24日周三 13:43写道: > Hi, Junrui > > Thanks for your detailed reply. > > After reading the updated FLIP-468

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-24 Thread Junrui Lee
Hi Ron, Thank you for your questions regarding the StreamGraphOptimizationStrategy. Here are my responses: 1.is there a better way to pass it to the runtime? At the moment, we have not thought of a better way. Considering that this is a class from the table layer, it can only be seen at the run