[jira] [Created] (FLINK-34986) Basic framework for async execution of state

2024-04-01 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34986: --- Summary: Basic framework for async execution of state Key: FLINK-34986 URL: https://issues.apache.org/jira/browse/FLINK-34986 Project: Flink Issue Type:

Re: [DISCUSS] Externalized Google Cloud Connectors

2024-04-01 Thread Leonard Xu
Hey, Claire Thanks starting this discussion, all flink external connector repos are sub-projects of Apache Flink, including https://github.com/apache/flink-connector-aws. Creating a flink external connector repo named flink-connectors-gcp as sub-project of Apache Beam is not a good idea

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-01 Thread Ron liu
Hi, Venkata krishnan Thank you for your involvement and suggestions, and hope that the design goals of this FLIP will be helpful to your business. >>> 1. In the proposed FLIP, given the example for the dynamic table, do the data sources always come from a single lake storage such as Paimon or

[jira] [Created] (FLINK-34985) It doesn't support to access fields by name for map function in thread mode

2024-04-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-34985: --- Summary: It doesn't support to access fields by name for map function in thread mode Key: FLINK-34985 URL: https://issues.apache.org/jira/browse/FLINK-34985 Project: Flink

RE: Re: Iceberg table maintenance

2024-04-01 Thread wenjin
Hi Peter, Thanks a lot for your answers, this detailed explanation has cleared my confusions and been greatly beneficial to me. If you don't mind, could I discuss two more questions with your? As you mentioned in your proposal and answers, the maintenance tasks may cause resource interference

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-04-01 Thread Ron liu
Congratulations! Best, Ron Jeyhun Karimov 于2024年4月1日周一 18:12写道: > Congratulations! > > Regards, > Jeyhun > > On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote: > > > Congratulations! > > Best, > > Guowei > > > > > > On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote: > > > > > Congratulations! > >

Re: [DISCUSS] FLIP-XXX: Introduce Flink SQL variables

2024-04-01 Thread Jeyhun Karimov
Hi Ferenc, Thanks for the proposal. Sounds like a good idea! I have a few questions on that: - What is its impact on query optimization because resolving variables at the parsing stage might affect query optimization. - What is the scope of variables? I mean when and how they override each

[jira] [Created] (FLINK-34984) Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-34984: Summary: Disaggregated State Storage and Management (Umbrella FLIP) Key: FLINK-34984 URL: https://issues.apache.org/jira/browse/FLINK-34984 Project: Flink Issue

[RESULT][VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei
Hey dev, I'm happy to announce that FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) [1] has been accepted with 7 approving votes (5 binding) [2] Piotrek Nowojski (binding) Feifan Wang (non-binding) Jing Ge (binding) Rui Fan (binding) Xintong (binding) Yue (non-binding) Yuan

Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei
+1 vote myself & Thanks all for the voting. I'm closing the vote and the result will be posted in a separate mail. Best Yuan On Fri, Mar 29, 2024 at 3:07 PM yue ma wrote: > +1 (non-binding) > > > Best, > Yue >

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-04-01 Thread Jeyhun Karimov
Congratulations! Regards, Jeyhun On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote: > Congratulations! > Best, > Guowei > > > On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote: > > > Congratulations! > > > > Best, > > Feng Jin > > > > On Mon, Apr 1, 2024 at 10:51 AM weijie guo > > wrote: > > > >>

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

2024-04-01 Thread Jeyhun Karimov
Hi everyone, Thanks for your valuable feedback! The discussion on this FLIP has been going on for a while. I would like to start a vote after 48 hours. Please let me know if you have any concerns or any further questions/comments. Regards, Jeyhun On Thu, Mar 21, 2024 at 6:01 PM Jeyhun

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-04-01 Thread wudi
Hi, Gentle ping to see if there are any other concerns or things that seems missing from the FLIP. Brs di.wu > 2024年3月25日 17:52,Feng Jin 写道: > > Hi Di > > Thank you for your patience and explanation. > > If this is a server-side configuration, we currently cannot modify it in > the client

[jira] [Created] (FLINK-34983) Hive param sink.partition-commit.policy.kind default value is not work in stream mode

2024-04-01 Thread yunfan (Jira)
yunfan created FLINK-34983: -- Summary: Hive param sink.partition-commit.policy.kind default value is not work in stream mode Key: FLINK-34983 URL: https://issues.apache.org/jira/browse/FLINK-34983 Project:

[jira] [Created] (FLINK-34982) FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-04-01 Thread Jinzhong Li (Jira)
Jinzhong Li created FLINK-34982: --- Summary: FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State Key: FLINK-34982 URL: https://issues.apache.org/jira/browse/FLINK-34982 Project: Flink