回复: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2023-09-27 Thread Chen Zhanghao
+1 (non-binding), thanks for driving this. Best, Zhanghao Chen 发件人: Shammon FY 发送时间: 2023年9月25日 13:28 收件人: dev 主题: [VOTE] FLIP-314: Support Customized Job Lineage Listener Hi devs, Thanks for all the feedback on FLIP-314: Support Customized Job Lineage Listener

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2023-09-27 Thread 曹帝胄
+1 (binding) Best, Dizhou Cao

[jira] [Created] (FLINK-33166) Support setting root logger level by config

2023-09-27 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33166: - Summary: Support setting root logger level by config Key: FLINK-33166 URL: https://issues.apache.org/jira/browse/FLINK-33166 Project: Flink Issue Type: Imp

Re: access to the design doc of FLINK-12477

2023-09-27 Thread Yun Tang
Hi Shuyi, Thank you for your interest in the previous design. Already CC'ed Jing and Stefan, who might have such doc access. Best Yun Tang From: Shuyi Chen Sent: Thursday, September 28, 2023 13:37 To: dev Subject: access to the design doc of FLINK-12477 Hi De

access to the design doc of FLINK-12477

2023-09-27 Thread Shuyi Chen
Hi Devs, can anyone grant access to the design doc of FLINK-12477? Thanks a lot. https://docs.google.com/document/d/1eDpsUKv2FqwZiS1Pm6gYO5eFHScBHfULKmH1-ZEWB4g Shuyi

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-09-27 Thread Shammon FY
Thanks Yuepeng for initiating this discussion. +1 in general too, in fact we have implemented a similar mechanism internally to ensure a balanced allocation of tasks to slots, it works well. Some comments about the mechanism 1. This mechanism will be only supported in `SlotPool` or both `SlotPoo

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-09-27 Thread Rui Fan
Hi Zhu Zhu, Thanks for your feedback here! You are right, user needs to set 2 options: - cluster.evenly-spread-out-slots=true - slot.sharing-strategy=TASK_BALANCED_PREFERRED Update it to one option is useful at user side, so `taskmanager.load-balance.mode` sounds good to me. I want to check some

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-09-27 Thread Yangze Guo
Thanks for driving this FLIP, Yuepeng Pan. +1 for the overall proposal to support balanced scheduling. Some questions on the Waiting mechanism and Allocation strategy for slot to TM: 1. Is it possible for the SlotPool to get the slot allocation results from the SlotManager in advance instead of w

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2023-09-27 Thread Yun Tang
+1 (binding) Best, Yun Tang From: Yangze Guo Sent: Thursday, September 28, 2023 9:20 To: dev@flink.apache.org Subject: Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener +1 (binding) Best, Yangze Guo On Tue, Sep 26, 2023 at 11:05 AM Leonard Xu wrote

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2023-09-27 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Tue, Sep 26, 2023 at 11:05 AM Leonard Xu wrote: > > +1(binding) > > > Best, > Leonard > > > On Sep 26, 2023, at 9:59 AM, Feng Jin wrote: > > > > +1(no-binding) > > > > > > thanks for driving this proposal > > > > > > Best, > > Feng > > > > On Mon, Sep 25, 2023 a

Re: [DISCUSS] Implementing SQL remote functions

2023-09-27 Thread Krzysztof Zarzycki
Hello Alan, At my company we implemented an open source Flink HTTP connector, that you might find interesting. It can be represented as a source table as well and be used in lookups. Here is the link https://github.com/getindata/flink-http-connector Best Krzysztof On Thu, Sep 21, 2023 at 7:34 AM

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-09-27 Thread Bonnie Arogyam Varghese
Hi Martjin, Yes, the suggestion for the configuration name made by Jark sounds good. Also, thanks to everyone who participated in this discussion. On Tue, Sep 19, 2023 at 2:40 PM Martijn Visser wrote: > Hey Jark, > > Sounds fine to me. > @Bonnie does that also work for you? > > Best regards, >

Re: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-27 Thread Jing Ge
Hi Zhanghao, Thanks for the update! Best regards, Jing On Mon, Sep 25, 2023 at 9:54 PM Chen Zhanghao wrote: > Hi Jing, > > I've updated Compatibility, Deprecation, and Migration Plan section to > list all the potential compatibility issues for users who want to upgrade > an existing job to use

Re: [ANNOUNCE] Release 1.18.0, release candidate #0

2023-09-27 Thread Jing Ge
Hi Folks, @Ryan FYI: CI passed and the PR has been merged. Thanks! If there are no more other concerns, I will start publishing 1.18-rc1. Best regards, Jing On Mon, Sep 25, 2023 at 1:40 PM Jing Ge wrote: > Hi Ryan, > > Thanks for reaching out. It is fine to include it but we need to wait > un

[RESULT][VOTE] FLIP-327: Support switching from batch to stream mode to improve throughput when processing backlog data

2023-09-27 Thread Dong Lin
Hi all, Thank everyone for your review and the votes! I am happy to announce that FLIP-327: Support switching from batch to stream mode to improve throughput when processing backlog data [1] has been accepted. There are 4 binding votes and 3 non-binding votes [2]: - Jing Ge (binding) - Rui Fan

Re: [VOTE] FLIP-327: Support switching from batch to stream mode to improve throughput when processing backlog data

2023-09-27 Thread Dong Lin
Thank you all for the votes! I will close the voting thread and summarize the result in a separate email. On Tue, Sep 26, 2023 at 1:11 AM Ahmed Hamdy wrote: > +1(non binding) > Best regards > Ahmed Hamdy > > On Mon, 25 Sep 2023, 19:57 Venkatakrishnan Sowrirajan, > wrote: > > > +1 (non-binding)

[jira] [Created] (FLINK-33165) Flink UI stack trace popup continually displayed when a job is deleted

2023-09-27 Thread david radley (Jira)
david radley created FLINK-33165: Summary: Flink UI stack trace popup continually displayed when a job is deleted Key: FLINK-33165 URL: https://issues.apache.org/jira/browse/FLINK-33165 Project: Flink

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-09-27 Thread Zhu Zhu
Thanks Yuepeng and Rui for creating this FLIP. +1 in general The idea is straight forward: best-effort gather all the slot requests and offered slots to form an overview before assigning slots, trying to balance the loads of task managers when assigning slots. I have one comment regarding the con

[jira] [Created] (FLINK-33164) HBase connector support ignore null value for partial update

2023-09-27 Thread tanjialiang (Jira)
tanjialiang created FLINK-33164: --- Summary: HBase connector support ignore null value for partial update Key: FLINK-33164 URL: https://issues.apache.org/jira/browse/FLINK-33164 Project: Flink I