Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Yangze Guo
Congratulations and welcome on board! Best, Yangze Guo On Mon, Apr 15, 2024 at 11:46 AM Muhammet Orazov wrote: > > Congratulations Zakelly! > > Best, > Muhammet > > > On 2024-04-15 02:50, Yuan Mei wrote: > > Hi everyone, > > > > On behalf of the PMC,

Re: [VOTE] Release 1.19.0, release candidate #1

2024-03-05 Thread Yangze Guo
? Best, Yangze Guo On Wed, Mar 6, 2024 at 2:00 PM Lincoln Lee wrote: > > Hi everyone, > > This rc is officially cancelled because of the incompleteness of python > wheel packages(lost 2 newly added py3.11 packages for mac, both 10.9 & > 11.0, will be fixed in [1]). > &

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2024-02-28 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Wed, Feb 28, 2024 at 11:54 AM Peter Huang wrote: > > +1 (non-binding) > > Thanks for consolidating the opinions from both Flink and OpenLineage > communities. Look forward to the collaboration. > > > Best Regards > Peter Huang > >

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2024-01-16 Thread Yangze Guo
not manually configured and if high-availability.job-recovery.enabled is set to false. If there are no further comments, I will adjust the FLIP based on these discussions and then initiate a vote. Best, Yangze Guo On Mon, Jan 15, 2024 at 5:55 PM Zhu Zhu wrote: > > Correction: > I'm fine

Re: [VOTE] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-14 Thread Yangze Guo
+1 binding Best, Yangze Guo On Thu, Jan 11, 2024 at 8:36 PM Rui Fan <1996fan...@gmail.com> wrote: > > +1 binding > > Best, > Rui > > > On Thu, 11 Jan 2024 at 19:45, xiangyu feng wrote: > > > Hi all, > > > > I would like to start the vote

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2024-01-10 Thread Yangze Guo
perhaps a ticket would be sufficient) for the refactoring of HA. WDYT? Best, Yangze Guo On Thu, Jan 11, 2024 at 12:19 AM Matthias Pohl wrote: > > Thanks for joining the discussion, everyone and sorry for picking it up > that late. Here are a few points, I want to add to this discuss

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Yangze Guo
+1 (non-binding) Best, Yangze Guo On Tue, Jan 9, 2024 at 5:06 PM Robert Metzger wrote: > > +1 (binding) > > > On Tue, Jan 9, 2024 at 9:54 AM Guowei Ma wrote: > > > +1 (binding) > > Best, > > Guowei > > > > > > On Tue, Jan 9, 2024 at 4:49

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2024-01-08 Thread Yangze Guo
%3Acomment-tabpanel#comment-17741054 Best, Yangze Guo On Mon, Jan 8, 2024 at 7:37 PM Zhu Zhu wrote: > > Thanks for creating the FLIP and starting the discussion, Yangze. It makes > sense to me to improve the job submission performance in OLAP scenarios. > > I have a few ques

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2024-01-08 Thread Yangze Guo
to true. +1 for high-availability.job-recovery.enabled, which would be more suitable with YAML hierarchy. Best, Yangze Guo On Mon, Jan 8, 2024 at 3:43 PM Rui Fan <1996fan...@gmail.com> wrote: > > Thanks to Yangze driving this proposal! > > Overall looks good to me! This

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2024-01-07 Thread Yangze Guo
increase the complexity and testing difficulty of the system. WDYT? Best, Yangze Guo On Mon, Jan 8, 2024 at 12:08 PM Yong Fang wrote: > > Thanks Yangze for starting this discussion. I have one comment: why do we > need to abstract two services as `LeaderServices` and > `PersistenceServices`?

Re: [Discuss] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-01 Thread Yangze Guo
Thanks for driving this, Xiangyu! +1 for the overall proposal. I believe this will enhance the availability and competitiveness of Flink in OLAP scenarios. Best, Yangze Guo On Tue, Dec 26, 2023 at 4:51 PM xiangyu feng wrote: > > Hi devs, > > I'm opening this thread to discuss FLIP-

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2023-12-28 Thread Yangze Guo
Thanks for the response, Zhanghao. PersistenceServices sounds good to me. Best, Yangze Guo On Wed, Dec 27, 2023 at 11:30 AM Zhanghao Chen wrote: > > Thanks for driving this effort, Yangze! The proposal overall LGTM. Other from > the throughput enhancement in the OLAP scenario, the s

[DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2023-12-19 Thread Yangze Guo
se find more details in the FLIP wiki document [1]. Looking forward to your feedback. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-403+High+Availability+Services+for+OLAP+Scenarios Best, Yangze Guo

Re: FLIP-403: High Availability Services for OLAP Scenarios

2023-12-19 Thread Yangze Guo
I just found that I missed the "[DISCUSS]" prefix. Will start another thread for this FLIP. Best, Yangze Guo On Tue, Dec 19, 2023 at 5:31 PM Yangze Guo wrote: > > Thanks for the response, Xiangyu. > > As said in FLIP, this is pure refactoring and should not affe

Re: FLIP-403: High Availability Services for OLAP Scenarios

2023-12-19 Thread Yangze Guo
Thanks for the response, Xiangyu. As said in FLIP, this is pure refactoring and should not affect the functionality of the current HA mechanism. The leader path should not be changed as well. There will not be any compatibility issue for existing HA. Best, Yangze Guo On Tue, Dec 19, 2023 at 5

[jira] [Created] (FLINK-33870) Split the HighAvailabilityServices into LeaderServices and PersistentServices

2023-12-17 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33870: -- Summary: Split the HighAvailabilityServices into LeaderServices and PersistentServices Key: FLINK-33870 URL: https://issues.apache.org/jira/browse/FLINK-33870 Project

FLIP-403: High Availability Services for OLAP Scenarios

2023-12-17 Thread Yangze Guo
se find more details in the FLIP wiki document [1]. Looking forward to your feedback. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-403+High+Availability+Services+for+OLAP+Scenarios Best, Yangze Guo

[jira] [Created] (FLINK-33852) FLIP-403 High Availability Services for OLAP Scenarios

2023-12-14 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33852: -- Summary: FLIP-403 High Availability Services for OLAP Scenarios Key: FLINK-33852 URL: https://issues.apache.org/jira/browse/FLINK-33852 Project: Flink Issue

Re: [VOTE] FLIP-396: Trial to test GitHub Actions as an alternative for Flink's current Azure CI infrastructure

2023-12-12 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Tue, Dec 12, 2023 at 3:51 PM Yuxin Tan wrote: > > +1 (non binding) > Thanks for the effort. > > Best, > Yuxin > > > Samrat Deb 于2023年12月12日周二 15:25写道: > > > +1 (non binding) > > Thanks for driving > > >

Re: [DISCUSS] FLIP-395: Migration to GitHub Actions

2023-11-30 Thread Yangze Guo
itHub Actions" a necessity in the code contribution process, we can encourage contributors to report unstable cases under a specific ticket umbrella when they encounter them. Best, Yangze Guo On Thu, Nov 30, 2023 at 12:10 AM Matthias Pohl wrote: > > With regards to Alex' concerns on hardw

Re: [VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-12 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Mon, Nov 13, 2023 at 11:35 AM weijie guo wrote: > > +1(binding) > > Best regards, > > Weijie > > > Lijie Wang 于2023年11月13日周一 10:40写道: > > > +1 (binding) > > > > Best, > > Lijie > > >

[jira] [Created] (FLINK-33532) Move the serialization of ShuffleDescriptorGroup out of the RPC main thread

2023-11-12 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33532: -- Summary: Move the serialization of ShuffleDescriptorGroup out of the RPC main thread Key: FLINK-33532 URL: https://issues.apache.org/jira/browse/FLINK-33532 Project

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread Yangze Guo
Great work! Congratulations to everyone involved! Best, Yangze Guo On Fri, Oct 27, 2023 at 10:23 AM Qingsheng Ren wrote: > > Congratulations and big THANK YOU to everyone helping with this release! > > Best, > Qingsheng > > On Fri, Oct 27, 2023 at 10:18 AM Benchao Li wr

Re: [VOTE] FLIP-370: Support Balanced Tasks Scheduling

2023-10-23 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Mon, Oct 23, 2023 at 12:00 PM Rui Fan <1996fan...@gmail.com> wrote: > > +1(binding) > > Thanks to Yuepeng and to everyone who participated in the discussion! > > Best, > Rui > > On Mon, Oct 23, 2023 at 11:55 AM Roc Marshal

Re: [ANNOUNCE] The Flink Speed Center and benchmark daily run are back online

2023-10-20 Thread Yangze Guo
Thanks for the effort, Zhaoqian! Best, Yangze Guo On Fri, Oct 20, 2023 at 2:55 PM Leonard Xu wrote: > > Thanks Zakelly for the great work. > > Best, > Leonard > > > 2023年10月19日 下午7:39,Jing Ge 写道: > > > > Hi Zakelly, > > > > Thank you for your ef

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-18 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Wed, Oct 18, 2023 at 2:15 AM Alexander Fedulov wrote: > > +1 (non-binding) > > Thanks for explicitly addressing my concerns from the previous attempt of > integrating the async-profiler ( FLIP-213 [1] ). > > Best, > Alexand

[jira] [Created] (FLINK-33289) SQL Gateway supports IPv6 addresses.

2023-10-17 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33289: -- Summary: SQL Gateway supports IPv6 addresses. Key: FLINK-33289 URL: https://issues.apache.org/jira/browse/FLINK-33289 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-10-16 Thread Yangze Guo
Thanks for the update, Rui. +1 for the latest version of the FLIP. Best, Yangze Guo On Tue, Oct 17, 2023 at 11:45 AM Rui Fan <1996fan...@gmail.com> wrote: > > Hi all, > > Offline discussed with Zhu Zhu, Yangze Guo, Yuepeng Pan. > We reached consensus on slot

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

2023-10-15 Thread Yangze Guo
Congrats, Ron! Best, Yangze Guo On Mon, Oct 16, 2023 at 11:48 AM Matt Wang wrote: > > Congratulations, Ron! > > > -- > > Best, > Matt Wang > > > Replied Message > | From | Feng Jin | > | Date | 10/16/2023 11:29 | > | To | | > | Subjec

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-15 Thread Yangze Guo
Congrats, Jane! Best, Yangze Guo On Mon, Oct 16, 2023 at 11:49 AM Matt Wang wrote: > > Congratulations Jane! > > > -- > > Best, > Matt Wang > > > Replied Message > | From | Feng Jin | > | Date | 10/16/2023 11:29 | > | To | | > | Subjec

[VOTE][RESULT] FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-15 Thread Yangze Guo
. Thus FLIP-374 has been accepted. Thanks everyone for joining the discussion and giving feedback! [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-374%3A+Adding+a+separate+configuration+for+specifying+Java+Options+of+the+SQL+Gateway Best, Yangze Guo

Re: [VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-12 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Fri, Oct 13, 2023 at 10:38 AM Yuepeng Pan wrote: > > +1(non-binding) > > Best, > Yuepeng Pan > At 2023-10-13 10:24:15, "Wencong Liu" wrote: > >+1(non-binding) > > > >Best, > >Wencong Liu > > > > &

[VOTE] FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-10 Thread Yangze Guo
/display/FLINK/FLIP-374%3A+Adding+a+separate+configuration+for+specifying+Java+Options+of+the+SQL+Gateway [2] https://lists.apache.org/thread/g4vl8mgnwgl7vjyvjy6zrc8w54b2lthv Best, Yangze Guo

Re: [DISCUSS] FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-09 Thread Yangze Guo
Thanks for all the comments! I will initiate the vote tomorrow if there is no further discussion. Best, Yangze Guo On Tue, Oct 10, 2023 at 12:20 AM Jing Ge wrote: > > +1 good idea! Looking forward to Flink OLAP! > > Best regards, > Jing > > On Sat, Oct 7, 2023 at 1:36

Re: [VOTE] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-10-09 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Mon, Oct 9, 2023 at 2:46 PM Yun Tang wrote: > > +1 (binding) > > Best > Yun Tang > > From: Weihua Hu > Sent: Monday, October 9, 2023 12:03 > To: dev@flink.apache.org > Subject: Re: [VOTE] FLIP-36

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-10-07 Thread Yangze Guo
could become a single-point bottleneck in OLAP scenarios. WDYT? Best, Yangze Guo On Sat, Oct 7, 2023 at 5:52 PM Rui Fan <1996fan...@gmail.com> wrote: > > Hi Yangze, > > Thanks for your quick response! > > Sorry, I re-read the 2.2.2 part[1] about the Waiting Mechanism,

Re: [DISCUSS] FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-07 Thread Yangze Guo
Thanks for all your comments. @Rui Thanks for the reminder. The "env.java.opts.all" has already taken effect now. Best, Yangze Guo On Sat, Oct 7, 2023 at 6:45 PM Benchao Li wrote: > > Thanks Yangze for preparing this FLIP, it's good to have this ability > for gateway si

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-10-07 Thread Yangze Guo
mechanism. I think it would be better to address this issue within the scope of this FLIP. However, I don't have a strong opinion on it, it depends on your bandwidth. Best, Yangze Guo On Sat, Oct 7, 2023 at 4:16 PM Rui Fan <1996fan...@gmail.com> wrote: > > Hi Yangze, > > > 2.

[jira] [Created] (FLINK-33203) FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-07 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33203: -- Summary: FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway Key: FLINK-33203 URL: https://issues.apache.org/jira/browse/FLINK-33203

[DISCUSS] FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-07 Thread Yangze Guo
a+separate+configuration+for+specifying+Java+Options+of+the+SQL+Gateway Best, Yangze Guo

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-10-01 Thread Yangze Guo
the cluster.evenly-spread-out-slots, LeastUtilizationResourceMatchingStrategy will be used to determine the slot distribution and the slot allocation in the three TM will be (taskmanager.numberOfTaskSlots=3): TM1: 3 slot TM2: 2 slot TM3: 2 slot Best, Yangze Guo On Sun, Oct 1, 2023 at 6:14 PM Rui Fan

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-09-27 Thread Yangze Guo
of section 2.2.3 can be resolved. Do I understand it correctly? Best, Yangze Guo On Wed, Sep 27, 2023 at 9:12 PM Zhu Zhu wrote: > > Thanks Yuepeng and Rui for creating this FLIP. > > +1 in general > The idea is straight forward: best-effort gather all the slot requests >

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2023-09-27 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Tue, Sep 26, 2023 at 11:05 AM Leonard Xu wrote: > > +1(binding) > > > Best, > Leonard > > > On Sep 26, 2023, at 9:59 AM, Feng Jin wrote: > > > > +1(no-binding) > > > > > > thanks for driving this proposa

Re: [VOTE] FLIP-362: Support minimum resource limitation

2023-09-25 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Mon, Sep 25, 2023 at 5:39 PM xiangyu feng wrote: > > Hi all, > > I would like to start the vote for FLIP-362: Support minimum resource > limitation[1]. > This FLIP was discussed in this thread [2]. > > The vote will be open for

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

2023-09-21 Thread Yangze Guo
Thanks for driving this, +1 for the proposal. Best, Yangze Guo On Fri, Sep 22, 2023 at 11:59 AM Lijie Wang wrote: > > Hi Junrui, > > +1 for this proposal, thanks for driving. > > Best, > Lijie > > ConradJam 于2023年9月22日周五 10:07写道: > > > +1 Support

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-20 Thread Yangze Guo
, Yangze Guo On Thu, Sep 21, 2023 at 11:15 AM Shammon FY wrote: > > Hi, > > I agree that `minimum resource limitation` will bring values for flink > session clusters, but for `Application Mode`, is it useful for streaming > and batch jobs? Is it necessary for us to not support th

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-20 Thread Yangze Guo
ay also require this configuration to accelerate the execution of batch jobs. WDYT? Best, Yangze Guo On Thu, Sep 21, 2023 at 4:49 AM Jing Ge wrote: > > Hi Xiangyu, > > Thanks for driving it! There is one thing I am not really sure if I > understand you correctly. > > According to the FL

Re: [Discuss] CRD for flink sql gateway in the flink k8s operator

2023-09-19 Thread Yangze Guo
Thanks for the reply, Gyula. Also thanks for the input from Thomas and Dongwoo. Helm charts / templates for creating SQL Gateway deployment / services sounds good to me. I'll work on it and also update that to the OLAP quickstart doc. Best, Yangze Guo On Tue, Sep 19, 2023 at 11:46 PM Dongwoo

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-18 Thread Yangze Guo
Thanks for driving this @Xiangyu. This is a feature that many users have requested for a long time. +1 for the overall proposal. Best, Yangze Guo On Tue, Sep 19, 2023 at 11:48 AM xiangyu feng wrote: > > Hi Devs, > > I'm opening this thread to discuss FLIP-362: Support mini

Re: [Discuss] CRD for flink sql gateway in the flink k8s operator

2023-09-18 Thread Yangze Guo
or manage them would be a bit wasted. Therefore, atm, we can allow users to directly submit jobs using JDBC or REST API. WDYT? Best, Yangze Guo On Mon, Sep 18, 2023 at 4:08 PM Gyula Fóra wrote: > > As I wrote in my previous answer, this could be done as a helm chart or as > part of the ope

Re: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-18 Thread Yangze Guo
Thanks for the clarification, Jing. I agree that using another term like endpoint can help us to distinguish it from the existing concept of "location". +1 for using the term endpoint and introducing TaskManagerLocation.getEndpoint(). Best, Yangze Guo On Mon, Sep 18, 2023 at 11:52 

Re: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-18 Thread Yangze Guo
Hi, Rui, I think the term "location" might be sufficiently clear in the specific context, e.g. SubtaskXXXInfo and TaskManagerXXXInfo. Could you elaborate more on what concept you think one might confuse it with? Best, Yangze Guo On Mon, Sep 18, 2023 at 12:07 PM Rui Fan <1996fan

Re: [VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-17 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Mon, Sep 18, 2023 at 11:37 AM Chen Zhanghao wrote: > > Hi All, > > Thanks for all the feedback on FLIP-363: Unify the Representation of > TaskManager Location in REST API and Web UI [1][2] > > I'd like to start a vote for FLIP-363.

Re: [Discuss] CRD for flink sql gateway in the flink k8s operator

2023-09-16 Thread Yangze Guo
n provide additional benefits and be more user-friendly, especially for users who are less familiar with Kubernetes. By using an operator, users can benefit from consistent version management with the session cluster and upgrade capabilities. Best, Yangze Guo On Fri, Sep 15, 2023 at 5:38 PM Gyula Fó

Re: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-15 Thread Yangze Guo
understanding of FLIP-321, if we want to deprecate the host field, we should annotate the related field / getter / setter with @Deprecated in this version, and keep them at least 2 minor releases. Best, Yangze Guo On Wed, Sep 13, 2023 at 8:52 PM Chen Zhanghao wrote: > > Hi Jing, > > Thanks for th

Re: [VOTE] FLIP-361: Improve GC Metrics

2023-09-15 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Thu, Sep 14, 2023 at 5:47 PM Maximilian Michels wrote: > > +1 (binding) > > On Thu, Sep 14, 2023 at 4:26 AM Venkatakrishnan Sowrirajan > wrote: > > > > +1 (non-binding) > > > > On Wed, Sep 13, 2023, 6:55 PM Matt

Re: [Discuss] CRD for flink sql gateway in the flink k8s operator

2023-09-15 Thread Yangze Guo
for OLAP and batch user. Best, Yangze Guo On Fri, Sep 15, 2023 at 3:19 PM ConradJam wrote: > > If we start from the crd direction, I think this mode is more like a > sidecar of the session cluster, which is submitted to the session cluster > by sending sql commands to the sql gate

Re: [VOTE] FLIP-357: Deprecate Iteration API of DataStream

2023-09-14 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Thu, Sep 14, 2023 at 6:02 PM Yuxin Tan wrote: > > +1 (non-binding) > > Best, > Yuxin > > > Xintong Song 于2023年9月14日周四 17:14写道: > > > +1 (binding) > > > > Best, > > > > Xintong > > > > >

[jira] [Created] (FLINK-33054) Align the job execution result fetching timeout in CollectResultFetcher to akka timeout

2023-09-06 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33054: -- Summary: Align the job execution result fetching timeout in CollectResultFetcher to akka timeout Key: FLINK-33054 URL: https://issues.apache.org/jira/browse/FLINK-33054

[jira] [Created] (FLINK-33053) Watcher leak in Zookeeper HA mode

2023-09-06 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33053: -- Summary: Watcher leak in Zookeeper HA mode Key: FLINK-33053 URL: https://issues.apache.org/jira/browse/FLINK-33053 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-357: Deprecate Iteration API of DataStream

2023-09-01 Thread Yangze Guo
+1 Thanks for driving this. Best, Yangze Guo On Fri, Sep 1, 2023 at 2:00 PM Xintong Song wrote: > > +1 > > Best, > > Xintong > > > > On Fri, Sep 1, 2023 at 1:11 PM Dong Lin wrote: > > > Thanks Wencong for initiating the discussion. > > > &g

[jira] [Created] (FLINK-32879) slotmanager.max-total-resource.cpu/memory should be ignored in standalone mode.

2023-08-15 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-32879: -- Summary: slotmanager.max-total-resource.cpu/memory should be ignored in standalone mode. Key: FLINK-32879 URL: https://issues.apache.org/jira/browse/FLINK-32879 Project

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-08 Thread Yangze Guo
Congrats, Hangxiang! Best, Yangze Guo On Tue, Aug 8, 2023 at 11:28 AM yh z wrote: > > Congratulations, Hangxiang ! > > > Best, > Yunhong Zheng (Swuferhong) > > yuxia 于2023年8月8日周二 09:20写道: > > > Congratulations, Hangxiang ! > > > > Best regard

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-08 Thread Yangze Guo
Congrats, Yanfei! Best, Yangze Guo On Tue, Aug 8, 2023 at 9:20 AM yuxia wrote: > > Congratulations, Yanfei! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "ron9 liu" > 收件人: "dev" > 发送时间: 星期一, 2023年 8 月 07日 下午 11:44:23 > 主题: R

Re: [DISCUSS] How about adding OLAP to Flink Roadmap?

2023-08-07 Thread Yangze Guo
also develop an end-to-end benchmark similar to Nexmark[2]. I'm enthusiastic about participating in this project. [1] https://github.com/apache/flink-benchmarks [2] https://github.com/nexmark/nexmark Best, Yangze Guo On Mon, Aug 7, 2023 at 8:20 PM Matthias Pohl wrote: > > Thanks Sham

[jira] [Created] (FLINK-32771) Remove the invalid config option slotmanager.request-timeout

2023-08-07 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-32771: -- Summary: Remove the invalid config option slotmanager.request-timeout Key: FLINK-32771 URL: https://issues.apache.org/jira/browse/FLINK-32771 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-03 Thread Yangze Guo
Congratulations, Weihua! Well deserved! Best, Yangze Guo On Fri, Aug 4, 2023 at 12:00 PM Paul Lam wrote: > > Congrats, Weihua! > > Best, > Paul Lam > > > 2023年8月4日 11:54,Dan Zou 写道: > > > > Congratulations WeiHua! > > Best, > > Dan Zou > &g

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-03 Thread Yangze Guo
Congrats, Matthias! Best, Yangze Guo On Fri, Aug 4, 2023 at 11:44 AM Qingsheng Ren wrote: > > Congratulations, Matthias! This is absolutely well deserved. > > Best, > Qingsheng > > On Fri, Aug 4, 2023 at 11:31 AM Rui Fan <1996fan...@gmail.com> wrote: > >

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread Yangze Guo
Congrats, Yong! Best, Yangze Guo On Mon, Jul 24, 2023 at 12:02 PM xiangyu feng wrote: > > Congratulations, Yong! > > Best, > Xiangyu > > liu ron 于2023年7月24日周一 11:48写道: > > > Congratulations, > > > > Best, > > Ron > > > > Qin

Re: Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-04 Thread Yangze Guo
Congrats everyone! Best, Yangze Guo On Tue, Jul 4, 2023 at 3:53 PM Rui Fan <1996fan...@gmail.com> wrote: > > Congratulations! > > Best, > Rui Fan > > On Tue, Jul 4, 2023 at 2:08 PM Zhu Zhu wrote: > > > Congratulations everyone! > > > > Thanks,

Re: [VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-24 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Sun, Jun 25, 2023 at 11:41 AM Jark Wu wrote: > > +1 (binding) > > Best, > Jark > > > 2023年6月25日 10:04,Xia Sun 写道: > > > > +1 (non-binding) > > > > Best Regards, > > > > Xia > > > > yuxia

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-23 Thread Yangze Guo
Congratulations, Leonard! Best, Yangze Guo On Mon, Apr 24, 2023 at 10:05 AM Shuo Cheng wrote: > > Congratulations, Leonard. > > Best, > Shuo > > On Sun, Apr 23, 2023 at 7:43 PM Sergey Nuyanzin wrote: > > > Congratulations, Leonard! > > > > On

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-23 Thread Yangze Guo
Congratulations, Qingsheng! Best, Yangze Guo On Mon, Apr 24, 2023 at 10:05 AM Shuo Cheng wrote: > > Congratulations, Qingsheng! > > Best, > Shuo > > On Sun, Apr 23, 2023 at 7:43 PM Sergey Nuyanzin wrote: > > > Congratulations, Qingsheng! > > > > On

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-29 Thread Yangze Guo
Congratulations! Best, Yangze Guo On Wed, Mar 29, 2023 at 1:57 PM Sergey Nuyanzin wrote: > > Congratulations! > > On Wed, Mar 29, 2023 at 4:11 AM Zhu Zhu wrote: > > > Congratulations! > > > > Cheers, > > Zhu > > > > Jing Zhang

Re: [Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-10 Thread Yangze Guo
+1 (binding) Zhanghao Chen 于 2023年3月10日周五 下午5:07写道: > Thanks Weihua. +1 (non-binding) > > Best, > Zhanghao Chen > > From: Weihua Hu > Sent: Thursday, March 9, 2023 13:27 > To: dev > Subject: [Vote] FLIP-298: Unifying the Implementation of SlotManager > > Hi

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-06 Thread Yangze Guo
Hi Weihua, Thanks for driving this. As Xintong mentioned, this was a technical debt from FLIP-56. The latest version of FLIP sounds good, +1 from my side. As a contributor to this component, I'm willing to assist with the review process. Feel free to reach me if you need help. Best, Yangze Guo

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

2022-08-24 Thread Yangze Guo
Congrats! Jark Wu 于 2022年8月24日周三 下午3:47写道: > Congrats Lijie! > > Best, > Jark > > On Wed, 24 Aug 2022 at 15:06, Qingsheng Ren wrote: > > > Congratulations Lijie! > > > > Best regards, > > Qingsheng > > > > > On Aug 22, 2022, at 16:29, Yang Wang wrote: > > > > > > Congrats Lijie! > > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Junhan Yang

2022-08-24 Thread Yangze Guo
Congrats! Jark Wu 于 2022年8月24日周三 下午3:46写道: > Congrats Junhan! > > Best, > Jark > > On Wed, 24 Aug 2022 at 15:05, Qingsheng Ren wrote: > > > Congratulations Junhan! > > > > Best regards, > > Qingsheng > > > > > On Aug 22, 2022, at 16:30, Yang Wang wrote: > > > > > > Congrats Junhan! > > > > >

[jira] [Created] (FLINK-28313) Add history server flag to DashboardConfiguration

2022-06-30 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-28313: -- Summary: Add history server flag to DashboardConfiguration Key: FLINK-28313 URL: https://issues.apache.org/jira/browse/FLINK-28313 Project: Flink Issue Type

[jira] [Created] (FLINK-28312) Introduce REST APIs for log URL retrieval

2022-06-30 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-28312: -- Summary: Introduce REST APIs for log URL retrieval Key: FLINK-28312 URL: https://issues.apache.org/jira/browse/FLINK-28312 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-28311) Introduce REST APIs for the environmental information

2022-06-30 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-28311: -- Summary: Introduce REST APIs for the environmental information Key: FLINK-28311 URL: https://issues.apache.org/jira/browse/FLINK-28311 Project: Flink Issue Type

[jira] [Created] (FLINK-28310) Introduce aggregating task metrics

2022-06-30 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-28310: -- Summary: Introduce aggregating task metrics Key: FLINK-28310 URL: https://issues.apache.org/jira/browse/FLINK-28310 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-28309) Introduce metrics of the duration that a task stays in each status

2022-06-30 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-28309: -- Summary: Introduce metrics of the duration that a task stays in each status Key: FLINK-28309 URL: https://issues.apache.org/jira/browse/FLINK-28309 Project: Flink

[jira] [Created] (FLINK-28308) Introduce accumulated time metrics that a running task is busy / idle / back-pressured

2022-06-30 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-28308: -- Summary: Introduce accumulated time metrics that a running task is busy / idle / back-pressured Key: FLINK-28308 URL: https://issues.apache.org/jira/browse/FLINK-28308

[jira] [Created] (FLINK-28307) FLIP-241: Completed Jobs Information Enhancement

2022-06-30 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-28307: -- Summary: FLIP-241: Completed Jobs Information Enhancement Key: FLINK-28307 URL: https://issues.apache.org/jira/browse/FLINK-28307 Project: Flink Issue Type: New

Re: Re: Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-27 Thread Yangze Guo
Congrats! Well deserved! zst...@163.com 于 2022年6月26日周日 下午5:31写道: > Congratulations, Shengkai and Qingsheng! > > > Best Regards, > Yuan > > > At 2022-06-24 16:45:25,"godfrey he" , said: > >Congrats, Shengkai and Qingsheng! > > > >Best, > >Godfrey > > > >Yu Li 于2022年6月22日周三 23:55写道: > >> > >>

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-27 Thread Yangze Guo
I've updated the FLIP. All of the newly introduced REST APIs will now apply to both the JobManager and the HistoryServer. @Chesnay Schepler @Xintong Song Please take another look at your convenience. Best, Yangze Guo On Fri, Jun 24, 2022 at 5:02 PM junhan yang wrote: > > Distinguish th

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-24 Thread Yangze Guo
Having two separate APIs sounds good to me. I'll update the FLIP accordingly. Best, Yangze Guo On Fri, Jun 24, 2022 at 4:27 PM Xintong Song wrote: > > I see. So you are suggesting the jobmanager to support both /foo/bar and > /jobs/:jobid/foo/bar, while the history server only

Re: [VOTE] FLIP-241: Completed Jobs Information Enhancement

2022-06-22 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Thu, Jun 23, 2022 at 1:07 PM junhan yang wrote: > > Hi everyone, > > Thanks for the feedbacks on the discussion thread[1]. I would like to start > a vote thread here for FLIP-241: Completed Jobs Information Enhancement[2]. > > The vote will

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-06-20 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Mon, Jun 20, 2022 at 2:18 PM Zhu Zhu wrote: > > +1 (binding) > > Thanks, > Zhu > > Yang Wang 于2022年6月20日周一 10:46写道: > > > > +1(binding) > > > > Best, > > Yang > > > > Yun Gao 于2022年6月17日周五 18:03写

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-17 Thread Yangze Guo
. ApplicationId in Yarn might help. But in this case, you can just sort them with the start time. Best, Yangze Guo On Fri, Jun 17, 2022 at 12:13 PM Jiangang Liu wrote: > > Thanks for the FLIP. It is helpful to track detail infos for completed jobs. > > I want to ask another ques

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-16 Thread Yangze Guo
hould describe > the time while the task is working as expected, i.e. the happy path. When do > we need it for analytics or diagnosis? A task could be busy or idle while it is working. Users may adjust the parallelism or the partition key according to the ratio between them. Best, Yangze Guo O

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-15 Thread Yangze Guo
Thanks for driving this, Junhan. I think it's a valuable usability improvement for both streaming and batch users. Looking forward to the community feedback. Best, Yangze Guo On Wed, Jun 15, 2022 at 3:10 PM junhan yang wrote: > > Hi all, > > I would like to open a discussion

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-05-26 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Thu, May 26, 2022 at 3:54 PM Yun Gao wrote: > > Thanks Lijie and Zhu for driving the FLIP! > > The blocked list functionality helps reduce the complexity in maintenance > and the currently design looks good to me, thus +1 from my side (bindi

Re: [VOTE] FLIP-235: Hybrid Shuffle Mode

2022-05-26 Thread Yangze Guo
+1 Best, Yangze Guo On Thu, May 26, 2022 at 4:42 PM Xintong Song wrote: > > +1 > > Best, > > Xintong > > > > On Thu, May 26, 2022 at 3:47 PM weijie guo > wrote: > > > Hi everyone, > > > > Thanks for the feedback for FLIP-235: Hybrid Shuffl

Re: [DISCUSS] FLIP-235: Hybrid Shuffle Mode

2022-05-19 Thread Yangze Guo
for the sum of them? If there is, how does MemoryDataManager and FileDataManager sync the memory usage? 3. How do you disable the slot sharing? If user configures both the slot sharing group and hybrid shuffle, what will happen to that job? Best, Yangze Guo On Thu, May 19, 2022 at 2:41 PM Xintong

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

2022-05-05 Thread Yangze Guo
Congratulations Yang! Best, Yangze Guo On Fri, May 6, 2022 at 10:11 AM Forward Xu wrote: > > Congratulations, Yang! > > > Best, > > Forward > > Jingsong Li 于2022年5月6日周五 10:07写道: > > > Congratulations, Yang! > > > > Best, > > Jingson

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-04-29 Thread Yangze Guo
and allocated? Best, Yangze Guo On Thu, Apr 28, 2022 at 3:11 PM Lijie Wang wrote: > > Hi Konstantin, > > Thanks for your feedback. I will response your 4 remarks: > > > 1) Thanks for reminding me of the controversy. I think “BlockList” is good > enough, and I will change i

[jira] [Created] (FLINK-27409) Cleanup stale slot allocation record when the resource requirement of a job is empty

2022-04-26 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-27409: -- Summary: Cleanup stale slot allocation record when the resource requirement of a job is empty Key: FLINK-27409 URL: https://issues.apache.org/jira/browse/FLINK-27409

[jira] [Created] (FLINK-27256) Log the root exception in closing the task manager connection

2022-04-14 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-27256: -- Summary: Log the root exception in closing the task manager connection Key: FLINK-27256 URL: https://issues.apache.org/jira/browse/FLINK-27256 Project: Flink

  1   2   3   4   >