Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-04 Thread Biao Geng
Congratulations, Weijie! Best, Biao Geng Yun Tang 于2024年6月5日周三 10:42写道: > Congratulations, Weijie! > > Best > Yun Tang > > From: Hangxiang Yu > Sent: Wednesday, June 5, 2024 10:00 > To: dev@flink.apache.org > Subject: Re: [ANN

Re: Best Practices? Fault Isolation for Processing Large Number of Same-Shaped Input Kafka Topics in a Big Flink Job

2024-05-12 Thread Biao Geng
are distributed or replicated correctly. When upstream kafka brokers fail due to some common reasons, the downstream flink job can do nothing. Hope these points help! Best, Biao Geng Kevin Lam 于2024年5月9日周四 03:52写道: > Hi everyone, > > I'm currently prototyping on a project where we need t

[jira] [Created] (FLINK-35273) PyFlink's LocalZonedTimestampType should respect timezone set by set_local_timezone

2024-04-30 Thread Biao Geng (Jira)
Biao Geng created FLINK-35273: - Summary: PyFlink's LocalZonedTimestampType should respect timezone set by set_local_timezone Key: FLINK-35273 URL: https://issues.apache.org/jira/browse/FLINK-35273

Re: [VOTE] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-26 Thread Biao Geng
+1 (non-binding) Best, Biao Geng gongzhongqiang 于2024年4月26日周五 00:41写道: > +1( (non-binding) > > > Best, > Zhongqiang Gong > > Mate Czagany 于2024年4月24日周三 16:06写道: > > > Hi everyone, > > > > I'd like to start a vote on the FLIP-446: Kubernetes Operator

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-14 Thread Biao Geng
Congrats, Jing! Best, Biao Geng Zakelly Lan 于2024年4月15日周一 10:17写道: > Congratulations, Jing! > > > Best, > Zakelly > > On Sat, Apr 13, 2024 at 12:47 AM Ferenc Csaky > wrote: > > > Congratulations, Jing! > > > > Best, > > Ferenc > >

Re: [VOTE] FLIP-355: Add parent dir of files to classpath using yarn.provided.lib.dirs

2023-09-14 Thread Biao Geng
+1 (non-binding) Best, Biao Geng Yang Wang 于2023年9月14日周四 12:07写道: > +1 (binding) > > Best, > Yang > > Becket Qin 于2023年9月14日周四 11:01写道: > > > +1 (binding) > > > > Thanks for the FLIP, Archit. > > > > Cheers, > > > > Jiangjie (Be

Re: [Discuss] FLIP-355: Add parent dir of files to classpath using yarn.provided.lib.dirs

2023-09-12 Thread Biao Geng
+1 for the FLIP. Another side thought is that in my experience, when users want to make Flink TM use a specific hadoop/hive configuration, an easier way is to ship the corresponding conf dir and set the env variable via containerized.taskmanager.env.HADOOP_CONF_DIR. Best, Biao Geng Archit Goyal

Re: [DISSCUSS] Kubernetes Operator Flink Version Support Policy

2023-09-06 Thread Biao Geng
+1 for the proposal. Best, Biao Geng Gyula Fóra 于2023年9月6日周三 16:10写道: > @Zhanghao Chen: > > I am not completely sure at this point what this will mean for 2.0 simply > because I am also not sure what that will mean for the operator as well :) > I think this will depend on th

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread Biao Geng
Congrats, Hangxiang! Best, Biao Geng 发送自 Outlook for iOS<https://aka.ms/o0ukef> 发件人: Qingsheng Ren 发送时间: Monday, August 7, 2023 4:23:11 PM 收件人: dev@flink.apache.org 主题: Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu Congratulations and welcome

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread Biao Geng
Congrats, Yanfei! Best, Biao Geng 发送自 Outlook for iOS<https://aka.ms/o0ukef> 发件人: Qingsheng Ren 发送时间: Monday, August 7, 2023 4:23:52 PM 收件人: dev@flink.apache.org 主题: Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei Congratulations and welcome,

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-30 Thread Biao Geng
fields like org.apache.flink.table.resource.ResourceManager#userClassLoader. It may be worthwhile to add more details about the serialization part. Best, Biao Geng Paul Lam 于2023年5月31日周三 11:49写道: > Hi Weihua, > > Thanks a lot for your input! Please see my comments inline. > > > - Is SQLRunner the better name

Re: 您好,退订

2023-05-05 Thread Biao Geng
你好,可以通过发送包含任意内容的邮件到 dev-unsubscr...@flink.apache.org 来取消dev订阅。 Best, Biao Geng Fang jun 于2023年5月5日周五 14:07写道: > > > Sent from my iPhone >

Re: 退订

2023-05-05 Thread Biao Geng
你好,可以通过发送包含任意内容的邮件到 dev-unsubscr...@flink.apache.org 来取消dev订阅。 Best, Biao Geng houyui <2008-ho...@163.com> 于2023年5月5日周五 13:33写道: > 您好: >退订!

[jira] [Created] (FLINK-31964) Improve the document of Autoscaler as 1.17.0 is released

2023-04-27 Thread Biao Geng (Jira)
Biao Geng created FLINK-31964: - Summary: Improve the document of Autoscaler as 1.17.0 is released Key: FLINK-31964 URL: https://issues.apache.org/jira/browse/FLINK-31964 Project: Flink Issue

Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-24 Thread Biao Geng
+1 (non-binding) Best, Biao Geng Martijn Visser 于2023年4月24日周一 20:20写道: > +1 (binding) > > On Mon, Apr 24, 2023 at 4:10 AM Feng Jin wrote: > > > +1 (non-binding) > > > > > > Best, > > Feng > > > > On Mon, Apr 24, 2023 at 9:55 AM Hang Ruan

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Biao Geng
Congrats, Rui! Best, Biao Geng weijie guo 于2023年2月21日周二 11:21写道: > Congrats, Rui! > > Best regards, > > Weijie > > > Leonard Xu 于2023年2月21日周二 11:03写道: > > > Congratulations, Rui! > > > > Best, > > Leonard > > > > > On Fe

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Biao Geng
Congrats, Lincoln! Best, Biao Geng 获取 Outlook for iOS<https://aka.ms/o0ukef> 发件人: Wencong Liu 发送时间: Tuesday, January 10, 2023 2:39:47 PM 收件人: dev@flink.apache.org 主题: Re:Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee Congratulations, Lincoln!

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.3.0 released

2022-12-16 Thread Biao Geng
Congratulations! Thanks a lot for the awesome work! Best regards, Biao Geng Őrhidi Mátyás 于2022年12月15日周四 01:30写道: > The Apache Flink community is very happy to announce the release of Apache > Flink Kubernetes Operator 1.3.0. > > Release highlights: > >- Upgrade to Fabri

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-05 Thread Biao Geng
erator with it! Best, Biao Geng From: Maximilian Michels Date: Saturday, November 5, 2022 at 2:37 AM To: dev Cc: Gyula Fóra , Thomas Weise , Marton Balassi , Őrhidi Mátyás Subject: [DISCUSS] FLIP-271: Autoscaling Hi, I would like to kick off the discussion on implementing autoscaling for Flink a

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.2.0, release candidate #2

2022-10-06 Thread Biao Geng
in application mode - Check licenses in source code Best, Biao Geng Maximilian Michels 于2022年10月6日周四 20:16写道: > Turns out the issue with the Helm installation was that I was using > cert-manager 1.9.1 instead of the recommended version 1.8.2. The operator > now deploys cleanly in my local en

[jira] [Created] (FLINK-29529) Update flink version in flink-python-example of flink k8s operator

2022-10-06 Thread Biao Geng (Jira)
Biao Geng created FLINK-29529: - Summary: Update flink version in flink-python-example of flink k8s operator Key: FLINK-29529 URL: https://issues.apache.org/jira/browse/FLINK-29529 Project: Flink

[jira] [Created] (FLINK-29362) Allow loading dynamic config for kerberos authentication in CliFrontend

2022-09-20 Thread Biao Geng (Jira)
Biao Geng created FLINK-29362: - Summary: Allow loading dynamic config for kerberos authentication in CliFrontend Key: FLINK-29362 URL: https://issues.apache.org/jira/browse/FLINK-29362 Project: Flink

[jira] [Created] (FLINK-28769) Flink History Server show wrong name of batch jobs

2022-08-01 Thread Biao Geng (Jira)
Biao Geng created FLINK-28769: - Summary: Flink History Server show wrong name of batch jobs Key: FLINK-28769 URL: https://issues.apache.org/jira/browse/FLINK-28769 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28503) Fix invalid link in Python FAQ Document

2022-07-12 Thread Biao Geng (Jira)
Biao Geng created FLINK-28503: - Summary: Fix invalid link in Python FAQ Document Key: FLINK-28503 URL: https://issues.apache.org/jira/browse/FLINK-28503 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-28495) Fix typos or mistakes of Flink CEP Document in the official website

2022-07-11 Thread Biao Geng (Jira)
Biao Geng created FLINK-28495: - Summary: Fix typos or mistakes of Flink CEP Document in the official website Key: FLINK-28495 URL: https://issues.apache.org/jira/browse/FLINK-28495 Project: Flink

[jira] [Created] (FLINK-28025) Document the change of serviceAccount in upgrading doc of k8s opeator

2022-06-13 Thread Biao Geng (Jira)
Biao Geng created FLINK-28025: - Summary: Document the change of serviceAccount in upgrading doc of k8s opeator Key: FLINK-28025 URL: https://issues.apache.org/jira/browse/FLINK-28025 Project: Flink

[jira] [Created] (FLINK-27894) Build flink-connector-hive failed using Maven@3.8.5

2022-06-03 Thread Biao Geng (Jira)
Biao Geng created FLINK-27894: - Summary: Build flink-connector-hive failed using Maven@3.8.5 Key: FLINK-27894 URL: https://issues.apache.org/jira/browse/FLINK-27894 Project: Flink Issue Type

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.0, release candidate #4

2022-06-01 Thread Biao Geng
applications without errors - Check licenses in the docs dir in source code - Submit ~50 streaming jobs using the same k8s operator deployment and the whole cluster works fine Best, Biao Geng Márton Balassi 于2022年6月1日周三 22:12写道: > Hi team, > > +1 (binding) > > Verified the following: &g

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.0, release candidate #1

2022-05-24 Thread Biao Geng
ound new issues besides what Gyula has mentioned. I will follow our jira list to validate other new features or improvements. Best, Biao Geng Yang Wang 于2022年5月24日周二 16:08写道: > Thanks Gyula for sharing the feedback. > > I have created two tickets[1][2] to fix the problems and will

Re: Job Logs - Yarn Application Mode

2022-05-19 Thread Biao Geng
to Flink web ui. Best, Biao Geng Shengkai Fang 于2022年5月20日周五 10:59写道: > Hi. > > I am not familiar with the YARN application mode. Because the job manager > is started when submit the jobs. So how can users know the address of the > JM? Do we need to look up the Yarn UI to searc

[jira] [Created] (FLINK-27615) Document the minimum supported version of k8s for flink k8s operator

2022-05-14 Thread Biao Geng (Jira)
Biao Geng created FLINK-27615: - Summary: Document the minimum supported version of k8s for flink k8s operator Key: FLINK-27615 URL: https://issues.apache.org/jira/browse/FLINK-27615 Project: Flink

[jira] [Created] (FLINK-27329) Add default value of replica of JM pod and remove declaring it in example yamls

2022-04-20 Thread Biao Geng (Jira)
Biao Geng created FLINK-27329: - Summary: Add default value of replica of JM pod and remove declaring it in example yamls Key: FLINK-27329 URL: https://issues.apache.org/jira/browse/FLINK-27329 Project

[jira] [Created] (FLINK-27309) Allow to load default flink configs in the k8s operator dynamically

2022-04-19 Thread Biao Geng (Jira)
Biao Geng created FLINK-27309: - Summary: Allow to load default flink configs in the k8s operator dynamically Key: FLINK-27309 URL: https://issues.apache.org/jira/browse/FLINK-27309 Project: Flink

[jira] [Created] (FLINK-27109) The naming pattern of ClusterRole in Flink K8s operator should consider namespace

2022-04-07 Thread Biao Geng (Jira)
Biao Geng created FLINK-27109: - Summary: The naming pattern of ClusterRole in Flink K8s operator should consider namespace Key: FLINK-27109 URL: https://issues.apache.org/jira/browse/FLINK-27109 Project

[jira] [Created] (FLINK-27009) Support SQL job submission in flink kubernetes opeartor

2022-04-02 Thread Biao Geng (Jira)
Biao Geng created FLINK-27009: - Summary: Support SQL job submission in flink kubernetes opeartor Key: FLINK-27009 URL: https://issues.apache.org/jira/browse/FLINK-27009 Project: Flink Issue Type

Re: [VOTE] Apache Flink Kubernetes Operator Release 0.1.0, release candidate #3

2022-03-31 Thread Biao Geng
+1 (non-binding) 1. Verify that the checksums and GPG files 2. Verify that the source distributions do not contain any binaries 3. Build the source distribution to ensure all source files 4. Verify that POM files and the README.md file do not have anything unexpected. 6. Verify that chart and

Re: [VOTE] Apache Flink Kubernetes Operator Release 0.1.0, release candidate #2

2022-03-30 Thread Biao Geng
Thanks Marton, I vote for consistency and `flink-kubernetes-operator` as well. `flink-operator` have been used widely in docker hub and other k8s operator implementations, which may confuse users. Best, Biao Gyula Fóra 于2022年3月30日周三 16:26写道: > Thanks Marton! > I think we should aim for

[jira] [Created] (FLINK-26832) Output more status info for JobObserver

2022-03-23 Thread Biao Geng (Jira)
Biao Geng created FLINK-26832: - Summary: Output more status info for JobObserver Key: FLINK-26832 URL: https://issues.apache.org/jira/browse/FLINK-26832 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26825) Document State Machine Graph for JM Deployment

2022-03-23 Thread Biao Geng (Jira)
Biao Geng created FLINK-26825: - Summary: Document State Machine Graph for JM Deployment Key: FLINK-26825 URL: https://issues.apache.org/jira/browse/FLINK-26825 Project: Flink Issue Type: Sub

Re: [VOTE]FLIP-215: Introduce FlinkSessionJob CRD in the kubernetes operator

2022-03-18 Thread Biao Geng
+1(non-binding) Thanks for the work! Best, Biao Geng Yang Wang 于2022年3月18日周五 19:01写道: > +1(binding) > > Thanks for your contribution. > > Best, > Yang > > Gyula Fóra 于2022年3月18日周五 18:44写道: > > > I think this is a simple and valuable addition that will also be

[jira] [Created] (FLINK-26671) Update 'Developer Guide' in README

2022-03-16 Thread Biao Geng (Jira)
Biao Geng created FLINK-26671: - Summary: Update 'Developer Guide' in README Key: FLINK-26671 URL: https://issues.apache.org/jira/browse/FLINK-26671 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26655) Merge isJobManagerPortReady and isJobManagerServing to check if JM pod can work correctly

2022-03-15 Thread Biao Geng (Jira)
Biao Geng created FLINK-26655: - Summary: Merge isJobManagerPortReady and isJobManagerServing to check if JM pod can work correctly Key: FLINK-26655 URL: https://issues.apache.org/jira/browse/FLINK-26655

Re: [DISCUSS] Preview release for Flink Kubernetes Operator

2022-03-13 Thread Biao Geng
the FLIP, it may be more convenient and can also help us write release notes later. I also created a draft <https://github.com/bgeng777/flink-kubernetes-operator/blob/features/doc/features.md> for myself to track completed or in-plan features. Hope it can help. Best, Biao Geng Gyula Fóra

[jira] [Created] (FLINK-26405) Add validation check of num of JM replica

2022-02-28 Thread Biao Geng (Jira)
Biao Geng created FLINK-26405: - Summary: Add validation check of num of JM replica Key: FLINK-26405 URL: https://issues.apache.org/jira/browse/FLINK-26405 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Flink Kubernetes Operator controller flow

2022-02-28 Thread Biao Geng
Hi Gyula, Thanks for the discussion. It also makes senses to me on the separation of 3 components and Yang's proposal. Just 1 follow-up thought after checking your PR: in the reconcile() method of controller, IIUC, the real flow could be

[jira] [Created] (FLINK-26216) Make 'replicas' work in JobManager Spec

2022-02-17 Thread Biao Geng (Jira)
Biao Geng created FLINK-26216: - Summary: Make 'replicas' work in JobManager Spec Key: FLINK-26216 URL: https://issues.apache.org/jira/browse/FLINK-26216 Project: Flink Issue Type: Bug

Re: Azure Pipelines are dealing with an incident, causing pipeline runs to fail

2022-02-10 Thread Biao Geng
Just notice that there are some recent pipelines that have finished successfully[1]. It seems that this issue is mitigated. [1] https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=31194=results Martijn Visser 于2022年2月10日周四 15:48写道: > It looks like the issues haven't been

[jira] [Created] (FLINK-26047) Support usrlib in HDFS for YARN application mode

2022-02-09 Thread Biao Geng (Jira)
Biao Geng created FLINK-26047: - Summary: Support usrlib in HDFS for YARN application mode Key: FLINK-26047 URL: https://issues.apache.org/jira/browse/FLINK-26047 Project: Flink Issue Type

[jira] [Created] (FLINK-26030) Set FLINK_LIB_DIR to lib under working dir in YARN containers

2022-02-08 Thread Biao Geng (Jira)
Biao Geng created FLINK-26030: - Summary: Set FLINK_LIB_DIR to lib under working dir in YARN containers Key: FLINK-26030 URL: https://issues.apache.org/jira/browse/FLINK-26030 Project: Flink

Re: [VOTE] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-06 Thread Biao Geng
+1 (non-binding) Best, Biao Geng Peter Huang 于2022年2月7日周一 14:31写道: > +1 (non-binding) > > > Best Regards > Peter Huang > > On Sun, Feb 6, 2022 at 7:35 PM Yang Wang wrote: > > > +1 (binding) > > > > Best, > > Yang > > > &g

Re: Looking for Maintainers for Flink on YARN

2022-01-26 Thread Biao Geng
Hi Konstantin, I am willing to be one maintainer of Flink on YARN. I have some relevant experience in maintaining Flink on YARN clusters in Alibaba and I hope I can make contributions to some of the cases in your list. Best, Biao Geng Konstantin Knauf 于2022年1月26日 周三17:17写道: > Hi every

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-01-26 Thread Biao Geng
FLIP impl! Best regard, Biao Geng [1] https://lists.apache.org/thread/l1dkp8v4bhlcyb4tdts99g7w4wdglfy4 [2] https://github.com/wangyang0918/flink-native-k8s-operator [3] https://github.com/GoogleCloudPlatform/flink-on-k8s-operator/pull/354 Yang Wang 于2022年1月26日周三 15:25写道: > Thanks Thomas for crea

Re: [DISCUSS] Future of Per-Job Mode

2022-01-13 Thread Biao Geng
it is worthwhile to consider dependency management more carefully before we make decisions. Best, Biao Geng Konstantin Knauf 于2022年1月13日周四 16:32写道: > Hi everyone, > > I would like to discuss and understand if the benefits of having Per-Job > Mode in Apache Flink outweigh i

[jira] [Created] (FLINK-24897) Enable application mode on YARN to use usrlib

2021-11-15 Thread Biao Geng (Jira)
Biao Geng created FLINK-24897: - Summary: Enable application mode on YARN to use usrlib Key: FLINK-24897 URL: https://issues.apache.org/jira/browse/FLINK-24897 Project: Flink Issue Type

[jira] [Created] (FLINK-24682) Unify the -C option behavior in both yarn application and per-job mode

2021-10-28 Thread Biao Geng (Jira)
Biao Geng created FLINK-24682: - Summary: Unify the -C option behavior in both yarn application and per-job mode Key: FLINK-24682 URL: https://issues.apache.org/jira/browse/FLINK-24682 Project: Flink