Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

2024-06-05 Thread Paul Lam
Congrats, Rui! Best, Paul Lam > 2024年6月6日 11:02,Junrui Lee 写道: > > Congratulations, Rui. > > Best, > Junrui > > Hang Ruan 于2024年6月6日周四 10:35写道: > >> Congratulations, Rui! >> >> Best, >> Hang >> >> Samrat Deb 于2024年6月6日周四

Re: [DISCUSSION] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-05-07 Thread Paul Lam
a migration (which is not yet supported). Best, Paul Lam > 2024年5月7日 14:38,Alexey Leonov-Vendrovskiy 写道: > > Hi everyone, > > PTAL at the proposed FLIP-456: CompiledPlan support for Batch Execution > Mode. It is pretty self-describing. > > Any thoughts are welcom

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Paul Lam
Congrats, Lincoln! Best, Paul Lam > 2024年4月12日 16:28,Rui Fan <1996fan...@gmail.com> 写道: > > Congratulations, Lincoln!

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Paul Lam
Congrats! Best, Paul Lam > 2024年3月28日 16:03,Rui Fan <1996fan...@gmail.com> 写道: > > Congratulations~ > > Best, > Rui > > On Thu, Mar 28, 2024 at 3:55 PM Yu Li wrote: > >> CC the Flink user and dev mailing list. >> >> Paimon originated w

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Paul Lam
Congrats! Thanks to everyone involved! Best, Paul Lam > 2024年3月18日 16:37,Samrat Deb 写道: > > Congratulations ! > > On Mon, 18 Mar 2024 at 2:07 PM, Jingsong Li wrote: > >> Congratulations! >> >> On Mon, Mar 18, 2024 at 4:30 PM Rui Fan <1996fan...@gma

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-19 Thread Paul Lam
Congrats, Jiabao! Best, Paul Lam > 2024年2月20日 10:29,Zakelly Lan 写道: > >> Congrats! Jiabao!

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-12-10 Thread Paul Lam
ing a POC on YARN application mode before starting a vote thread. I’ve been busy lately, but the FLIP is active for sure. The situation will change in a couple of weeks. Thank you for reaching out! I’ll let you know when the POC is completed. Best, Paul Lam > 2023年11月21日 06:01,Ferenc Csaky 写道

Re: [DISCUSS] FLIP-383: Support Job Recovery for Batch Jobs

2023-12-04 Thread Paul Lam
at once and run in parallel. Instead, they could be dependent on other jobs like a DAG. The schedule of the jobs is controlled by the user's main method. IIUC, in the FLIP, the main method is lost after the recovery, and only submitted jobs would be recovered. Is that right? Best, Paul Lam > 2023

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread Paul Lam
Finally! Thanks to all! Best, Paul Lam > 2023年10月27日 03:58,Alexander Fedulov 写道: > > Great work, thanks everyone! > > Best, > Alexander > > On Thu, 26 Oct 2023 at 21:15, Martijn Visser > wrote: > >> Thank you all who have contributed! >> >

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-15 Thread Paul Lam
Congrats, Jane! Best, Paul Lam > 2023年10月16日 09:58,Jark Wu 写道: > > Hi, everyone > > On behalf of the PMC, I'm very happy to announce Jane Chan as a new Flink > Committer. > > Jane started code contribution in Jan 2021 and has been active in the Flink > community si

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-04 Thread Paul Lam
Congrats, Hong! Best, Paul Lam > 2023年8月4日 14:59,Jark Wu 写道: > > Congratulations, Hong! > > Best, > Jark > > On Fri, 4 Aug 2023 at 14:24, Sergey Nuyanzin wrote: > >> Congratulations, Hong! >> >> On Fri, Aug 4, 2023 at 7:25 AM Shammon FY wrote:

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-04 Thread Paul Lam
Congratulation, Matthias! Best, Paul Lam > 2023年8月4日 15:09,yuxia 写道: > > Congratulation, Matthias! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Yun Tang" > 收件人: "dev" > 发送时间: 星期五, 2023年 8 月 04日 下午 3:04:52 > 主题: Re

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-03 Thread Paul Lam
Congrats, Weihua! Best, Paul Lam > 2023年8月4日 11:54,Dan Zou 写道: > > Congratulations WeiHua! > Best, > Dan Zou > > > > > >> 2023年8月4日 11:30,Leonard Xu 写道: >> >> Congratulations >

Re: [DISCUSS] FLIP-348: Support System Columns in SQL and Table API

2023-08-02 Thread Paul Lam
very accessible and more aligned across the catalogs. BTW, I second Alexey that systems columns should not be shown with DESCRIBE statements. WDYT? Thanks! Best, Paul Lam > 2023年7月31日 23:54,Jark Wu 写道: > > Hi Timo, > > Thanks for your proposal. I think this is a nice feature

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread Paul Lam
Congrats, Shammon! Best, Paul Lam > 2023年7月24日 10:56,Jingsong Li 写道: > > Shammon

Re: Kubernetes Operator 1.6.0 release planning

2023-07-20 Thread Paul Lam
Thanks, Gyula. +1 (non-binding) Best, Paul Lam > 2023年7月20日 19:18,Márton Balassi 写道: > > Thanks, Gyula. > > +1 (binding) > > On Thu, Jul 20, 2023 at 5:01 AM Samrat Deb wrote: > >> thank you gyula , >> for driving it. >> +1(non binding) >>

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-05 Thread Paul Lam
Congrats and cheers! Best, Paul Lam > 2023年7月4日 18:04,Benchao Li 写道: > > Congratulations! > > Feng Jin 于2023年7月4日周二 16:17写道: > >> Congratulations! >> >> Best, >> Feng Jin >> >> >> >> On Tue, Jul 4, 2023 at 4:13 PM Y

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-29 Thread Paul Lam
ictures have transparent background when readers click on it. It > would be great if you can replace them with pictures with white background. Fixed. Thanks for pointing that out :) Best, Paul Lam > 2023年6月27日 06:51,Jing Ge 写道: > > Hi Paul, > > Thanks for driving it and thank you all

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-26 Thread Paul Lam
e I get the job done. Best, Paul Lam > 2023年6月26日 14:27,Shengkai Fang 写道: > > Hi, Paul. > > Thanks for your update. I have a few questions about the new design: > > * How can we ship the json plan to the JobManager? > > The current design only exposes an option a

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-19 Thread Paul Lam
. We could make follow-up discussions in the jira tickets. Best, Paul Lam > 2023年6月12日 15:29,Shengkai Fang 写道: > > > > If it’s the case, I’m good with introducing a new module and making SQL > > Driver > > an internal class and accepts JSON plans only. > >

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-12 Thread Paul Lam
ies to the JobManager/TaskManager local directory > before working. > > The first step could be done in another ticket in Flink. Or some external > Flink jobs management system > could also take care of this. > > [1]. https://issues.apache.org/jira/browse/FLINK-28915 > >

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-09 Thread Paul Lam
correctly. cc'ed @Yang to gather more opinions. [1] https://spark.apache.org/docs/latest/running-on-kubernetes.html#dependency-management Best, Paul Lam > 2023年6月8日 12:15,Mason Chen 写道: > > Hi Paul, > > Thanks for your response! > > I agree that utilizing SQL Drivers

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-08 Thread Paul Lam
ore about the benefit we get from an extra loader? Best, Paul Lam > 2023年6月7日 17:25,Shengkai Fang 写道: > > Hi. Paul. Thanks for your update and the update makes me understand the > design much better. > > But I still have some questions about the FLIP. > >> For S

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-08 Thread Paul Lam
big +1 for a built-in file distribution mechanism on K8s. Best, Paul Lam > 2023年6月7日 10:51,Weihua Hu 写道: > > Hi, > > Thanks for updating the FLIP. > > I have two cents on the distribution of SQLs and resources. > 1. Should we support a common file distribution mechani

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-06 Thread Paul Lam
cific to it. Best, Paul Lam > 2023年6月6日 06:30,Mason Chen 写道: > > Hi Paul, > > +1 for this feature and supporting SQL file + JSON plans. We get a lot of > requests to just be able to submit a SQL file, but the JSON plan > optimizations make sense. > > +1 for init cont

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-05 Thread Paul Lam
ache.org/confluence/display/FLINK/FLIP-316:+Introduce+SQL+Driver [3] https://github.com/apache/flink/blob/3245e0443b2a4663552a5b707c5c8c46876c1f6d/flink-runtime/src/test/java/org/apache/flink/runtime/state/filesystem/AbstractFileCheckpointStorageAccessTestBase.java#L161 Best, Paul Lam > 2023年

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-02 Thread Paul Lam
. Hopefully, we can further align our opinions. Best, Paul Lam > 2023年6月2日 18:02,Paul Lam 写道: > > Hi Jark, > > Thanks a lot for your input! > >> If we decide to submit ExecNodeGraph instead of SQL file, is it still >> necessary to support SQL Driver? > >

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-02 Thread Paul Lam
stems or use init containers to localize the resources. Now I lean toward introducing a fs to do the distribution job. WDYT? Best, Paul Lam > 2023年6月1日 20:33,Jark Wu 写道: > > Hi Paul, > > Thanks for starting this discussion. I like the proposal! This is a > frequently requested feature!

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-01 Thread Paul Lam
. Flink may enforce single-job execution in application mode, in that case, I guess we must execute one stored procedure with its dedicated Flink cluster, am I right? Thanks! Best, Paul Lam > 2023年6月1日 17:04,yuxia 写道: > > Sorry for missing the importart part, repeat it agin:

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-01 Thread Paul Lam
://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/overview/ Best, Paul Lam > 2023年6月1日 13:55,Weihua Hu 写道: > > Thanks Paul for your reply. > > SQLDriver looks good to me. > > 2. Do you mean a pass the SQL string a configuration or a program argume

Re: [DISCUSSION] Improved USER/SYSTEM exception wrapping in Flink code base

2023-05-31 Thread Paul Lam
the exceptions by which classloader it comes from. In addition, we could introduce extra configurations to allow manual execution classification based on the package name of exceptions. [1] https://lists.apache.org/thread/gms4nysnb3o4v2k6421m5hsq0g7gtr81 Best, Paul Lam > 2023年5月25日 23:07,Teoh, Hong

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-31 Thread Paul Lam
about the serialization part. I agree. That’s a missing part. But if we use ExecNodeGraph as Shengkai mentioned, do we eliminate the need for serialization of SessionState? Best, Paul Lam > 2023年5月31日 13:07,Biao Geng 写道: > > Thanks Paul for the proposal!I believe it would be very useful f

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-31 Thread Paul Lam
rror handling, execution workflow, and the impact on job > statements? Sure. I’ll let you know when I finish the details. Paul Lam > 2023年5月31日 10:56,Shengkai Fang 写道: > > Thanks for the proposal. The Application mode is very important to Flink > SQL. But I have some questions about the

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-30 Thread Paul Lam
Sorry for the typo. I mean “We already have a PythonDriver doing the same job for PyFlink." Best, Paul Lam > 2023年5月31日 11:49,Paul Lam 写道: > > 1. I have a PythonDriver doing the same job for PyFlink [1]

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-30 Thread Paul Lam
configuration and SQL init file to customize the default session configuration. - For web submission, there’s no dynamic configuration as I’m aware of. Do you think it’s sufficient already or is it still necessary to implement it at the SQL driver level? Best, Paul Lam > 2023年5月31日 10:40,Shammon FY

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-30 Thread Paul Lam
g command: ``` ./bin/flink run \ --pyModule table.word_count \ --pyFiles examples/python/table ``` The CLI determines if it’s a SQL job, if yes apply the SQL Driver automatically. [1] https://github.com/apache/flink/blob/master/flink-python/src/main/java/org/apache/flink/client/python/Py

[DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-29 Thread Paul Lam
INK-26541> Best, Paul Lam

Inconsistent Display Formats of TIMESTAMP_LTZ

2023-04-25 Thread Paul Lam
/src/main/java/org/apache/flink/formats/common/TimeFormats.java#L82> [3] https://docs.snowflake.com/en/sql-reference/data-types-datetime#timestamp-examples <https://docs.snowflake.com/en/sql-reference/data-types-datetime#timestamp-examples> Best, Paul Lam

Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-22 Thread Paul Lam
+1 (non-binding) Best, Paul Lam > 2023年4月23日 10:57,Shammon FY 写道: > > +1 (non-binding) > > Best, > Shammon FY > > On Sun, Apr 23, 2023 at 10:35 AM Qingsheng Ren <mailto:renqs...@gmail.com>> wrote: > >> Thanks for pushing this FLIP forward,

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-22 Thread Paul Lam
Congrats, Leonard! Best, Paul Lam > 2023年4月23日 11:08,Junrui Lee 写道: > > Congratulations, Leonard! > > Best, > Junrui > > Wencong Liu 于2023年4月23日周日 11:05写道: > >> Congratulations, Leonard! >> >> Best, >> Wencong LIu >> >> &g

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Paul Lam
Congrats, Rui! Best, Paul Lam > 2023年2月21日 09:50,Matt Wang 写道: > > Congrats Rui > > > -- > > Best, > Matt Wang > > > Replied Message > | From | yuxia | > | Date | 02/21/2023 09:22 | > | To | dev | > | Subject | Re: [ANNOUNCE] New A

Re: [VOTE] FLIP-275: Support Remote SQL Client Based on SQL Gateway

2022-12-20 Thread Paul Lam
+1 (non-binding) Best, Paul Lam > 2022年12月20日 11:35,Shengkai Fang 写道: > > +1(binding) > > Best, > Shengkai > > yu zelin 于2022年12月14日周三 20:41写道: > >> Hi, all, >> >> Thanks for all your feedbacks so far. Through the discussion on this >>

Re: [VOTE] FLIP-273: Improve Catalog API to Support ALTER TABLE syntax

2022-12-01 Thread Paul Lam
+1 (non-binding) Best, Paul Lam > 2022年12月2日 09:17,yuxia 写道: > > +1 (non-binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Yaroslav Tkachenko" > 收件人: "dev" > 发送时间: 星期五, 2022年 12 月 02日 上午 12:27:24 > 主题: Re: [VOTE] FLI

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-22 Thread Paul Lam
Congrats, Matyas! Best, Paul Lam > 2022年11月22日 15:35,Sergey Nuyanzin 写道: > > Congratulations, Matyas! > > On Tue, Nov 22, 2022 at 8:31 AM Steven Wu wrote: > >> Congrats, Matyas! >> >> On Mon, Nov 21, 2022 at 11:19 PM godfrey he wrote: >> >

Re: [DISCUSS]Introduce a time-segment based restart strategy

2022-11-21 Thread Paul Lam
Dong’s proposal LGTM. Best, Paul Lam > 2022年11月19日 10:50,Dong Lin 写道: > > Hey Weihua, > > Thanks for proposing the new strategy! > > If I understand correctly, the main issue is that different failover > regions can be restarted independently, but they share the same

Re: [DISCUSS]Introduce a time-segment based restart strategy

2022-11-04 Thread Paul Lam
fine-grained and wouldn’t increase the unnecessary retry time if the job are failed due to different causes. Best, Paul Lam > 2022年11月4日 17:33,Paul Lam 写道: > > Hi Weihua, > > +1 for the new restart strategy you suggested. > > We’re also using failure-rate strategy as the

Re: [DISCUSS]Introduce a time-segment based restart strategy

2022-11-04 Thread Paul Lam
prevent counting further errors after the first failure happens, so that a burst errors would not exhaust the number of allow failures. Best, Paul Lam > 2022年11月4日 16:45,Weihua Hu 写道: > > Hi, everyone > > I'd like to bring up a discussion about restart strategy. Flink sup

Re: [ANNOUNCE] Apache Flink 1.16.0 released

2022-10-30 Thread Paul Lam
Congrats! Finally! Best, Paul Lam > 2022年10月31日 11:58,Yuxin Tan 写道: > > Congrats! Glad to hear that. > > Best, > Yuxin > > > weijie guo 于2022年10月31日周一 11:51写道: > >> Congratulations, this is a version with many new features and thanks to >&

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-10-10 Thread Paul Lam
Congrats, Danny! Best, Paul Lam > 2022年10月10日 15:05,Robert Metzger 写道: > > Hi everyone, > > I'm very happy and excited to announce that Danny Cranmer has joined the > Flink PMC! > > Danny has been a committer since January 2021. He has been very active with > al

Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser

2022-09-12 Thread Paul Lam
Congrats, Martijn! Well deserved! Best, Paul Lam > 2022年9月13日 10:53,Jingsong Li 写道: > > Congrats, Martijn! > > Best, > Jingsong > > On Tue, Sep 13, 2022 at 10:48 AM Yang Wang wrote: >> >> Congrats, Martijn! >> >> Best,

Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-20 Thread Paul Lam
Congrats, Qingsheng and Shengkai! Best, Paul Lam > 2022年6月20日 15:57,Martijn Visser 写道: > > Congratulations to both of you, this is very much deserved! > > Op ma 20 jun. 2022 om 09:53 schreef Jark Wu : > >> Hi everyone, >> >> On behalf of the PMC, I'm

[RESULT][VOTE] FLIP-222: Support full job lifecycle statements in SQL client

2022-06-17 Thread Paul Lam
] https://cwiki.apache.org/confluence/display/FLINK/FLIP-222%3A+Support+full+job+lifecycle+statements+in+SQL+client [2] https://lists.apache.org/thread/vphqmcttzqqbmltqtn5wnk2od85oqc4d Best, Paul Lam

[VOTE] FLIP-222: Support full job lifecycle statements in SQL client

2022-06-13 Thread Paul Lam
! [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-222%3A+Support+full+job+lifecycle+statements+in+SQL+client [2] https://lists.apache.org/thread/qkvh9p5w9b12s7ykh3l7lv7m9dbgnf1g Best, Paul Lam

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-06-13 Thread Paul Lam
Hi team, I think we’ve reached consensus on the FLIP, thus I’m starting a vote thread. Thank you all for the your advice in the discussion! Best, Paul Lam > 2022年6月10日 02:26,Jing Ge 写道: > > Hi Paul, > > Fired a ticket: https://issues.apache.org/jira/browse/FLINK-

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-13 Thread Paul Lam
Congrats, Jingsong! Well deserved! Best, Paul Lam > 2022年6月13日 16:31,Lincoln Lee 写道: > > Congratulations, Jingsong! > > Best, > Lincoln Lee > > > Jark Wu 于2022年6月13日周一 16:29写道: > >> Congrats, Jingsong! >> >> Cheers, >> Jark >&

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-06-09 Thread Paul Lam
]. [1] https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/state/savepoints/#disposing-savepoints Best, Paul Lam > 2022年6月9日 15:41,Martijn Visser 写道: > > Hi all, > > I would not include a DROP SAVEPOINT syntax. With the recently introduced > CLAIM/NO CLAIM m

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-06-09 Thread Paul Lam
this statement as follow-up tasks which should touch REST API and Flink CLI? Best, Paul Lam > 2022年6月9日 11:53,godfrey he 写道: > > Hi all, > > Regarding `PIPELINE`, it comes from flink-core module, see > `PipelineOptions` class for more details. > `JOBS` is a more generic

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-06-08 Thread Paul Lam
to the latest discussions. Best, Paul Lam > 2022年6月8日 07:31,Jing Ge 写道: > > Hi Paul, > > Sorry that I am a little bit too late to join this thread. Thanks for driving > this and starting this informative discussion. The FLIP looks really > interesting. It will help us a lot to

Re: [DISCUSS] Api Since Version Annotation

2022-06-06 Thread Paul Lam
+1 I think @since annotation would be super helpful when upgrading Flink versions. BTW, I proposed to add @since annotation to configuration options as well [1]. [1] https://issues.apache.org/jira/browse/FLINK-23700 Best, Paul Lam > 2022年6月6日 15:49,Jingsong Li 写道: > > Hi everyone,

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-06-04 Thread Paul Lam
. Best, Paul Lam godfrey he 于2022年5月23日周一 21:34写道: > Hi Paul, > > Thanks for the update. > > >'SHOW QUERIES' lists all jobs in the cluster, no limit on APIs > (DataStream or SQL) or > clients (SQL client or CLI). > > Is DataStream job a QUERY? I think not. >

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-05-19 Thread Paul Lam
Best, Paul Lam > 2022年5月18日 17:48,Jark Wu 写道: > > Hi Paul, > > 1) SHOW QUERIES > +1 to add finished time, but it would be better to call it "end_time" to > keep aligned with names in Web UI. > > 2) DROP QUERY > I think we shouldn't throw exceptions for batc

Re: [VOTE] FLIP-91: Support SQL Gateway

2022-05-19 Thread Paul Lam
+1 (non-binding) Best, Paul Lam > 2022年5月20日 10:48,Jark Wu 写道: > > +1 (binding) > > Best, > Jark > > On Fri, 20 May 2022 at 10:39, Shengkai Fang wrote: > >> Hi, everyone. >> >> Thanks for your feedback for FLIP-91: Support SQL Gateway[1] on t

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-05-18 Thread Paul Lam
CLI. Maybe we could make it a follow-up FLIP, which includes the modifications to clusterClient/jobClient and Flink CLI. WDYT? Best, Paul Lam > 2022年5月17日 20:34,godfrey he 写道: > > Godfrey

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-05-11 Thread Paul Lam
le of queries? > Including show queries, create savepoint, remove savepoint, stop query with a > savepoint, and restart query with savepoint. Agreed. Adding it to the FLIP as well. Best, Paul Lam > 2022年5月7日 18:22,Jark Wu 写道: > > Hi Paul, > > I think this FLIP has already

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

2022-05-06 Thread Paul Lam
Congrats, Yang! Well Deserved! Best, Paul Lam > 2022年5月6日 14:38,Yun Tang 写道: > > Congratulations, Yang! > > Best > Yun Tang > > From: Jing Ge > Sent: Friday, May 6, 2022 14:24 > To: dev > Subject: Re: [ANNOUNCE] New Flink PM

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-05-06 Thread Paul Lam
.102/b14200/statements_10001.htm <https://docs.oracle.com/cd/B19306_01/server.102/b14200/statements_10001.htm> [2] https://www.postgresql.org/docs/current/sql-savepoint.html [3] https://mariadb.com/kb/en/savepoint/ Best, Paul Lam > 2022年5月4日 16:42,Paul Lam 写道: > > Hi Shengkai, &g

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-05-04 Thread Paul Lam
have two questions here. > > 1. Could you add some details about the behaviour with the different > execution.target, e.g. session, application mode? > > 2. Considering the SQL Client/Gateway is not limited to submitting the job > to the specified cluster, is it able

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-04-28 Thread Paul Lam
/sql/jar/ [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-152%3A+Hive+Query+Syntax+Compatibility [3] https://cwiki.apache.org/confluence/display/FLINK/FLIP-223%3A+Support+HiveServer2+Endpoint Best, Paul Lam Martijn Visser 于2022年4月26日周二 20:14写道: > Hi Paul, > > Thanks for

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-04-22 Thread Paul Lam
t may be more user friendly to return them all in the SHOW statement? > It's better we can also get the infos about the cluster where the job is > running on through the DESCRIBE statement. I think cluster info could be part of session properties instead. WDYT? Best, Paul Lam > 2022年4月

Re: [DISCUSS] FLIP-223: Support HiveServer2 Endpoint

2022-04-21 Thread Paul Lam
Hi Shengkai, Thanks for starting the discussion. As the FLIP doesn’t mention SQL client, I’m assuming that SQL client would remain supporting REST endpoint only? Best, Paul Lam > 2022年4月21日 14:45,Shengkai Fang 写道: > > Hi, Flink developers. > > I want to start a discussion

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

2022-04-21 Thread Paul Lam
result set before returning it to the client? Thanks a lot! Best, Paul Lam > 2022年4月21日 14:42,Shengkai Fang 写道: > > Hi, Flink developers. > > I want to start a discussion about the FLIP-91: Support Flink SQL > Gateway[1]. Flink SQL Gateway is a service that allo

Re: [DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-04-20 Thread Paul Lam
ping @Timo @Jark @Shengkai Best, Paul Lam > 2022年4月18日 17:12,Paul Lam 写道: > > Hi team, > > I’d like to start a discussion about FLIP-222 [1], which adds query lifecycle > statements to SQL client. > > Currently, SQL client supports submitting queries (queries in a b

[DISCUSS] FLIP-222: Support full query lifecycle statements in SQL client

2022-04-18 Thread Paul Lam
tps://cwiki.apache.org/confluence/display/FLINK/FLIP-222:+Support+full+query+lifecycle+statements+in+SQL+client> [2] https://lists.apache.org/thread/wr47ng0m2hdybjkrwjlk9ftwg403odqb Best, Paul Lam

Re: [DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-18 Thread Paul Lam
Sorry for misspelling your name, Shengkai. The autocomple plugin is not very wise. Best, Paul Lam > 2022年4月18日 11:39,Paul Lam 写道: > > Hi Shanghai, > > You’re right. We can only retrieve the job names from the cluster, and > display > them as query names. > > I

Re: [DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-17 Thread Paul Lam
https://cwiki.apache.org/confluence/display/FLINK/FLIP-222%3A+Support+full+query+lifecycle+statements+in+SQL+client Best, Paul Lam > 2022年4月18日 10:39,Shengkai Fang 写道: > > Hi, Paul. > > I am just confused that how the client can retrieve the SQL statement from > the cluste

Re: [DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-11 Thread Paul Lam
for application/per-clusters modes, the clusters would stop when the job terminates. WDYT? Best, Paul Lam > 2022年4月11日 14:17,Jark Wu 写道: > > Hi Paul, I grant the permission to you. > > Regarding the "SHOW QUERIES", how will you bookkeep and persist the running > and com

Re: [DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-05 Thread Paul Lam
e to create a FLIP? Best, Paul Lam > 2022年4月4日 15:36,Timo Walther 写道: > > Hi Paul, > > thanks for proposing this. I think in general it makes sense to have those > commands in SQL Client. > > However, this will be a big shift because we start adding job lifecycle S

Re: [DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-01 Thread Paul Lam
if possible. My Confluence user name is `paulin3280`, and the full name is `Paul Lam`. > I'm also copying in @Timo Walther and @Jark Wu > for their opinion on this. Looking forward to your opinions @Timo @Jark :) Best, Paul Lam > 2022年4月1日 18:10,Martijn Visser 写道: > > Hi P

Re: [DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-01 Thread Paul Lam
ent status of Flink SQL client/gateway.) WDYT? Best, Paul Lam > 2022年4月1日 17:33,Martijn Visser 写道: > > Hi Paul, > > Thanks for opening the discussion. I agree that there are opportunities in > this area to increase user value. > > I would say that the syntax should be p

[DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-01 Thread Paul Lam
reach a consensus on the syntax, we could either implement it in Kyuubi and contribute back to Flink, or directly implement it in Flink. Looking forward for your feedback ;) [1] https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/sql/overview/#reserved-keywords Best, Paul

Re: Change of focus

2022-02-28 Thread Paul Lam
Thanks Till, for everything! I learned a lot from you. Wish lots of joys in your new journey. Best, Paul Lam > 2022年3月1日 11:00,Yuan Mei 写道: > > Thanks Till for everything you've done for the community! > Good luck with your new adventure and best wishes to your new life! >

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Paul Lam
Congrats! Well deserved! Best, Paul Lam > 2022年2月16日 21:30,Robert Metzger 写道: > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce two new Flink > committers: Feng Wang and Zhipeng Zhang! > > Feng is one of the most active Flink evangelists in China,

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Paul Lam
Congrats to all of you! Best, Paul Lam > 2022年2月17日 01:24,Roman Khachatryan 写道: > > Congratulations! > > Regards, > Roman > > On Wed, Feb 16, 2022 at 5:22 PM Matthias Pohl wrote: >> >> Congratulations to all of you :) >> >> On W

Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul

2021-11-15 Thread Paul Lam
Congrats Fabian! Best, Paul Lam > 2021年11月16日 11:26,Zhilong Hong 写道: > > Congratulations, Fabian! > > Best regards, > Zhilong Hong > > On Tue, Nov 16, 2021 at 10:19 AM Yangze Guo wrote: > >> Congrats & well deserved! >> >> Best, >>

Re: [ANNOUNCE] New Apache Flink Committer - Jing Zhang

2021-11-15 Thread Paul Lam
Congrats Jing! Best, Paul Lam > 2021年11月16日 10:48,Yun Tang 写道: > > Congratulations, Jing! > > Best > Yun Tang > > From: Yuepeng Pan > Sent: Tuesday, November 16, 2021 10:12 > To: dev@flink.apache.org > Cc: beyond1...@gmail.

Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-11 Thread Paul Lam
Congrats! Well deserved! Best, Paul Lam > 2021年11月12日 12:16,Yangze Guo 写道: > > Congrats, Leonard! > > Jingsong Li 于 2021年11月12日周五 下午12:15写道: > >> Congrats & well deserved, Leonard! >> >> Thank you for your exciting contributions to Flink! >&g

Re: [ANNOUNCE] New Apache Flink Committer - Yangze Guo

2021-11-11 Thread Paul Lam
Congrats Yangze! Best, Paul Lam > 2021年11月12日 10:29,Jingsong Li 写道: > > Congrats & well deserved! > > Best, > Jingsong > > On Fri, Nov 12, 2021 at 10:28 AM Zakelly Lan wrote: >> >> Congrats & well deserved, Yangze Guo! >> >> Best, &g

Re: [ANNOUNCE] New PMC member: Xintong Song

2021-06-16 Thread Paul Lam
Congrats, Xintong! Well deserved! Best, Paul Lam > 2021年6月16日 17:23,Dawid Wysakowicz 写道: > > Hi all! > > I'm very happy to announce that Xintong Song has joined the Flink PMC! > > Congratulations and welcome Xintong! > > Best, > Dawid >

Re: Add control mode for flink

2021-06-08 Thread Paul Lam
through the whole DAG, but events needs to be acknowledged by downstream and can overtake records, while stream records are not). So I’m wondering if we plan to unify the two approaches in the new control flow (as Xintong mentioned both in the previous mails)? Best, Paul Lam > 2021年6月8日 14

Re: [ANNOUNCE] New Apache Flink Committer - Rui Li

2021-04-21 Thread Paul Lam
Congrats, Rui! Well deserved. Best, Paul Lam > 2021年4月22日 11:20,Jark Wu 写道: > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Rui Li as a new Flink > committer. > > Rui Li has been a very active contributor for more than two year, with 180+ >

Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Paul Lam
Congrats, Guowei! Best, Paul Lam > 2021年1月21日 07:21,Steven Wu 写道: > > Congrats, Guowei! > > On Wed, Jan 20, 2021 at 10:32 AM Seth Wiesman wrote: > >> Congratulations! >> >> On Wed, Jan 20, 2021 at 3:41 AM hailongwang <18868816...@163.com&

Re: [ANNOUNCE] Welcome Danny Cranmer as a new Apache Flink Committer

2021-01-12 Thread Paul Lam
Congrats, Danny! Best, Paul Lam > 2021年1月12日 16:48,Tzu-Li (Gordon) Tai 写道: > > Hi everyone, > > I'm very happy to announce that the Flink PMC has accepted Danny Cranmer to > become a committer of the project. > > Danny has been extremely helpful on the mailing l

Re: [ANNOUNCE] Apache Flink 1.11.3 released

2020-12-18 Thread Paul Lam
Well done! Thanks to Gordon and Xintong, and everyone that contributed to the release. Best, Paul Lam > 2020年12月18日 19:20,Xintong Song 写道: > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.11.3, which is the third bugfix release for the

Re: [ANNOUNCE] New Apache Flink Committer - Congxian Qiu

2020-10-30 Thread Paul Lam
Congrats, Congxian! Well deserved! Best, Paul Lam > 2020年10月30日 15:12,Zhijiang 写道: > > Congrats, Congxian!

Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He

2020-09-16 Thread Paul Lam
Congrats, Godfrey! Best, Paul Lam > 2020年9月16日 17:03,Xingbo Huang 写道: > > Congratulations, well deserved. > > Best, > Xingbo > > Xintong Song 于2020年9月16日周三 下午4:59写道: > >> Congratulations, Godfrey~! >> >> Thank you~ >> >> Xintong

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Paul Lam
Congrats, Yun! Well deserved! Best, Paul Lam > 2020年9月15日 19:14,Yang Wang 写道: > > Congratulations, Yun! > > Best, > Yang > > Leonard Xu 于2020年9月15日周二 下午7:11写道: > >> Congrats, Yun! >> >> Best, >> Leonard >>> 在 2020年9月15日,19:01,Yangze Guo 写道: >>> >>> Congrats, Yun! >> >>

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Paul Lam
Congrats, Arvid! Best, Paul Lam > 2020年9月15日 15:29,Jingsong Li 写道: > > Congratulations Arvid ! > > Best, > Jingsong > > On Tue, Sep 15, 2020 at 3:27 PM Dawid Wysakowicz > wrote: > >> Congratulations Arvid! Very well deserved! >> >> Best, &

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Paul Lam
Congrats, Igal! Best, Paul Lam > 2020年9月15日 16:14,Tzu-Li (Gordon) Tai 写道: > > Hi all, > > It's great seeing many new Flink committers recently, and to add to that > I'd like to announce one more new committer: Igal Shilman! > > Igal has been a long time member of the

Re: [VOTE] Remove deprecated DataStream#fold and DataStream#split in 1.12

2020-08-28 Thread Paul Lam
+1 Best, Paul Lam > 2020年8月28日 15:41,Dawid Wysakowicz 写道: > > Hi all, > > I would like to start a vote for removing deprecated, but Public(Evolving) > methods in the upcoming 1.12 release: > > XxxDataStream#fold and all related classes (such as FoldingDes

Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-27 Thread Paul Lam
Congrats, Dian! Best, Paul Lam > 2020年8月27日 17:42,Marta Paes Moreira 写道: > > Congrats, Dian! > > On Thu, Aug 27, 2020 at 11:39 AM Yuan Mei <mailto:yuanmei.w...@gmail.com>> wrote: > Congrats! > > On Thu, Aug 27, 2020 at 5:38 PM Xingbo Huang &

  1   2   >