Re: [DISCUSS] FLIP-314: Support Customized Job Lineage Listener

2023-06-27 Thread Feng Jin
Hi Shammon Thank you for proposing this FLIP. I think the Flink Job lineage is a very useful feature. I have few question: 1. For DataStream Jobs, users need to set up lineage relationships when building DAGs for their custom sources and sinks. However, for some common connectors such as Kafka Con

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread Feng Jin
+1 (no-binding) Best Feng On Wed, Jun 28, 2023 at 11:03 PM Jing Ge wrote: > +1(binding) > > On Wed, Jun 28, 2023 at 1:51 PM Mang Zhang wrote: > > > +1 (no-binding) > > > > > > -- > > > > Best regards, > > Mang Zhang > > > > > > > > > > > > At 2023-06-28 17:48:15, "yuxia" wrote: > > >Hi every

Re: Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-04 Thread Feng Jin
Congratulations! Best, Feng Jin On Tue, Jul 4, 2023 at 4:13 PM Yuxin Tan wrote: > Congratulations! > > Best, > Yuxin > > > Dunn Bangui 于2023年7月4日周二 16:04写道: > > > Congratulations! > > > > Best, > > Bangui Dunn > > > > Y

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-24 Thread Feng Jin
Congratulations, Yong Fang Best, Feng On Mon, Jul 24, 2023 at 3:12 PM Leonard Xu wrote: > Congratulations, Yong Fang > > Best, > Leonard > > > On Jul 24, 2023, at 2:01 PM, yuxia wrote: > > > > Congrats, Shammon! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Benchao Li" >

Re: Support read ROWKIND metadata by ROW_KIND() function

2023-07-24 Thread Feng Jin
Hi casel, Thank you for initiating the discussion about RowKind meta. I believe that in certain scenarios, it is necessary to expose RowKind. We also have similar situations internally: In simple terms, we need to be able to control the behavior of RowKind in both Source and Sink: - When reading

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-04 Thread Feng Jin
Congratulations Weihua! Best regards, Feng On Fri, Aug 4, 2023 at 4:28 PM weijie guo wrote: > Congratulations Weihua! > > Best regards, > > Weijie > > > Lijie Wang 于2023年8月4日周五 15:28写道: > > > Congratulations, Weihua! > > > > Best, > > Lijie > > > > yuxia 于2023年8月4日周五 15:14写道: > > > > > Congr

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-04 Thread Feng Jin
Congratulations, Matthias! Best regards Feng On Fri, Aug 4, 2023 at 4:29 PM weijie guo wrote: > Congratulations, Matthias! > > Best regards, > > Weijie > > > Wencong Liu 于2023年8月4日周五 15:50写道: > > > Congratulations, Matthias! > > > > Best, > > Wencong Liu > > > > > > > > > > > > > > > > > > >

Re: [DISCUSS][FLINK-31788][FLINK-33015] Add back Support emitUpdateWithRetract for TableAggregateFunction

2023-09-10 Thread Feng Jin
Thanks Jane for following up on this issue! +1 for adding it back first. Supporting emitUpdateWithRetract for TableAggregateFunction is a good feature, we should support it unless there are better alternatives. Best, Feng On Thu, Sep 7, 2023 at 11:01 PM Lincoln Lee wrote: > Thanks to Jane fo

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread Feng Jin
Thanks for driving this, looking forward to this feature. +1 (non-binding) Best, Feng On Wed, Sep 13, 2023 at 9:11 PM Chen Zhanghao wrote: > Thanks for driving this. +1 (non-binding) > > Best, > Zhanghao Chen > > 发件人: Rui Fan <1996fan...@gmail.com> > 发送时间: 202

Re: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-16 Thread Feng Jin
Hi, Zhanghao Thank you for proposing this FLIP, it is a very meaningful feature. I agree that currently we may only consider the parallelism setting of the source itself. If we consider the parallelism setting of other operators, it may make the entire design more complex. Regarding the situatio

Re: [DISCUSS] Implementing SQL remote functions

2023-09-20 Thread Feng Jin
Hi Alan I believe that supporting asynchronous UDF is a valuable feature. Currently, there is a similar FLIP[1] available: Can this meet your needs? [1]. https://cwiki.apache.org/confluence/display/FLINK/FLIP-313%3A+Add+support+of+User+Defined+AsyncTableFunction Best, Feng On Thu, Sep 21, 2023

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2023-09-25 Thread Feng Jin
+1(no-binding) thanks for driving this proposal Best, Feng On Mon, Sep 25, 2023 at 11:19 PM Jing Ge wrote: > +1(binding) Thanks! > > Best Regards, > Jing > > On Sun, Sep 24, 2023 at 10:30 PM Shammon FY wrote: > > > Hi devs, > > > > Thanks for all the feedback on FLIP-314: Support Customized

Re: [VOTE] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-10-09 Thread Feng Jin
+1 (non-binding) Best, Feng On Mon, Oct 9, 2023 at 3:12 PM Yangze Guo wrote: > +1 (binding) > > Best, > Yangze Guo > > On Mon, Oct 9, 2023 at 2:46 PM Yun Tang wrote: > > > > +1 (binding) > > > > Best > > Yun Tang > > > > From: Weihua Hu > > Sent: Monday, Octob

Re: [DISCUSS] FLIP-373: Support Configuring Different State TTLs using SQL Hint

2023-10-09 Thread Feng Jin
Hi Jane, Thank you for proposing this FLIP. I believe that this FLIP will greatly enhance the flexibility of setting state, and by setting different operators' TTL, it can also increase job stability, especially in regular join scenarios. The parameter design is very concise, big +1 for this, and

Re: Re: [DISCUSS] FLIP-373: Support Configuring Different State TTLs using SQL Hint

2023-10-10 Thread Feng Jin
, > >resulting in the loss of the hint at this step. To support this, we may > >need to rewrite some optimization rules in Calcite, which could be a > >follow-up work if required. > > > >Best, > >Jane > > > >On Tue, Oct 10, 2023 at 1:40 AM Feng Jin wrote: &g

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-15 Thread Feng Jin
Congratulations Jane! Best, Feng On Mon, Oct 16, 2023 at 11:23 AM yh z wrote: > Congratulations Jane! > > Best, > Yunhong (swuferHong) > > Yuxin Tan 于2023年10月16日周一 11:11写道: > > > Congratulations Jane! > > > > Best, > > Yuxin > > > > > > xiangyu feng 于2023年10月16日周一 10:27写道: > > > > > Congratul

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

2023-10-15 Thread Feng Jin
Congratulations, Ron! Best, Feng On Mon, Oct 16, 2023 at 11:22 AM yh z wrote: > Congratulations, Ron! > > Best, > Yunhong (SwuferHong) > > Yuxin Tan 于2023年10月16日周一 11:12写道: > > > Congratulations, Ron! > > > > Best, > > Yuxin > > > > > > Junrui Lee 于2023年10月16日周一 10:24写道: > > > > > Congratulat

Re: [VOTE] FLIP-373: Support Configuring Different State TTLs using SQL Hint

2023-10-22 Thread Feng Jin
+1(non-binding) Best, Feng On Mon, Oct 23, 2023 at 11:58 AM Xuyang wrote: > +1(non-binding) > > > > > -- > > Best! > Xuyang > > > > > > At 2023-10-23 11:38:15, "Jane Chan" wrote: > >Hi developers, > > > >Thanks for all the feedback on FLIP-373: Support Configuring Different > >State

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread Feng Jin
Thanks for the great work! Congratulations Best, Feng Jin On Fri, Oct 27, 2023 at 12:36 AM Leonard Xu wrote: > Congratulations, Well done! > > Best, > Leonard > > On Fri, Oct 27, 2023 at 12:23 AM Lincoln Lee > wrote: > > > Thanks for the great work! Congrats

Re: [DISCUSS] FLIP-390: Support System out and err to be redirected to LOG or discarded

2023-11-08 Thread Feng Jin
Hi, Rui. Thank you for initiating this proposal. I have a question regarding redirecting stdout and stderr to LOG: Will they be written to the taskManager.log file by default or the taskManager.out file? If we can make taskmanager.out splittable and rolling, would it be easier for users to use t

Re: [DISCUSS] FLIP-390: Support System out and err to be redirected to LOG or discarded

2023-11-14 Thread Feng Jin
; > file > > > > > > > name), > > > > > > > 3. Check the file size periodically: all logs are written by > log > > > > > plugin, > > > > > > > they can check the log file size after writing. However, > > > System.out >

[Discuss] :Introduce Catalog dynamic registration in flink catalog manager.

2023-02-06 Thread Feng Jin
ay be catalog name conflicts between different catalogProviders. Looking forward to your reply, any feedback is appreciated! Best. Feng Jin

Re: [Discuss] :Introduce Catalog dynamic registration in flink catalog manager.

2023-02-09 Thread Feng Jin
. Or whether this can be disabled and SHOW CATALOGS > > > can be used for listing first without having a default catalog. > > > > > > What do you think about option 2 and 3? > > > > > > In any case, I would propose we pass a CatalogProvider to > > >

Re: [Discuss] :Introduce Catalog dynamic registration in flink catalog manager.

2023-02-09 Thread Feng Jin
d a new one for later usage? If we reuse the > > same Catalog, I think it's more like lazy initialization. I am a > > little prone to rebuild a new one because it's easier for us to catalog jar > > hot updates. > > > > 2. Users use the `CREATE CAT

Re: [Discuss] :Introduce Catalog dynamic registration in flink catalog manager.

2023-02-10 Thread Feng Jin
t, > Jark > > > 2023年2月10日 15:44,Feng Jin 写道: > > > > @Shengkai > >> About the catalog jar hot updates > > > > Currently we do not have a similar requirement, but if the catalog > > management interface is opened, this can indeed realize the hot &

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Feng Jin
Congratulations! Weijie Best, Feng On Tue, Feb 14, 2023 at 2:19 PM Leonard Xu wrote: > > Congratulations! Weijie > > Best, > Leonard

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-15 Thread Feng Jin
Congratulations, Jing! Best, Feng On Thu, Feb 16, 2023 at 2:24 PM Weihua Hu wrote: > > Congratulations, Jing! > > Best, > Weihua > > > On Thu, Feb 16, 2023 at 2:03 PM Dian Fu wrote: > > > Congratulations Jing! > > > > Regards, > > Dian > > > > On Wed, Feb 15, 2023 at 8:04 PM Yun Tang wrote: >

[DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-03-29 Thread Feng Jin
Hi everyone, I would like to start a discuss on FLIP-295: Support persistence of Catalog configuration and asynchronous registration Currently, when using Catalog in Flink, it is necessary to re-register each time. Therefore, providing persistent configuration for Catalog will make its management

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-03 Thread Feng Jin
Hi everyone, Thank you all for your interest in this DISCUSS. @Shammon > How to handle a catalog with the same name that exists for both of them? I believe this is a crucial point. Based on my current personal understanding, the Map catalogs will serve as a cache for instantiated catalogs and hav

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-04 Thread Feng Jin
; BTW, by saying asynchronous registration, I would like to expect there > > will be an executor to open or register catalog in the background, but > from > > your previous comments, > > "the Catalog instance will be initialized if it has not been initialized > > ye

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-07 Thread Feng Jin
t is registered or added in `CatalogManager`? > > Best, > Shammon FY > > > On Tue, Apr 4, 2023 at 5:22 PM Feng Jin wrote: > > > Thank you for your reply. I am very sorry for the misunderstanding caused > > by my deviation from the original discussion. > > > &g

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-13 Thread Feng Jin
e a replacement of option 1, because, afaiu, issues mentioned > > previously with option 1 are not solved yet. Do you still want to propose > > both options and ask for suggestions for both of them? > > 4. After you updated the FLIP, there are some inconsistent descriptions > in

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-21 Thread Feng Jin
Congratulations, Leonard Best, Feng Jin On Fri, Apr 21, 2023 at 8:38 PM Mang Zhang wrote: > Congratulations, Leonard. > > > -- > > Best regards, > Mang Zhang > > > > > > At 2023-04-21 19:47:52, "Jark Wu" wrote: > >Hi everyone,

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-21 Thread Feng Jin
Congratulations, Qingsheng Best, Feng Jin On Fri, Apr 21, 2023 at 8:39 PM Mang Zhang wrote: > Congratulations, Qingsheng. > > > > > > -- > > Best regards, > Mang Zhang > > > > > > At 2023-04-21 19:50:02, "Jark Wu" wrote: > &g

Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-23 Thread Feng Jin
+1 (non-binding) Best, Feng On Mon, Apr 24, 2023 at 9:55 AM Hang Ruan wrote: > +1 (non-binding) > > Best, > Hang > > Paul Lam 于2023年4月23日周日 11:58写道: > > > +1 (non-binding) > > > > Best, > > Paul Lam > > > > > 2023年4月23日 10:57,Shammon FY 写道: > > > > > > +1 (non-binding) > > > > > > Best, > >

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-27 Thread Feng Jin
e if this is the intended behaviour. If Map catalogs is > used as a cache, it should be invalid, once the related catalog has been > removed from the CatalogStore by another instance. Did I miss something? > > Best regards, > Jing > > On Thu, Apr 13, 2023 at 4:40 PM Fen

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-04 Thread Feng Jin
being configured. That is the reason why I mentioned in the > last email that the example code wrt the Optional CatalogStore is not > correct. > > Best regards, > Jing > > On Thu, Apr 27, 2023 at 3:55 PM Feng Jin wrote: > > > Hi Jing > > > > > > > T

[DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-25 Thread Feng Jin
Hi, everyone. I’d like to start a discussion about FLIP-308: Support Time Travel In Batch Mode [1] Time travel is a SQL syntax used to query historical versions of data. It allows users to specify a point in time and retrieve the data and schema of a table as it appeared at that time. With time

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-25 Thread Feng Jin
d in Calcite for this, we can make this available in > > > Flink earlier by copying the corresponding classes until the next > > > Calcite upgrade is performed. > > > > > > 2. Semantics > > > > > > How do we interpret the timestamp? In Flink we h

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-28 Thread Feng Jin
for improving the FLIP. It looks good to me. We could still > reconsider in the future how to provide more common built-in cache > functionality in CatalogManager so that not every CatalogSotre > implementation has to take care of it. > > Best regards, > Jing > > On Thu,

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-29 Thread Feng Jin
meTravel, but I didn't see the alternative in > > the FLIP doc. IMO, this is an important thing we need to clarify because > we > > need to know whether the Connector supports this, and what > column/metadata > > corresponds to 'system_time'. > > > &

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-29 Thread Feng Jin
oint 6 described follow-up options for further improvement. > > Best regards, > Jing > > On Mon, May 29, 2023 at 5:31 AM Feng Jin wrote: > > > Hi all, I would like to update you on the latest progress of the FLIP. > > > > > > Last week, Leonard Xu, HangRuan, J

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-05-29 Thread Feng Jin
Hi, Shammon Thanks for driving this Flip, [Support Customized Job Meta Data Listener] will make it easier for Flink to collect lineage information. I fully agree with the overall solution and have a small question: 1. Will an exception thrown by the listener affect the normal execution process?

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-31 Thread Feng Jin
; > 3. Regarding the options `sql.catalog.store.type` and > > `sql.catalog.store.file.path`, how about renaming them to > > `catalog.store.type` and `catalog.store.path`? > > > > Best, > > Ron > > > > Feng Jin 于2023年5月29日周一 21:19写道: > > > > &

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-01 Thread Feng Jin
r to mention the changed > behavior of CREATE CATALOG statement if FileCatalogStore (or other > persisted catalog store) is used. > > > Best, > Jark > > On Thu, 1 Jun 2023 at 11:26, Feng Jin wrote: > > > Hi , thanks all for reviewing the flip. > > > > @Ron >

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-01 Thread Feng Jin
ed to createxxx from registerxxx. > > On Fri, Jun 2, 2023 at 11:04 AM Feng Jin wrote: > > > > Hi jark, thanks for your suggestion. > > > > > 1. How to register the CatalogStore for Table API? I think the > > CatalogStore should be immutable once TableEnv

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-03 Thread Feng Jin
the connection among these sessions? > > I think sql gateway need to maintain a connection pool in > > the CatalogStoreFactory and each session get its own connection from the > > pool when it is created. > > Then the `CatalogStoreFactory` may need the `open`/`close` methods to

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-04 Thread Feng Jin
; Bests, > Samrat > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-295%3A+Support+lazy+initialization+of+catalogs+and+persistence+of+catalog+configurations > > On Sat, Jun 3, 2023 at 5:54 PM Feng Jin wrote: > > > Hi Hang and Jark > > > >

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-06 Thread Feng Jin
+catalog+configurations Best, Feng On Sun, Jun 4, 2023 at 3:33 PM Feng Jin wrote: > Hi Samrat, > > Thanks for your advice. > > > 1. The createCatalog method does not mention any exceptions being > thrown. > > CreateCatalog will throw CatalogException like registerCatalog

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-06-06 Thread Feng Jin
Feng > >>>>> > >>>>> Thanks for driving this FLIP, Time travel is very useful for Flink > >>>>> integrate with data lake system. I have one question why the > >>>>> implementation > >>>>> of TimeTravel is d

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-06 Thread Feng Jin
tore and the File CatalogStore” , > Do we have plan to offer a default CatalogStore if user didn’t config > this? IIUC, users can obtains the benefits from lazy catalog > initialization If > we have a default catalogstore even it is in-memory. > > Best, > Leonard > > &g

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-06-06 Thread Feng Jin
;>>> > >>>>> Hi, Feng > >>>>> > >>>>> Thanks for driving this FLIP, Time travel is very useful for Flink > >>>>> integrate with data lake system. I have one question why the > >>>>> implementation > >&

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-06-06 Thread Feng Jin
r temporary tables. Best, Feng On Tue, Jun 6, 2023 at 9:32 PM Feng Jin wrote: > Sorry I replied to the wrong mail. Please ignore the last email. > > > Hi Leonard > > > 1. Unification SQL > > I agree that it is crucial for us to support both batch and streaming > proce

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-06-07 Thread Feng Jin
will consider > the session timezone, which is the expected result. But it's inconvenient > for users. > > Taking this a special case, and converting "TIMESTAMP '2023-04-27 > 00:00:00'" to a unix timestamp with session timezone, will be convenient > for us

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-08 Thread Feng Jin
hi, Aitozi Thank you for your proposal. In our production environment, we often encounter efficiency issues with user-defined functions (UDFs), which can lead to slower processing speeds. I believe that this FLIP will make it easier for UDFs to be executed more efficiently. I have a small quest

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-11 Thread Feng Jin
rivate constructor. > 2. The method `initCatalog` in `CatalogManager` is not introduced. > > Best, > Hang > > Feng Jin 于2023年6月6日周二 21:17写道: > > > Hi Leonard, > > > > Thanks for your reply. > > > > > 1. a How to construct a CatalogDescriptor

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-06-11 Thread Feng Jin
plicitly > > > to TIMESTAMP_LTZ, or they just have a different definition of the > syntax. > > > > > > But for us, we are definitely using timestamp/timestmap_ltz literal > here, > > > that's why it is special, and we must highlight this behavior t

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-06-12 Thread Feng Jin
+catalog+configurations Best, Feng On Mon, Jun 12, 2023 at 10:54 AM Feng Jin wrote: > hi, Hang > > Thanks for your reply, Make sense to me, I updated the FLIP. > > > Best, > > Feng > > > > On Fri, Jun 9, 2023 at 3:34 PM Hang Ruan wrote: > >> H

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Feng Jin
Hi Aitozi, We do need to remind users about thread safety issues. Thank you for your efforts on this FLIP. I have no further questions. Best, Feng On Tue, Jun 13, 2023 at 6:05 AM Jing Ge wrote: > Hi Aitozi, > > Thanks for taking care of that part. I have no other concern. > > Best regards, > Ji

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-06-12 Thread Feng Jin
Tue, Jun 13, 2023 at 10:42 AM Aitozi wrote: > Hi Feng, > Thanks for your question. We do not provide a way to switch the UDTF > between sync and async way, > So there should be no thread safety problem here. > > Best, > Aitozi > > Feng Jin 于2023年6月13日周二 10:31写道:

[VOTE] FLIP-295: Support lazy initialization of catalogs and persistence of catalog configurations

2023-06-13 Thread Feng Jin
Hi everyone Thanks for all the feedback about the FLIP-295: Support lazy initialization of catalogs and persistence of catalog configurations[1]. [2] is the discussion thread. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until June 19, 10:00AM G

Re: Re: [VOTE] FLIP-311: Support Call Stored Procedure

2023-06-13 Thread Feng Jin
+1 (no-binding) Best, Feng On Wed, Jun 14, 2023 at 7:02 AM Jing Ge wrote: > +1(binding) > > Best Regards, > Jing > > On Tue, Jun 13, 2023 at 9:03 AM Mang Zhang wrote: > > > +1 (no-binding) > > > > > > > > > > -- > > > > Best regards, > > Mang Zhang > > > > > > > > > > > > 在 2023-06-13 13:19:

Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener

2023-06-15 Thread Feng Jin
+1(no-binding) Best, Feng On Thu, Jun 15, 2023 at 8:33 PM liu ron wrote: > +1(no-binding) > > Best, > Ron > > yuxia 于2023年6月15日周四 20:15写道: > > > +1 (binding) > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Leonard Xu" > > 收件人: "dev" > > 发送时间: 星期四, 2023年 6 月 15日 下午 8:09:00

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-06-15 Thread Feng Jin
10:57 AM Feng Jin wrote: > Thanks Benchao and Leonard. > > 'Implicitly type conversion' makes sense to me. I will emphasize the > 'Implicitly type conversion' in the document. > > > Best, > Feng > > On Sat, Jun 10, 2023 at 10:11 AM Be

[RESULT][VOTE]FLIP-295: Support lazy initialization of catalogs and persistence of catalog configurations

2023-06-19 Thread Feng Jin
Hi everyone, Happy to announce that FLIP-295[1] has been approved! According to the vote thread[2], there are 7 approving votes, out of which 5 are binding: - Hang Ruan (non-binding) - Rui Fan (binding) - Jing Ge (binding) - Dong Lin (binding) - Leonard Xu (binding) - Shammon FY (non-binding) - J

[VOTE] FLIP-308: Support Time Travel

2023-06-19 Thread Feng Jin
Hi everyone Thanks for all the feedback about the FLIP-308: Support Time Travel[1]. [2] is the discussion thread. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until June 22, 12:00AM GMT) unless there is an objection or an insufficient number of

[RESULT][VOTE]FLIP-308: Support Time Travel

2023-06-22 Thread Feng Jin
Hi everyone, Happy to announce that FLIP-308[1] has been approved! According to the vote thread[2], there are 7 approving votes, out of which 6 are binding: - yuxia (binding) - Lincoln Lee (binding) - Benchao Li (binding) - Jing Ge (binding) - Leonard Xu (binding) - John Roesler (non-binding) - Y

Re: [VOTE] FLIP-390: Support System out and err to be redirected to LOG or discarded

2023-11-22 Thread Feng Jin
+1(non-binding) Best, Feng On Wed, Nov 22, 2023 at 6:37 PM Leonard Xu wrote: > +1(binding) > > Best, > Leonard > > > 2023年11月22日 下午6:19,Roman Khachatryan 写道: > > > > +1 (binding) > > > > > > Thanks for the proposal > > > > Regards, > > Roman > > > > On Wed, Nov 22, 2023, 10:08 AM Piotr Nowojsk

Re: [VOTE] Release 1.17.2, release candidate #1

2023-11-23 Thread Feng Jin
+1(non-binding) - verified signatures and hashsums - Verified there are no binaries in the source archive - Built Flink from sources - Started local standalone cluster, submitted sql job using sql-client Best, Feng On Thu, Nov 23, 2023 at 11:08 PM Hang Ruan wrote: > +1 (non-binding) > > - ver

Re: [VOTE] Release 1.16.3, release candidate #1

2023-11-23 Thread Feng Jin
+1(non-binding) - verified signatures and hashsums - Verified there are no binaries in the source archive - Built Flink from sources - Started local standalone cluster, submitted sql job using sql-client Best, Feng On Thu, Nov 23, 2023 at 11:00 PM Hang Ruan wrote: > +1 (non-binding) > > - veri

Re: Streaming data from AWS S3 Source

2023-11-23 Thread Feng Jin
Hi Neelabh You can use FileSystem Connector . for DataStream [1] for TableAPI [2] . And you need to put necessary dependency to your flink environment. [3] For Flink SQL setup, you can reference `sql getting started module`[4] [1]. https://nightlies.apache.org/flink/flink-docs-master/docs/c

Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-04 Thread Feng Jin
Hi xuyang, Thank you for initiating this proposal. I'm glad to see that TVF's functionality can be fully supported. Regarding the early fire, late fire, and allow lateness features, how will they be provided to users? The documentation doesn't seem to provide a detailed description of this part.

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-06 Thread Feng Jin
This is incredibly exciting news, a big +1 for this. Thank you for the fantastic work on Flink CDC. We have created thousands of real-time integration jobs using Flink CDC connectors. Best, Feng On Thu, Dec 7, 2023 at 1:45 PM gongzhongqiang wrote: > It's very exciting to hear the news. > +1 f

[DISCUSS] FLIP-387: Support named parameters for functions and call procedures

2023-12-14 Thread Feng Jin
Hi all, Xuyang and I would like to start a discussion of FLIP-387: Support named parameters for functions and call procedures [1] Currently, when users call a function or call a procedure, they must specify all fields in order. When there are a large number of parameters, it is easy to make mist

Re: [DISCUSS] FLIP-387: Support named parameters for functions and call procedures

2023-12-14 Thread Feng Jin
it simple and don't allow overloading > named parameters. With the optionality, users can add an arbitrary > number of parameters to the signature of the same eval method. > > Regards, > Timo > > On 14.12.23 10:02, Feng Jin wrote: > > Hi all, > > > > > &g

Re: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-02 Thread Feng Jin
Congratulations, Alex! Best, Feng On Tue, Jan 2, 2024 at 11:04 PM Chen Yu wrote: > Congratulations, Alex! > > Best, > Yu Chen > > > 发件人: Zhanghao Chen > 发送时间: 2024年1月2日 22:44 > 收件人: dev > 抄送: Alexander Fedulov > 主题: Re: [ANNOUNCE] New Apache Flink Commi

Re: Re: [DISCUSS] FLIP-387: Support named parameters for functions and call procedures

2024-01-02 Thread Feng Jin
in the FLIP previously, I'll go over the code of PoC, and > post here if there are any more concerns. > > Xuyang 于2023年12月21日周四 10:39写道: > > > > > Hi, Benchao. > > > > > > When Feng Jin and I tried the poc together, we found that when using > udaf

[VOTE] FLIP-387: Support named parameters for functions and call procedures

2024-01-04 Thread Feng Jin
or an insufficient number of votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-387%3A+Support+named+parameters+for+functions+and+call+procedures [2] https://lists.apache.org/thread/bto7mpjvcx7d7k86owb00dwrm65jx8cn Best, Feng Jin

Re: [VOTE] FLIP-387: Support named parameters for functions and call procedures

2024-01-05 Thread Feng Jin
menter. > > Regards, > Timo > > > On 05.01.24 05:06, Lincoln Lee wrote: > > +1 (binding) > > > > Best, > > Lincoln Lee > > > > > > Benchao Li 于2024年1月5日周五 11:46写道: > > > >> +1 (binding) > >> > >>

Re: [VOTE] FLIP-387: Support named parameters for functions and call procedures

2024-01-07 Thread Feng Jin
Hi Alexey Thank you for the reminder, the link has been updated. Best, Feng Jin On Sat, Jan 6, 2024 at 12:55 AM Alexey Leonov-Vendrovskiy < vendrov...@gmail.com> wrote: > Thanks for starting the vote! > Do you mind adding a link from the FLIP to this thread? > > Thanks, &

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Feng Jin
+1 (non-binding) Best, Feng Jin On Tue, Jan 9, 2024 at 5:29 PM Yuxin Tan wrote: > +1 (non-binding) > > Best, > Yuxin > > > Márton Balassi 于2024年1月9日周二 17:25写道: > > > +1 (binding) > > > > On Tue, Jan 9, 2024 at 10:15 AM Leonard Xu wrote: > > &

Re: Re: [VOTE] FLIP-387: Support named parameters for functions and call procedures

2024-01-09 Thread Feng Jin
Thank you all! Closing the vote. The result will be sent in a separate email. Best, Feng Jin On Wed, Jan 10, 2024 at 2:04 PM Hang Ruan wrote: > +1 (non-binding) > > Best, > Hang > > Jingsong Li 于2024年1月10日周三 12:03写道: > > > +1 > > > > On Wed,

[RESULT][VOTE] FLIP-387: Support named parameters for functions and call procedures

2024-01-09 Thread Feng Jin
hread/m3hw5cc1ovtvvplv9hpd56fzzl44xxcr Best, Feng Jin

Re: Re: [VOTE] FLIP-377: Support fine-grained configuration to control filter push down for Table/SQL Sources

2024-01-23 Thread Feng Jin
+1 (non-binding) Best, Feng Jin On Tue, Jan 23, 2024 at 5:46 PM Qingsheng Ren wrote: > +1 (binding) > > Thanks for driving this, Jiabao! > > Best, > Qingsheng > > On Fri, Jan 19, 2024 at 2:11 PM Jark Wu wrote: > > > +1 (binding) > > > > Best,

Re: [SUMMARY] Flink 1.19 Release Sync 01/23/2024

2024-01-24 Thread Feng Jin
request that we merge the pull request next Monday(Jan 29th). I apologize if this affects your related schedule. [1]. https://issues.apache.org/jira/browse/FLINK-34054 Best regards, Feng Jin On Wed, Jan 24, 2024 at 10:00 PM Lincoln Lee wrote: > Hi devs, > > I'd like to share s

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-19 Thread Feng Jin
Congratulations, Jiabao! Best, Feng On Mon, Feb 19, 2024 at 7:35 PM Sergey Nuyanzin wrote: > Congratulations, Jiabao! > > On Mon, Feb 19, 2024 at 12:26 PM Yanquan Lv wrote: > > > Congratulations, Jiabao. > > > > He Wang 于2024年2月19日周一 19:21写道: > > > > > Congrats, Jiabao! > > > > > > On Mon, F

Re: Temporal join on rolling aggregate

2024-02-23 Thread Feng Jin
+1 Support this feature. There are many limitations to using time window aggregation currently, and if we can declare watermark and time attribute on the view, it will make it easier for us to use time windows. Similarly, it would be very useful if the primary key could be declared in the view. Th

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2024-02-28 Thread Feng Jin
+1 (non-binding) Best, Feng Jin On Thu, Feb 29, 2024 at 4:41 AM Márton Balassi wrote: > +1 (binding) > > Marton > > On Wed, Feb 28, 2024 at 5:14 PM Gyula Fóra wrote: > > > +1 (binding) > > > > Gyula > > > > On Wed, Feb 28, 2024 at 11:10

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-11 Thread Feng Jin
+1 (non-binding) - Verified signatures and checksums - Verified that source does not contain binaries - Build source code successfully - Run a simple sql query successfully Best, Feng Jin On Tue, Mar 12, 2024 at 11:09 AM Ron liu wrote: > +1 (non binding) > > quickly verified: >

Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax

2024-03-13 Thread Feng Jin
r's > > business, there is no similar statement for users to use. > > > > According to the online discussion in FLINK-24939 [2] with Jark Wu and > Feng > > Jin, since `CatalogStore` > > has been introduced in FLIP-295 [3], we could use this component to >

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-14 Thread Feng Jin
Hi Di Thank you for initiating this FLIP, +1 for this. Regarding the option `doris.filter.query` of doris source table Can we directly implement the FilterPushDown capability of Flink Source like Jdbc Source [1] instead of introducing an option? Regarding two-phase commit, > At the same time,

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Feng Jin
Congratulations! Best, Feng On Mon, Mar 18, 2024 at 6:18 PM Yuepeng Pan wrote: > Congratulations! > > > Thanks to release managers and everyone involved. > > > > > Best, > Yuepeng Pan > > > > > > > > > At 2024-03-18 18:09:45, "Yubin Li" wrote: > >Congratulations! > > > >Thanks to release manag

Re: [VOTE] FLIP-436: Introduce Catalog-related Syntax

2024-03-19 Thread Feng Jin
+1 (non-binding) Best, Feng On Tue, Mar 19, 2024 at 7:46 PM Ferenc Csaky wrote: > +1 (non-binding). > > Best, > Ferenc > > > > > On Tuesday, March 19th, 2024 at 12:39, Jark Wu wrote: > > > > > > > +1 (binding) > > > > Best, > > Jark > > > > On Tue, 19 Mar 2024 at 19:05, Yuepeng Pan panyuep...@

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-20 Thread Feng Jin
Hi Ron and Lincoln Thanks for driving this discussion. I believe it will greatly improve the convenience of managing user real-time pipelines. I have some questions. *Regarding Limitations of Dynamic Table:* > Does not support modifying the select statement after the dynamic table is created.

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Feng Jin
Congratulations! Best, Feng On Thu, Mar 21, 2024 at 11:37 AM Ron liu wrote: > Congratulations! > > Best, > Ron > > Jark Wu 于2024年3月21日周四 10:46写道: > > > Congratulations and welcome! > > > > Best, > > Jark > > > > On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > > > > > Co

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-22 Thread Feng Jin
wo-phase commit, when a commit fails, the checkpoint will also > fail, and the job will be continuously retried. > > [1] > https://github.com/apache/doris-flink-connector/blob/master/flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisDynamicTableSource.java#L58 > >

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-24 Thread Feng Jin
or/src/main/java/org/apache/doris/flink/sink/committer/DorisCommitter.java#L150-L160 > [2] > https://github.com/apache/doris-flink-connector/blob/master/flink-doris-connector/src/main/java/org/apache/doris/flink/table/DorisConfigOptions.java#L89-L98 > > Brs > di.wu > > > > &g

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-25 Thread Feng Jin
most cases > unless you are restarting from a checkpoint that occurred a long time ago. > What do you think? > > > [1] > https://github.com/apache/doris/blob/master/fe/fe-common/src/main/java/org/apache/doris/common/Config.java#L163-L168 > > > Brs > di.wu > > &

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-31 Thread Feng Jin
Congratulations! Best, Feng Jin On Mon, Apr 1, 2024 at 10:51 AM weijie guo wrote: > Congratulations! > > Best regards, > > Weijie > > > Hang Ruan 于2024年4月1日周一 09:49写道: > > > Congratulations! > > > > Best, > > Hang > > > >

Re: [VOTE] FLIP-399: Flink Connector Doris

2024-04-09 Thread Feng Jin
+1 (non-binding) Best, Feng On Tue, Apr 9, 2024 at 5:56 PM gongzhongqiang wrote: > +1 (non-binding) > > Best, > > Zhongqiang Gong > > wudi <676366...@qq.com.invalid> 于2024年4月9日周二 10:48写道: > > > Hi devs, > > > > I would like to start a vote about FLIP-399 [1]. The FLIP is about > > contributing

  1   2   >