Re: [DISCUSS] FLIP-138: Declarative Resource management

Thanks for the response! >> The scheduler doesn't have to wait for one stage to finish Does it mean we will declare resources and decide the parallelism for a stage which is partially schedulable, i.e. when input data are ready just for part of the execution vertices? >> This will get more

[jira] [Created] (FLINK-19082) Add docs for temporal table and temporal table join

Leonard Xu created FLINK-19082: -- Summary: Add docs for temporal table and temporal table join Key: FLINK-19082 URL: https://issues.apache.org/jira/browse/FLINK-19082 Project: Flink Issue Type:

[jira] [Created] (FLINK-19081) Deprecate TemporalTableFunction and Table$createTemporalTableFunction()

Leonard Xu created FLINK-19081: -- Summary: Deprecate TemporalTableFunction and Table$createTemporalTableFunction() Key: FLINK-19081 URL: https://issues.apache.org/jira/browse/FLINK-19081 Project: Flink

[jira] [Created] (FLINK-19080) Materialize timeindicator data type in the right input of temporal join

Leonard Xu created FLINK-19080: -- Summary: Materialize timeindicator data type in the right input of temporal join Key: FLINK-19080 URL: https://issues.apache.org/jira/browse/FLINK-19080 Project: Flink

[jira] [Created] (FLINK-19079) Support row time deduplicate operator

Leonard Xu created FLINK-19079: -- Summary: Support row time deduplicate operator Key: FLINK-19079 URL: https://issues.apache.org/jira/browse/FLINK-19079 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19078) Import rowtime join temporal operator

Leonard Xu created FLINK-19078: -- Summary: Import rowtime join temporal operator Key: FLINK-19078 URL: https://issues.apache.org/jira/browse/FLINK-19078 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19076) Import rule to deal Temporal Join condition

Leonard Xu created FLINK-19076: -- Summary: Import rule to deal Temporal Join condition Key: FLINK-19076 URL: https://issues.apache.org/jira/browse/FLINK-19076 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19077) Improve process time temporal join operator

Leonard Xu created FLINK-19077: -- Summary: Improve process time temporal join operator Key: FLINK-19077 URL: https://issues.apache.org/jira/browse/FLINK-19077 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19075) Infer changelog trait for temporal join node

Leonard Xu created FLINK-19075: -- Summary: Infer changelog trait for temporal join node Key: FLINK-19075 URL: https://issues.apache.org/jira/browse/FLINK-19075 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-19074) Materialize timeindicator in the right input of temporal join

Leonard Xu created FLINK-19074: -- Summary: Materialize timeindicator in the right input of temporal join Key: FLINK-19074 URL: https://issues.apache.org/jira/browse/FLINK-19074 Project: Flink

[jira] [Created] (FLINK-19073) Improve streamExecTemporalJoinRule

Leonard Xu created FLINK-19073: -- Summary: Improve streamExecTemporalJoinRule Key: FLINK-19073 URL: https://issues.apache.org/jira/browse/FLINK-19073 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19072) Import Temporal Table join rule

Leonard Xu created FLINK-19072: -- Summary: Import Temporal Table join rule Key: FLINK-19072 URL: https://issues.apache.org/jira/browse/FLINK-19072 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19070) Hive connector should throw a meaningful exception if user reads/writes ACID tables

Rui Li created FLINK-19070: -- Summary: Hive connector should throw a meaningful exception if user reads/writes ACID tables Key: FLINK-19070 URL: https://issues.apache.org/jira/browse/FLINK-19070 Project:

[jira] [Created] (FLINK-19071) Some Hive window functions are not supported

Rui Li created FLINK-19071: -- Summary: Some Hive window functions are not supported Key: FLINK-19071 URL: https://issues.apache.org/jira/browse/FLINK-19071 Project: Flink Issue Type: Task

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations , Dian! Best Yun Tang From: Yang Wang Sent: Friday, August 28, 2020 10:28 To: Arvid Heise Cc: Benchao Li ; dev ; user-zh ; Dian Fu ; user Subject: Re: [ANNOUNCE] New PMC member: Dian Fu Congratulations Dian ! Best, Yang Arvid Heise

[jira] [Created] (FLINK-19069) finalizeOnMaster takes too much time and client timeouts

Jiayi Liao created FLINK-19069: -- Summary: finalizeOnMaster takes too much time and client timeouts Key: FLINK-19069 URL: https://issues.apache.org/jira/browse/FLINK-19069 Project: Flink Issue

[jira] [Created] (FLINK-19068) Filter verbose pod events for KubernetesResourceManagerDriver

Xintong Song created FLINK-19068: Summary: Filter verbose pod events for KubernetesResourceManagerDriver Key: FLINK-19068 URL: https://issues.apache.org/jira/browse/FLINK-19068 Project: Flink

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian ! Best, Yang Arvid Heise 于2020年8月28日周五 上午1:39写道： > Congrats Dian :) > > On Thu, Aug 27, 2020 at 5:01 PM Benchao Li wrote: > >> Congratulations Dian! >> >> Cranmer, Danny 于2020年8月27日周四 下午10:55写道： >> >>> Congratulations Dian! :D >>> >>> On 27/08/2020, 15:25, "Robert

Re: [VOTE] FLIP-132: Temporal Table DDL and Temporal Table Join

Hi all, The voting time for FLIP-132 has passed. I'm closing the vote now. There were 4 + 1 votes, 3 of which are binding: - Fabian (binding) - Jark (binding) - Rui Li (non-binding) - Kurt (binding) There were no -1 votes. Hereby, FLIP-132 has been accepted. Thanks everyone for participating

[jira] [Created] (FLINK-19067) FileNotFoundException when run flink examples on standby JobManager

JieFang.He created FLINK-19067: -- Summary: FileNotFoundException when run flink examples on standby JobManager Key: FLINK-19067 URL: https://issues.apache.org/jira/browse/FLINK-19067 Project: Flink

[jira] [Created] (FLINK-19066) InnerJoinITCase.testBigForSpill failed with "java.lang.ClassCastException: org.apache.flink.table.runtime.util.ResettableExternalBuffer$BufferIterator cannot be cast to

Dian Fu created FLINK-19066: --- Summary: InnerJoinITCase.testBigForSpill failed with "java.lang.ClassCastException: org.apache.flink.table.runtime.util.ResettableExternalBuffer$BufferIterator cannot be cast to

Re: [ANNOUNCE] Introducing the GSoD 2020 Participants.

Welcome. I'm grateful for having you two on board. I'll guess that the documentation will be top-notched in 3 months judging from your background. I hope we can learn from the improvements and also apply them to the other parts of the documentation (or avoid the fixed issues in the future). On

Re: [DISCUSS] FLIP-138: Declarative Resource management

The scheduler doesn't have to wait for one stage to finish. It is still aware that the upstream execution vertex has finished, and can request/use slots accordingly to schedule the consumer. This will get more complicated once we allow the scheduler to change the parallelism while the job is

Re: [DISCUSS] FLIP-138: Declarative Resource management

Thanks Chesnay for proposing this improvement. It's of good value to allow jobs to make best use of available resources adaptively. Not to mention it further supports reactive mode. So big +1 for it. I have a minor concern about possible regression in certain cases due to the proposed

Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats Dian :) On Thu, Aug 27, 2020 at 5:01 PM Benchao Li wrote: > Congratulations Dian! > > Cranmer, Danny 于2020年8月27日周四 下午10:55写道： > >> Congratulations Dian! :D >> >> On 27/08/2020, 15:25, "Robert Metzger" wrote: >> >> CAUTION: This email originated from outside of the

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! Cranmer, Danny 于2020年8月27日周四 下午10:55写道： > Congratulations Dian! :D > > On 27/08/2020, 15:25, "Robert Metzger" wrote: > > CAUTION: This email originated from outside of the organization. Do > not click links or open attachments unless you can confirm the sender

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! :D On 27/08/2020, 15:25, "Robert Metzger" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Congratulations Dian! On Thu, Aug

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! On Thu, Aug 27, 2020 at 3:09 PM Congxian Qiu wrote: > Congratulations Dian > Best, > Congxian > > > Xintong Song 于2020年8月27日周四 下午7:50写道： > > > Congratulations Dian~! > > > > Thank you~ > > > > Xintong Song > > > > > > > > On Thu, Aug 27, 2020 at 7:42 PM Jark Wu wrote: >

[jira] [Created] (FLINK-19065) java.lang.IllegalStateException: Auto generated UIDs have been disabled on join

Maris created FLINK-19065: - Summary: java.lang.IllegalStateException: Auto generated UIDs have been disabled on join Key: FLINK-19065 URL: https://issues.apache.org/jira/browse/FLINK-19065 Project: Flink

[jira] [Created] (FLINK-19064) HBaseRowDataInputFormat is leaking resources

Robert Metzger created FLINK-19064: -- Summary: HBaseRowDataInputFormat is leaking resources Key: FLINK-19064 URL: https://issues.apache.org/jira/browse/FLINK-19064 Project: Flink Issue Type:

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian Best, Congxian Xintong Song 于2020年8月27日周四 下午7:50写道： > Congratulations Dian~! > > Thank you~ > > Xintong Song > > > > On Thu, Aug 27, 2020 at 7:42 PM Jark Wu wrote: > > > Congratulations Dian! > > > > Best, > > Jark > > > > On Thu, 27 Aug 2020 at 19:37, Leonard Xu wrote:

Re: [ANNOUNCE] Weekly Community Update 2020/31-34

Thanks a lot for doing these updates! On Tue, Aug 25, 2020 at 10:23 PM Konstantin Knauf wrote: > Dear community, > > The "weekly" community update is back after a short summer break! This time > I've tried to cover most of what happened during the last four weeks, but I > might pick up some

[jira] [Created] (FLINK-19063) Support join late event from dimension table side in temporal table join

Leonard Xu created FLINK-19063: -- Summary: Support join late event from dimension table side in temporal table join Key: FLINK-19063 URL: https://issues.apache.org/jira/browse/FLINK-19063 Project: Flink

Re: Next Stateful Functions Release

+1 The feature set also seems quite in line with user feedback, which is always great to see. Thanks, Igal! On Thu, Aug 27, 2020 at 1:34 PM Robert Metzger wrote: > +1 to release Statefun 2.2 > > On Tue, Aug 25, 2020 at 2:16 PM David Anderson > wrote: > > > Igal, > > > > The feature set you

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian~! Thank you~ Xintong Song On Thu, Aug 27, 2020 at 7:42 PM Jark Wu wrote: > Congratulations Dian! > > Best, > Jark > > On Thu, 27 Aug 2020 at 19:37, Leonard Xu wrote: > > > Congrats, Dian! Well deserved. > > > > Best > > Leonard > > > > > 在 2020年8月27日，19:34，Kurt Young

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! Best, Jark On Thu, 27 Aug 2020 at 19:37, Leonard Xu wrote: > Congrats, Dian! Well deserved. > > Best > Leonard > > > 在 2020年8月27日，19:34，Kurt Young 写道： > > > > Congratulations Dian! > > > > Best, > > Kurt > > > > > > On Thu, Aug 27, 2020 at 7:28 PM Rui Li wrote: > > >

Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats, Dian! Well deserved. Best Leonard > 在 2020年8月27日，19:34，Kurt Young 写道： > > Congratulations Dian! > > Best, > Kurt > > > On Thu, Aug 27, 2020 at 7:28 PM Rui Li wrote: > >> Congratulations Dian! >> >> On Thu, Aug 27, 2020 at 5:39 PM Yuan Mei wrote: >> >>> Congrats! >>> >>> On

Re: Next Stateful Functions Release

+1 to release Statefun 2.2 On Tue, Aug 25, 2020 at 2:16 PM David Anderson wrote: > Igal, > > The feature set you propose sounds great to me -- as a user I see > plenty there to get excited about. As for the feature freeze date, I > don't really have an informed opinion. > > David > > On Mon,

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! Best, Kurt On Thu, Aug 27, 2020 at 7:28 PM Rui Li wrote: > Congratulations Dian! > > On Thu, Aug 27, 2020 at 5:39 PM Yuan Mei wrote: > >> Congrats! >> >> On Thu, Aug 27, 2020 at 5:38 PM Xingbo Huang wrote: >> >>> Congratulations Dian! >>> >>> Best, >>> Xingbo >>> >>>

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! On Thu, Aug 27, 2020 at 5:39 PM Yuan Mei wrote: > Congrats! > > On Thu, Aug 27, 2020 at 5:38 PM Xingbo Huang wrote: > >> Congratulations Dian! >> >> Best, >> Xingbo >> >> jincheng sun 于2020年8月27日周四 下午5:24写道： >> >>> Hi all, >>> >>> On behalf of the Flink PMC, I'm happy to

[jira] [Created] (FLINK-19062) Improve alter table DDL

Jingsong Lee created FLINK-19062: Summary: Improve alter table DDL Key: FLINK-19062 URL: https://issues.apache.org/jira/browse/FLINK-19062 Project: Flink Issue Type: New Feature

Re: Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats Dian! Best, Yangze Guo On Thu, Aug 27, 2020 at 6:26 PM Zhu Zhu wrote: > > Congratulations Dian! > > Thanks, > Zhu > > Zhijiang 于2020年8月27日周四 下午6:04写道： > > > Congrats, Dian! > > > > -- > > From:Yun Gao > > Send

Re: Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! Thanks, Zhu Zhijiang 于2020年8月27日周四 下午6:04写道： > Congrats, Dian! > > -- > From:Yun Gao > Send Time:2020年8月27日(星期四) 17:44 > To:dev ; Dian Fu ; user < > u...@flink.apache.org>; user-zh > Subject:Re: Re:

Re: Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats, Dian! -- From:Yun Gao Send Time:2020年8月27日(星期四) 17:44 To:dev ; Dian Fu ; user ; user-zh Subject:Re: Re: [ANNOUNCE] New PMC member: Dian Fu Congratulations Dian ! Best Yun

Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats, Dian! Best, Paul Lam > 2020年8月27日 17:42，Marta Paes Moreira 写道： > > Congrats, Dian! > > On Thu, Aug 27, 2020 at 11:39 AM Yuan Mei > wrote: > Congrats! > > On Thu, Aug 27, 2020 at 5:38 PM Xingbo Huang > wrote: >

Re: Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian ! Best Yun -- Sender:Marta Paes Moreira Date:2020/08/27 17:42:34 Recipient:Yuan Mei Cc:Xingbo Huang; jincheng sun; dev; Dian Fu; user; user-zh Theme:Re: [ANNOUNCE] New PMC member: Dian Fu Congrats, Dian!

Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats, Dian! On Thu, Aug 27, 2020 at 11:39 AM Yuan Mei wrote: > Congrats! > > On Thu, Aug 27, 2020 at 5:38 PM Xingbo Huang wrote: > >> Congratulations Dian! >> >> Best, >> Xingbo >> >> jincheng sun 于2020年8月27日周四 下午5:24写道： >> >>> Hi all, >>> >>> On behalf of the Flink PMC, I'm happy to

Re: [DISCUSS] Remove Kafka 0.10.x connector (and possibly 0.11.x)

Hi, I think it’s okay, given that we can either migrate to the universal connector or still use the compatible 0.10/0.11 connector of 1.11 release as Chesnay mentioned when upgrading to 1.12. IIUC, the migration process to the universal connector would be (please correct me if I’m wrong): 1.

Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats! On Thu, Aug 27, 2020 at 5:38 PM Xingbo Huang wrote: > Congratulations Dian! > > Best, > Xingbo > > jincheng sun 于2020年8月27日周四 下午5:24写道： > >> Hi all, >> >> On behalf of the Flink PMC, I'm happy to announce that Dian Fu is now >> part of the Apache Flink Project Management Committee

Re: [ANNOUNCE] New PMC member: Dian Fu

Congratulations Dian! Best, Xingbo jincheng sun 于2020年8月27日周四 下午5:24写道： > Hi all, > > On behalf of the Flink PMC, I'm happy to announce that Dian Fu is now part > of the Apache Flink Project Management Committee (PMC). > > Dian Fu has been very active on PyFlink component, working on various >

[ANNOUNCE] New PMC member: Dian Fu

Hi all, On behalf of the Flink PMC, I'm happy to announce that Dian Fu is now part of the Apache Flink Project Management Committee (PMC). Dian Fu has been very active on PyFlink component, working on various important features, such as the Python UDF and Pandas integration, and keeps checking

[jira] [Created] (FLINK-19061) HiveCatalog fails to get partition column stats if partition value contains special characters

Rui Li created FLINK-19061: -- Summary: HiveCatalog fails to get partition column stats if partition value contains special characters Key: FLINK-19061 URL: https://issues.apache.org/jira/browse/FLINK-19061

[jira] [Created] (FLINK-19060) Checkpoint not triggered when use broadcast stream

henvealf created FLINK-19060: Summary: Checkpoint not triggered when use broadcast stream Key: FLINK-19060 URL: https://issues.apache.org/jira/browse/FLINK-19060 Project: Flink Issue Type: Bug

Re: [DISCUSS] Removing deprecated methods from DataStream API

Did you consider DataStream.project() yet? In general I think we should remove most of the relational-ish methods from DataStream. More candidates in this set of methods would be the tuple index/expression methods for aggregations like min/max etc... Aljoscha On 25.08.20 20:52, Konstantin

Re: [DISCUSS] Remove Kafka 0.10.x connector (and possibly 0.11.x)

@Konstantin: Yes, I'm talking about dropping those modules. We don't have any special code for supporting Kafka 0.10/0.11 in the "modern" connector, that comes from the Kafka Consumer/Producer code we're using. @Paul: The modern Kafka connector works with Kafka brokers as far back as 0.10,

Re: [ANNOUNCE] Apache Flink 1.10.2 released

Congrats, thanks for the release manager work Zhu Zhu and everyone involved in! Best, Zhijiang -- From:liupengcheng Send Time:2020年8月26日(星期三) 19:37 To:dev ; Xingbo Huang Cc:Guowei Ma ; user-zh ; Yangze Guo ; Dian Fu ; Zhu Zhu ;

[jira] [Created] (FLINK-19059) Support to consume retractions for OVER WINDOW operator

Jark Wu created FLINK-19059: --- Summary: Support to consume retractions for OVER WINDOW operator Key: FLINK-19059 URL: https://issues.apache.org/jira/browse/FLINK-19059 Project: Flink Issue Type: