[jira] [Created] (FLINK-19089) Replace ReentrantLock with ReentrantReadWriteLock in ClosableBlockingQueue

2020-08-28 Thread dugenkui (Jira)
dugenkui created FLINK-19089: Summary: Replace ReentrantLock with ReentrantReadWriteLock in ClosableBlockingQueue Key: FLINK-19089 URL: https://issues.apache.org/jira/browse/FLINK-19089 Project: Flink

Re: Re: Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-28 Thread Yu Li
Congratulations, Dian! Best Regards, Yu On Sat, 29 Aug 2020 at 02:10, Thomas Weise wrote: > Congratulations! > > On Fri, Aug 28, 2020 at 4:51 AM Haibo Sun wrote: > > > Congratulations Dian ! > > > > > > > > Best, > > Haibo > > > > At 2020-08-27 18:03:38, "Zhijiang" > > wrote: > > >Congrats,

Re: Re: Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-28 Thread Thomas Weise
Congratulations! On Fri, Aug 28, 2020 at 4:51 AM Haibo Sun wrote: > Congratulations Dian ! > > > > Best, > Haibo > > At 2020-08-27 18:03:38, "Zhijiang" > wrote: > >Congrats, Dian! > > > > > >-- > >From:Yun Gao > >Send

[jira] [Created] (FLINK-19088) flink sql 1.11 HbaseTableSource Supports FilterPushDown

2020-08-28 Thread sijun.huang (Jira)
sijun.huang created FLINK-19088: --- Summary: flink sql 1.11 HbaseTableSource Supports FilterPushDown Key: FLINK-19088 URL: https://issues.apache.org/jira/browse/FLINK-19088 Project: Flink Issue

Re: [DISCUSS] FLIP-138: Declarative Resource management

2020-08-28 Thread Till Rohrmann
Thanks for creating this FLIP @Chesnay and the good input @Xintong and @Zhu Zhu. Let me try to add some comments concerning your questions: # FLIP-56 I think there is nothing fundamentally contradicting FLIP-56 in the FLIP for declarative resource management. As Chesnay said, we have to keep

Re:Re: Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-28 Thread Haibo Sun
Congratulations Dian ! Best, Haibo At 2020-08-27 18:03:38, "Zhijiang" wrote: >Congrats, Dian! > > >-- >From:Yun Gao >Send Time:2020年8月27日(星期四) 17:44 >To:dev ; Dian Fu ; user >; user-zh >Subject:Re: Re: [ANNOUNCE] New PMC

[jira] [Created] (FLINK-19087) ReaultPartitionWriter should not expose subpartition but only subpartition-readers

2020-08-28 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-19087: Summary: ReaultPartitionWriter should not expose subpartition but only subpartition-readers Key: FLINK-19087 URL: https://issues.apache.org/jira/browse/FLINK-19087

Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-28 Thread Dian Fu
Thanks you all! It's my honor and pleasure to work with you in such a great community. Regards, Dian > 在 2020年8月28日,下午2:40,Till Rohrmann 写道: > > Congrats, Dian! > > Cheers, > Till > > On Fri, Aug 28, 2020 at 8:33 AM Wei Zhong wrote: > >> Congratulations Dian! >> >>> 在

Re: [VOTE] Remove deprecated DataStream#fold and DataStream#split in 1.12

2020-08-28 Thread David Anderson
+1 David On Fri, Aug 28, 2020 at 9:41 AM Dawid Wysakowicz wrote: > Hi all, > > I would like to start a vote for removing deprecated, but Public(Evolving) > methods in the upcoming 1.12 release: > >- XxxDataStream#fold and all related classes (such as >FoldingDescriptor, FoldFunction,

Re: [DISCUSS] Remove Kafka 0.10.x connector (and possibly 0.11.x)

2020-08-28 Thread Aljoscha Krettek
Yes, that should be the process. But I'd try it in a testing environment before doing it in the production environment. Aljoscha On 27.08.20 11:42, Paul Lam wrote: Hi, I think it’s okay, given that we can either migrate to the universal connector or still use the compatible 0.10/0.11

Re: [ANNOUNCE] Introducing the GSoD 2020 Participants.

2020-08-28 Thread David Anderson
I'm really pleased we were able to attract such well-qualified participants, and look forward to working with and learning from you both. David On Thu, Aug 27, 2020 at 8:45 PM Arvid Heise wrote: > Welcome. I'm grateful for having you two on board. I'll guess that the > documentation will be

Re: [DISCUSS] FLIP-138: Declarative Resource management

2020-08-28 Thread Zhu Zhu
Thanks for the explanation @Chesnay Schepler . Yes, for batch jobs it can be safe to schedule downstream vertices if there are enough slots in the pool, even if these slots are still in use at that moment. And the job can still progress even if the vertices stick to the original parallelism.

Re: [DISCUSS] FLIP-141: Intra-Slot Managed Memory Sharing

2020-08-28 Thread Xintong Song
> > A quick question, does network memory treated as managed memory now? Or in > the future? > No, network memory is independent from managed memory ATM. And I'm not aware of any plan to combine these two. Any insights there? Thank you~ Xintong Song On Fri, Aug 28, 2020 at 4:35 PM Kurt Young

Re: [DISCUSS] FLIP-138: Declarative Resource management

2020-08-28 Thread Chesnay Schepler
Maybe :) Imagine a case where the producer and consumer have the same ResourceProfile, or at least one where the consumer requirements are less than the producer ones. In this case, the scheduler can happily schedule consumers, because it knows it will get enough slots. If the profiles are

Re: [DISCUSS] FLIP-141: Intra-Slot Managed Memory Sharing

2020-08-28 Thread Kurt Young
A quick question, does network memory treated as managed memory now? Or in the future? Best, Kurt On Wed, Aug 26, 2020 at 5:32 PM Xintong Song wrote: > Hi devs, > > I'd like to bring the discussion over FLIP-141[1], which proposes how > managed memory should be shared by various use cases

Re: [VOTE] Remove deprecated DataStream#fold and DataStream#split in 1.12

2020-08-28 Thread Paul Lam
+1 Best, Paul Lam > 2020年8月28日 15:41,Dawid Wysakowicz 写道: > > Hi all, > > I would like to start a vote for removing deprecated, but Public(Evolving) > methods in the upcoming 1.12 release: > > XxxDataStream#fold and all related classes (such as FoldingDescriptor, > FoldFunction, ...) >

Re: [VOTE] Remove deprecated DataStream#fold and DataStream#split in 1.12

2020-08-28 Thread Aljoscha Krettek
+1 Aljoscha On 28.08.20 09:41, Dawid Wysakowicz wrote: Hi all, I would like to start a vote for removing deprecated, but Public(Evolving) methods in the upcoming 1.12 release: * XxxDataStream#fold and all related classes (such as FoldingDescriptor, FoldFunction, ...) *

[jira] [Created] (FLINK-19086) Performance regressin 2020-08-28 in globalWindow benchmark

2020-08-28 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-19086: - Summary: Performance regressin 2020-08-28 in globalWindow benchmark Key: FLINK-19086 URL: https://issues.apache.org/jira/browse/FLINK-19086 Project: Flink

[VOTE] Remove deprecated DataStream#fold and DataStream#split in 1.12

2020-08-28 Thread Dawid Wysakowicz
Hi all, I would like to start a vote for removing deprecated, but Public(Evolving) methods in the upcoming 1.12 release: * XxxDataStream#fold and all related classes (such as FoldingDescriptor, FoldFunction, ...) * DataStream#split This was discussed in

Re: [DISCUSS] Removing deprecated methods from DataStream API

2020-08-28 Thread Dawid Wysakowicz
@Yun Yes, I created the ticket with target version 2.0.0, which was agreed by deprecating the method ;) I will soon start a vote for actually removing it in 1.12 and if we agree on that I will change the target version. On 28/08/2020 09:33, Yun Tang wrote: > I noticed that the ticket to remove

Re: [DISCUSS] Removing deprecated methods from DataStream API

2020-08-28 Thread Dawid Wysakowicz
@Aljoscha I have not thought about DataStream#project. I see your argument and I do agree with you it makes sense to eventually remove them. They are not deprecated yet though. Moreover I think we could include deprecating it as part of the efforts of FLIP-131/FLIP-134. I will add the argument

Re: [DISCUSS] Removing deprecated methods from DataStream API

2020-08-28 Thread Yun Tang
I noticed that the ticket to remove deprecated DataStream#fold() [1] has been created but not yet reach an agreement or assigned. Actually fold related function and state descriptions has been deprecated for long than 3 years, and I think it's okay to remove such kind of state now. [1]

[jira] [Created] (FLINK-19085) Remove deprecated methods for writing CSV and Text files from DataStream

2020-08-28 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-19085: Summary: Remove deprecated methods for writing CSV and Text files from DataStream Key: FLINK-19085 URL: https://issues.apache.org/jira/browse/FLINK-19085

[jira] [Created] (FLINK-19084) Remove deprecated methods in ExecutionConfig

2020-08-28 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-19084: Summary: Remove deprecated methods in ExecutionConfig Key: FLINK-19084 URL: https://issues.apache.org/jira/browse/FLINK-19084 Project: Flink Issue

[jira] [Created] (FLINK-19083) Remove deprecated DataStream#split

2020-08-28 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-19083: Summary: Remove deprecated DataStream#split Key: FLINK-19083 URL: https://issues.apache.org/jira/browse/FLINK-19083 Project: Flink Issue Type:

Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-28 Thread Till Rohrmann
Congrats, Dian! Cheers, Till On Fri, Aug 28, 2020 at 8:33 AM Wei Zhong wrote: > Congratulations Dian! > > > 在 2020年8月28日,14:29,Jingsong Li 写道: > > > > Congratulations , Dian! > > > > Best, Jingsong > > > > On Fri, Aug 28, 2020 at 11:06 AM Walter Peng > wrote: > >

Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-28 Thread Wei Zhong
Congratulations Dian! > 在 2020年8月28日,14:29,Jingsong Li 写道: > > Congratulations , Dian! > > Best, Jingsong > > On Fri, Aug 28, 2020 at 11:06 AM Walter Peng > wrote: > congrats! > > Yun Tang wrote: > > Congratulations , Dian! > > > -- > Best, Jingsong Lee