Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread Biao Liu
Congrats! Thanks, Biao /'bɪ.aʊ/ On Tue, 28 Mar 2023 at 10:29, Hang Ruan wrote: > Congratulations! > > Best, > Hang > > yu zelin 于2023年3月28日周二 10:27写道: > >> Congratulations! >> >> Best, >> Yu Zelin >> >> 2023年3月27日 17:23,Yu Li 写道: >> >> Dear Flinkers, >> >> >> >> As you may have noticed, we

[jira] [Created] (FLINK-31124) Add it case for HiveTableSink speculative execution

2023-02-17 Thread Biao Liu (Jira)
Biao Liu created FLINK-31124: Summary: Add it case for HiveTableSink speculative execution Key: FLINK-31124 URL: https://issues.apache.org/jira/browse/FLINK-31124 Project: Flink Issue Type

[jira] [Created] (FLINK-31123) Add it case for FileSink speculative execution

2023-02-17 Thread Biao Liu (Jira)
Biao Liu created FLINK-31123: Summary: Add it case for FileSink speculative execution Key: FLINK-31123 URL: https://issues.apache.org/jira/browse/FLINK-31123 Project: Flink Issue Type

[jira] [Created] (FLINK-30842) Add document for sink supports speculative execution

2023-01-30 Thread Biao Liu (Jira)
Biao Liu created FLINK-30842: Summary: Add document for sink supports speculative execution Key: FLINK-30842 URL: https://issues.apache.org/jira/browse/FLINK-30842 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-30823) Enable speculative execution for some of the typical built-in sinks

2023-01-30 Thread Biao Liu (Jira)
Biao Liu created FLINK-30823: Summary: Enable speculative execution for some of the typical built-in sinks Key: FLINK-30823 URL: https://issues.apache.org/jira/browse/FLINK-30823 Project: Flink

[jira] [Created] (FLINK-30799) Make SinkFunction support speculative execution for batch jobs

2023-01-26 Thread Biao Liu (Jira)
Biao Liu created FLINK-30799: Summary: Make SinkFunction support speculative execution for batch jobs Key: FLINK-30799 URL: https://issues.apache.org/jira/browse/FLINK-30799 Project: Flink

[jira] [Created] (FLINK-30798) Make OutputFormat support speculative execution for batch jobs

2023-01-26 Thread Biao Liu (Jira)
Biao Liu created FLINK-30798: Summary: Make OutputFormat support speculative execution for batch jobs Key: FLINK-30798 URL: https://issues.apache.org/jira/browse/FLINK-30798 Project: Flink

[jira] [Created] (FLINK-30755) Make SinkV2 support speculative execution for batch jobs

2023-01-19 Thread Biao Liu (Jira)
Biao Liu created FLINK-30755: Summary: Make SinkV2 support speculative execution for batch jobs Key: FLINK-30755 URL: https://issues.apache.org/jira/browse/FLINK-30755 Project: Flink Issue Type

Re: [DISCUSS] Promote SinkV2 to @Public and deprecate SinkFunction

2023-01-18 Thread Biao Liu
Hi Martijn, Thanks for bringing us this discussion! I think it's time to mark SinkFunction as deprecated. It may help a lot to encourage users to migrate existing sink connectors to the new interface. About the concern of Lijie, I'm not sure if it's OK to compatibly change the interface with

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2023-01-18 Thread Biao Liu
t; On Thu, Jan 12, 2023 at 8:56 AM Martijn Visser > wrote: > > > Hi Biao, > > > > While I rather wouldn't add new features to (to-be) deprecated features, > I > > would be +0 for this. > > > > Best regards, > > > > Martijn > > > > O

[jira] [Created] (FLINK-30725) FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-17 Thread Biao Liu (Jira)
Biao Liu created FLINK-30725: Summary: FLIP-281: Sink Supports Speculative Execution For Batch Job Key: FLINK-30725 URL: https://issues.apache.org/jira/browse/FLINK-30725 Project: Flink Issue

Re: [VOTE] FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-13 Thread Biao Liu
t; Best regards, > > > > > Yuxia > > > > > > > > > > - 原始邮件 - > > > > > 发件人: "Zhu Zhu" > > > > > 收件人: "dev" > > > > > 发送时间: 星期二, 2023年 1 月 10日 下午 5:50:39 > > > > > 主题: Re

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2023-01-11 Thread Biao Liu
nks for the explanation of how SinkV2 knows the right subtask > > > attempt. I have no more questions, +1 for the proposal. > > > > > > Best, > > > Lijie > > > > > > Biao Liu 于2022年12月28日周三 17:22写道: > > > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Biao Liu
Congratulations, Lincoln! Thanks, Biao /'bɪ.aʊ/ On Tue, 10 Jan 2023 at 14:59, Hang Ruan wrote: > Congratulations, Lincoln! > > Best, > Hang > > Biao Geng 于2023年1月10日周二 14:57写道: > > > Congrats, Lincoln! > > Best, > > Biao Geng > > > > 获取 Outlook for iOS > >

Re: [VOTE] FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-04 Thread Biao Liu
ope. I would like to read it in the next few days. Can you > keep the vote open a little longer? > > Best regards, > > Martijn > > On Wed, Jan 4, 2023 at 1:31 PM Biao Liu wrote: > > > Hi everyone, > > > > Thanks for all the feedback! > > > > Ba

[VOTE] FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-04 Thread Biao Liu
Hi everyone, Thanks for all the feedback! Based on the discussion[1], we seem to have a consensus. So I'd like to start a vote on FLIP-281: Sink Supports Speculative Execution For Batch Job[2]. The vote will last for 72 hours, unless there is an objection or insufficient votes. [1]

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2022-12-28 Thread Biao Liu
o. > > > Thanks for driving this FLIP. > > > After quick look of this FLIP, I have a question about "expose the > > attempt > > > number which can be used to isolate data produced by speculative > > executions > > > with the same subtask id". >

[DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2022-12-22 Thread Biao Liu
Hi everyone, I would like to start a discussion about making Sink support speculative execution for batch jobs. This proposal is a follow up of "FLIP-168: Speculative Execution For Batch Job"[1]. Speculative execution is very meaningful for batch jobs. And it would be more complete after

Re: [ANNOUNCE] Apache Flink 1.16.0 released

2022-10-28 Thread Biao Liu
Congrats! Glad to hear that. BTW, I just found the document link of 1.16 from https://flink.apache.org/ is not correct. [image: 截屏2022-10-28 17.01.28.png] Thanks, Biao /'bɪ.aʊ/ On Fri, 28 Oct 2022 at 14:46, Xingbo Huang wrote: > The Apache Flink community is very happy to announce the

Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Biao Liu
Congrats, Guowei! Thanks, Biao /'bɪ.aʊ/ On Thu, 21 Jan 2021 at 09:30, Paul Lam wrote: > Congrats, Guowei! > > Best, > Paul Lam > > > 2021年1月21日 07:21,Steven Wu 写道: > > > > Congrats, Guowei! > > > > On Wed, Jan 20, 2021 at 10:32 AM Seth Wiesman > wrote: > > > >> Congratulations! > >> > >>

Re: [ANNOUNCE] New Apache Flink Committer - Congxian Qiu

2020-10-29 Thread Biao Liu
Congrads! Thanks, Biao /'bɪ.aʊ/ On Thu, 29 Oct 2020 at 15:14, Xingbo Huang wrote: > Congratulations Congxian. > > Best, > Xingbo > > Dian Fu 于2020年10月29日周四 下午3:05写道: > > > Congratulations Congxian! > > > > Regards, > > Dian > > > > > 在 2020年10月29日,下午2:35,Yangze Guo 写道: > > > > > >

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-07 Thread Biao Liu
Congrats Piotr! Well deserved! Thanks, Biao /'bɪ.aʊ/ On Tue, 7 Jul 2020 at 13:03, Congxian Qiu wrote: > Congratulations Piotr! > > Best, > Congxian > > > Zhijiang 于2020年7月7日周二 下午12:25写道: > > > Congratulations Piotr! > > > > Best, > > Zhijiang > > > > > >

Re: [ANNOUNCE] Yu Li is now part of the Flink PMC

2020-06-21 Thread Biao Liu
Congrats! Thanks, Biao /'bɪ.aʊ/ On Thu, 18 Jun 2020 at 19:41, Ufuk Celebi wrote: > Congrats! :-) > > – Ufuk > > > On Thu, Jun 18, 2020 at 9:47 AM Marta Paes Moreira > wrote: > > > Awesome! Congratulations, Yu! > > > > On Thu, Jun 18, 2020 at 9:16 AM Zhu Zhu wrote: > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Xintong Song

2020-06-04 Thread Biao Liu
Congrats! Thanks, Biao /'bɪ.aʊ/ On Fri, 5 Jun 2020 at 13:32, Thomas Weise wrote: > Congratulations! > > > On Thu, Jun 4, 2020, 10:17 PM Yuan Mei wrote: > > > Congrats, Xintong! > > > > On Fri, Jun 5, 2020 at 12:45 PM Becket Qin wrote: > > > > > Hi all, > > > > > > On behalf of the PMC, I’m

[jira] [Created] (FLINK-16945) Execute CheckpointFailureManager.FailJobCallback directly in main thread executor

2020-04-02 Thread Biao Liu (Jira)
Biao Liu created FLINK-16945: Summary: Execute CheckpointFailureManager.FailJobCallback directly in main thread executor Key: FLINK-16945 URL: https://issues.apache.org/jira/browse/FLINK-16945 Project

Re: [ANNOUNCE] New Committers and PMC member

2020-04-01 Thread Biao Liu
Congrats! Thanks, Biao /'bɪ.aʊ/ On Thu, 2 Apr 2020 at 11:59, Yuan Mei wrote: > Congrats :-) > > On Wed, Apr 1, 2020 at 4:52 PM Stephan Ewen wrote: > > > Hi all! > > > > Happy to announce that over the last few weeks, several people in the > > community joined in new roles: > > > > -

[jira] [Created] (FLINK-16561) Resuming Externalized Checkpoint (rocks, incremental, no parallelism change) end-to-end test fails on Azure

2020-03-11 Thread Biao Liu (Jira)
Biao Liu created FLINK-16561: Summary: Resuming Externalized Checkpoint (rocks, incremental, no parallelism change) end-to-end test fails on Azure Key: FLINK-16561 URL: https://issues.apache.org/jira/browse/FLINK

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-01-29 Thread Biao Liu
Congrats! On Wed, Jan 29, 2020 at 10:37 aihua li wrote: > Congratulations Yu LI, well deserved. > > > 2020年1月23日 下午4:59,Stephan Ewen 写道: > > > > Hi all! > > > > We are announcing that Yu Li has joined the rank of Flink committers. > > > > Yu joined already in late December, but the

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-16 Thread Biao Liu
+1 I think that's how it should be. Timer should align with other regular state. If user wants a better performance without memory concern, memory or FS statebackend might be considered. Or maybe we could optimize the performance by introducing a specific column family for timer. It could have

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

2020-01-16 Thread Biao Liu
Congrats! Thanks, Biao /'bɪ.aʊ/ On Fri, 17 Jan 2020 at 13:43, Rui Li wrote: > Congratulations Dian, well deserved! > > On Thu, Jan 16, 2020 at 5:58 PM jincheng sun > wrote: > >> Hi everyone, >> >> I'm very happy to announce that Dian accepted the offer of the Flink PMC >> to become a

Re: Potential side-effect of connector code to JM/TM

2019-12-17 Thread Biao Liu
Hi Yingjie, Thanks for figuring out the impressive bug and bringing this discussion. I'm afraid there is no such a silver bullet for isolation from third-party library. However I agree that resource checking utils might help. It seems that you and Till have already raised some feasible ideas.

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Biao Liu
Congrats Zhu Zhu! Thanks, Biao /'bɪ.aʊ/ On Mon, 16 Dec 2019 at 10:23, Congxian Qiu wrote: > Congrats, Zhu Zhu! > > Best, > Congxian > > > aihua li 于2019年12月16日周一 上午10:16写道: > > > Congratulations, zhuzhu! > > > > > 在 2019年12月16日,上午10:04,Jingsong Li 写道: > > > > > > Congratulations Zhu Zhu! >

[jira] [Created] (FLINK-14971) Move ACK and declined message handling in the same thread with triggering

2019-11-27 Thread Biao Liu (Jira)
Biao Liu created FLINK-14971: Summary: Move ACK and declined message handling in the same thread with triggering Key: FLINK-14971 URL: https://issues.apache.org/jira/browse/FLINK-14971 Project: Flink

Re: Error:java: 无效的标记: --add-exports=java.base/sun.net.util=ALL-UNNAMED

2019-11-13 Thread Biao Liu
Hi, I have encountered the same issue when setting up a dev environment. It seems that the my Intellij (2019.2.1) unexpectedly activates java11 profile of maven. It doesn't match the Java compiler (JDK8). I'm not sure why it happened silently. So for me, the solution is "Intellij" -> "View" ->

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-08 Thread Biao Liu
Congratulations Jack! Thanks, Biao /'bɪ.aʊ/ On Fri, 8 Nov 2019 at 19:55, Wei Zhong wrote: > Congratulations Jark! > > Best, > Wei > > > > 在 2019年11月8日,19:36,Zhijiang 写道: > > > > Congratulations Jark! > > > > Best, > > Zhijiang > > > > > >

Re: Checkstyle-IDEA plugin For Java

2019-11-04 Thread Biao Liu
Hi yanjun, I have just checked the CheckStyle-IDEA plugin (latest version 5.33.1) [1]. 8.14 is available in my environment (macOS). I have no idea why it's unavailable in your IDE. Here are just some guesses. 1. There are some similar plugins of style checking. Have you install the correct one?

Re: [DISCUSS] FLIP-83: Flink End-to-end Performance Testing Framework

2019-11-04 Thread Biao Liu
Thanks Yu for bringing this topic. +1 for this proposal. Glad to have an e2e performance testing. It seems this proposal is separated into several stages. Is there a more detailed plan? Thanks, Biao /'bɪ.aʊ/ On Mon, 4 Nov 2019 at 19:54, Congxian Qiu wrote: > +1 for this idea. > >

Re: [ANNOUNCE] Becket Qin joins the Flink PMC

2019-10-28 Thread Biao Liu
Congrats Becket! Thanks, Biao /'bɪ.aʊ/ On Tue, 29 Oct 2019 at 12:07, jincheng sun wrote: > Congratulations Becket. > Best, > Jincheng > > Rui Li 于2019年10月29日周二 上午11:37写道: > > > Congrats Becket! > > > > On Tue, Oct 29, 2019 at 11:20 AM Leonard Xu wrote: > > > > > Congratulations! Becket. >

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-21 Thread Biao Liu
+1 (non-binding) Thanks, Biao /'bɪ.aʊ/ On Tue, 22 Oct 2019 at 10:26, Jark Wu wrote: > +1 (non-binding) > > Best, > Jark > > On Tue, 22 Oct 2019 at 09:38, Hequn Cheng wrote: > > > +1 (non-binding) > > > > Best, Hequn > > > > On Tue, Oct 22, 2019 at 9:21 AM Dian Fu wrote: > > > > > +1

Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

2019-10-12 Thread Biao Liu
Hi Stehpan, +1 for having Stateful Functions in Flink. Before discussing which repository it should belong, I was wondering if we have reached an agreement of "splitting flink repository" as Piotr mentioned or not. It seems that it's just no more further discussion. It's OK for me to add it to

Re: [VOTE] FLIP-74: Flink JobClient API

2019-10-11 Thread Biao Liu
+1 (non-binding), glad to have this improvement! Thanks, Biao /'bɪ.aʊ/ On Fri, 11 Oct 2019 at 14:44, Jeff Zhang wrote: > +1, overall design make sense to me > > SHI Xiaogang 于2019年10月11日周五 上午11:15写道: > > > +1. The interface looks fine to me. > > > > Regards, > > Xiaogang > > > > Zili Chen

Re: [SURVEY] Dropping non Credit-based Flow Control

2019-10-10 Thread Biao Liu
Thanks for start this survey, Piotr. We have benefitted from credit-based flow control a lot. I can't figure out a reason to use non credit-based model. I think we have kept the older code paths long enough (1.5 -> 1.9). That's a big burden to maintain. Especially there are a lot duplicated codes

[SURVEY] How do you use ExternallyInducedSource or WithMasterCheckpointHook

2019-10-09 Thread Biao Liu
Hi everyone, I would like to reach out to the user who uses or is interested in `ExternallyInducedSource` or `WithMasterCheckpointHook` interfaces. The background of this survey is I'm doing some reworking of `CheckpointCoordinator`. I encountered a problem that the semantics of

[jira] [Created] (FLINK-14344) Snapshot master hook state asynchronously

2019-10-08 Thread Biao Liu (Jira)
Biao Liu created FLINK-14344: Summary: Snapshot master hook state asynchronously Key: FLINK-14344 URL: https://issues.apache.org/jira/browse/FLINK-14344 Project: Flink Issue Type: Sub-task

Re: Have trouble on running flink

2019-09-24 Thread Biao Liu
Hi Russell, I don't think `BackendBuildingException` is root cause. In your case, this exception appears when task is under cancelling. Have you ever checked the log of yarn node manager? There should be an exit code of container. Even more the container is probably killed by yarn node manager.

Re: [DISCUSS] FLIP-63: Rework table partition support

2019-09-11 Thread Biao Liu
Hi Jingsong, Thanks for explaining. It looks cool! Thanks, Biao /'bɪ.aʊ/ On Wed, 11 Sep 2019 at 11:37, JingsongLee wrote: > Hi biao, thanks for your feedbacks: > > Actually, the runtime source partition of runtime is similar to split, > which concerns data reading, parallelism and fault

Re: [DISCUSS] Features for Apache Flink 1.10

2019-09-11 Thread Biao Liu
Thanks Gary for kicking off the discussion. +1 for the feature freeze time. Also thanks Gary and Yu Li for volunteering as the release manager. BTW, I'm working on refactoring of `CheckpointCoordinator` [1]. It would be great if it is included in 1.10. 1.

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

2019-09-11 Thread Biao Liu
Congrats Zili! Thanks, Biao /'bɪ.aʊ/ On Wed, 11 Sep 2019 at 18:43, Oytun Tez wrote: > Congratulations! > > --- > Oytun Tez > > *M O T A W O R D* > The World's Fastest Human Translation Platform. > oy...@motaword.com — www.motaword.com > > > On Wed, Sep 11, 2019 at 6:36 AM bupt_ljy wrote: >

Re: [DISCUSS] FLIP-63: Rework table partition support

2019-09-10 Thread Biao Liu
Hi Jingsong, Thank you for bringing this discussion. Since I don't have much experience of Flink table/SQL, I'll ask some questions from runtime or engine perspective. > ... where we describe how to partition support in flink and how to integrate to hive partition. FLIP-27 [1] introduces

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-09 Thread Biao Liu
Congrats, Kostas! Thanks, Biao /'bɪ.aʊ/ On Mon, 9 Sep 2019 at 16:07, JingsongLee wrote: > Congrats, Kostas! Well deserved. > > Best, > Jingsong Lee > > > -- > From:Kostas Kloudas > Send Time:2019年9月9日(星期一) 15:50 > To:dev ; Yun

Re: Build failure on flink-python

2019-09-02 Thread Biao Liu
anks to @Wei Zhong for the fixing. > > Best, Hequn > > On Mon, Sep 2, 2019 at 4:41 PM Biao Liu wrote: > > > There are already some Jira tickets opened for this failure [1] [2]. > > Sorry I didn't recognize them. > > > > 1. https://issues.apache.org/jira/browse

Re: Build failure on flink-python

2019-09-02 Thread Biao Liu
There are already some Jira tickets opened for this failure [1] [2]. Sorry I didn't recognize them. 1. https://issues.apache.org/jira/browse/FLINK-13906 2. https://issues.apache.org/jira/browse/FLINK-13932 Thanks, Biao /'bɪ.aʊ/ On Mon, 2 Sep 2019 at 16:24, Biao Liu wrote: > Hi guys, &g

Build failure on flink-python

2019-09-02 Thread Biao Liu
Hi guys, I just found I can't pass the Travis build due to some errors in flink-python module [1]. I'm sure my PR has nothing related with flink-python. And there are also a lot of builds are failing on these errors. I have rebased master branch and tried several times. But it doesn't work.

[jira] [Created] (FLINK-13905) Separate checkpoint triggering into stages

2019-08-30 Thread Biao Liu (Jira)
Biao Liu created FLINK-13905: Summary: Separate checkpoint triggering into stages Key: FLINK-13905 URL: https://issues.apache.org/jira/browse/FLINK-13905 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-13904) Avoid competition between different rounds of checkpoint triggering

2019-08-30 Thread Biao Liu (Jira)
Biao Liu created FLINK-13904: Summary: Avoid competition between different rounds of checkpoint triggering Key: FLINK-13904 URL: https://issues.apache.org/jira/browse/FLINK-13904 Project: Flink

[jira] [Created] (FLINK-13848) Support “scheduleAtFixedRate/scheduleAtFixedDelay” in RpcEndpoint#MainThreadExecutor

2019-08-25 Thread Biao Liu (Jira)
Biao Liu created FLINK-13848: Summary: Support “scheduleAtFixedRate/scheduleAtFixedDelay” in RpcEndpoint#MainThreadExecutor Key: FLINK-13848 URL: https://issues.apache.org/jira/browse/FLINK-13848 Project

Re: CiBot Update

2019-08-22 Thread Biao Liu
Thanks Chesnay a lot, I love this feature! Thanks, Biao /'bɪ.aʊ/ On Thu, 22 Aug 2019 at 20:55, Hequn Cheng wrote: > Cool, thanks Chesnay a lot for the improvement! > > Best, Hequn > > On Thu, Aug 22, 2019 at 5:02 PM Zhu Zhu wrote: > > > Thanks Chesnay for the CI improvement! > > It is very

Re: [DISCUSS] FLIP-52: Remove legacy Program interface.

2019-08-15 Thread Biao Liu
+1 Thanks Kostas for pushing this. Thanks, Biao /'bɪ.aʊ/ On Thu, 15 Aug 2019 at 16:03, Kostas Kloudas wrote: > Thanks a lot for the quick response! > I will consider the Flink Accepted and will start working on it. > > Cheers, > Kostas > > On Thu, Aug 15, 2019 at 5:29 AM SHI Xiaogang >

[jira] [Created] (FLINK-13732) Enhance JobManagerMetricGroup with FLIP-6 architecture

2019-08-14 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13732: Summary: Enhance JobManagerMetricGroup with FLIP-6 architecture Key: FLINK-13732 URL: https://issues.apache.org/jira/browse/FLINK-13732 Project: Flink Issue Type

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread Biao Liu
Congrats! Thanks, Biao /'bɪ.aʊ/ On Thu, 15 Aug 2019 at 10:03, Jark Wu wrote: > Congratulations Andrey! > > > Cheers, > Jark > > On Thu, 15 Aug 2019 at 00:57, jincheng sun > wrote: > > > Congrats Andrey! Very happy to have you onboard :) > > > > Best, Jincheng > > > > Yu Li 于2019年8月15日周四

Re: [VOTE] Flink Project Bylaws

2019-08-13 Thread Biao Liu
+1 (non-binding) Thanks for pushing this! Thanks, Biao /'bɪ.aʊ/ On Wed, 14 Aug 2019 at 09:37, Jark Wu wrote: > +1 (non-binding) > > Best, > Jark > > On Wed, 14 Aug 2019 at 09:22, Kurt Young wrote: > > > +1 (binding) > > > > Best, > > Kurt > > > > > > On Wed, Aug 14, 2019 at 1:34 AM Yun

Re: [DISCUSS] Repository split

2019-08-09 Thread Biao Liu
Hi folks, Thanks for bringing this discussion Chesnay. +1 for the motivation. It's really a bad experience of waiting Travis building for a long time. WRT the solution, personally I agree with Dawid/David. IMO the biggest benefit of splitting repository is reducing build time. I think it could

[jira] [Created] (FLINK-13635) Unexpectedly interrupted in AsyncFunction#timeout

2019-08-07 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13635: Summary: Unexpectedly interrupted in AsyncFunction#timeout Key: FLINK-13635 URL: https://issues.apache.org/jira/browse/FLINK-13635 Project: Flink Issue Type

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Biao Liu
Congrats Hequn! Thanks, Biao /'bɪ.aʊ/ On Wed, Aug 7, 2019 at 6:00 PM Zhu Zhu wrote: > Congratulations to Hequn! > > Thanks, > Zhu Zhu > > Zili Chen 于2019年8月7日周三 下午5:16写道: > >> Congrats Hequn! >> >> Best, >> tison. >> >> >> Jeff Zhang 于2019年8月7日周三 下午5:14写道: >> >>> Congrats Hequn! >>> >>>

Re: [DISCUSS][CODE STYLE] Usage of Java Optional

2019-08-02 Thread Biao Liu
liJ IDEA also report warnings if a class field is Optional, > > because Optional is not serializable. > > > > > > Do we allow Optional as class field only if the class is not serializable > > or forbid this totally? > > > > Thanks, > > Jark > > > &

Re: [DISCUSS][CODE STYLE] Usage of Java Optional

2019-08-02 Thread Biao Liu
Hi Andrey, Thanks for working on this. +1 it's clear and acceptable for me. To Qi, IMO the most performance critical codes are "per record" code path. We should definitely avoid Optional there. For your concern, it's "per buffer" code path which seems to be acceptable with Optional. Just one

Re: [DISCUSS][CODE STYLE] Breaking long function argument lists and chained method calls

2019-08-02 Thread Biao Liu
Hi Andrey, Thank you for bringing us this discussion. I would like to make some details clear. Correct me if I am wrong. The guide draft [1] says the line length is limited in 100 characters. From my understanding, this discussion suggests if there is more than 100 characters in one line (both

Re: [VOTE] Publish the PyFlink into PyPI

2019-08-01 Thread Biao Liu
Thanks Jincheng for working on this. +1 (non-binding) Thanks, Biao /'bɪ.aʊ/ On Thu, Aug 1, 2019 at 8:55 PM Jark Wu wrote: > +1 (non-binding) > > Cheers, > Jark > > On Thu, 1 Aug 2019 at 17:45, Yu Li wrote: > > > +1 (non-binding) > > > > Thanks for driving this! > > > > Best Regards, > > Yu

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-07-30 Thread Biao Liu
Hi Gordon, Thanks for updating progress. Currently I'm working on FLINK-9900. I need a committer to assign the ticket to me. Tzu-Li (Gordon) Tai 于2019年7月30日 周二13:01写道: > Hi all, > > There are quite a few instabilities in our builds right now (master + > release-1.9), some of which are directed

Re: [DISCUSS] Removing the flink-mapr-fs module

2019-07-29 Thread Biao Liu
ted in Flink 1.9.0, yes. > Or we only remove it in Flink 1.10.0. > > Aljoscha > > > On 29. Jul 2019, at 11:35, Biao Liu wrote: > > > > Hi Aljoscha, > > > > Does it mean the MapRFileSystem is no longer supported since 1.9.0? > > > > On Mon

Re: [DISCUSS] Removing the flink-mapr-fs module

2019-07-29 Thread Biao Liu
Hi Aljoscha, Does it mean the MapRFileSystem is no longer supported since 1.9.0? On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi wrote: > +1 > > > On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang wrote: > > > +1 to remove it. > > > > Aljoscha Krettek 于2019年7月29日周一 下午5:01写道: > > > > > Hi, > > > > > >

Re: [DISCUSS] FLIP-27: Refactor Source Interface

2019-07-26 Thread Biao Liu
; > > > Some experiments on how to build the source reader and its library for > common threading/split patterns: > > https://github.com/StephanEwen/flink/tree/source_interface/flink-core/src/main/java/org/apache/flink/api/common/src > > > Best, > Stephan > > >

Re: [DISCUSS] FLIP-27: Refactor Source Interface

2019-07-25 Thread Biao Liu
On Thu, Mar 28, 2019 at 4:38 PM Biao Liu wrote: > Hi Steven, > Thank you for the feedback. Please take a look at the document FLIP-27 > <https://cwiki.apache.org/confluence/display/FLINK/FLIP-27%3A+Refactor+Source+Interface> > which > is updated recently. A lot of details of

Re: [DISCUSS] Allow at-most-once delivery in case of failures

2019-07-23 Thread Biao Liu
e failover > strategy. We can list these components and discuss implementation details > then. > > What do you think, Biao Liu and Zhu Zhu? > > Regards, > Xiaogang > > > Stephan Ewen 于2019年7月24日周三 上午1:31写道: > > > Hi all! > > > > This is an inter

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Biao Liu
Congrats Kurt! Well deserved! Danny Chan 于2019年7月23日周二 下午6:01写道: > Congratulations Kurt, Well deserved. > > Best, > Danny Chan > 在 2019年7月23日 +0800 PM5:24,dev@flink.apache.org,写道: > > > > Congratulations Kurt, Well deserved. >

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-22 Thread Biao Liu
Congrats Zhijiang. Well deserved! SHI Xiaogang 于2019年7月23日 周二08:35写道: > Congratulations Zhijiang! > > Regards, > Xiaogang > > Guowei Ma 于2019年7月23日周二 上午8:08写道: > > > Congratulations Zhijiang > > > > 发自我的 iPhone > > > > > 在 2019年7月23日,上午12:55,Xuefu Z 写道: > > > > > > Congratulations, Zhijiang! >

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-22 Thread Biao Liu
+1, make sense to me. Mailing list seems to be a more "community" way. Timo Walther 于2019年7月22日周一 下午4:06写道: > +1 sounds good to inform people about instabilities or other issues > > Regards, > Timo > > > Am 22.07.19 um 09:58 schrieb Haibo Sun: > > +1. Sounds good.Letting the PR creators know

Re: Request for permission as a contributor

2019-07-19 Thread Biao Liu
Hi, There is no need for contribution permission anymore, see [1]. 1. http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-JIRA-permissions-changed-Only-committers-can-assign-somebody-to-a-ticket-td30695.html 蒋正贵 于2019年7月19日周五 下午5:21写道: > HiGuys, > > I want to contribute to

Re: [DISCUSS] Drop stale class Program

2019-07-19 Thread Biao Liu
ndatory; > } > > This really helps to launch a Flink job by a frontend (if the rest services > returns back those infos). > > Best, > Flavio > > On Fri, Jul 19, 2019 at 9:57 AM Biao Liu wrote: > > > Hi Zili, > > > > Thank you for bring us this discussion

Re: [DISCUSS] Drop stale class Program

2019-07-19 Thread Biao Liu
Hi Zili, Thank you for bring us this discussion. My gut feeling is +1 for dropping it. Usually it costs some time to deprecate a public (actually it's `PublicEvolving`) API. Ideally it should be marked as `Deprecated` first. Then it might be abandoned it in some later version. I'm not sure how

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

2019-07-12 Thread Biao Liu
Congrats, Rong! Hequn Cheng 于2019年7月12日周五 下午1:09写道: > Congratulations Rong! > > Best, Hequn > > On Fri, Jul 12, 2019 at 12:19 PM Jeff Zhang wrote: > >> Congrats, Rong! >> >> >> vino yang 于2019年7月12日周五 上午10:08写道: >> >>> congratulations Rong Rong! >>> >>> Fabian Hueske 于2019年7月11日周四

[jira] [Created] (FLINK-13101) Introduce "blocking after chaining off" property of StreamGraph

2019-07-04 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13101: Summary: Introduce "blocking after chaining off" property of StreamGraph Key: FLINK-13101 URL: https://issues.apache.org/jira/browse/FLINK-13101 Proj

[jira] [Created] (FLINK-13099) Add a new type UNDEFINED of shuffle mode

2019-07-04 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13099: Summary: Add a new type UNDEFINED of shuffle mode Key: FLINK-13099 URL: https://issues.apache.org/jira/browse/FLINK-13099 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-13098) Add a new type UNDEFINED of shuffle mode

2019-07-04 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13098: Summary: Add a new type UNDEFINED of shuffle mode Key: FLINK-13098 URL: https://issues.apache.org/jira/browse/FLINK-13098 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-13042) Make slot sharing configurable on ExecutionConfig

2019-07-01 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13042: Summary: Make slot sharing configurable on ExecutionConfig Key: FLINK-13042 URL: https://issues.apache.org/jira/browse/FLINK-13042 Project: Flink Issue Type

Re: [DISCUSS] META-FLIP: Sticking (or not) to a strict FLIP voting process

2019-06-27 Thread Biao Liu
Hi community, Thanks Aljoscha for bringing us this discussion. As Aljoscha said, "lazy majority" is always the voting rule of FLIP. It seems that people just ignored or didn't realized this rule. My concern is that what we can do to make sure developers will obey the rules. I think Kurt has

[jira] [Created] (FLINK-12974) Bump checkstyle version to 8.14

2019-06-25 Thread Biao Liu (JIRA)
Biao Liu created FLINK-12974: Summary: Bump checkstyle version to 8.14 Key: FLINK-12974 URL: https://issues.apache.org/jira/browse/FLINK-12974 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Jincheng Sun is now part of the Flink PMC

2019-06-24 Thread Biao Liu
Congratulations Jincheng! qianjin Xu 于2019年6月25日周二 上午10:25写道: > Congratulations Jincheng! > > > Best > > Forward > > > > > Robert Metzger 于2019年6月24日周一 下午11:09写道: > > > Hi all, > > > > On behalf of the Flink PMC, I'm happy to announce that Jincheng Sun is > now > > part of the Apache Flink

[jira] [Created] (FLINK-12961) StreamExecutionEnvironment supports executing job with StreamGraph

2019-06-24 Thread Biao Liu (JIRA)
Biao Liu created FLINK-12961: Summary: StreamExecutionEnvironment supports executing job with StreamGraph Key: FLINK-12961 URL: https://issues.apache.org/jira/browse/FLINK-12961 Project: Flink

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-06-24 Thread Biao Liu
Hi community, I have tested two most widely used mailbox website mail.qq.com and mail.163.com(belongs to Netease). qq.mail works fine, good job @vino yang ! 163.mail almost works fine. I have received all the response mails, although the last one is marked as spam. I received the new mail of

Re: Something wrong with travis?

2019-06-18 Thread Biao Liu
It has been crashed for more than 14 hours. Hope it recovers soon. Jeff Zhang 于2019年6月18日周二 下午3:21写道: > If it is travis caching issue, we can file apache infra ticket and ask them > to clean the cache. > > > > Chesnay Schepler 于2019年6月18日周二 下午3:18写道: > > > This is (hopefully a short-lived)

[jira] [Created] (FLINK-12866) Connectors module failed on Travis checking

2019-06-16 Thread Biao Liu (JIRA)
Biao Liu created FLINK-12866: Summary: Connectors module failed on Travis checking Key: FLINK-12866 URL: https://issues.apache.org/jira/browse/FLINK-12866 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-12823) PartitionTransformation supports DataExchangeMode property

2019-06-12 Thread Biao Liu (JIRA)
Biao Liu created FLINK-12823: Summary: PartitionTransformation supports DataExchangeMode property Key: FLINK-12823 URL: https://issues.apache.org/jira/browse/FLINK-12823 Project: Flink Issue

Re: [DISCUSS] Allow at-most-once delivery in case of failures

2019-06-11 Thread Biao Liu
Hi Piotrek, I agree with you that there are strained resources of community to support such a feature. I was planing to start a similar discussion after 1.9 released. Anyway we don't have enough time to support this feature now, but I think a discussion is fine. It's very interesting of your

Re: [DISCUSS] Support Local Aggregation in Flink

2019-06-04 Thread Biao Liu
Hi Vino, +1 for this feature. It's useful for data skew. And it could also reduce shuffled datum. I have some concerns about the API part. From my side, this feature should be more like an improvement. I'm afraid the proposal is an overkill about the API part. Many other systems support

[jira] [Created] (FLINK-12686) StreamGraph Supports Blink Batch Mode

2019-05-30 Thread Biao Liu (JIRA)
Biao Liu created FLINK-12686: Summary: StreamGraph Supports Blink Batch Mode Key: FLINK-12686 URL: https://issues.apache.org/jira/browse/FLINK-12686 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Features for Apache Flink 1.9.0

2019-05-28 Thread Biao Liu
Thanks for being the release manager, Gordon & Kurt. For FLIP-27, there are still some more details need to discuss. I don't think it could catch up the release of 1.9. @Aljoscha, @Stephan, do you agree that? zhijiang 于2019年5月28日周二 下午11:28写道: > Hi Gordon, > > Thanks for the kind reminder of

[jira] [Created] (FLINK-12332) Cancel running tasks if exist before shutting down TM

2019-04-25 Thread Biao Liu (JIRA)
Biao Liu created FLINK-12332: Summary: Cancel running tasks if exist before shutting down TM Key: FLINK-12332 URL: https://issues.apache.org/jira/browse/FLINK-12332 Project: Flink Issue Type

Re: Introducing Flink's Plugin mechanism

2019-04-10 Thread Biao Liu
Hi Stefan , Thank you for bringing this discussion. As Zhijiang said, class conflict makes a lot of trouble in our production environment. I was wondering is there any design document currently? It might be helpful to understand the PR and even the whole picture as Piotr said in the future it

Re: [ANNOUNCE] Apache Flink 1.8.0 released

2019-04-10 Thread Biao Liu
Great news! Thanks Aljoscha and all the contributors. Till Rohrmann 于2019年4月10日周三 下午6:11写道: > Thanks a lot to Aljoscha for being our release manager and to the > community making this release possible! > > Cheers, > Till > > On Wed, Apr 10, 2019 at 12:09 PM Hequn Cheng wrote: > >> Thanks a lot

  1   2   >