[jira] [Created] (FLINK-14715) HiveModuleTest fails with Hive-3.1.1

2019-11-11 Thread Rui Li (Jira)
Rui Li created FLINK-14715: -- Summary: HiveModuleTest fails with Hive-3.1.1 Key: FLINK-14715 URL: https://issues.apache.org/jira/browse/FLINK-14715 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-14714) BytesHashMap should not warn invoking stack when it want to spill

2019-11-11 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14714: Summary: BytesHashMap should not warn invoking stack when it want to spill Key: FLINK-14714 URL: https://issues.apache.org/jira/browse/FLINK-14714 Project: Flink

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread Yu Li
Thanks Bowen and Peter! Great to know. Best Regards, Yu On Tue, 12 Nov 2019 at 13:38, Peter Huang wrote: > Thank you in advance. Once the PR is done from my side, I will @ you and > yu for review. > > On Mon, Nov 11, 2019 at 9:15 PM Bowen Li wrote: > >> Thanks Peter! I assigned the ticket to

[jira] [Created] (FLINK-14713) Show Attempt History in Vertex SubTask

2019-11-11 Thread lining (Jira)
lining created FLINK-14713: -- Summary: Show Attempt History in Vertex SubTask Key: FLINK-14713 URL: https://issues.apache.org/jira/browse/FLINK-14713 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14712) Add NetWork metric for IOMetricsInfo

2019-11-11 Thread lining (Jira)
lining created FLINK-14712: -- Summary: Add NetWork metric for IOMetricsInfo Key: FLINK-14712 URL: https://issues.apache.org/jira/browse/FLINK-14712 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread Peter Huang
Thank you in advance. Once the PR is done from my side, I will @ you and yu for review. On Mon, Nov 11, 2019 at 9:15 PM Bowen Li wrote: > Thanks Peter! I assigned the ticket to you, and I can help with reviewing > and merging PRs of this FLIP. > > Ccing 1.10 release manager Yu that we are on

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread Bowen Li
Thanks Peter! I assigned the ticket to you, and I can help with reviewing and merging PRs of this FLIP. Ccing 1.10 release manager Yu that we are on track of FLIP-79. Cheers, Bowen On Mon, Nov 11, 2019 at 9:03 PM Peter Huang wrote: > Thanks, everyone for joining the discussion and giving

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread Peter Huang
Thanks, everyone for joining the discussion and giving feedback!. The voting time for FLIP-79 has passed. I'm closing the vote now. There were seven +1 votes, 3 of which are binding: - Bowen Li (binding) - Kurt Yong (binding) - Shuyi Chen (binding) - Terry Wang (non-binding) - Xuefu Zhang

[jira] [Created] (FLINK-14711) Create Alter Function and Show Functions DDL

2019-11-11 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14711: - Summary: Create Alter Function and Show Functions DDL Key: FLINK-14711 URL: https://issues.apache.org/jira/browse/FLINK-14711 Project: Flink Issue Type:

Re: [DISCUSS] Releasing Flink 1.8.3

2019-11-11 Thread Hequn Cheng
Hi all, Thanks a lot for your kindly reply and feedbacks. @Jincheng Thank you very much for providing the release help. @Yang Wang Thanks a lot for your PR. I think it is an important fix! I left some comments in FLINK-13184 and we can discuss whether this is a blocker there. I have gone over

[jira] [Created] (FLINK-14710) Decide column nullability according to Hive constraints

2019-11-11 Thread Rui Li (Jira)
Rui Li created FLINK-14710: -- Summary: Decide column nullability according to Hive constraints Key: FLINK-14710 URL: https://issues.apache.org/jira/browse/FLINK-14710 Project: Flink Issue Type:

Re: [DISCUSS] PyFlink User-Defined Function Resource Management

2019-11-11 Thread Dian Fu
Hi Jincheng, Thanks for the reply and also looking forward to the feedback from the community. Thanks, Dian > 在 2019年11月11日,下午2:34,jincheng sun 写道: > > Hi all, > > +1, Thanks for bring up this discussion Dian! > > The Resource Management is very important for PyFlink UDF. So, It's great >

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread Jingsong Li
+1 (non-binding) Best, Jingsong Lee On Tue, Nov 12, 2019 at 9:49 AM vino yang wrote: > +1 (non-binding) > > Best, > Vino > > Xuefu Z 于2019年11月12日周二 上午3:27写道: > > > +1 (non-binding) > > > > On Mon, Nov 11, 2019 at 9:54 AM Shuyi Chen wrote: > > > > > +1 (binding) > > > > > > On Sat, Nov 9,

Re: Flink Read thousands of files with batch

2019-11-11 Thread tison
I suspect you suffer from Client submission failure which also throws AskTimeoutException. The related configure option are `akka.client.timeout` which you can increase. However, there was some cases you can resolve the problem by upgrading Java to latest minimum version 8u212 Best, tison. Zhu

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread vino yang
+1 (non-binding) Best, Vino Xuefu Z 于2019年11月12日周二 上午3:27写道: > +1 (non-binding) > > On Mon, Nov 11, 2019 at 9:54 AM Shuyi Chen wrote: > > > +1 (binding) > > > > On Sat, Nov 9, 2019 at 11:17 PM Kurt Young wrote: > > > > > +1 (binding) > > > > > > Best, > > > Kurt > > > > > > > > > On Sun, Nov

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread Xuefu Z
+1 (non-binding) On Mon, Nov 11, 2019 at 9:54 AM Shuyi Chen wrote: > +1 (binding) > > On Sat, Nov 9, 2019 at 11:17 PM Kurt Young wrote: > > > +1 (binding) > > > > Best, > > Kurt > > > > > > On Sun, Nov 10, 2019 at 12:25 PM Peter Huang > > > wrote: > > > > > Hi Yu, > > > > > > Thanks for your

Re: [VOTE] FLIP-79: Flink Function DDL Support (1.10 Release Feature Only)

2019-11-11 Thread Shuyi Chen
+1 (binding) On Sat, Nov 9, 2019 at 11:17 PM Kurt Young wrote: > +1 (binding) > > Best, > Kurt > > > On Sun, Nov 10, 2019 at 12:25 PM Peter Huang > wrote: > > > Hi Yu, > > > > Thanks for your reminder about the timeline of delivering the basic > > function DDL in release 1.10. > > As I replied

[jira] [Created] (FLINK-14709) Allow outputting elements in close method of chained drivers.

2019-11-11 Thread David Moravek (Jira)
David Moravek created FLINK-14709: - Summary: Allow outputting elements in close method of chained drivers. Key: FLINK-14709 URL: https://issues.apache.org/jira/browse/FLINK-14709 Project: Flink

[jira] [Created] (FLINK-14708) Introduce full restarts failover strategy for NG scheduler

2019-11-11 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14708: --- Summary: Introduce full restarts failover strategy for NG scheduler Key: FLINK-14708 URL: https://issues.apache.org/jira/browse/FLINK-14708 Project: Flink Issue Type:

Re: [DISCUSS] Stateful Functions - Contribution Details

2019-11-11 Thread Stephan Ewen
Thanks, all for the discussion! About the name: - Like Igal mentioned, the name "Stateful Functions" and the abbreviation "statefun" underwent some iterations and testing with a small sample of developers from a few companies. If anyone has an amazing suggestion for another name, please

[jira] [Created] (FLINK-14707) Refactor checkpoint related methods within Environment

2019-11-11 Thread Yun Tang (Jira)
Yun Tang created FLINK-14707: Summary: Refactor checkpoint related methods within Environment Key: FLINK-14707 URL: https://issues.apache.org/jira/browse/FLINK-14707 Project: Flink Issue Type:

[jira] [Created] (FLINK-14706) Remove legacy KvStateMessage

2019-11-11 Thread Yun Tang (Jira)
Yun Tang created FLINK-14706: Summary: Remove legacy KvStateMessage Key: FLINK-14706 URL: https://issues.apache.org/jira/browse/FLINK-14706 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14705) Remove nullables argument of BatchTestBase.registerCollection in blink planner

2019-11-11 Thread Danny Chen (Jira)
Danny Chen created FLINK-14705: -- Summary: Remove nullables argument of BatchTestBase.registerCollection in blink planner Key: FLINK-14705 URL: https://issues.apache.org/jira/browse/FLINK-14705 Project:

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-11 Thread Rui Li
Congrats Jark! On Mon, Nov 11, 2019 at 2:49 PM Yadong Xie wrote: > Congratulations Jark! > > Danny Chan 于2019年11月11日周一 上午10:41写道: > > > Congrats Jark! Well deserved ! > > > > Best, > > Danny Chan > > 在 2019年11月11日 +0800 AM9:59,dev@flink.apache.org,写道: > > > > > > Congrats Jark! > > > --

Re: Flink Read thousands of files with batch

2019-11-11 Thread Zhu Zhu
Hi Dominik, Would you check whether the JM GC status? One possible cause is that the large number of file metas inHadoopInputFormat is burdening the JM memory. `akka.ask.timeout` is the default RPC timeout, while some RPCs may override this timeout for their own purpose. e.g. the RPCs from web

[jira] [Created] (FLINK-14704) Remove uesless SynchronousSavepointLatch

2019-11-11 Thread Yun Tang (Jira)
Yun Tang created FLINK-14704: Summary: Remove uesless SynchronousSavepointLatch Key: FLINK-14704 URL: https://issues.apache.org/jira/browse/FLINK-14704 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14703) Port the Kafka SQL related tests.

2019-11-11 Thread Zheng Hu (Jira)
Zheng Hu created FLINK-14703: Summary: Port the Kafka SQL related tests. Key: FLINK-14703 URL: https://issues.apache.org/jira/browse/FLINK-14703 Project: Flink Issue Type: Sub-task