Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations! Best, Terry Wang > 2020年1月17日 14:09，Biao Liu 写道： > > Congrats! > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Fri, 17 Jan 2020 at 13:43, Rui Li > wrote: > Congratulations Dian, well deserved! > > On Thu, Jan 16, 2020 at 5:58 PM jincheng sun

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

+1 I think that's how it should be. Timer should align with other regular state. If user wants a better performance without memory concern, memory or FS statebackend might be considered. Or maybe we could optimize the performance by introducing a specific column family for timer. It could have

Re: [DISCUSS] Make AppendingState#add refuse to add null element

@Aljoscha Krettek , got it and thanks for your clarification. Best Yun Tang 获取 Outlook for Android From: Aljoscha Krettek Sent: Thursday, January 16, 2020 8:40:57 PM To: dev@flink.apache.org Subject: Re:

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats! Thanks, Biao /'bɪ.aʊ/ On Fri, 17 Jan 2020 at 13:43, Rui Li wrote: > Congratulations Dian, well deserved! > > On Thu, Jan 16, 2020 at 5:58 PM jincheng sun > wrote: > >> Hi everyone, >> >> I'm very happy to announce that Dian accepted the offer of the Flink PMC >> to become a

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations Dian, well deserved! On Thu, Jan 16, 2020 at 5:58 PM jincheng sun wrote: > Hi everyone, > > I'm very happy to announce that Dian accepted the offer of the Flink PMC > to become a committer of the Flink project. > > Dian Fu has been contributing to Flink for many years. Dian Fu

[jira] [Created] (FLINK-15626) Remove legacy scheduler

Zhu Zhu created FLINK-15626: --- Summary: Remove legacy scheduler Key: FLINK-15626 URL: https://issues.apache.org/jira/browse/FLINK-15626 Project: Flink Issue Type: New Feature Components:

[jira] [Created] (FLINK-15625) flink sql multiple statements syntatic validation supports

jackylau created FLINK-15625: Summary: flink sql multiple statements syntatic validation supports Key: FLINK-15625 URL: https://issues.apache.org/jira/browse/FLINK-15625 Project: Flink Issue

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats! Best Yuan On Thu, Jan 16, 2020 at 5:59 PM jincheng sun wrote: > Hi everyone, > > I'm very happy to announce that Dian accepted the offer of the Flink PMC to > become a committer of the Flink project. > > Dian Fu has been contributing to Flink for many years. Dian Fu played an >

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats, Dian! Best, Paul Lam > 在 2020年1月17日，10:49，tison 写道： > > Congratulations! Dian > > Best, > tison. > > > Zhu Zhu mailto:reed...@gmail.com>> 于2020年1月17日周五 > 上午10:47写道： > Congratulations Dian. > > Thanks, > Zhu Zhu > > hailongwang <18868816...@163.com >

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations! Dian Best, tison. Zhu Zhu 于2020年1月17日周五 上午10:47写道： > Congratulations Dian. > > Thanks, > Zhu Zhu > > hailongwang <18868816...@163.com> 于2020年1月17日周五 上午10:01写道： > >> >> Congratulations Dian ! >> >> Best, >> Hailong Wang >> >> >> >> >> 在 2020-01-16 21:15:34，"Congxian Qiu" 写道：

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations Dian. Thanks, Zhu Zhu hailongwang <18868816...@163.com> 于2020年1月17日周五 上午10:01写道： > > Congratulations Dian ! > > Best, > Hailong Wang > > > > > 在 2020-01-16 21:15:34，"Congxian Qiu" 写道： > > Congratulations Dian Fu > > Best, > Congxian > > > Jark Wu 于2020年1月16日周四 下午7:44写道： > >>

Re: [DISCUSS] FLIP-72: Introduce Pulsar Connector

Hi everyone, I've updated the Catalog PR and make all settings small case. And tests are added as well. Hi Bowen, could you please take a look. https://github.com/apache/flink/pull/10455 For the sink part of the connector, I've made a separate PR https://github.com/apache/flink/pull/10875. Could

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

Hi Stephan, Thanks for starting this discussion. +1 for stores times in RocksDB by default. In the past, when Flink didn't save the times with RocksDb, I had a headache. I always adjusted parameters carefully to ensure that there was no risk of Out of Memory. Just curious, how much impact of

[jira] [Created] (FLINK-15624) Pulsar Sink

Yijie Shen created FLINK-15624: -- Summary: Pulsar Sink Key: FLINK-15624 URL: https://issues.apache.org/jira/browse/FLINK-15624 Project: Flink Issue Type: Sub-task Reporter: Yijie

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations Dian ! Best, Hailong Wang 在 2020-01-16 21:15:34，"Congxian Qiu" 写道： Congratulations Dian Fu Best, Congxian Jark Wu 于2020年1月16日周四 下午7:44写道： Congratulations Dian and welcome on board! Best, Jark On Thu, 16 Jan 2020 at 19:32, Jingsong Li wrote: >

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations! Dian Fu > 2020年1月16日 下午6:22，Shuo Cheng 写道： > > Congratulations! Dian Fu

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats! On Thu, Jan 16, 2020 at 13:45 Peter Huang wrote: > Congratulations, Dian! > > > Best Regards > Peter Huang > > On Thu, Jan 16, 2020 at 11:04 AM Yun Tang wrote: > >> Congratulations, Dian! >> >> Best >> Yun Tang >> -- >> *From:* Benchao Li >> *Sent:*

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations, Dian! Best Regards Peter Huang On Thu, Jan 16, 2020 at 11:04 AM Yun Tang wrote: > Congratulations, Dian! > > Best > Yun Tang > -- > *From:* Benchao Li > *Sent:* Thursday, January 16, 2020 22:27 > *To:* Congxian Qiu > *Cc:* dev@flink.apache.org ;

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

Hi Stephan, I am +1 for the change which stores timers in RocksDB by default. Some users hope the checkpoint could be completed as fast as possible, which also need the timer stored in RocksDB to not affect the sync part of checkpoint. Best Yun Tang From:

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations, Dian! Best Yun Tang From: Benchao Li Sent: Thursday, January 16, 2020 22:27 To: Congxian Qiu Cc: dev@flink.apache.org ; Jingsong Li ; jincheng sun ; Shuo Cheng ; Xingbo Huang ; Wei Zhong ; Hequn Cheng ; Leonard Xu ; Jeff Zhang ; user ;

[jira] [Created] (FLINK-15623) Buildling flink-python with maven profile docs-and-source fails

Gary Yao created FLINK-15623: Summary: Buildling flink-python with maven profile docs-and-source fails Key: FLINK-15623 URL: https://issues.apache.org/jira/browse/FLINK-15623 Project: Flink

[jira] [Created] (FLINK-15622) Clarify plugin mechanism in documentation

Seth Wiesman created FLINK-15622: Summary: Clarify plugin mechanism in documentation Key: FLINK-15622 URL: https://issues.apache.org/jira/browse/FLINK-15622 Project: Flink Issue Type:

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

Hi Stephan, Thanks for starting this discussion. I am +1 for this change. In general, number of timer state keys can have the same order as number of main state keys. So if RocksDB is used for main state for scalability, it makes sense to have timers there as well unless timers are used for only

[jira] [Created] (FLINK-15621) State TTL: Remove deprecated option and method to disable TTL compaction filter

Andrey Zagrebin created FLINK-15621: --- Summary: State TTL: Remove deprecated option and method to disable TTL compaction filter Key: FLINK-15621 URL: https://issues.apache.org/jira/browse/FLINK-15621

[jira] [Created] (FLINK-15620) State TTL: Remove deprecated enable default background cleanup

Andrey Zagrebin created FLINK-15620: --- Summary: State TTL: Remove deprecated enable default background cleanup Key: FLINK-15620 URL: https://issues.apache.org/jira/browse/FLINK-15620 Project: Flink

Re: [DISCUSS] Add N-Ary Stream Operator

Hi, Good question. I think not, at least not in the first version, unless someone can convince us that this is better to do immediately. Piotrek > On 14 Jan 2020, at 04:49, Yun Tang wrote: > > Hi > > I noticed that previous design doc [1] also talked about the topic of > introducing new

[DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

Hi all! I would suggest a change of the current default for timers. A bit of background: - Timers (for windows, process functions, etc.) are state that is managed and checkpointed as well. - When using the MemoryStateBackend and the FsStateBackend, timers are kept on the JVM heap, like

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations Dian. Congxian Qiu 于2020年1月16日周四 下午10:15写道： > Congratulations Dian Fu > > Best, > Congxian > > > Jark Wu 于2020年1月16日周四 下午7:44写道： > >> Congratulations Dian and welcome on board! >> >> Best, >> Jark >> >> On Thu, 16 Jan 2020 at 19:32, Jingsong Li wrote: >> >> > Congratulations

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations Dian Fu Best, Congxian Jark Wu 于2020年1月16日周四 下午7:44写道： > Congratulations Dian and welcome on board! > > Best, > Jark > > On Thu, 16 Jan 2020 at 19:32, Jingsong Li wrote: > > > Congratulations Dian Fu. Well deserved! > > > > Best, > > Jingsong Lee > > > > On Thu, Jan 16, 2020

Re: Frequently checkpoint failure, could make the flink sql state not clear?

Hi, AFAIK, whether a timer will fire is irrelevant to checkpoint success or not. Best, Congxian LakeShen 于2020年1月16日周四 下午8:53写道： > Hi community， now I am using Flink sql , and I set the retention time, As > I all know is that Flink will set the timer for per key to clear their > state, if

[jira] [Created] (FLINK-15619) GroupWindowTableAggregateITCase.testAllProcessingTimeTumblingGroupWindowOverCount failed on Azure

Congxian Qiu(klion26) created FLINK-15619: - Summary: GroupWindowTableAggregateITCase.testAllProcessingTimeTumblingGroupWindowOverCount failed on Azure Key: FLINK-15619 URL:

[jira] [Created] (FLINK-15618) Remove useless JobTimeoutException

vinoyang created FLINK-15618: Summary: Remove useless JobTimeoutException Key: FLINK-15618 URL: https://issues.apache.org/jira/browse/FLINK-15618 Project: Flink Issue Type: Wish

[jira] [Created] (FLINK-15617) Remove useless JobRetrievalException

vinoyang created FLINK-15617: Summary: Remove useless JobRetrievalException Key: FLINK-15617 URL: https://issues.apache.org/jira/browse/FLINK-15617 Project: Flink Issue Type: Wish

Frequently checkpoint failure, could make the flink sql state not clear?

Hi community， now I am using Flink sql , and I set the retention time, As I all know is that Flink will set the timer for per key to clear their state, if Flink task always checkpoint failure, are the key state cleared by timer? Thanks to your replay.

Re: [DISCUSS] Make AppendingState#add refuse to add null element

This is mostly a remnant from the previous state API, see [1] for reference. The behaviour was basically copied to the new state implementations, which was a mistake, in hindsight. Also see [2] where I added AppendingState, here I also didn't document any special null behaviour. Best,

Re: [DISCUSS] Improve TableFactory

Thanks Bowen and Timo for involving. Hi Bowen, > 1. is it better to have explicit APIs like "createBatchTableSource(...)" I think it is better to keep one method, since in [1], we have reached one in DataStream layer to maintain a single API in "env.source". I think it is good to not split batch

[jira] [Created] (FLINK-15616) Move boot error messages from python-udf-boot.log to taskmanager's log file

Hequn Cheng created FLINK-15616: --- Summary: Move boot error messages from python-udf-boot.log to taskmanager's log file Key: FLINK-15616 URL: https://issues.apache.org/jira/browse/FLINK-15616 Project:

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations Dian and welcome on board! Best, Jark On Thu, 16 Jan 2020 at 19:32, Jingsong Li wrote: > Congratulations Dian Fu. Well deserved! > > Best, > Jingsong Lee > > On Thu, Jan 16, 2020 at 6:26 PM jincheng sun > wrote: > >> Congrats Dian Fu and welcome on board! >> >> Best, >>

Re: [DISCUSS] Improve TableFactory

Hi Jingsong, I'm also +1 for adding a context in the source and sink factories. Base on the Timo's proposal, IMO, 1) table path might be useful because it is a part of DDL and users might use it as the source/sink display name in explainSource(). 2) isStreamingMode vs isBounded: however, a

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations Dian Fu. Well deserved! Best, Jingsong Lee On Thu, Jan 16, 2020 at 6:26 PM jincheng sun wrote: > Congrats Dian Fu and welcome on board! > > Best, > Jincheng > > Shuo Cheng 于2020年1月16日周四 下午6:22写道： > >> Congratulations! Dian Fu >> >> > Xingbo Wei Zhong 于2020年1月16日周四 下午6:13写道：

[jira] [Created] (FLINK-15615) Docs: wrong guarantees stated for the file sink

Roman Khachatryan created FLINK-15615: - Summary: Docs: wrong guarantees stated for the file sink Key: FLINK-15615 URL: https://issues.apache.org/jira/browse/FLINK-15615 Project: Flink

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats Dian Fu and welcome on board! Best, Jincheng Shuo Cheng 于2020年1月16日周四 下午6:22写道： > Congratulations! Dian Fu > > > Xingbo Wei Zhong 于2020年1月16日周四 下午6:13写道： jincheng sun > 于2020年1月16日周四 下午5:58写道： >

[ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations! Dian Fu > Xingbo Wei Zhong 于2020年1月16日周四 下午6:13写道： jincheng sun > 于2020年1月16日周四 下午5:58写道：

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations, Dian. Well deserved! Best, Xingbo Wei Zhong 于2020年1月16日周四 下午6:13写道： > Congrats Dian Fu! Well deserved! > > Best, > Wei > > 在 2020年1月16日，18:10，Hequn Cheng 写道： > > Congratulations, Dian. > Well deserved! > > Best, Hequn > > On Thu, Jan 16, 2020 at 6:08 PM Leonard Xu wrote: >

[jira] [Created] (FLINK-15614) Consolidate documentation on how to integrate Hadoop

Chesnay Schepler created FLINK-15614: Summary: Consolidate documentation on how to integrate Hadoop Key: FLINK-15614 URL: https://issues.apache.org/jira/browse/FLINK-15614 Project: Flink

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats Dian Fu! Well deserved! Best, Wei > 在 2020年1月16日，18:10，Hequn Cheng 写道： > > Congratulations, Dian. > Well deserved! > > Best, Hequn > > On Thu, Jan 16, 2020 at 6:08 PM Leonard Xu > wrote: > Congratulations! Dian Fu > > Best, > Leonard > >> 在

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations, Dian. Well deserved! Best, Hequn On Thu, Jan 16, 2020 at 6:08 PM Leonard Xu wrote: > Congratulations! Dian Fu > > Best, > Leonard > > 在 2020年1月16日，18:00，Jeff Zhang 写道： > > Congrats Dian Fu ！ > > jincheng sun 于2020年1月16日周四 下午5:58写道： > >> Hi everyone, >> >> I'm very happy to

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congratulations! Dian Fu Best, Leonard > 在 2020年1月16日，18:00，Jeff Zhang 写道： > > Congrats Dian Fu ！ > > jincheng sun mailto:sunjincheng...@gmail.com>> > 于2020年1月16日周四 下午5:58写道： > Hi everyone, > > I'm very happy to announce that Dian accepted the offer of the Flink PMC to > become a

Re: [DISCUSS] Improve TableFactory

Hi Jingsong, +1 for adding a context in the source and sink factories. A context class also allows for future modifications without touching the TableFactory interface again. How about: interface TableSourceFactory { interface Context { // ... } } Because I find the name

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats Dian Fu ！ jincheng sun 于2020年1月16日周四 下午5:58写道： > Hi everyone, > > I'm very happy to announce that Dian accepted the offer of the Flink PMC > to become a committer of the Flink project. > > Dian Fu has been contributing to Flink for many years. Dian Fu played an > essential role in

[ANNOUNCE] Dian Fu becomes a Flink committer

Hi everyone, I'm very happy to announce that Dian accepted the offer of the Flink PMC to become a committer of the Flink project. Dian Fu has been contributing to Flink for many years. Dian Fu played an essential role in PyFlink/CEP/SQL/Table API modules. Dian Fu has contributed several major

[jira] [Created] (FLINK-15613) execute sql appear "java.lang.IndexOutOfBoundsException"

xiaojin.wy created FLINK-15613: -- Summary: execute sql appear "java.lang.IndexOutOfBoundsException" Key: FLINK-15613 URL: https://issues.apache.org/jira/browse/FLINK-15613 Project: Flink Issue

[jira] [Created] (FLINK-15612) Implement a DataTypeLookup

Timo Walther created FLINK-15612: Summary: Implement a DataTypeLookup Key: FLINK-15612 URL: https://issues.apache.org/jira/browse/FLINK-15612 Project: Flink Issue Type: Sub-task

?????? Let Flink SQL PlannerExpressionParserImpl#FieldRefrence use Unicode as its default charset

Hi, What I am talking about is the `PlannerExpressionParserImpl`, which is written by Scala Parser tool, Every time we call StreamTableEnvironment#FromDataStream, the field String (or maybe scala.Symbol by scala Api) shall be parsed by `PlannerExpressionParserImpl` into `Expression`. As we