Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-29 Thread Leonard Xu
Hi, Timo > I do think that this topic must be part of the FLIP as well. Esp. if the FLIP > has the title "time function behavior" and this is clearly a behavioral > aspect. We are performing a heavy refactoring of the SQL query semantics in > Flink here which will affect a lot of users. We

[jira] [Created] (FLINK-21212) Can no longer cast INT to DATE

2021-01-29 Thread Rex Remind (Jira)
Rex Remind created FLINK-21212: -- Summary: Can no longer cast INT to DATE Key: FLINK-21212 URL: https://issues.apache.org/jira/browse/FLINK-21212 Project: Flink Issue Type: Improvement

Re: [VOTE] FLIP-160: Declarative scheduler

2021-01-29 Thread Xintong Song
+1 (binding) Thank you~ Xintong Song On Fri, Jan 29, 2021 at 10:41 PM Robert Metzger wrote: > ... and thanks a lot for your work :) I'm really excited about finally > adding this feature to Flink! > > > On Fri, Jan 29, 2021 at 3:40 PM Robert Metzger > wrote: > > > +1 (binding) > > > > On

[jira] [Created] (FLINK-21211) Looking for reviews on a framework based on flink-statefun

2021-01-29 Thread Zixuan Rao (Jira)
Zixuan Rao created FLINK-21211: -- Summary: Looking for reviews on a framework based on flink-statefun Key: FLINK-21211 URL: https://issues.apache.org/jira/browse/FLINK-21211 Project: Flink

[DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-01-29 Thread Jane Chan
Hi everyone, I would like to start a discussion on FLINK-21045 [1] about supporting `LOAD MODULE` and `UNLOAD MODULE` SQL syntax. It's first proposed by FLIP-68 [2] as following. -- load a module with the given name and append it to the end of the module list LOAD MODULE 'name' [WITH

[jira] [Created] (FLINK-21210) ApplicationClusterEntryPoints should explicitly close PackagedProgram

2021-01-29 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21210: Summary: ApplicationClusterEntryPoints should explicitly close PackagedProgram Key: FLINK-21210 URL: https://issues.apache.org/jira/browse/FLINK-21210

[jira] [Created] (FLINK-21209) Update stackbrew maintainer field

2021-01-29 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21209: Summary: Update stackbrew maintainer field Key: FLINK-21209 URL: https://issues.apache.org/jira/browse/FLINK-21209 Project: Flink Issue Type:

[jira] [Created] (FLINK-21208) pyarrow exception when using window with pandas udaf

2021-01-29 Thread YufeiLiu (Jira)
YufeiLiu created FLINK-21208: Summary: pyarrow exception when using window with pandas udaf Key: FLINK-21208 URL: https://issues.apache.org/jira/browse/FLINK-21208 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-29 Thread Timo Walther
Hi Leonard, I do think that this topic must be part of the FLIP as well. Esp. if the FLIP has the title "time function behavior" and this is clearly a behavioral aspect. We are performing a heavy refactoring of the SQL query semantics in Flink here which will affect a lot of users. We cannot

[jira] [Created] (FLINK-21207) 'csv.disable-quote-character' can not take effect during deserialization

2021-01-29 Thread sharkd tu (Jira)
sharkd tu created FLINK-21207: - Summary: 'csv.disable-quote-character' can not take effect during deserialization Key: FLINK-21207 URL: https://issues.apache.org/jira/browse/FLINK-21207 Project: Flink

Re: [VOTE] FLIP-160: Declarative scheduler

2021-01-29 Thread Robert Metzger
... and thanks a lot for your work :) I'm really excited about finally adding this feature to Flink! On Fri, Jan 29, 2021 at 3:40 PM Robert Metzger wrote: > +1 (binding) > > On Fri, Jan 29, 2021 at 3:23 PM Till Rohrmann > wrote: > >> Hi all, >> >> since the discussion [1] about FLIP-160 [2]

Re: [VOTE] FLIP-160: Declarative scheduler

2021-01-29 Thread Robert Metzger
+1 (binding) On Fri, Jan 29, 2021 at 3:23 PM Till Rohrmann wrote: > Hi all, > > since the discussion [1] about FLIP-160 [2] seems to have reached a > consensus, I'd like to start a formal vote for the FLIP. > > Please vote +1 to approve the FLIP, or -1 with a comment. The vote will be > open at

Re: [VOTE] FLIP-159: Reactive Mode

2021-01-29 Thread Till Rohrmann
LGTM. Thanks for the work Robert! +1 (binding) Cheers, Till On Thu, Jan 28, 2021 at 11:27 AM Yang Wang wrote: > Thanks Robert for your great work on this FLIP. This is really a big step > to make Flink auto scalable. > > +1 (non-binding) > > > Best, > Yang > > Robert Metzger 于2021年1月28日周四

[VOTE] FLIP-160: Declarative scheduler

2021-01-29 Thread Till Rohrmann
Hi all, since the discussion [1] about FLIP-160 [2] seems to have reached a consensus, I'd like to start a formal vote for the FLIP. Please vote +1 to approve the FLIP, or -1 with a comment. The vote will be open at least until Wednesday, Feb 3rd. Cheers, Till [1]

Re: [DISCUSS] FLIP-160: Declarative scheduler

2021-01-29 Thread Till Rohrmann
Thanks a lot for all your input. I have update the FLIP-160 with your suggestions: 1) Add job configuration as a follow up 2) Pull out IO operations out of the ExecutionGraph if the failover becomes too slow 3) Introduce a configuration parameter for the timeout in the "Waiting for resources"

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-01-29 Thread Till Rohrmann
Thanks for summarizing the discussion, Yangze. I agree that setting resource requirements per operator is not very user friendly. Moreover, I couldn't come up with a different proposal which would be as easy to use and wouldn't expose internal scheduling details. In fact, following this argument

[jira] [Created] (FLINK-21206) Implement HeapKeyValueStateIterator

2021-01-29 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-21206: Summary: Implement HeapKeyValueStateIterator Key: FLINK-21206 URL: https://issues.apache.org/jira/browse/FLINK-21206 Project: Flink Issue Type:

[jira] [Created] (FLINK-21205) Maybe remove Locality enum

2021-01-29 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21205: Summary: Maybe remove Locality enum Key: FLINK-21205 URL: https://issues.apache.org/jira/browse/FLINK-21205 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-21204) Remove LogicalSlot#getSlotSharingGroupId

2021-01-29 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21204: Summary: Remove LogicalSlot#getSlotSharingGroupId Key: FLINK-21204 URL: https://issues.apache.org/jira/browse/FLINK-21204 Project: Flink Issue Type:

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-01-29 Thread Shengkai Fang
Hi, Rui. You are right. I have already modified the FLIP. The main changes: # -f parameter has no restriction about the statement type. Sometimes, users use the pipe to redirect the result of queries to debug when submitting job by -f parameter. It's much convenient comparing to writing INSERT

[jira] [Created] (FLINK-21203) Don’t collect -U&+U Row When they are equals In the LastRowFunction

2021-01-29 Thread wangpeibin (Jira)
wangpeibin created FLINK-21203: -- Summary: Don’t collect -U&+U Row When they are equals In the LastRowFunction Key: FLINK-21203 URL: https://issues.apache.org/jira/browse/FLINK-21203 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.10.3 released

2021-01-29 Thread Dian Fu
Thanks Xintong for driving this release! Regards, Dian > 在 2021年1月29日,下午5:24,Till Rohrmann 写道: > > Thanks Xintong for being our release manager. Well done! > > Cheers, > Till > > On Fri, Jan 29, 2021 at 9:50 AM Yang Wang > wrote: > Thanks Xintong for driving

Re: [ANNOUNCE] Apache Flink 1.10.3 released

2021-01-29 Thread Till Rohrmann
Thanks Xintong for being our release manager. Well done! Cheers, Till On Fri, Jan 29, 2021 at 9:50 AM Yang Wang wrote: > Thanks Xintong for driving this release. > > Best, > Yang > > Yu Li 于2021年1月29日周五 下午3:52写道: > >> Thanks Xintong for being our release manager and everyone else who made >>

Re: [DISCUSS] FLIP-160: Declarative scheduler

2021-01-29 Thread Chesnay Schepler
Yes, since we're only operating within the scheduler, which exists separately for each job, we don't have to worry about collisions with other jobs. On 1/27/2021 11:08 AM, Yangze Guo wrote: Thanks for preparing the FLIP and driving the discussion, Till. All of my questions have already been

[jira] [Created] (FLINK-21202) Introduce TimeWindow and CountWindow in PyFlink

2021-01-29 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-21202: Summary: Introduce TimeWindow and CountWindow in PyFlink Key: FLINK-21202 URL: https://issues.apache.org/jira/browse/FLINK-21202 Project: Flink Issue Type:

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-01-29 Thread Rui Li
Hi Shengkai, Regarding #2, maybe the -f options in flink and hive have different implications, and we should clarify the behavior. For example, if the client just submits the job and exits, what happens if the file contains two INSERT statements? I don't think we should treat them as a statement

Re: [ANNOUNCE] Apache Flink 1.10.3 released

2021-01-29 Thread Yang Wang
Thanks Xintong for driving this release. Best, Yang Yu Li 于2021年1月29日周五 下午3:52写道: > Thanks Xintong for being our release manager and everyone else who made > the release possible! > > Best Regards, > Yu > > > On Fri, 29 Jan 2021 at 15:05, Xintong Song wrote: > >> The Apache Flink community is

[jira] [Created] (FLINK-21201) Creating BoundedBlockingSubpartition blocks TaskManager’s main thread

2021-01-29 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-21201: Summary: Creating BoundedBlockingSubpartition blocks TaskManager’s main thread Key: FLINK-21201 URL: https://issues.apache.org/jira/browse/FLINK-21201 Project: Flink

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-01-29 Thread Shengkai Fang
Hi Rui, Thanks for your feedback. I agree with your suggestions. For the suggestion 1: Yes. we are plan to strengthen the set command. In the implementation, it will just put the key-value into the `Configuration`, which will be used to generate the table config. If hive supports to read the

[jira] [Created] (FLINK-21200) User defined functions refuse to accept multi-set arguments without type hints

2021-01-29 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-21200: --- Summary: User defined functions refuse to accept multi-set arguments without type hints Key: FLINK-21200 URL: https://issues.apache.org/jira/browse/FLINK-21200