[jira] [Created] (FLINK-18551) Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode

Yumeng Zhang created FLINK-18551: Summary: Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode Key: FLINK-18551 URL: https://issues.apache.org/jira/browse/FLINK-18551 Projec

Flink memory consumption

Hi, I have Flink 1.7 running on our production. I can see that the Memory used by the Job Managers are pretty high. Below is a snapshot of our pods running the JM. I had to commit 3GB memory, with a memory limit of 5GB. I have one cluster per job, to make it scalable based on our traffic rate and

[jira] [Created] (FLINK-18550) use TableResult#collect to get select result for sql client

godfrey he created FLINK-18550: -- Summary: use TableResult#collect to get select result for sql client Key: FLINK-18550 URL: https://issues.apache.org/jira/browse/FLINK-18550 Project: Flink Issu

[jira] [Created] (FLINK-18549) flink 1.11 can not commit partition automatically

Jun Zhang created FLINK-18549: - Summary: flink 1.11 can not commit partition automatically Key: FLINK-18549 URL: https://issues.apache.org/jira/browse/FLINK-18549 Project: Flink Issue Type: Bug

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

+1 for a quick release to fix those blocker/critical bugs. Best, Godfrey Congxian Qiu 于2020年7月10日周五 上午10:30写道： > +1 for a quick bug fix release for 1.11 > > Best, > Congxian > > > Yu Li 于2020年7月10日周五 上午9:37写道： > > > +1, thanks Jark for bringing this up and Dian for volunteering as our > > rele

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

Thanks for kickoff the discussion Jark, and thanks for the volunteer of release manager Dian. I am +1 for the proposal of bringing Flink 1.11.1 soon since some critical bug fix accumulated. Regarding the performance issue that Thomas mentioned before, we have not any conclusions at the moment.

[jira] [Created] (FLINK-18548) Improve FlinkCalcMergeRule to merge calc nodes better

Leonard Xu created FLINK-18548: -- Summary: Improve FlinkCalcMergeRule to merge calc nodes better Key: FLINK-18548 URL: https://issues.apache.org/jira/browse/FLINK-18548 Project: Flink Issue Type:

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

+1 for a quick bug fix release for 1.11 Best, Congxian Yu Li 于2020年7月10日周五 上午9:37写道： > +1, thanks Jark for bringing this up and Dian for volunteering as our > release manager. > > Best Regards, > Yu > > > On Fri, 10 Jul 2020 at 09:29, Hequn Cheng wrote: > > > +1 for a quick bug fix release an

[jira] [Created] (FLINK-18547) the filesystem sql connector can't work well

tinny cat created FLINK-18547: - Summary: the filesystem sql connector can't work well Key: FLINK-18547 URL: https://issues.apache.org/jira/browse/FLINK-18547 Project: Flink Issue Type: Bug

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

+1, thanks Jark for bringing this up and Dian for volunteering as our release manager. Best Regards, Yu On Fri, 10 Jul 2020 at 09:29, Hequn Cheng wrote: > +1 for a quick bug fix release and Dian as the release manager. > > Best, > Hequn > > > On Thu, Jul 9, 2020 at 9:22 PM Dian Fu wrote: > >

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

+1 for a quick bug fix release and Dian as the release manager. Best, Hequn On Thu, Jul 9, 2020 at 9:22 PM Dian Fu wrote: > Hi Jark, > > Thanks for offering the help. It would definitely be helpful. > > Regards, > Dian > > > 在 2020年7月9日，下午8:54，Benchao Li 写道： > > > > +1 for a quick bug fix rel

Re: [DISCUSS] FLIP-129: Refactor Descriptor API to register connector in Table API

Hi Dawid, Thanks for the great feedback! Here are my responses: 1) computedColumn(..) vs column(..) I'm fine to use `column(..)` in both cases. 2) Expression DSL vs pure SQL string for computed columns This is a good point. Actually, I also prefer to use Expression DSL because this is more Table

[jira] [Created] (FLINK-18546) Upgrade to Kafka Schema Registry Client 5.5.0

Lucas Heimberg created FLINK-18546: -- Summary: Upgrade to Kafka Schema Registry Client 5.5.0 Key: FLINK-18546 URL: https://issues.apache.org/jira/browse/FLINK-18546 Project: Flink Issue Type:

Re: Improvement idea: Naming the maven modules.

Yes, The tree of modules (usually on the left) shows the maven modules as a tree. Yet I find that not very easy to use because of the readability of the artifact names and because this becomes very wide (i.e. takes up a lot of screen space). Having the maven modules with a name you'll get much bett

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

Hi Jark, Thanks for offering the help. It would definitely be helpful. Regards, Dian > 在 2020年7月9日，下午8:54，Benchao Li 写道： > > +1 for a quick bug fix release for 1.11 > > Aljoscha Krettek 于2020年7月9日周四 下午8:11写道： > >> +1 >> >> I'd also be in favour of releasing a 1.11.1 quickly >> >> Aljoscha

[jira] [Created] (FLINK-18545) Sql api cannot special flink job name

venn wu created FLINK-18545: --- Summary: Sql api cannot special flink job name Key: FLINK-18545 URL: https://issues.apache.org/jira/browse/FLINK-18545 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-18544) FunctionITCase.testInvalidUseOfSystemScalarFunction fails

Dawid Wysakowicz created FLINK-18544: Summary: FunctionITCase.testInvalidUseOfSystemScalarFunction fails Key: FLINK-18544 URL: https://issues.apache.org/jira/browse/FLINK-18544 Project: Flink

[jira] [Created] (FLINK-18543) FunctionITCase.testInvalidUseOfSystemScalarFunction

Dian Fu created FLINK-18543: --- Summary: FunctionITCase.testInvalidUseOfSystemScalarFunction Key: FLINK-18543 URL: https://issues.apache.org/jira/browse/FLINK-18543 Project: Flink Issue Type: Test

Re: Improvement idea: Naming the maven modules.

Couldn't you just use the tree view and get basically the same thing? On 09/07/2020 14:51, Niels Basjes wrote: Attempt 2 to get you the images. Now as attachments. Niels On Thu, Jul 9, 2020 at 2:38 PM Chesnay Schepler > wrote: The images didn't go through.

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

+1 for a quick bug fix release for 1.11 Aljoscha Krettek 于2020年7月9日周四 下午8:11写道： > +1 > > I'd also be in favour of releasing a 1.11.1 quickly > > Aljoscha > > On 09.07.20 13:57, Jark Wu wrote: > > Hi Dian, > > > > Glad to hear that you want to be the release manager of Flink 1.11.1. > > I am very

Re: Improvement idea: Naming the maven modules.

Attempt 2 to get you the images. Now as attachments. Niels On Thu, Jul 9, 2020 at 2:38 PM Chesnay Schepler wrote: > The images didn't go through. > > On 09/07/2020 14:21, Niels Basjes wrote: > > Hi, > > I have the idea that naming the modules would make life easier for the > developers. > My ma

Re: Improvement idea: Naming the maven modules.

The images didn't go through. On 09/07/2020 14:21, Niels Basjes wrote: Hi, I have the idea that naming the modules would make life easier for the developers. My main question: Do you agree? If so I'll clean up my experiment (see below) and put up a pull request. When I load the Flink code in

Improvement idea: Naming the maven modules.

Hi, I have the idea that naming the modules would make life easier for the developers. My main question: Do you agree? If so I'll clean up my experiment (see below) and put up a pull request. When I load the Flink code into IntelliJ I currently see this list of Maven modules: [image: image.png]

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

+1 I'd also be in favour of releasing a 1.11.1 quickly Aljoscha On 09.07.20 13:57, Jark Wu wrote: Hi Dian, Glad to hear that you want to be the release manager of Flink 1.11.1. I am very willing to help you with the final steps of the release process. Best, Jark On Thu, 9 Jul 2020 at 17:57,

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

Hi Dian, Glad to hear that you want to be the release manager of Flink 1.11.1. I am very willing to help you with the final steps of the release process. Best, Jark On Thu, 9 Jul 2020 at 17:57, Jingsong Li wrote: > FLINK-18461 is really a blocker for the CDC feature. > > So +1 for releasing Fl

[jira] [Created] (FLINK-18542) GPUDiscoveryScriptTest fails for permission denied

Paul Lin created FLINK-18542: Summary: GPUDiscoveryScriptTest fails for permission denied Key: FLINK-18542 URL: https://issues.apache.org/jira/browse/FLINK-18542 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-18541) Verify the Elasticsearch authentication option in end to end test

Jark Wu created FLINK-18541: --- Summary: Verify the Elasticsearch authentication option in end to end test Key: FLINK-18541 URL: https://issues.apache.org/jira/browse/FLINK-18541 Project: Flink Issu

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

FLINK-18461 is really a blocker for the CDC feature. So +1 for releasing Flink 1.11.1 soon. Best, Jingsong On Thu, Jul 9, 2020 at 5:34 PM jincheng sun wrote: > Thanks for bring up this discussion Jark. > +1, looking forward the first bugfix version of Flink 1.11. > > Best, > Jincheng > > Dian

[jira] [Created] (FLINK-18540) Unnecessary retract messages when setIdleStateRetentionTime before converting dynamic table to retract stream

WeiqiangSun created FLINK-18540: --- Summary: Unnecessary retract messages when setIdleStateRetentionTime before converting dynamic table to retract stream Key: FLINK-18540 URL: https://issues.apache.org/jira/browse/FL

Re: Check pointing for simple pipeline

Hi Prasanna, I'd like to add my two cents here. I would not say using the incremental checkpoint is always the best choice. It might have its downsides when restoring from the checkpoint as it will have to apply all the deltas. Therefore restoring from a non-incremental checkpoint might be faster.

[jira] [Created] (FLINK-18539) StreamExecutionEnvironment#addSource(SourceFunction, TypeInformation) doesn't use the user defined type information

Jark Wu created FLINK-18539: --- Summary: StreamExecutionEnvironment#addSource(SourceFunction, TypeInformation) doesn't use the user defined type information Key: FLINK-18539 URL: https://issues.apache.org/jira/browse/FLIN

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

Thanks for bring up this discussion Jark. +1, looking forward the first bugfix version of Flink 1.11. Best, Jincheng Dian Fu 于2020年7月9日周四 下午5:28写道： > Thanks Jark for bringing up this discussion. I also noticed that there are > already users trying out the CDC feature and so it makes sense to ha

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

Thanks Jark for bringing up this discussion. I also noticed that there are already users trying out the CDC feature and so it makes sense to have a quick 1.11.1 release. I would volunteer as the release manager of 1.11.1 if we finally decide to have a quick release. Also +1 to create the first

[jira] [Created] (FLINK-18538) SqlClientException

neo created FLINK-18538: --- Summary: SqlClientException Key: FLINK-18538 URL: https://issues.apache.org/jira/browse/FLINK-18538 Project: Flink Issue Type: Bug Components: Table SQL / Client

[jira] [Created] (FLINK-18537) Remove RowDataTypeInfo

Timo Walther created FLINK-18537: Summary: Remove RowDataTypeInfo Key: FLINK-18537 URL: https://issues.apache.org/jira/browse/FLINK-18537 Project: Flink Issue Type: Sub-task Compone

来自靳亚洽的邮件

[jira] [Created] (FLINK-18536) [Kinesis][EFO] Configuration deserialisation and validation

Danny Cranmer created FLINK-18536: - Summary: [Kinesis][EFO] Configuration deserialisation and validation Key: FLINK-18536 URL: https://issues.apache.org/jira/browse/FLINK-18536 Project: Flink

Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

Hi folks, I'd like to revive the discussion about FLIP-36 Support Interactive Programming in Flink Table API https://cwiki.apache.org/confluence/display/FLINK/FLIP-36%3A+Support+Interactive+Programming+in+Flink The FLIP proposes to add support for interactive programming in Flink Table API. Spe

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

I do agree it would be beneficial to have the 1.11.1 rather soon. Personally additionally to Jark's list I'd like to see: FLINK-18419  Can not create a catalog from user jar (https://issues.apache.org/jira/browse/FLINK-18419) incluedd. It has a PR already. Best, Dawid On 09/07/2020 09:51, Leo

Re: [DISCUSS] Releasing Flink 1.11.1 soon?

Hi, Jark Thanks fro bringing this discussion. We canceled the blocker priority of FLINK-18461 when release Flink 1.11.0 from time consideration, IIRC, the majority of us agreed to have a timely 1.11.1 in the vote mail of Flink 1.11.0. And I have noticed some user voice[1][2] that they’re using

Re: [DISCUSS] FLIP-129: Refactor Descriptor API to register connector in Table API

Correction to my point 4. The example is correct. I did not read it carefully enough. Sorry for the confusion. Nevertheless I'd still like to see a bit more explanation on the LikeOptions. On 07/07/2020 04:32, Jark Wu wrote: > Hi everyone, > > Leonard and I prepared a FLIP about refactoring curren

Re: [DISCUSS] FLIP-129: Refactor Descriptor API to register connector in Table API

Hi Jark, Thanks for starting the discussion. I think this is an important effort. I really like the general concept, but I have a few comments to the details of the FLIP. 1) I don't see any benefit in differentiating the computedColumn vs column in the method name. It does add cognitive burden. C