[jira] [Created] (FLINK-17935) Logs could not show up when deploying Flink on Yarn via "--executor"

2020-05-25 Thread Yang Wang (Jira)
Yang Wang created FLINK-17935: - Summary: Logs could not show up when deploying Flink on Yarn via "--executor" Key: FLINK-17935 URL: https://issues.apache.org/jira/browse/FLINK-17935 Project: Flink

[jira] [Created] (FLINK-17934) StreamingFileWriter should set chainingStrategy

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17934: Summary: StreamingFileWriter should set chainingStrategy Key: FLINK-17934 URL: https://issues.apache.org/jira/browse/FLINK-17934 Project: Flink Issue Type:

Re: [DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-25 Thread Stephan Ewen
Nice work, thanks for pushing this, Gordon! +1 also from my side for a quick release. I think it already warrants a release to have the 1.10.1 upgrade and the fix to not fail on savepoints that are triggered concurrently to a checkpoint. Even nicer that there are two cool new features included.

[jira] [Created] (FLINK-17933) TaskManager was terminated on Yarn - investigate

2020-05-25 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17933: - Summary: TaskManager was terminated on Yarn - investigate Key: FLINK-17933 URL: https://issues.apache.org/jira/browse/FLINK-17933 Project: Flink

[VOTE] Release flink-shaded 11.0, release candidate #1

2020-05-25 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #1 for the version 11.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

[jira] [Created] (FLINK-17932) All hbase config Options can not work in HBaseTableSource

2020-05-25 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-17932: -- Summary: All hbase config Options can not work in HBaseTableSource Key: FLINK-17932 URL: https://issues.apache.org/jira/browse/FLINK-17932 Project: Flink Issue

[jira] [Created] (FLINK-17931) Document fromValues

2020-05-25 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17931: Summary: Document fromValues Key: FLINK-17931 URL: https://issues.apache.org/jira/browse/FLINK-17931 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Robert Metzger
Hi all, thanks a lot for the feedback. The majority of responses are very positive to my proposal. I have put my proposal into our wiki: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=154995514 Regarding the comments so far: @Jark: I clarified this in the wiki. @Israel: I have

[jira] [Created] (FLINK-17928) Incorrect state size reported when using unaligned checkpoints

2020-05-25 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17928: -- Summary: Incorrect state size reported when using unaligned checkpoints Key: FLINK-17928 URL: https://issues.apache.org/jira/browse/FLINK-17928 Project: Flink

[jira] [Created] (FLINK-17929) Fix invalid liquid expressions

2020-05-25 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17929: Summary: Fix invalid liquid expressions Key: FLINK-17929 URL: https://issues.apache.org/jira/browse/FLINK-17929 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17927) Default value of "sink.partition-commit.trigger" should be "process-time"

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17927: Summary: Default value of "sink.partition-commit.trigger" should be "process-time" Key: FLINK-17927 URL: https://issues.apache.org/jira/browse/FLINK-17927 Project:

[jira] [Created] (FLINK-17926) Can't build flink-web docker image because of EOL of Ubuntu:18.10

2020-05-25 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-17926: - Summary: Can't build flink-web docker image because of EOL of Ubuntu:18.10 Key: FLINK-17926 URL: https://issues.apache.org/jira/browse/FLINK-17926

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Congxian Qiu
@ches...@apache.org Thanks for the confirmation Best, Congxian Zhu Zhu 于2020年5月25日周一 下午4:13写道: > This is very helpful! > +1 > > Thanks, > Zhu Zhu > > Yang Wang 于2020年5月25日周一 下午4:04写道: > > > +1 from this useful proposal. > > > > This makes me clearer about "Resolve" and "Close" since I used

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-05-25 Thread Yun Tang
If we still need to accept PRs for Flink-1.9/1.10, that could explain why we still need that command hint. Chesnay, thanks for your explanation. From: Chesnay Schepler Sent: Monday, May 25, 2020 18:17 To: dev@flink.apache.org ; Yun Tang Subject: Re: [DISCUSS]

[jira] [Created] (FLINK-17925) Throws unsupported exception when using metastore commit policy for filesystem table

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17925: Summary: Throws unsupported exception when using metastore commit policy for filesystem table Key: FLINK-17925 URL: https://issues.apache.org/jira/browse/FLINK-17925

[jira] [Created] (FLINK-17924) HBase connector:we can write data to HBase table, but con`t read data from HBase

2020-05-25 Thread pengnengsong (Jira)
pengnengsong created FLINK-17924: Summary: HBase connector:we can write data to HBase table, but con`t read data from HBase Key: FLINK-17924 URL: https://issues.apache.org/jira/browse/FLINK-17924

Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Hequn Cheng
+1 It would be nice to have these fixes! Best, Hequn On Mon, May 25, 2020 at 5:00 PM Zhijiang wrote: > Thanks for driving this, Chesnay! > +1 on my side. > > Best, > Zhijiang > -- > From:Till Rohrmann > Send Time:2020年5月25日(星期一)

Re: Shall we avoid binding "unsafe ports" during random port selection?

2020-05-25 Thread Ufuk Celebi
I agree with Till. I think this should be a concern of the user configuring the port range. – Ufuk On Mon, May 25, 2020 at 10:27 AM Till Rohrmann wrote: > Hi Weike, > > would it be good enough if the user did not include unsafe ranges when > specifying `rest.bind-port`? My concern with

Re: [DISCUSS] FLIP-126: Unify (and separate) Watermark Assigners

2020-05-25 Thread Aljoscha Krettek
The specifics of naming diverged a bit from the FLIP during implementation but that should be fine. What matters in the end is the intention of the FLIP and that the code that is committed in the end is good and consistent in itself. Best, Aljoscha On 24.05.20 05:12, Guanghui Zhang wrote:

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-05-25 Thread Chesnay Schepler
The travis bot commands must be retained so long as we accept PRs for 1.9/1.10 . On 25/05/2020 10:50, Yun Tang wrote: I noticed that there still existed travis related bot commands in the github PR page, and I think we should remove the command hint now.

[jira] [Created] (FLINK-17923) It will throw MemoryAllocationException if rocksdb statebackend and Python UDF are used in the same slot

2020-05-25 Thread Dian Fu (Jira)
Dian Fu created FLINK-17923: --- Summary: It will throw MemoryAllocationException if rocksdb statebackend and Python UDF are used in the same slot Key: FLINK-17923 URL: https://issues.apache.org/jira/browse/FLINK-17923

[jira] [Created] (FLINK-17922) Refactor generic and hive table rules for HiveCatalog

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17922: Summary: Refactor generic and hive table rules for HiveCatalog Key: FLINK-17922 URL: https://issues.apache.org/jira/browse/FLINK-17922 Project: Flink Issue

Re: Please update the Requirements of PyPI

2020-05-25 Thread jincheng sun
Thanks Ray and Till, Could you provide more information about the errors you encountered? Is it the same error message as reported in https://issues.apache.org/jira/browse/BEAM-8368? Best, Jincheng Till Rohrmann 于2020年5月25日周一 下午4:28写道: > Thanks for the pointer Ray. I've pulled in Jincheng

[jira] [Created] (FLINK-17921) RpcGlobalAggregateManager#updateGlobalAggregate would cause akka.timeout

2020-05-25 Thread zhangminglei (Jira)
zhangminglei created FLINK-17921: Summary: RpcGlobalAggregateManager#updateGlobalAggregate would cause akka.timeout Key: FLINK-17921 URL: https://issues.apache.org/jira/browse/FLINK-17921 Project:

Re: [ANNOUNCE] Apache Flink 1.11.0, release candidate #1

2020-05-25 Thread Yang Wang
Since the official image for 1.11 has not been release, I just want to post how to build the image with provided Flink binary. I think many users are running Flink in container environment(e.g. docker, Kubernetes, etc.) and hope this could help them with the testing. git clone

[jira] [Created] (FLINK-17920) Add the Python example of Time-windowed join in Table API doc

2020-05-25 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-17920: Summary: Add the Python example of Time-windowed join in Table API doc Key: FLINK-17920 URL: https://issues.apache.org/jira/browse/FLINK-17920 Project: Flink

Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Zhijiang
Thanks for driving this, Chesnay! +1 on my side. Best, Zhijiang -- From:Till Rohrmann Send Time:2020年5月25日(星期一) 16:28 To:dev Subject:Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0) +1 for the new flink-shaded

[jira] [Created] (FLINK-17919) KafkaConsumerThread should add ratelimiter functionality as well

2020-05-25 Thread zhangminglei (Jira)
zhangminglei created FLINK-17919: Summary: KafkaConsumerThread should add ratelimiter functionality as well Key: FLINK-17919 URL: https://issues.apache.org/jira/browse/FLINK-17919 Project: Flink

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-05-25 Thread Yun Tang
I noticed that there still existed travis related bot commands in the github PR page, and I think we should remove the command hint now. From: Robert Metzger Sent: Thursday, April 23, 2020 15:44 To: dev Subject: Re: [DISCUSS] Switch to Azure Pipelines as the

Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Till Rohrmann
+1 for the new flink-shaded release. Cheers, Till On Mon, May 25, 2020 at 9:06 AM Chesnay Schepler wrote: > Hello, > > I would like to do another flink-shaded release for 1.11.0, to include a > zookeeper 3.4 security fix and resolve a shading issue when working with > Gradle. > > >

Re: Please update the Requirements of PyPI

2020-05-25 Thread Till Rohrmann
Thanks for the pointer Ray. I've pulled in Jincheng who works on Flink's Python integration. Cheers, Till On Mon, May 25, 2020 at 8:41 AM Ray Chen wrote: > Hi PyFlink Developers, > > > I got some errors from the pyarrow depended on apache-flink v1.10.1. > > It seems updating pyarrow version

Re: Shall we avoid binding "unsafe ports" during random port selection?

2020-05-25 Thread Till Rohrmann
Hi Weike, would it be good enough if the user did not include unsafe ranges when specifying `rest.bind-port`? My concern with excluding unsafe ports is that it adds some invisible magic which can be hard to understand for the user. I think over the past couple of years it has proven that auto

Re: java.lang.NoSuchMethodError while writing to Kafka from Flink

2020-05-25 Thread Chesnay Schepler
Please double-check that your distribution and application jar were built against the same Flink version. This looks related to a binary-compatibility issues reporter in FLINK-13586 .

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Zhu Zhu
This is very helpful! +1 Thanks, Zhu Zhu Yang Wang 于2020年5月25日周一 下午4:04写道: > +1 from this useful proposal. > > This makes me clearer about "Resolve" and "Close" since I used to be > confused by this two button. > > Best, > Yang > > Jingsong Li 于2020年5月25日周一 下午3:10写道: > > > +1 for the

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Yang Wang
+1 from this useful proposal. This makes me clearer about "Resolve" and "Close" since I used to be confused by this two button. Best, Yang Jingsong Li 于2020年5月25日周一 下午3:10写道: > +1 for the proposal. > It makes me clearer. > > Best, > Jingsong Lee > > On Mon, May 25, 2020 at 2:51 PM Zhijiang

[jira] [Created] (FLINK-17918) Jobs with two input operators are loosing data in unaligned checkpoints

2020-05-25 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17918: -- Summary: Jobs with two input operators are loosing data in unaligned checkpoints Key: FLINK-17918 URL: https://issues.apache.org/jira/browse/FLINK-17918 Project:

[ANNOUNCE] Weekly Community Update 2020/21

2020-05-25 Thread Konstantin Knauf
Dear community, happy to share this week's community update! Flink Development == * [releases] Zhijiang has published a first release candidate for Apache Flink 1.11.0. This is a "preview-only" release candidate to facilitate current testing efforts. There will not be a vote on

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Jingsong Li
+1 for the proposal. It makes me clearer. Best, Jingsong Lee On Mon, May 25, 2020 at 2:51 PM Zhijiang wrote: > Thanks for launching this discussion and giving so detailed infos, > Robert! +1 on my side for the proposal. > > For "Affects Version", I previously thought it was only for the

Re: [DISCUSS] FLIP-84 Feedback Summary

2020-05-25 Thread Timo Walther
+1 Personally, I would declare it as `collect(): ClosableIterator` to avoid an additional class in the API and reuse existing Flink utils. Regards, Timo On 17.05.20 10:21, Jingsong Li wrote: +1 Best, Jingsong Lee On Sun, May 17, 2020 at 3:42 PM Kurt Young wrote: +1 from my side. Best,

[DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Chesnay Schepler
Hello, I would like to do another flink-shaded release for 1.11.0, to include a zookeeper 3.4 security fix and resolve a shading issue when working with Gradle.

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Zhijiang
Thanks for launching this discussion and giving so detailed infos, Robert! +1 on my side for the proposal. For "Affects Version", I previously thought it was only for the already released versions, so it can give a reminder that the fix should also pick into the related released branches for

Please update the Requirements of PyPI

2020-05-25 Thread Ray Chen
Hi PyFlink Developers, I got some errors from the pyarrow depended on apache-flink v1.10.1. It seems updating pyarrow version greater than 0.14 will solve the problem. The version of Flink on PyPI depends on < 0.14, so cause the error. Best, Ray Chen

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Yun Tang
Hi I like the idea to give clear description of JIRA fields in Flink community when creating tickets. After reading from Robert's explanation, I found my previous understanding differs from the field at "Affect Version/s", and is close to general understanding as JIRA official guide said[1]:

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Chesnay Schepler
flink-web is independent from any release, so there should be no affects/fix version. On 25/05/2020 07:56, Congxian Qiu wrote: Hi Currently, when I'm going to create an issue for Project-website. I'm not very sure what the "Affect Version/s" should be set. The problem is that the current

[jira] [Created] (FLINK-17917) ResourceInformationReflector#getExternalResources should ignore the external resource with a value of 0

2020-05-25 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-17917: -- Summary: ResourceInformationReflector#getExternalResources should ignore the external resource with a value of 0 Key: FLINK-17917 URL:

[jira] [Created] (FLINK-17915) TransitiveClosureITCase>JavaProgramTestBase.testJobWithObjectReuse:113 Error while calling the test program: Could not retrieve JobResult

2020-05-25 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17915: -- Summary: TransitiveClosureITCase>JavaProgramTestBase.testJobWithObjectReuse:113 Error while calling the test program: Could not retrieve JobResult Key: FLINK-17915 URL:

[jira] [Created] (FLINK-17916) Separate KafkaShuffle read/write to different environments

2020-05-25 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-17916: Summary: Separate KafkaShuffle read/write to different environments Key: FLINK-17916 URL: https://issues.apache.org/jira/browse/FLINK-17916 Project: Flink Issue

[jira] [Created] (FLINK-17914) HistoryServerTest.testCleanExpiredJob:158->runArchiveExpirationTest:214 expected:<2> but was:<0>

2020-05-25 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17914: -- Summary: HistoryServerTest.testCleanExpiredJob:158->runArchiveExpirationTest:214 expected:<2> but was:<0> Key: FLINK-17914 URL: