Re: [VOTE] FLIP-179: Expose Standardized Operator Metrics

2021-07-30 Thread Steven Wu
+1 (non-binding) On Fri, Jul 30, 2021 at 3:55 AM Arvid Heise wrote: > Dear devs, > > I'd like to open a vote on FLIP-179: Expose Standardized Operator Metrics > [1] which was discussed in this thread [2]. > The vote will be open for at least 72 hours unless there is an objection > or not enough

[jira] [Created] (FLINK-23568) Plaintext Java Keystore Password Risks in the flink-conf.yaml File

2021-07-30 Thread Hui Wang (Jira)
Hui Wang created FLINK-23568: Summary: Plaintext Java Keystore Password Risks in the flink-conf.yaml File Key: FLINK-23568 URL: https://issues.apache.org/jira/browse/FLINK-23568 Project: Flink

[jira] [Created] (FLINK-23567) Hive 1.1.0 failed to write using flink sql 1.3.1 because the JSON class was not found

2021-07-30 Thread wuyang (Jira)
wuyang created FLINK-23567: -- Summary: Hive 1.1.0 failed to write using flink sql 1.3.1 because the JSON class was not found Key: FLINK-23567 URL: https://issues.apache.org/jira/browse/FLINK-23567 Project:

Re: [VOTE] Release 1.12.5, release candidate #3

2021-07-30 Thread godfrey he
+1 (non-binding) - Checked checksums and signatures: OK - Built from source: OK - Checked the flink-web PR - find one typo about flink version - Submit some jobs from sql-client to local cluster, checked the web-ui, cp, sp, log, etc: OK Best, Godfrey Robert Metzger 于2021年7月30日周五 下午4:33写道:

Re: [VOTE] Release 1.13.2, release candidate #3

2021-07-30 Thread godfrey he
+1 (non-binding) - Checked checksums and signatures: OK - Built from source: OK - Checked the flink-web PR - find one typo about the number of the fixes and improvements - Submit some jobs from sql-client to local cluster, checked the web-ui, cp, sp, log, etc: OK Best, Godfrey Xingbo Huang

[jira] [Created] (FLINK-23566) Mysql 8.0 Public Key Retrieval is not allowed

2021-07-30 Thread MING (Jira)
MING created FLINK-23566: Summary: Mysql 8.0 Public Key Retrieval is not allowed Key: FLINK-23566 URL: https://issues.apache.org/jira/browse/FLINK-23566 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-23565) Window TVF Supports session window in runtime

2021-07-30 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-23565: -- Summary: Window TVF Supports session window in runtime Key: FLINK-23565 URL: https://issues.apache.org/jira/browse/FLINK-23565 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-180: Adjust StreamStatus and Idleness definition

2021-07-30 Thread Arvid Heise
Hi Martijn, 1. Good question. The watermarks and statuses of the splits are first aggregated before emitted through the reader. The watermark strategy of the user is actually applied on all SourceOutputs (=splits). Since one split is active and one is idle, the watermark of the reader will not

Re: [DISCUSS] FLIP-177: Extend Sink API

2021-07-30 Thread Hausmann, Steffen
Hey Guowei, there is one additional aspect I want to highlight that is relevant for the types of destinations we had in mind when designing the AsyncSink. I'll again use Kinesis as an example, but the same argument applies to other destinations. We are using the PutRecords API to persist up to

Re: [DISCUSS] FLIP-177: Extend Sink API

2021-07-30 Thread Arvid Heise
Hi Guowei, hi all, The main drawback of the AsyncIO approach is the decreased flexibility. In particular, as you mentioned for the advanced backpressure use cases, you would need to chain several AsyncIOs: >>>But whether a sink is overloaded not only depends on the queue size. It > also depends

[VOTE] FLIP-177: Extend Sink API

2021-07-30 Thread Arvid Heise
Hi all, I'd like to start a vote on FLIP-177: Extend Sink API [1] which provides small extensions to the Sink API introduced through FLIP-143. The vote will be open for at least 72 hours unless there is an objection or not enough votes. Note that the FLIP was larger initially and I cut down all

[jira] [Created] (FLINK-23564) Make taskmanager.out and taskmanager.err rollable

2021-07-30 Thread zlzhang0122 (Jira)
zlzhang0122 created FLINK-23564: --- Summary: Make taskmanager.out and taskmanager.err rollable Key: FLINK-23564 URL: https://issues.apache.org/jira/browse/FLINK-23564 Project: Flink Issue Type:

[jira] [Created] (FLINK-23563) Sometimes ‘Stop’ cannot stop the job

2021-07-30 Thread Han Yin (Jira)
Han Yin created FLINK-23563: --- Summary: Sometimes ‘Stop’ cannot stop the job Key: FLINK-23563 URL: https://issues.apache.org/jira/browse/FLINK-23563 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-23562) Update CI docker image to latest java version (1.8.0_292)

2021-07-30 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23562: -- Summary: Update CI docker image to latest java version (1.8.0_292) Key: FLINK-23562 URL: https://issues.apache.org/jira/browse/FLINK-23562 Project: Flink

[jira] [Created] (FLINK-23561) Detail the container completed message

2021-07-30 Thread zlzhang0122 (Jira)
zlzhang0122 created FLINK-23561: --- Summary: Detail the container completed message Key: FLINK-23561 URL: https://issues.apache.org/jira/browse/FLINK-23561 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-179: Expose Standardized Operator Metrics

2021-07-30 Thread Arvid Heise
Hi everyone, I started the voting thread [1]. Please cast your vote there or ask additional questions here. Best, Arvid [1] https://lists.apache.org/thread.html/r70d321b6aa62ab4e31c8b73552b2de7846c4d31ed6f08d6541a9b36e%40%3Cdev.flink.apache.org%3E On Fri, Jul 30, 2021 at 10:46 AM Becket Qin

[VOTE] FLIP-179: Expose Standardized Operator Metrics

2021-07-30 Thread Arvid Heise
Dear devs, I'd like to open a vote on FLIP-179: Expose Standardized Operator Metrics [1] which was discussed in this thread [2]. The vote will be open for at least 72 hours unless there is an objection or not enough votes. The proposal excludes the implementation for the currentFetchEventTimeLag

Re: [DISCUSS] FLIP-180: Adjust StreamStatus and Idleness definition

2021-07-30 Thread Martijn Visser
Hi all, I have a couple of questions after studying the FLIP and the docs: 1. What happens when one of the readers has two splits assigned and one of the splits actually receives data? 2. If I understand it correctly the Kinesis Source uses dynamic shard discovery by default (so in case of

[jira] [Created] (FLINK-23560) Performance regression on 29.07.2021

2021-07-30 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-23560: -- Summary: Performance regression on 29.07.2021 Key: FLINK-23560 URL: https://issues.apache.org/jira/browse/FLINK-23560 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-179: Expose Standardized Operator Metrics

2021-07-30 Thread Becket Qin
Hi Arvid, I think it is OK to leave eventTimeFetchLag out of the scope of this FLIP given that it may involve additional API changes. 5. RecordMetadata is currently not simplifying any code. By the current > design RecordMetadata is a read-only data structure that is constant for > all records

[jira] [Created] (FLINK-23559) Enable periodic materialisation in tests

2021-07-30 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-23559: -- Summary: Enable periodic materialisation in tests Key: FLINK-23559 URL: https://issues.apache.org/jira/browse/FLINK-23559 Project: Flink Issue Type:

Re: [VOTE] Release 1.12.5, release candidate #3

2021-07-30 Thread Robert Metzger
Thanks a lot for providing the new staging repository. I dropped the 1440 and 1441 staging repositories, to avoid that other RC reviewers accidentally look into it, or that we accidentally release it. +1 (binding) Checks: - I didn't find any additional issues in the release announcement - the

[jira] [Created] (FLINK-23558) E2e tests fail because of quiesced system timers service

2021-07-30 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-23558: Summary: E2e tests fail because of quiesced system timers service Key: FLINK-23558 URL: https://issues.apache.org/jira/browse/FLINK-23558 Project: Flink

[jira] [Created] (FLINK-23557) 'Resuming Externalized Checkpoint (hashmap, sync, no parallelism change) end-to-end test' fails on Azure

2021-07-30 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-23557: Summary: 'Resuming Externalized Checkpoint (hashmap, sync, no parallelism change) end-to-end test' fails on Azure Key: FLINK-23557 URL:

[jira] [Created] (FLINK-23556) SQLClientSchemaRegistryITCase fails with " Subject ... not found"

2021-07-30 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-23556: Summary: SQLClientSchemaRegistryITCase fails with " Subject ... not found" Key: FLINK-23556 URL: https://issues.apache.org/jira/browse/FLINK-23556 Project:

Re: [DISCUSS] FLIP-179: Expose Standardized Operator Metrics

2021-07-30 Thread Arvid Heise
Hi folks, To move on with the FLIP, I will cut out eventTimeFetchLag out of scope and go ahead with the remainder. I will open a VOTE later to today. Best, Arvid On Wed, Jul 28, 2021 at 8:44 AM Arvid Heise wrote: > Hi Becket, > > I have updated the PR according to your suggestion (note that

Re: [VOTE] Release 1.13.2, release candidate #3

2021-07-30 Thread Xingbo Huang
+1 (non-binding) - Verified checksums and signatures - Verified Python wheel package contents - Pip install apache-flink-libraries source package and apache-flink wheel package in Mac - Write and Run a Simple Python UDF job in Python REPL Best, Xingbo Yu Li 于2021年7月30日周五 下午2:33写道: > +1

Re: [VOTE] Release 1.13.2, release candidate #3

2021-07-30 Thread Yu Li
+1 (binding) - Checked the diff between 1.13.1 and 1.13.2-rc3: OK ( https://github.com/apache/flink/compare/release-1.13.1...release-1.13.2-rc3) - commons-io version has been bumped to 2.8.0 through FLINK-22747 and all NOTICE files updated correctly - guava version has been bumped to 29.0 for

[jira] [Created] (FLINK-23555) Improve common subexpression elimination by using local references

2021-07-30 Thread weibowen (Jira)
weibowen created FLINK-23555: Summary: Improve common subexpression elimination by using local references Key: FLINK-23555 URL: https://issues.apache.org/jira/browse/FLINK-23555 Project: Flink

Re: [VOTE] Release 1.11.4, release candidate #1

2021-07-30 Thread JING ZHANG
Thanks @godfrey for driving this. +1 (non-binding) 1. built from source code flink-1.11.4-src.tgz succeeded 2. Started a local Flink cluster, ran the WordCount example, WebUI looks good, no suspicious

[jira] [Created] (FLINK-23554) SqlCli throws an exception and hang

2021-07-30 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-23554: -- Summary: SqlCli throws an exception and hang Key: FLINK-23554 URL: https://issues.apache.org/jira/browse/FLINK-23554 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-23553) Trigger global failover for a synchronous savepoint failure

2021-07-30 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-23553: Summary: Trigger global failover for a synchronous savepoint failure Key: FLINK-23553 URL: https://issues.apache.org/jira/browse/FLINK-23553 Project: Flink

Re: [VOTE] Release 1.11.4, release candidate #1

2021-07-30 Thread Jingsong Li
+1 (non-binding) - Verified checksums and signatures - Verified local cluster - Verified sql-client and run a job Best, Jingsong On Thu, Jul 29, 2021 at 9:26 PM Robert Metzger wrote: > Thanks a lot for creating the release candidate! > > +1 (binding) > > Checks: > - manually checked the diff

Re: [VOTE] Release 1.13.2, release candidate #3

2021-07-30 Thread Jingsong Li
+1 (non-binding) - Check if checksums and GPG files match the corresponding release files - staging repository looks fine - Start a local cluster (start-cluster.sh), logs fine - Run sql-client and run a job, looks fine I found an unexpected log in sql-client: "Searching for