Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-05-27 Thread Zhu Zhu
Regarding the concern of the SlotManager, my two cents: 1. it is necessary for the SlotManager to host blocked slots, in 2 cases: a. In standalone mode, a taskmanager may be temporarily added to the blocklist. We do not want the TM to get disconnected and shut down. So we need to keep its

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-05-27 Thread Zhu Zhu
Hi Chesnay, Would you share your thoughts in the discussion thread if there are still concerns? Thanks, Zhu Chesnay Schepler 于2022年5月27日周五 14:54写道: > > -1 to put a lid on things for now, because I'm not quite done yet with > the discussion. > > On 27/05/2022 05:25, Yangze Guo wrote: > > +1

[jira] [Created] (FLINK-27822) Translate the doc of checkpoint/savepoint guarantees

2022-05-27 Thread fanrui (Jira)
fanrui created FLINK-27822: -- Summary: Translate the doc of checkpoint/savepoint guarantees Key: FLINK-27822 URL: https://issues.apache.org/jira/browse/FLINK-27822 Project: Flink Issue Type:

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.0, release candidate #2

2022-05-27 Thread Gyula Fóra
Hi Devs! We have been performing extensive manual testing on the release. We have found some very infrequent savepoint upgrade issues with Flink 1.15 deployments that we could not reliably reproduce so far. I have added a fix that hopefully eliminates the root cause (

RE: [VOTE] Apache Flink Kubernetes Operator Release 1.0.0, release candidate #2

2022-05-27 Thread Jim Busche
Hi Yang, Oh, I’ve been using podman on Red Hat for testing: podman version Client: Podman Engine Version: 4.0.2 API Version: 4.0.2 If I use Docker (version 20.10.13 for me right now) then it builds fine with that COPY git line. Nice! To use podman, I need to either comment

Re: [DISCUSS] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-05-27 Thread godfrey he
Hi, everyone. Thanks for all the inputs. If there is no more feedback, I think we can start the vote next monday. Best, Godfrey Martijn Visser 于2022年5月25日周三 19:46写道: > > Hi Godfrey, > > Thanks for creating the FLIP. I have no comments. > > Best regards, > > Martijn > > > On Tue, 17 May 2022 at

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-05-27 Thread Jing Ge
Thanks all for the valuable discussion. The new feature looks very interesting. According to the FLIP description: "*Currently we have JDBC, Hive and HBase connector implemented lookup table source. All existing implementations will be migrated to the current design and the migration will be

[jira] [Created] (FLINK-27821) Cannot delete flinkdeployment when the pod and deployment deleted manually

2022-05-27 Thread Hector Miuler Malpica Gallegos (Jira)
Hector Miuler Malpica Gallegos created FLINK-27821: -- Summary: Cannot delete flinkdeployment when the pod and deployment deleted manually Key: FLINK-27821 URL:

[jira] [Created] (FLINK-27820) Handle Upgrade/Deployment errors gracefully

2022-05-27 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-27820: -- Summary: Handle Upgrade/Deployment errors gracefully Key: FLINK-27820 URL: https://issues.apache.org/jira/browse/FLINK-27820 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-234: Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems

2022-05-27 Thread Jark Wu
Hi Lincoln, Delayed Dim Join is a frequently requested feature, it's exciting to see this feature is on the road. The FLIP looks good to me in general. I only left some minor comments. 1) support retry for sync lookup I'm also fine with the idea proposed by Jingsong. But this doesn't conflict

[jira] [Created] (FLINK-27819) Generate better operationIds for OpenAPI spec

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27819: Summary: Generate better operationIds for OpenAPI spec Key: FLINK-27819 URL: https://issues.apache.org/jira/browse/FLINK-27819 Project: Flink Issue

[jira] [Created] (FLINK-27818) Model enums as references in OpenAPI spec

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27818: Summary: Model enums as references in OpenAPI spec Key: FLINK-27818 URL: https://issues.apache.org/jira/browse/FLINK-27818 Project: Flink Issue

[jira] [Created] (FLINK-27817) TaskManager metaspace OOM for session cluster

2022-05-27 Thread godfrey he (Jira)
godfrey he created FLINK-27817: -- Summary: TaskManager metaspace OOM for session cluster Key: FLINK-27817 URL: https://issues.apache.org/jira/browse/FLINK-27817 Project: Flink Issue Type: New

[jira] [Created] (FLINK-27816) file source reader has Some requirements

2022-05-27 Thread jinshuangxian (Jira)
jinshuangxian created FLINK-27816: - Summary: file source reader has Some requirements Key: FLINK-27816 URL: https://issues.apache.org/jira/browse/FLINK-27816 Project: Flink Issue Type:

[jira] [Created] (FLINK-27815) Improve the join reorder strategy for batch sql job

2022-05-27 Thread godfrey he (Jira)
godfrey he created FLINK-27815: -- Summary: Improve the join reorder strategy for batch sql job Key: FLINK-27815 URL: https://issues.apache.org/jira/browse/FLINK-27815 Project: Flink Issue Type:

[jira] [Created] (FLINK-27814) Add an abstraction layer for connectors to read and write row data instead of key-values

2022-05-27 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27814: --- Summary: Add an abstraction layer for connectors to read and write row data instead of key-values Key: FLINK-27814 URL: https://issues.apache.org/jira/browse/FLINK-27814

[jira] [Created] (FLINK-27813) java.lang.IllegalStateException: afte migration from statefun 3.1.1 to 3.2.0

2022-05-27 Thread Oleksandr (Jira)
Oleksandr created FLINK-27813: - Summary: java.lang.IllegalStateException: afte migration from statefun 3.1.1 to 3.2.0 Key: FLINK-27813 URL: https://issues.apache.org/jira/browse/FLINK-27813 Project:

[jira] [Created] (FLINK-27812) Support Dynamic change of watched namespaces

2022-05-27 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-27812: - Summary: Support Dynamic change of watched namespaces Key: FLINK-27812 URL: https://issues.apache.org/jira/browse/FLINK-27812 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-05-27 Thread Jingsong Li
Hi all, I think the problem now is below: 1. AllCache and PartialCache interface on the non-uniform, one needs to provide LookupProvider, the other needs to provide CacheBuilder. 2. AllCache definition is not flexible, for example, PartialCache can use any custom storage, while the AllCache can

[jira] [Created] (FLINK-27811) Remove netty dependency in flink-test-utils

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27811: Summary: Remove netty dependency in flink-test-utils Key: FLINK-27811 URL: https://issues.apache.org/jira/browse/FLINK-27811 Project: Flink Issue

[jira] [Created] (FLINK-27810) Elasticsearch e2e jars bundle way more than they should

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27810: Summary: Elasticsearch e2e jars bundle way more than they should Key: FLINK-27810 URL: https://issues.apache.org/jira/browse/FLINK-27810 Project: Flink

Re: [DISCUSS] FLIP-217 Support watermark alignment of source splits

2022-05-27 Thread Becket Qin
I had an offline discussion with Piotr and here is the summary. Please correct me if I miss something, Piotr. There are two things we would like to seek more opinions from the community, so we can make progress on this FLIP. 1. The General pattern to add obligatory features to existing

[jira] [Created] (FLINK-27809) Clarify that cluster-id is mandatory for Kubernetes HA in standalone mode

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27809: Summary: Clarify that cluster-id is mandatory for Kubernetes HA in standalone mode Key: FLINK-27809 URL: https://issues.apache.org/jira/browse/FLINK-27809

[jira] [Created] (FLINK-27808) Allow "kubernetes" as setting for HA_MODE

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27808: Summary: Allow "kubernetes" as setting for HA_MODE Key: FLINK-27808 URL: https://issues.apache.org/jira/browse/FLINK-27808 Project: Flink Issue

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-05-27 Thread Chesnay Schepler
-1 to put a lid on things for now, because I'm not quite done yet with the discussion. On 27/05/2022 05:25, Yangze Guo wrote: +1 (binding) Best, Yangze Guo On Thu, May 26, 2022 at 3:54 PM Yun Gao wrote: Thanks Lijie and Zhu for driving the FLIP! The blocked list functionality helps reduce

Re: [DISCUSS] FLIP-232: Add Retry Support For Async I/O In DataStream API

2022-05-27 Thread Jark Wu
Thanks, Lincoln, the updated comments look good to me. Best, Jark On Fri, 27 May 2022 at 14:21, Lincoln Lee wrote: > Hi Jark & developers, > > I'm fine with this, and minor changes: > > "timeout from first invoke to final completion of asynchronous operation, > may include multiple retries,

Re: [DISCUSS] FLIP-232: Add Retry Support For Async I/O In DataStream API

2022-05-27 Thread Lincoln Lee
Hi Jark & developers, I'm fine with this, and minor changes: "timeout from first invoke to final completion of asynchronous operation, may include multiple retries, and will be reset in case of failover" The FLIP[1] was updated including two changes: 1. generic type naming, use OUT instead of T