Re: [DISCUSS] DockerHub repository maintainers

Forgot to mention that, we have also proposed to use one shared account and limit its access to the PMC members, like what we do with the PyPI account. Unfortunately, INFRA rejected this proposal [1]. Thank you~ Xintong Song [1] https://issues.apache.org/jira/browse/INFRA-23208 On Thu, Apr

[DISCUSS] DockerHub repository maintainers

Hi devs, I'd like to start a discussion about maintainers for DockerHub repositories under the *apache* namespace [1]. Currently, the Flink community maintains various repositories (flink, flink-statefun, flink-statefun-playground, and flink-kubernetes-operator) on DockerHub under the *apache*

Re: [DISCUSS] FLIP-227: Support overdraft buffer

Hi Anton Kalashnikov, Thanks for your very clear reply, I think you are totally right. The 'maxBuffersNumber - buffersInUseNumber' can be used as the overdraft buffer, it won't need the new buffer configuration.Flink users can turn up the maxBuffersNumber to control the overdraft buffer size.

Re: [VOTE] FLIP-216: Introduce pluggable dialect and plan for migrating Hive dialect

+1 (Binding) A very good step to move forward. Best. Jingsong On Wed, Apr 27, 2022 at 9:33 PM yuxia wrote: > > Hi, everyone > > Thanks all for attention to FLIP-216: Introduce pluggable dialect and plan > for migrating Hive dialect [1] and participation in the discussion in the > mail thread

Re:Re: [DISCUSS] FLIP-168: Speculative execution for Batch Job

Hi zhu: This sounds like a great job! Thanks for your great job. In our company, there are already some jobs using Flink Batch, but everyone knows that the offline cluster has a lot more load than the online cluster, and the failure rate of the machine is also much higher. If

[jira] [Created] (FLINK-27435) Kubernetes Operator keeps savepoint history

Thomas Weise created FLINK-27435: Summary: Kubernetes Operator keeps savepoint history Key: FLINK-27435 URL: https://issues.apache.org/jira/browse/FLINK-27435 Project: Flink Issue Type:

Re: [DISCUSS] Planning Flink 1.16

Thanks Konstantin and Chesnay for starting the discussion. And thanks Konstantin, Chesnay, Godfrey, Martijn for volunteering. The 1.16 release at the end of July means that there are currently only 3 months to fully commit to 1.16 development, and I'm a little concerned that this is too short a

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

> * Should we introduce the REST Gateway as part of Flink's main repository? Wouldn't we be better off to maintain this in a separate repository under ASF? Ideally you would like to be able to support multiple Flink versions with one version of the REST Gateway I think? We would be better off

[jira] [Created] (FLINK-27434) How to get CatalogManager.schemaResolver from Catalog.alterTable interface？

wuwenchi created FLINK-27434: Summary: How to get CatalogManager.schemaResolver from Catalog.alterTable interface？ Key: FLINK-27434 URL: https://issues.apache.org/jira/browse/FLINK-27434 Project: Flink

Re: [DISCUSS] Docker images for SNAPSHOT

Hi everyone, thank you for your feedback. I created a ticket for us with the INFRA team [1] Best, Alexander Fedulov [1] https://issues.apache.org/jira/browse/INFRA-23213 On Tue, Apr 26, 2022 at 8:49 PM Martijn Visser wrote: > Hi Alex, > > After checking with ASF Infra, the only thing we need

Latest Keynotes and sessions confirmed

[image: Beam Summit 2022 - Cover Twitter.png] Beam Summit program is ready! Hello Flink community, We are very excited to share that the Beam Summit program is ready! Beam Summit will be a hybrid event, having hybrid talks on Monday and Tuesday, and

[jira] [Created] (FLINK-27433) E2E log artifacts contain several thousand rocksdb logs

Chesnay Schepler created FLINK-27433: Summary: E2E log artifacts contain several thousand rocksdb logs Key: FLINK-27433 URL: https://issues.apache.org/jira/browse/FLINK-27433 Project: Flink

[jira] [Created] (FLINK-27432) Replace Time with Duration in TaskSlotTable

Chesnay Schepler created FLINK-27432: Summary: Replace Time with Duration in TaskSlotTable Key: FLINK-27432 URL: https://issues.apache.org/jira/browse/FLINK-27432 Project: Flink Issue

Re: [DISCUSS] FLIP-227: Support overdraft buffer

Hi fanrui, Thanks for creating the FLIP. In general, I think the overdraft is good idea and it should help in described above cases. Here are my thoughts about configuration: Please, correct me if I am wrong but as I understand right now we have following calculation. maxBuffersNumber(per

[jira] [Created] (FLINK-27431) Allow Duration for RpcTimeouts

Chesnay Schepler created FLINK-27431: Summary: Allow Duration for RpcTimeouts Key: FLINK-27431 URL: https://issues.apache.org/jira/browse/FLINK-27431 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-27430) Remove unused MockResourceManagerRuntimeServices#timeout

Chesnay Schepler created FLINK-27430: Summary: Remove unused MockResourceManagerRuntimeServices#timeout Key: FLINK-27430 URL: https://issues.apache.org/jira/browse/FLINK-27430 Project: Flink

[VOTE] FLIP-216: Introduce pluggable dialect and plan for migrating Hive dialect

Hi, everyone Thanks all for attention to FLIP-216: Introduce pluggable dialect and plan for migrating Hive dialect [1] and participation in the discussion in the mail thread [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not

[jira] [Created] (FLINK-27429) Implement Vertica JDBC Dialect

Jasmin Redzepovic created FLINK-27429: - Summary: Implement Vertica JDBC Dialect Key: FLINK-27429 URL: https://issues.apache.org/jira/browse/FLINK-27429 Project: Flink Issue Type: New

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

Hi Lijie, I think, this makes sense and +1 to only support manually blocking taskmanagers and nodes. Maybe the different strategies can also be maintained outside of Apache Flink. A few remarks: 1) Can we use another term than "bla.cklist" due to the controversy around the term? [1] There was

Re: [DISCUSS] Planning Flink 1.16

Thanks Konstantin and Chesnay for starting the discussion and volunteering. The timeline proposal sounds reasonable :+1: Best, D. On Tue, Apr 26, 2022 at 1:37 PM Martijn Visser wrote: > Hi everyone, > > Thanks for starting this discussion. I would also volunteer to help out as > a release

Re: [DISCUSS] Planning Flink 1.16

Hi Konstantin, Feature freeze end of July sounds reasonable. I think what we learned with the 1.15 release pushing it to a later point in time due to holidays etc., might set the tone early. Best, Joe > On 26.04.2022, at 12:23, Konstantin Knauf wrote: > > Hi everyone, > > With Flink 1.15

[jira] [Created] (FLINK-27428) Deduplicate #toDuration(Time)

Chesnay Schepler created FLINK-27428: Summary: Deduplicate #toDuration(Time) Key: FLINK-27428 URL: https://issues.apache.org/jira/browse/FLINK-27428 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-27427) Remove timeouts from RpcUtils#terminate*

Chesnay Schepler created FLINK-27427: Summary: Remove timeouts from RpcUtils#terminate* Key: FLINK-27427 URL: https://issues.apache.org/jira/browse/FLINK-27427 Project: Flink Issue Type:

[jira] [Created] (FLINK-27426) Replace Time with Duration in RPC system internals

Chesnay Schepler created FLINK-27426: Summary: Replace Time with Duration in RPC system internals Key: FLINK-27426 URL: https://issues.apache.org/jira/browse/FLINK-27426 Project: Flink

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

Hi ShengKai, After I read FLIP-91[1], I want to add an init-file option. Its functionality is the same as option '-i' of Flink SQL Client. When I use Catalog(HiveCatalog), I need to execute `CREATE CATALOG` by this option after SQL Gateway starts every time. Shall we name this option

[jira] [Created] (FLINK-27425) Default job service account needs access to services to work with Kafka

Mark Nuttall created FLINK-27425: Summary: Default job service account needs access to services to work with Kafka Key: FLINK-27425 URL: https://issues.apache.org/jira/browse/FLINK-27425 Project:

Re: [DISCUSS] Next Flink Kubernetes Operator release timeline

Thanks @Chesnay Schepler for pointing out this. The only public interface the flink-kubernetes-operator provides is the CRD[1]. We are trying to stabilize the CRD from v1beta1. If more fields are introduced to support new features(e.g. standalone mode, SQL jobs), they should have the default

Add a init-file option into FLIP-91

Hi all, After I read FLIP-91[1], I want to add an init-file option. Its functionality is the same as option '-i' of Flink SQL Client. When I use Catalog(HiveCatalog), I need to execute `CREATE CATALOG` by this option after SQL Gateway starts every time. Shall we name this option

[jira] [Created] (FLINK-27424) StreamExecutionEnvironment.readFile() api monitor file directory errors

zhangqw152 created FLINK-27424: -- Summary: StreamExecutionEnvironment.readFile() api monitor file directory errors Key: FLINK-27424 URL: https://issues.apache.org/jira/browse/FLINK-27424 Project: Flink