Re: [VOTE] Create a separate sub project for FLIP-188: flink-store

+1 for a separate repository and release pipeline in the same way as flink-statefun [1], flink-ml [2] and the coming flink-connectors [3]. +1 for naming it as "flink-table-store" (I'm also ok with "flink-table-storage", but slightly prefer "flink-table-store" because it's shorter) Thanks for

Re: [VOTE] Create a separate sub project for FLIP-188: flink-store

+1 for the name of `flink-table-store`. Best Yun Tang From: Jingsong Li Sent: Monday, January 10, 2022 10:46 To: dev Subject: Re: [VOTE] Create a separate sub project for FLIP-188: flink-store Hi David, thanks for your suggestion. I think we should re-use as

[jira] [Created] (FLINK-25586) ExecutionGraphInfoStore in session cluster should split failed and successful jobs

Shammon created FLINK-25586: --- Summary: ExecutionGraphInfoStore in session cluster should split failed and successful jobs Key: FLINK-25586 URL: https://issues.apache.org/jira/browse/FLINK-25586 Project:

Re: Unable to update logback configuration in Flink Native Kubernetes

Sorry for the late reply. Flink clients will ship the log4j-console.properties and logback-console.xml via K8s ConfigMap and then mount to JobManager/TaskManager pod. So if you want to update the log settings or using logback, all you need is to update the client-local files. Best, Yang

[jira] [Created] (FLINK-25585) JobManagerHAProcessFailureRecoveryITCase.testDispatcherProcessFailure failed on the azure

Yun Gao created FLINK-25585: --- Summary: JobManagerHAProcessFailureRecoveryITCase.testDispatcherProcessFailure failed on the azure Key: FLINK-25585 URL: https://issues.apache.org/jira/browse/FLINK-25585

is task reassignment possible

Hi there, We ran multiple large scale applications YARN clusters, one observation were those jobs often CPU skewed due to topology or data skew on subtasks. And for better or worse, the skew leads to a few task managers consuming large vcores while majority task managers consume much less. Our

[jira] [Created] (FLINK-25584) Azure failed on install node and npm for Flink : Runtime web

Yun Gao created FLINK-25584: --- Summary: Azure failed on install node and npm for Flink : Runtime web Key: FLINK-25584 URL: https://issues.apache.org/jira/browse/FLINK-25584 Project: Flink Issue

[jira] [Created] (FLINK-25583) [FLIP-191] Support compacting small files for FileSink

Yun Gao created FLINK-25583: --- Summary: [FLIP-191] Support compacting small files for FileSink Key: FLINK-25583 URL: https://issues.apache.org/jira/browse/FLINK-25583 Project: Flink Issue Type: New

Re: [DISCUSS] Releasing Flink 1.14.3

Hi Thomas, Since multiple wheel packages with different python versions for mac and linux are generated, building locally requires you have multiple machines with different os and Python environments. I have triggered the wheel package build of release-1.14.3-rc1 in my private Azure[1] and you

Re: [DISCUSS] Deprecate MapR FS

+1 for dropping the MapR Fs. Best Yun Tang From: Till Rohrmann Sent: Wednesday, January 5, 2022 18:33 To: Martijn Visser Cc: David Morávek ; dev ; Seth Wiesman ; User Subject: Re: [DISCUSS] Deprecate MapR FS +1 for dropping the MapR FS. Cheers, Till On Wed,

Re: [DISCUSS] Add the ability of evolution RowData in sql/table job

Hi wenlong Thanks for your helpful suggestions, I will prepare the design doc these days to outline the implementation plan for further discussion. Best, Aitozi wenlong.lwl 于2022年1月10日周一 10:07写道： > Hi, Aitozi, > thanks for bringing up the discussion on the state evolution of flink sql. >

Re: [Ask for review]

Hi wenlong, Thanks for your help first, we can keep the discussion in jira. Best, Aitozi wenlong.lwl 于2022年1月10日周一 09:43写道： > hi, Aitozi, thanks for the contribution first. I checked the issue, it > seems that the discussion is blocked and hasn't finished yet. Anyway, I > would like to

Re: [DISCUSS] Releasing Flink 1.14.3

Hi Martijn, I started building the release artifacts. The Maven part is ready. Currently blocked on the Azure build for the PyFlink wheel packages. I had to submit a "Azure DevOps Parallelism Request" and that might take a couple of days. Does someone have the steps to build the wheels locally?

Re: [VOTE] Create a separate sub project for FLIP-188: flink-store

Hi David, thanks for your suggestion. I think we should re-use as many common components with connectors as possible. I don't fully understand what you mean, but for this project I prefer to use Maven rather than Gradle. Best, Jingsong On Fri, Jan 7, 2022 at 11:59 PM David Morávek wrote: > >

[jira] [Created] (FLINK-25582) flink sql kafka source cannot special custom parallelism

venn wu created FLINK-25582: --- Summary: flink sql kafka source cannot special custom parallelism Key: FLINK-25582 URL: https://issues.apache.org/jira/browse/FLINK-25582 Project: Flink Issue Type:

Re: [DISCUSS] Add the ability of evolution RowData in sql/table job

Hi, Aitozi, thanks for bringing up the discussion on the state evolution of flink sql. It would be a great improvement on flink sql. I think it would be better if you could prepare a document providing more details about the solution, it would be a big story and huge change and we need to discuss

Flink SQL Kafka connector

hello Is there any plan to develop batch mode of Flink SQL Kafka connector? I would like to use kafka connector for daily/hourly/minute-by-minute statistics, but currently only supports streaming mode and kafka parameters only support the start parameter setting, not the end parameter setting.

Re: [Ask for review]

hi, Aitozi, thanks for the contribution first. I checked the issue, it seems that the discussion is blocked and hasn't finished yet. Anyway, I would like to join and help review the solution and pr. Best, Wenlong On Sun, 9 Jan 2022 at 16:53, Aitozi wrote: > Hi community: > I have created

[jira] [Created] (FLINK-25581) Jobmanager does not archive completed jobs

Leonid Ilyevsky created FLINK-25581: --- Summary: Jobmanager does not archive completed jobs Key: FLINK-25581 URL: https://issues.apache.org/jira/browse/FLINK-25581 Project: Flink Issue Type:

[DISCUSS] Add the ability of evolution RowData in sql/table job

Hi all: When we use Flink SQL to develop job, we encounter a big problem that, the state may become incompatible after changing sql. It mainly caused by two case: 1. The operator number may change and make the state of the operator can not mapping to the previous state. 2. The format of the

[Ask for review]

Hi community: I have created a pr to improve window performance in some scene. But it seems lack of review for a long time. Can any sql guys can help take a look and give me some feedback? Thanks in advance :) Aitozi