Re: [DISCUSS] Pushing Apache Flink 1.15 Feature Freeze

+1 to extend the feature freeze date to Feb. 14th, which might be a good Valentine's Day present for all Flink developers as well (smile). Best Regards, Yu On Wed, 26 Jan 2022 at 14:50, Yuan Mei wrote: > +1 extending feature freeze for one week. > > Code Freeze on 6th (end of Spring Festival)

Re: [DISCUSS] Pushing Apache Flink 1.15 Feature Freeze

+1, especially for the reasons Yuan has mentioned D. On Wed, Jan 26, 2022 at 9:15 AM Yu Li wrote: > +1 to extend the feature freeze date to Feb. 14th, which might be a good > Valentine's Day present for all Flink developers as well (smile). > > Best Regards, > Yu > > > On Wed, 26 Jan 2022 at 14

Re: Looking for Maintainers for Flink on YARN

Hi everyone, We are seeing an increasing number of test instabilities related to YARN [1]. Does someone in this group have the time to pick these up? The Flink Confluence contains a guide on how to triage test instability tickets. Thanks, Konstantin [1] https://issues.apache.org/jira/browse/FLI

[jira] [Created] (FLINK-25817) FLIP-201: Persist local state in working directory

Till Rohrmann created FLINK-25817: - Summary: FLIP-201: Persist local state in working directory Key: FLINK-25817 URL: https://issues.apache.org/jira/browse/FLINK-25817 Project: Flink Issue Ty

[jira] [Created] (FLINK-25818) Add explanation how Kafka Source deals with idleness when parallelism is higher then the number of partitions

Martijn Visser created FLINK-25818: -- Summary: Add explanation how Kafka Source deals with idleness when parallelism is higher then the number of partitions Key: FLINK-25818 URL: https://issues.apache.org/jira/bro

Re: Looking for Maintainers for Flink on YARN

The link to the filter is not correct. Here is the correct link: https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20component%20%3D%20%22Deployment%20%2F%20YARN%22%20AND%20labels%20%3D%20test-stability On Wed

Re: [VOTE] FLIP-203: Incremental savepoints

+1 (binding) Thanks for driving this Piotr! Just one more (belated) suggestion: in the "Checkpoint vs savepoint guarantees" section, there are still question marks scattered in the table, and I suggest putting all TODO works into the "Limitations" section, or adding a "Future Work" section, for ea

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

Hi Thomas, Thanks a lot for the great efforts in this well-organized FLIP! After reading the FLIP carefully, I think Yang has given some great feedback and I just want to share some of my concerns: # 1 Flink Native vs Standalone integration I believe it is reasonable to support both modes in the lo

[jira] [Created] (FLINK-25819) NetworkBufferPoolTest.testIsAvailableOrNotAfterRequestAndRecycleMultiSegments fails on AZP

Till Rohrmann created FLINK-25819: - Summary: NetworkBufferPoolTest.testIsAvailableOrNotAfterRequestAndRecycleMultiSegments fails on AZP Key: FLINK-25819 URL: https://issues.apache.org/jira/browse/FLINK-25819

Re: Looking for Maintainers for Flink on YARN

Hi Konstantin, I am willing to be one maintainer of Flink on YARN. I have some relevant experience in maintaining Flink on YARN clusters in Alibaba and I hope I can make contributions to some of the cases in your list. Best, Biao Geng Konstantin Knauf 于2022年1月26日 周三17:17写道： > Hi everyone, > > W

[jira] [Created] (FLINK-25820) Introduce Table Store Flink Source

Jingsong Lee created FLINK-25820: Summary: Introduce Table Store Flink Source Key: FLINK-25820 URL: https://issues.apache.org/jira/browse/FLINK-25820 Project: Flink Issue Type: Sub-task

Re: [VOTE] FLIP-203: Incremental savepoints

+1 (non-binding) I'm pleased to see this significant improvement coming along, as well as the effort made in the FLIP to document what is and isn't supported (and where ??? remain). On Wed, Jan 26, 2022 at 10:58 AM Yu Li wrote: > +1 (binding) > > Thanks for driving this Piotr! Just one more (be

[jira] [Created] (FLINK-25821) Add the doc of execution mode in PyFlink

Huang Xingbo created FLINK-25821: Summary: Add the doc of execution mode in PyFlink Key: FLINK-25821 URL: https://issues.apache.org/jira/browse/FLINK-25821 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

Hi Biao, # 1 Flink Native vs Standalone integration I think we have got a trend in this discussion[1] that the newly introduced Flink K8s operator will start with native K8s integration first. Do you have some concerns about this? # 2 K8S StatefulSet v.s. K8S Deployment IIUC, the FlinkDeployment

[jira] [Created] (FLINK-25822) Migrate away from using Source- and SinkFunctions for internal tests

Alexander Fedulov created FLINK-25822: - Summary: Migrate away from using Source- and SinkFunctions for internal tests Key: FLINK-25822 URL: https://issues.apache.org/jira/browse/FLINK-25822 Projec

Re: [VOTE] Apache Flink Stateful Functions 3.2.0, release candidate #1

Hi everyone, a quick update on the vote: The correct link for the artifacts at the Apache Nexus repository is https://repository.apache.org/content/repositories/orgapacheflink-1485/. Moreover, there is now also a tag for the GoLang SDK: https://github.com/apache/flink-statefun/tree/statefun-sdk-

Re: [DISCUSS] FLIP-213: TaskManager's Flame Graphs

This is an expected feature, as we also experienced browser crashes on existing operator-level flame graphs Best, Echo Lee > 在 2022年1月24日，下午6:16，David Morávek 写道： > > Hi Jacky, > > The link seems to be broken, here is the correct one [1]. > > [1] > https://cwiki.apache.org/confluence/displa

[jira] [Created] (FLINK-25823) Remove Mesos from Flink Landing page

Matthias Pohl created FLINK-25823: - Summary: Remove Mesos from Flink Landing page Key: FLINK-25823 URL: https://issues.apache.org/jira/browse/FLINK-25823 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-25824) E2e test phase fails on AZP after "Unable to locate package moreutils"

Roman Khachatryan created FLINK-25824: - Summary: E2e test phase fails on AZP after "Unable to locate package moreutils" Key: FLINK-25824 URL: https://issues.apache.org/jira/browse/FLINK-25824 Proj

[jira] [Created] (FLINK-25825) MySqlCatalogITCase fails on azure

Roman Khachatryan created FLINK-25825: - Summary: MySqlCatalogITCase fails on azure Key: FLINK-25825 URL: https://issues.apache.org/jira/browse/FLINK-25825 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-25826) Handle symbols at a central place with serializable format

Timo Walther created FLINK-25826: Summary: Handle symbols at a central place with serializable format Key: FLINK-25826 URL: https://issues.apache.org/jira/browse/FLINK-25826 Project: Flink Is

[jira] [Created] (FLINK-25828) build_stateful_functions.sh can fail if target contains source or javadoc jar

Till Rohrmann created FLINK-25828: - Summary: build_stateful_functions.sh can fail if target contains source or javadoc jar Key: FLINK-25828 URL: https://issues.apache.org/jira/browse/FLINK-25828 Proje

[jira] [Created] (FLINK-25829) Do not deploy empty statefun-sdk-js jar

Till Rohrmann created FLINK-25829: - Summary: Do not deploy empty statefun-sdk-js jar Key: FLINK-25829 URL: https://issues.apache.org/jira/browse/FLINK-25829 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-25830) Typo mistake in "Metric Report page" of the documentation

ChengKai Yang created FLINK-25830: - Summary: Typo mistake in "Metric Report page" of the documentation Key: FLINK-25830 URL: https://issues.apache.org/jira/browse/FLINK-25830 Project: Flink

Re: [DISCUSS] FLIP-213: TaskManager's Flame Graphs

Hi Jacky, Could you please clarify what kind of *problems* you experience with the large parallelism? You referred to D3, is it something related to rendering on the browser side or is it about the samples collection process? Were you able to identify the bottleneck? Fundamentally I have some con

[jira] [Created] (FLINK-25831) ExecutionVertex.getLatestPriorAllocation fails if there is an unsuccessful restart attempt

Till Rohrmann created FLINK-25831: - Summary: ExecutionVertex.getLatestPriorAllocation fails if there is an unsuccessful restart attempt Key: FLINK-25831 URL: https://issues.apache.org/jira/browse/FLINK-25831

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

Hi All, Since it has turned out that DTM can't be added as member of JobMaster I've came up with a better proposal. David, thank

Re: [VOTE] FLIP-203: Incremental savepoints

+1 (non-binding) Thanks Piotr. -- Best regards, Anton Kalashnikov 26.01.2022 11:21, David Anderson пишет: +1 (non-binding) I'm pleased to see this significant improvement coming along, as well as the effort made in the FLIP to document what is and isn't supported (and where ??? remain). On We

Re: [DISCUSS] FLIP-213: TaskManager's Flame Graphs

I'd second to Alex's concerns. Is there a reason why you can't use the async-profiler directly? In what kind of environment are your Flink clusters running (YARN / k8s / ...)? Best, D. On Wed, Jan 26, 2022 at 4:32 PM Alexander Fedulov wrote: > Hi Jacky, > > Could you please clarify what kind of

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

Thanks the update, I'll go over it tomorrow. On Wed, Jan 26, 2022 at 5:33 PM Gabor Somogyi wrote: > Hi All, > > Since it has turned out that DTM can't be added as member of JobMaster > < > https://github.com/gaborgsomogyi/flink/blob/8ab75e46013f159778ccfce52463e7bc63e395a9/flink-runtime/src/main

Re: [DISCUSS] FLIP-213: TaskManager's Flame Graphs

Hi Jacky, I like the idea to leverage the async profiler to debug, as this professional tool could also detect the native CPU call apart from the stacks within JVM, which could help profile native programs such as RocksDB. However, as Alexander raised, how we handle the security and the multi-

[jira] [Created] (FLINK-25832) When the TaskManager is closed, its associated slot is not set to the released state.

john created FLINK-25832: Summary: When the TaskManager is closed, its associated slot is not set to the released state. Key: FLINK-25832 URL: https://issues.apache.org/jira/browse/FLINK-25832 Project: Flink

[jira] [Created] (FLINK-25833) FlinkUserCodeClassLoader is not registered as parallel capable

nicolasyang created FLINK-25833: --- Summary: FlinkUserCodeClassLoader is not registered as parallel capable Key: FLINK-25833 URL: https://issues.apache.org/jira/browse/FLINK-25833 Project: Flink

[jira] [Created] (FLINK-25834) 'flink run' command can not use 'pipeline.classpaths' in flink-conf.yaml

Ada Wong created FLINK-25834: Summary: 'flink run' command can not use 'pipeline.classpaths' in flink-conf.yaml Key: FLINK-25834 URL: https://issues.apache.org/jira/browse/FLINK-25834 Project: Flink

[jira] [Created] (FLINK-25835) The task initialization duration is recorded in logs

Bo Cui created FLINK-25835: -- Summary: The task initialization duration is recorded in logs Key: FLINK-25835 URL: https://issues.apache.org/jira/browse/FLINK-25835 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-25836) test_keyed_process_function_with_state of BatchModeDataStreamTests faild in PyFlink

Huang Xingbo created FLINK-25836: Summary: test_keyed_process_function_with_state of BatchModeDataStreamTests faild in PyFlink Key: FLINK-25836 URL: https://issues.apache.org/jira/browse/FLINK-25836

[jira] [Created] (FLINK-25837) RPC Serialization failure when multiple job managers

Matthew McMahon created FLINK-25837: --- Summary: RPC Serialization failure when multiple job managers Key: FLINK-25837 URL: https://issues.apache.org/jira/browse/FLINK-25837 Project: Flink Is

[jira] [Created] (FLINK-25838) BatchArrowPythonOverWindowAggregateFunctionOperatorTest. testFinishBundleTriggeredByTime failed in Azure

Huang Xingbo created FLINK-25838: Summary: BatchArrowPythonOverWindowAggregateFunctionOperatorTest. testFinishBundleTriggeredByTime failed in Azure Key: FLINK-25838 URL: https://issues.apache.org/jira/browse/FLINK

Re: [DISCUSS] FLIP-213: TaskManager's Flame Graphs

Hi jacky, Thanks for bring up this discussion, I think it's an useful feature which can make the performance tuning more portable, +1 for this Best, Aitozi Jacky Lau <281293...@qq.com.invalid> 于2022年1月24日周一 16:48写道： > Hi All, >     I would like to start the discussion on FLIP-213 < > https:

[jira] [Created] (FLINK-25839) 'Run kubernetes application HA test' failed on azure due to could not get 3 completed checkpoints in 120 sec

Yun Gao created FLINK-25839: --- Summary: 'Run kubernetes application HA test' failed on azure due to could not get 3 completed checkpoints in 120 sec Key: FLINK-25839 URL: https://issues.apache.org/jira/browse/FLINK-25839