[jira] [Created] (FLINK-29898) ClusterEntrypointTest.testCloseAsyncShouldBeExecutedInShutdownHook fails on CI

2022-11-04 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-29898: - Summary: ClusterEntrypointTest.testCloseAsyncShouldBeExecutedInShutdownHook fails on CI Key: FLINK-29898 URL: https://issues.apache.org/jira/browse/FLINK-29898

[jira] [Created] (FLINK-29897) PyFlinkStreamUserDefinedFunctionTests.test_table_function fails on CI

2022-11-04 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-29897: - Summary: PyFlinkStreamUserDefinedFunctionTests.test_table_function fails on CI Key: FLINK-29897 URL: https://issues.apache.org/jira/browse/FLINK-29897 Project:

Re: [jira] [Created] (FLINK-28372) Investigate Akka Artery

2022-11-04 Thread Razin Bouzar
Hi all, Has there been any further work or discussions around this issue? The Netty security vulnerabilities in 3.10.6 are of some concern. On Mon, Jul 4, 2022 at 3:45 AM Chesnay Schepler (Jira) wrote: > Chesnay Schepler created FLINK-28372: > > >

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-04 Thread Őrhidi Mátyás
Thank you Max, Gyula! This is definitely an exciting one :) Cheers, Matyas On Fri, Nov 4, 2022 at 1:16 PM Gyula Fóra wrote: > Hi! > > Thank you for the proposal Max! It is great to see this highly desired > feature finally take shape. > > I think we have all the right building blocks to make

[jira] [Created] (FLINK-29896) DynamoDB CI Failing to run checks

2022-11-04 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29896: - Summary: DynamoDB CI Failing to run checks Key: FLINK-29896 URL: https://issues.apache.org/jira/browse/FLINK-29896 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-04 Thread Gyula Fóra
Hi! Thank you for the proposal Max! It is great to see this highly desired feature finally take shape. I think we have all the right building blocks to make this successful. Cheers, Gyula On Fri, Nov 4, 2022 at 7:37 PM Maximilian Michels wrote: > Hi, > > I would like to kick off the

[jira] [Created] (FLINK-29895) Improve code coverage and integration tests for DynamoDB implementation of Async Sink

2022-11-04 Thread Yuri Gusev (Jira)
Yuri Gusev created FLINK-29895: -- Summary: Improve code coverage and integration tests for DynamoDB implementation of Async Sink Key: FLINK-29895 URL: https://issues.apache.org/jira/browse/FLINK-29895

[DISCUSS] FLIP-271: Autoscaling

2022-11-04 Thread Maximilian Michels
Hi, I would like to kick off the discussion on implementing autoscaling for Flink as part of the Flink Kubernetes operator. I've outlined an approach here which I find promising: https://cwiki.apache.org/confluence/display/FLINK/FLIP-271%3A+Autoscaling I've been discussing this approach with

Re: Stateful Functions with Flink 1.15 and onwards

2022-11-04 Thread Tzu-Li (Gordon) Tai
@Galen The next step is essentially for someone to be the release manager and drive the release process for StateFun 3.3.0 [1]. The document for the release process might be slightly outdated in some places, but overall outlines the process pretty clearly. As I mentioned earlier, there's quite a

Re: SQL Gateway and SQL Client

2022-11-04 Thread Jamie Grier
Hi Shengkai, We're doing more and more Flink development at Confluent these days and we're currently trying to bootstrap a prototype that relies on the SQL Client and Gateway. We will be using the the components in some of our projects and would like to co-develop them with you and the rest

[jira] [Created] (FLINK-29894) Rename flink-connector-dynamodb to flink-connector-aws

2022-11-04 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29894: - Summary: Rename flink-connector-dynamodb to flink-connector-aws Key: FLINK-29894 URL: https://issues.apache.org/jira/browse/FLINK-29894 Project: Flink

[jira] [Created] (FLINK-29893) k8s python e2e test failed due to permission error when pulling the Docker image

2022-11-04 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29893: - Summary: k8s python e2e test failed due to permission error when pulling the Docker image Key: FLINK-29893 URL: https://issues.apache.org/jira/browse/FLINK-29893

[jira] [Created] (FLINK-29892) flink-conf.yaml does not accept hash (#) in the env.java.opts property

2022-11-04 Thread Sergio Sainz (Jira)
Sergio Sainz created FLINK-29892: Summary: flink-conf.yaml does not accept hash (#) in the env.java.opts property Key: FLINK-29892 URL: https://issues.apache.org/jira/browse/FLINK-29892 Project:

[jira] [Created] (FLINK-29891) The RetryRule tests print some excessive stacktraces that might confuse people investigating actual issues

2022-11-04 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29891: - Summary: The RetryRule tests print some excessive stacktraces that might confuse people investigating actual issues Key: FLINK-29891 URL:

[jira] [Created] (FLINK-29890) UDFs classloading from JARs in 1.16 is broken

2022-11-04 Thread Alexander Fedulov (Jira)
Alexander Fedulov created FLINK-29890: - Summary: UDFs classloading from JARs in 1.16 is broken Key: FLINK-29890 URL: https://issues.apache.org/jira/browse/FLINK-29890 Project: Flink

[jira] [Created] (FLINK-29889) netty-tcnative-static does not bundle tcnative-classes

2022-11-04 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29889: Summary: netty-tcnative-static does not bundle tcnative-classes Key: FLINK-29889 URL: https://issues.apache.org/jira/browse/FLINK-29889 Project: Flink

Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

2022-11-04 Thread Maximilian Michels
Hey Yun, I wonder whether we need to add a new option when registering timers. Won't it be sufficient to flush all pending timers on termination but not allow new ones to be registered? -Max On Wed, Nov 2, 2022 at 11:20 AM Yun Gao wrote: > Hi everyone, > I would like to open a discussion[1]

Re: Stateful Functions with Flink 1.15 and onwards

2022-11-04 Thread Galen Warren
Thanks Gordon. What is the next step here? On Thu, Nov 3, 2022 at 1:45 PM Tzu-Li (Gordon) Tai wrote: > FYI, release-3.3 branch has been cut and is ready for the release process > for StateFun 3.3.0: > https://github.com/apache/flink-statefun/tree/release-3.3 > > On Tue, Nov 1, 2022 at 10:21 AM

Re: ASF Slack

2022-11-04 Thread Martijn Visser
Hi Max, > I wonder how that has played out since the creation of the Slack workspace? I haven't been following the Slack communication. I think it has primarily played a role next to the existing User mailing list: lots of user questions. There were maybe a handful of conversations where the

[jira] [Created] (FLINK-29888) Improve MutatedConfigurationException for disallowed changes in CheckpointConfig and ExecutionConfig

2022-11-04 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-29888: -- Summary: Improve MutatedConfigurationException for disallowed changes in CheckpointConfig and ExecutionConfig Key: FLINK-29888 URL:

Re: ASF Slack

2022-11-04 Thread Maximilian Michels
Hey Martijn, hi Chesnay, >The big problem of using the ASF Slack instance is that users can join any Slack channel, including ones outside of Flink. That is one of the main motivations for proposing to move to the ASF Slack. We can create an unlimited number of "flink-XY" channels in the ASF

Re: [DISCUSS]Introduce a time-segment based restart strategy

2022-11-04 Thread Paul Lam
In addition, there’s another viable alternative strategy that could be applied with or without the proposed strategy. We could group the exceptions occurred in an interval by exception class. Only a distinct exception within an interval is counted as one failure. The upside is that it’s more

[jira] [Created] (FLINK-29887) Lookup cache in JDBC table connector is not each process (i.e. TaskManager) will hold a cache

2022-11-04 Thread linweijiang (Jira)
linweijiang created FLINK-29887: --- Summary: Lookup cache in JDBC table connector is not each process (i.e. TaskManager) will hold a cache Key: FLINK-29887 URL: https://issues.apache.org/jira/browse/FLINK-29887

Re: [DISCUSS]Introduce a time-segment based restart strategy

2022-11-04 Thread Paul Lam
Hi Weihua, +1 for the new restart strategy you suggested. We’re also using failure-rate strategy as the cluster-wide default and faced the same problem, which we solved with a similar approach. FYI. We added a freeze period config option to failure-rate strategy. The freeze period would

[jira] [Created] (FLINK-29886) networkThroughput 1000,100ms,OpenSSL Benchmark is failing

2022-11-04 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-29886: -- Summary: networkThroughput 1000,100ms,OpenSSL Benchmark is failing Key: FLINK-29886 URL: https://issues.apache.org/jira/browse/FLINK-29886 Project: Flink

[GitHub] [flink-connector-shared-utils] leonardBang commented on pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-04 Thread GitBox
leonardBang commented on PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#issuecomment-1303154579 Happy to see you start working @zentol , Could you take a look my comments here? https://github.com/apache/flink/pull/21227 sorry to reply under this issue but I've

[jira] [Created] (FLINK-29885) SqlValidatorException :Column 'currency' is ambiguous

2022-11-04 Thread ZuoYan (Jira)
ZuoYan created FLINK-29885: -- Summary: SqlValidatorException :Column 'currency' is ambiguous Key: FLINK-29885 URL: https://issues.apache.org/jira/browse/FLINK-29885 Project: Flink Issue Type:

[jira] [Created] (FLINK-29884) Flaky test failure in finegrained_resource_management/SortMergeResultPartitionTest.testRelease

2022-11-04 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-29884: --- Summary: Flaky test failure in finegrained_resource_management/SortMergeResultPartitionTest.testRelease Key: FLINK-29884 URL: https://issues.apache.org/jira/browse/FLINK-29884

[DISCUSS]Introduce a time-segment based restart strategy

2022-11-04 Thread Weihua Hu
Hi, everyone I'd like to bring up a discussion about restart strategy. Flink supports 3 kinds of restart strategy. These work very well for jobs with specific configs, but for platform users who manage hundreds of jobs, there is no common strategy to use. Let me explain the reason. We manage a

[jira] [Created] (FLINK-29883) Benchmarks are failing

2022-11-04 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29883: Summary: Benchmarks are failing Key: FLINK-29883 URL: https://issues.apache.org/jira/browse/FLINK-29883 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29882) LargeDataITCase is not stable

2022-11-04 Thread Jane Chan (Jira)
Jane Chan created FLINK-29882: - Summary: LargeDataITCase is not stable Key: FLINK-29882 URL: https://issues.apache.org/jira/browse/FLINK-29882 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29881) when Fetch results in sql gateway, the result using open api is different from using restful api

2022-11-04 Thread yiwei93 (Jira)
yiwei93 created FLINK-29881: --- Summary: when Fetch results in sql gateway, the result using open api is different from using restful api Key: FLINK-29881 URL: https://issues.apache.org/jira/browse/FLINK-29881

[jira] [Created] (FLINK-29880) Hive sink supports merge files in batch mode

2022-11-04 Thread luoyuxia (Jira)
luoyuxia created FLINK-29880: Summary: Hive sink supports merge files in batch mode Key: FLINK-29880 URL: https://issues.apache.org/jira/browse/FLINK-29880 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-29879) Introduce operators for files merging

2022-11-04 Thread luoyuxia (Jira)
luoyuxia created FLINK-29879: Summary: Introduce operators for files merging Key: FLINK-29879 URL: https://issues.apache.org/jira/browse/FLINK-29879 Project: Flink Issue Type: Sub-task