Re: [VOTE] FLIP-304: Pluggable Failure Enrichers

2023-04-19 Thread David Morávek
Hi Panos, It seems that most recent discussions (e.g. changing the semantics of the config option) are not reflected in the FLIP. Can you please double-check that this is the correct version? Best, D. On Mon, Apr 17, 2023 at 9:24 AM Panagiotis Garefalakis wrote: > Hello everyone, > > I want t

Re:Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-19 Thread Mang Zhang
hi, Jing Thank you for your reply. >1. It looks like you found another way to design the atomic CTAS with new >serializable TwoPhaseCatalogTable instead of making Catalog serializable as >described in FLIP-218. Did I understand correctly? Yes, when I was implementing the FLIP-218 solution, I enco

[jira] [Created] (FLINK-31847) Flink Connector JDBC CI Failing

2023-04-19 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-31847: - Summary: Flink Connector JDBC CI Failing Key: FLINK-31847 URL: https://issues.apache.org/jira/browse/FLINK-31847 Project: Flink Issue Type: Technical Debt

Re: [VOTE] Release flink-connector-jdbc v3.1.0, release candidate #1

2023-04-19 Thread Danny Cranmer
Thank Benchao for the hotfix. I noticed the CI is also failing/flaky for the main branch, I have raised a follow-up [1]. Danny, [1] https://issues.apache.org/jira/browse/FLINK-31847 On Sun, Apr 16, 2023 at 10:57 AM Benchao Li wrote: > And I've filed a hotfix PR[1] to fix the copyright issue. >

Re: [VOTE] Release flink-connector-jdbc v3.1.0, release candidate #1

2023-04-19 Thread Martijn Visser
Hi all, There was already a blocker ticken op for this, that's https://issues.apache.org/jira/browse/FLINK-31770. There's also an open PR that should resolve it, but is waiting on a reviewer. See https://github.com/apache/flink-connector-jdbc/pull/22 I've already done the administration, so this

Re: [VOTE] Release flink-connector-opensearch, release candidate #1

2023-04-19 Thread Danny Cranmer
Thanks for driving, Martijn. +1 (binding) - Release notes look good - Verified source archive signature/checksums - Verified binary signature/checksums - Verified no binaries in the source archive - Source tag exists on GitHub - Reviewed web PR - Verified NOTICE files Observations - NOTICE files

[jira] [Created] (FLINK-31848) And Operator has side effect when operands have udf

2023-04-19 Thread zju_zsx (Jira)
zju_zsx created FLINK-31848: --- Summary: And Operator has side effect when operands have udf Key: FLINK-31848 URL: https://issues.apache.org/jira/browse/FLINK-31848 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31849) Enforce some some simple validation directly through the CRD

2023-04-19 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-31849: -- Summary: Enforce some some simple validation directly through the CRD Key: FLINK-31849 URL: https://issues.apache.org/jira/browse/FLINK-31849 Project: Flink Iss

[jira] [Created] (FLINK-31850) Fix args in JobSpec not being passed through to Flink in Standalone mode - 1.4.0

2023-04-19 Thread Gil Shmaya (Jira)
Gil Shmaya created FLINK-31850: -- Summary: Fix args in JobSpec not being passed through to Flink in Standalone mode - 1.4.0 Key: FLINK-31850 URL: https://issues.apache.org/jira/browse/FLINK-31850 Project:

[jira] [Created] (FLINK-31851) Remove unused KubernetesMultipleComponentLeaderElectionHaServicesFactory

2023-04-19 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31851: -- Summary: Remove unused KubernetesMultipleComponentLeaderElectionHaServicesFactory Key: FLINK-31851 URL: https://issues.apache.org/jira/browse/FLINK-31851 Project: Flink

[jira] [Created] (FLINK-31852) NumRecordsOut metrics broken

2023-04-19 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-31852: -- Summary: NumRecordsOut metrics broken Key: FLINK-31852 URL: https://issues.apache.org/jira/browse/FLINK-31852 Project: Flink Issue Type: New Feature Co

[jira] [Created] (FLINK-31853) Remove use of ExecutionAttemptMappingProvider

2023-04-19 Thread Junrui Li (Jira)
Junrui Li created FLINK-31853: - Summary: Remove use of ExecutionAttemptMappingProvider Key: FLINK-31853 URL: https://issues.apache.org/jira/browse/FLINK-31853 Project: Flink Issue Type: Improvem

Re: [VOTE] FLIP-304: Pluggable Failure Enrichers

2023-04-19 Thread Piotr Nowojski
+1 to what David wrote. I think we need to update the FLIP and extend the voting? Piotrek śr., 19 kwi 2023 o 09:06 David Morávek napisał(a): > Hi Panos, > > It seems that most recent discussions (e.g. changing the semantics of the > config option) are not reflected in the FLIP. Can you please d

[jira] [Created] (FLINK-31854) Flink connector redshift

2023-04-19 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-31854: -- Summary: Flink connector redshift Key: FLINK-31854 URL: https://issues.apache.org/jira/browse/FLINK-31854 Project: Flink Issue Type: New Feature Compo

DefaultInputSplitAssigner question

2023-04-19 Thread Péter Váry
Hi Team, Recently I ran into the DefaultInputSplitAssigner [1]. The javadoc documentation states: /** * This is the default implementation of the {@link InputSplitAssigner} interface. The default input * split assigner simply returns all input splits of an input vertex *in the order they wer

[jira] [Created] (FLINK-31855) Canceling a job through the UI isn't possible in standalone

2023-04-19 Thread Gil Shmaya (Jira)
Gil Shmaya created FLINK-31855: -- Summary: Canceling a job through the UI isn't possible in standalone Key: FLINK-31855 URL: https://issues.apache.org/jira/browse/FLINK-31855 Project: Flink Issu

[jira] [Created] (FLINK-31856) Add support for Opensearch Connector REST client customization

2023-04-19 Thread Jira
Michael Hempel-Jørgensen created FLINK-31856: Summary: Add support for Opensearch Connector REST client customization Key: FLINK-31856 URL: https://issues.apache.org/jira/browse/FLINK-31856

[jira] [Created] (FLINK-31857) Support pluginable observers mechanism

2023-04-19 Thread Daren Wong (Jira)
Daren Wong created FLINK-31857: -- Summary: Support pluginable observers mechanism Key: FLINK-31857 URL: https://issues.apache.org/jira/browse/FLINK-31857 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31858) Add Autoscaler support for Session Job

2023-04-19 Thread phoebe chen (Jira)
phoebe chen created FLINK-31858: --- Summary: Add Autoscaler support for Session Job Key: FLINK-31858 URL: https://issues.apache.org/jira/browse/FLINK-31858 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31859) Update maven cyclonedx plugin to 2.7.7

2023-04-19 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-31859: --- Summary: Update maven cyclonedx plugin to 2.7.7 Key: FLINK-31859 URL: https://issues.apache.org/jira/browse/FLINK-31859 Project: Flink Issue Type: Tech

ValueState losing event randomly onTimer trigger

2023-04-19 Thread Kireet Agrawal
Hi Flink dev community! I'm adding an event delay function for certain events using Flink timers, but occasionally the ValueState seems to lose the event. I see a ValueState loss of ~20 events out of 1250, and I don't see a pattern to it yet. The code is below: public class ProjectionEvictionEven

Re: [DISCUSS] Status of Statefun Project

2023-04-19 Thread Galen Warren
> > I use Apache Flink for stream processing, and StateFun as a hand-off point > for the rest of the application. > It serves well as a bridge between a Flink Streaming job and > micro-services. This is essentially how I use it as well, and I would also be sad to see it sunsetted. It works well;

Re: [VOTE] Release flink-connector-elasticsearch, release candidate #1

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Thu, Apr 13, 2023 at 1:51 PM Andriy Redko wrote: > +1 (non-binding), thank you Martijn! > > MV> Hi everyone, > MV>

Re: [VOTE] Release flink-connector-aws, 4.1.0 for Flink 1.17

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Wed, Apr 12, 2023 at 12:13 PM Samrat Deb wrote: > +1 (non binding) > > > On Tue, 4 Apr 2023 at 1:42 AM, Elphas Tor

Re: [VOTE] Release flink-connector-mongodb v1.0.1, release candidate #1

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Apr 14, 2023 at 9:55 AM Samrat Deb wrote: > +1 (non binding) > > On Fri, 14 Apr 2023 at 1:23 PM, Teoh, Hong

Re: [VOTE] Release flink-connector-pulsar, release candidate #1

2023-04-19 Thread Martijn Visser
@Yufan can you make sure that these changes are properly included in the closed Jira tickets, under "Release Notes" ? +1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs

Re: [VOTE] Release flink-connector-cassandra v3.1.0, release candidate #1

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Apr 14, 2023 at 2:42 PM Elphas Toringepi wrote: > Thanks Danny > > +1 (non-binding) > > * Checked release not

Re: [VOTE] Release flink-connector-opensearch, release candidate #1

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs Note: the copyright year in the NOTICE files have been updated to 2023 On Wed, Apr 19, 2023 at 9:43 AM Danny Cranmer

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.1, release candidate #1

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Apr 14, 2023 at 6:15 PM Ryan Skraba wrote: > Hello! +1 (non-binding) > > I've validated the source for the R

Re: [VOTE] Release flink-connector-jdbc v3.1.0, release candidate #1

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Wed, Apr 19, 2023 at 9:35 AM Martijn Visser wrote: > Hi all, > > There was already a blocker ticken op for this, t

Re: [VOTE] Release flink-connector-rabbitmq v3.0.1, release candidate #1

2023-04-19 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Mon, Apr 17, 2023 at 7:00 PM Ryan Skraba wrote: > Hello! +1 (non-binding) > > I've validated the source for the R

[jira] [Created] (FLINK-31860) FlinkDeployments never finalize when namespace is deleted

2023-04-19 Thread Jayme Howard (Jira)
Jayme Howard created FLINK-31860: Summary: FlinkDeployments never finalize when namespace is deleted Key: FLINK-31860 URL: https://issues.apache.org/jira/browse/FLINK-31860 Project: Flink Iss

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-19 Thread yuxia
Share some insights about the new TwoPhaseCatalogTable proposed after offline discussion with Mang. The main or important reason is that the TwoPhaseCatalogTable enables external connectors to implement theirs own logic for commit / abort. In FLIP-218, for atomic CTAS, the Catalog will then jus

Re: [VOTE] Release flink-connector-mongodb v1.0.1, release candidate #1

2023-04-19 Thread Leonard Xu
+1 (binding) - verified signatures - verified hashsums - checked Github release tag - built from source code succeeded - reviewed the web PR Best, Leonard > On Apr 20, 2023, at 2:41 AM, Martijn Visser wrote: > > +1 (binding) > > - Validated hashes > - Verified signature > - Verified that n

Re: DefaultInputSplitAssigner question

2023-04-19 Thread Zhu Zhu
Hi Peter, Maybe you can try Flink new source[1]? It allows you to customize your own `SplitEnumerator` which can control how to assign splits. DefaultInputSplitAssigner is not a public interface. And currently there is no requirement of the order of splits by Flink itself. Therefore, it looks to

[jira] [Created] (FLINK-31861) Introduce ByteArraySchema which serialize/deserialize data of type byte array

2023-04-19 Thread Dian Fu (Jira)
Dian Fu created FLINK-31861: --- Summary: Introduce ByteArraySchema which serialize/deserialize data of type byte array Key: FLINK-31861 URL: https://issues.apache.org/jira/browse/FLINK-31861 Project: Flink