Re: [VOTE] Apache Flink Kubernetes Operator Release 1.5.0, release candidate #1

2023-05-11 Thread Gyula Fóra
Very strange, I also get an error when running the examples from the RC. It's different but could be related: Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://10.96.0.1/api/v1/namespaces/default/pods. Message: PodList in version "v1" cannot be

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.5.0, release candidate #1

2023-05-11 Thread Márton Balassi
Hi Jim and Ted, Thanks for the quick response. For Openshift issue I would assume that adding the RBAC suggested here [1] would solve the problem, it seems fine to me. For the missing taskmanager could you please share the relevant logs from your jobmanager pod that is already show running? Thank

[VOTE] Apache Flink Kubernetes Operator Release 1.5.0, release candidate #1

2023-05-11 Thread Hao t Chang
Seems missing taskmanager pod. I tried the following: kubectl create -f https://github.com/jetstack/cert-manager/releases/download/v1.8.2/cert-manager.yaml helm install 1.5rc1 https://dist.apache.org/repos/dist/dev/flink/flink-kubernetes-operator-1.5.0-rc1/flink-kubernetes-operator-1.5.0-helm.tgz

[jira] [Created] (FLINK-32065) Got NoSuchFileException when initialize source function.

2023-05-11 Thread Spongebob (Jira)
Spongebob created FLINK-32065: - Summary: Got NoSuchFileException when initialize source function. Key: FLINK-32065 URL: https://issues.apache.org/jira/browse/FLINK-32065 Project: Flink Issue Type

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.5.0, release candidate #1

2023-05-11 Thread Jim Busche
Hi Gyula, Thanks for the RC-1. I'm taking a look at the rc-1, and I'm having a problem deploying on OpenShift 4.10 and 4.12 for some reason. I first tried the helm install method in the default namespace, and the operator launches fine. But when I try one of the example flinkdeployments it's

Re: Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-05-11 Thread Jingsong Li
Hi Mang, Thanks for starting this FLIP. I have some doubts about the `TwoPhaseCatalogTable`. Generally, our Flink design places execution in the TableFactory or directly in the Catalog, so introducing an executable table makes me feel a bit strange. (Spark is this style, but Flink may not be) An

Re:Scala Compilation Errors with Flink code in IntelliJ. Builds fine with Maven command line.

2023-05-11 Thread Wencong Liu
Hi Brandon Wright, I think you could try the following actions in IntelliJ IDE: First, execute the command "mvn clean install -Dfast -DskipTests=true -Dscala-2.12" in terminal. Second, in "File -> Invalidate Caches", select all options and restart the IDE. Finally, click "maven r

Scala Compilation Errors with Flink code in IntelliJ. Builds fine with Maven command line.

2023-05-11 Thread Brandon Wright
I clone the Flink git repository, master branch, I configure a Java 8 JDK, and I can build the flink project successfully with: mvn clean package -DskipTests However, when I load the project into IntelliJ, and try to compile the project and run the Scala tests in the IDE I get a lot of compilat

Re: [DISCUSS] FLIP-278: Hybrid Source Connector

2023-05-11 Thread Ilya Soin
Hi, Ran Tao. Thanks for the reply! I agree that a way to manage inconsistent field names / numbers will need to be provided and that for POC it’s enough to support the case where the batch and streaming schemas are consistent. However, in the example provided by me, the schemas in batch and str

[DISCUSS] FLIP-312: Add Yarn ACLs to Flink Containers

2023-05-11 Thread Archit Goyal
Hi all, I am opening this thread to discuss the proposal to support Yarn ACLs to Flink containers which has been documented in FLIP-312 . This FLIP mentions about providing Yarn application ACL mech

[jira] [Created] (FLINK-32064) Add sub-directory of test output file for JsonPlanTest to indicate the plan's version

2023-05-11 Thread Jane Chan (Jira)
Jane Chan created FLINK-32064: - Summary: Add sub-directory of test output file for JsonPlanTest to indicate the plan's version Key: FLINK-32064 URL: https://issues.apache.org/jira/browse/FLINK-32064 Proj

[VOTE] Apache Flink Kubernetes Operator Release 1.5.0, release candidate #1

2023-05-11 Thread Gyula Fóra
Hi everyone, Please review and vote on the release candidate #1 for the version 1.5.0 of Apache Flink Kubernetes Operator, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Release Overview** As an overview, the release consists of th

[jira] [Created] (FLINK-32063) AWS CI mvn compile fails to cast objects to parent type.

2023-05-11 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-32063: --- Summary: AWS CI mvn compile fails to cast objects to parent type. Key: FLINK-32063 URL: https://issues.apache.org/jira/browse/FLINK-32063 Project: Flink Issue

[jira] [Created] (FLINK-32062) Expose MetricGroup in FlinkResourceListener interface to allow users to create custom metrics

2023-05-11 Thread Tamir Sagi (Jira)
Tamir Sagi created FLINK-32062: -- Summary: Expose MetricGroup in FlinkResourceListener interface to allow users to create custom metrics Key: FLINK-32062 URL: https://issues.apache.org/jira/browse/FLINK-32062

[jira] [Created] (FLINK-32061) Resource metric groups are not cleaned up on removal

2023-05-11 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32061: -- Summary: Resource metric groups are not cleaned up on removal Key: FLINK-32061 URL: https://issues.apache.org/jira/browse/FLINK-32061 Project: Flink

Re: [DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-11 Thread Xiaogang Zhou
Hi Zakelly, Thanks for replay, I have add some more information in the FLIP document. Please help review and let me know if further evidence is needed. https://cwiki.apache.org/confluence/display/FLINK/%5BWIP%5DFLIP-310%3Ause+VARINT+and+ZIGZAG+to+encode+ROWDATA+in+state#id-[WIP]FLIP310:useVARINTa

[jira] [Created] (FLINK-32060) Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32060: - Summary: Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5 Key: FLINK-32060 URL: https://issues.apache.org/jira/browse/FLINK-32060 Project: F

[jira] [Created] (FLINK-32059) Migrate subclasses of BatchAbstractTestBase in batch.sql.agg and batch.sql.join to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32059: - Summary: Migrate subclasses of BatchAbstractTestBase in batch.sql.agg and batch.sql.join to JUnit5 Key: FLINK-32059 URL: https://issues.apache.org/jira/browse/FLINK-32059 P

[jira] [Created] (FLINK-32058) Migrate subclasses of BatchAbstractTestBase in runtime.batch.sql to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32058: - Summary: Migrate subclasses of BatchAbstractTestBase in runtime.batch.sql to JUnit5 Key: FLINK-32058 URL: https://issues.apache.org/jira/browse/FLINK-32058 Project: Flink

Re: [DISCUSS] Release Flink 1.16.2

2023-05-11 Thread Martijn Visser
+1 - much appreciated On Thu, May 11, 2023 at 9:24 AM Xintong Song wrote: > +1 > > I'll help with the steps that require PMC privileges. > > Best, > > Xintong > > > > On Thu, May 11, 2023 at 3:13 PM Jingsong Li > wrote: > > > +1 for releasing 1.16.2 > > > > Best, > > Jingsong > > > > On Thu, Ma

Re: [DISCUSS] Release Flink 1.17.1

2023-05-11 Thread Martijn Visser
+1, thanks for volunteering! On Thu, May 11, 2023 at 9:23 AM Xintong Song wrote: > +1 > > I'll help with the steps that require PMC privileges. > > Best, > > Xintong > > > > On Thu, May 11, 2023 at 3:12 PM Jingsong Li > wrote: > > > +1 for releasing 1.17.1 > > > > Best, > > Jingsong > > > > On

[jira] [Created] (FLINK-32057) Autoscaler should use the new vertex resource api in 1.18

2023-05-11 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-32057: -- Summary: Autoscaler should use the new vertex resource api in 1.18 Key: FLINK-32057 URL: https://issues.apache.org/jira/browse/FLINK-32057 Project: Flink Issue T

[jira] [Created] (FLINK-32056) Update the used Pulsar connector in flink-python to 4.0.0

2023-05-11 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-32056: -- Summary: Update the used Pulsar connector in flink-python to 4.0.0 Key: FLINK-32056 URL: https://issues.apache.org/jira/browse/FLINK-32056 Project: Flink

[jira] [Created] (FLINK-32055) Migrate all subclasses of BatchAbstractTestBase to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32055: - Summary: Migrate all subclasses of BatchAbstractTestBase to JUnit5 Key: FLINK-32055 URL: https://issues.apache.org/jira/browse/FLINK-32055 Project: Flink Issue Typ

Re: [DISCUSS] Release Flink 1.17.1

2023-05-11 Thread Xintong Song
+1 I'll help with the steps that require PMC privileges. Best, Xintong On Thu, May 11, 2023 at 3:12 PM Jingsong Li wrote: > +1 for releasing 1.17.1 > > Best, > Jingsong > > On Thu, May 11, 2023 at 1:29 PM Gyula Fóra wrote: > > > > +1 for the release > > > > Gyula > > > > On Thu, 11 May 202

Re: [DISCUSS] Release Flink 1.16.2

2023-05-11 Thread Xintong Song
+1 I'll help with the steps that require PMC privileges. Best, Xintong On Thu, May 11, 2023 at 3:13 PM Jingsong Li wrote: > +1 for releasing 1.16.2 > > Best, > Jingsong > > On Thu, May 11, 2023 at 1:28 PM Gyula Fóra wrote: > > > > +1 for the release > > > > Gyula > > > > On Thu, 11 May 202

Re: [DISCUSS] Release Flink 1.16.2

2023-05-11 Thread Jingsong Li
+1 for releasing 1.16.2 Best, Jingsong On Thu, May 11, 2023 at 1:28 PM Gyula Fóra wrote: > > +1 for the release > > Gyula > > On Thu, 11 May 2023 at 05:08, weijie guo wrote: > > > [1] > > > > https://issues.apache.org/jira/browse/FLINK-31092?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%20

Re: [DISCUSS] Release Flink 1.17.1

2023-05-11 Thread Jingsong Li
+1 for releasing 1.17.1 Best, Jingsong On Thu, May 11, 2023 at 1:29 PM Gyula Fóra wrote: > > +1 for the release > > Gyula > > On Thu, 11 May 2023 at 05:35, Yun Tang wrote: > > > +1 for release flink-1.17.1 > > > > The blocker issue might cause silent incorrect data, it's better to have a > > fi

[jira] [Created] (FLINK-32054) ElasticsearchSinkITCase.testElasticsearchSink fails on AZP

2023-05-11 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-32054: --- Summary: ElasticsearchSinkITCase.testElasticsearchSink fails on AZP Key: FLINK-32054 URL: https://issues.apache.org/jira/browse/FLINK-32054 Project: Flink