Re: [DISCUSS] Flink SQL Syntax for Query/Savepoint Management

2022-04-04 Thread Timo Walther
Hi Paul, thanks for proposing this. I think in general it makes sense to have those commands in SQL Client. However, this will be a big shift because we start adding job lifecycle SQL syntax. It would be great to further investigate which other commands are required that would be usually be

[GitHub] [flink-statefun] FilKarnicki commented on a diff in pull request #309: [FLINK-26570][statefun] Remote module configuration interpolation

2022-04-04 Thread GitBox
FilKarnicki commented on code in PR #309: URL: https://github.com/apache/flink-statefun/pull/309#discussion_r841456053 ## docs/content/docs/modules/overview.md: ## @@ -61,3 +61,36 @@ spec: A module YAML file can contain multiple YAML documents, separated by `---`, each repre

Re: [DISCUSS] Bumping operator CRD version to v1alpha2

2022-04-04 Thread Őrhidi Mátyás
I prefer the 2nd option Gyula, shouldn't we target v1beta1 already? On Mon, Apr 4, 2022 at 8:47 AM Gyula Fóra wrote: > Hi all! > > With the preview release almost (hopefully today) officially out we need to > bump the CRD version of the deployment objects. > > As there will likely be a second pr

Re: [DISCUSS] assign SQL Table properties from environment variables

2022-04-04 Thread Timo Walther
Hi Fred, thanks for starting this discussion. I totally agree that this an issue that the community should solve. It popped up before and is still unsolved today. Great that you offer your help here. So let's clarify the implementation details. 1) Global vs. Local solution Is this a DDL-onl

[GitHub] [flink] XComp commented on a diff in pull request #19275: [FLINK-24491][runtime] Make the job termination wait until the archiving of ExecutionGraphInfo finishes

2022-04-04 Thread GitBox
XComp commented on code in PR #19275: URL: https://github.com/apache/flink/pull/19275#discussion_r841387465 ## flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/Dispatcher.java: ## @@ -1060,40 +1066,24 @@ protected CleanupJobState jobReachedTerminalState(Execution

[jira] [Created] (FLINK-27043) Remove CSV connector test usages

2022-04-04 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-27043: --- Summary: Remove CSV connector test usages Key: FLINK-27043 URL: https://issues.apache.org/jira/browse/FLINK-27043 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-27044) Drop support for Hive versions 1.*, 2.1.* and 2.2.*

2022-04-04 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-27044: -- Summary: Drop support for Hive versions 1.*, 2.1.* and 2.2.* Key: FLINK-27044 URL: https://issues.apache.org/jira/browse/FLINK-27044 Project: Flink Issu

Re: Question about community collaboration options

2022-04-04 Thread Martijn Visser
Hi Hao, What I see is that people who are already ASF committers ping each other in the ASF Slack, besides pinging people in PRs itself. Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser On Sat, 2 Apr 2022 at 10:00, Hao t Chang wrote: > Hi Mart

[jira] [Created] (FLINK-27045) Remove shared TestingUtils executor

2022-04-04 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27045: Summary: Remove shared TestingUtils executor Key: FLINK-27045 URL: https://issues.apache.org/jira/browse/FLINK-27045 Project: Flink Issue Type: Techn

[jira] [Created] (FLINK-27046) [JUnit5 Migration] Module: flink-*-glue-schema-registry

2022-04-04 Thread Ryan Skraba (Jira)
Ryan Skraba created FLINK-27046: --- Summary: [JUnit5 Migration] Module: flink-*-glue-schema-registry Key: FLINK-27046 URL: https://issues.apache.org/jira/browse/FLINK-27046 Project: Flink Issue T

[jira] [Created] (FLINK-27047) DispatcherResourceCleanupTest is unstable

2022-04-04 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27047: Summary: DispatcherResourceCleanupTest is unstable Key: FLINK-27047 URL: https://issues.apache.org/jira/browse/FLINK-27047 Project: Flink Issue Type:

[jira] [Created] (FLINK-27048) Add ArchUnit tests for Elasticsearch to only depend on public API

2022-04-04 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27048: Summary: Add ArchUnit tests for Elasticsearch to only depend on public API Key: FLINK-27048 URL: https://issues.apache.org/jira/browse/FLINK-27048 Project: Fl

[ANNOUNCE] Apache Flink Kubernetes Operator 0.1.0 released

2022-04-04 Thread Gyula Fóra
The Apache Flink community is very happy to announce the release of Apache Flink Kubernetes Operator 0.1.0. The Flink Kubernetes Operator allows users to manage their Apache Flink applications and their lifecycle through native k8s tooling like kubectl. This is the first release of this new commun

[jira] [Created] (FLINK-27049) Add "What is Flink Kubernetes Operator?" link to flink website

2022-04-04 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-27049: -- Summary: Add "What is Flink Kubernetes Operator?" link to flink website Key: FLINK-27049 URL: https://issues.apache.org/jira/browse/FLINK-27049 Project: Flink I

[jira] [Created] (FLINK-27050) TestingDispatcher.Builder instantiates a RPCSystem without shutting it down

2022-04-04 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-27050: - Summary: TestingDispatcher.Builder instantiates a RPCSystem without shutting it down Key: FLINK-27050 URL: https://issues.apache.org/jira/browse/FLINK-27050 Project

[NOTICE] Migration to GitHub Actions

2022-04-04 Thread Chesnay Schepler
Over the next few weeks we will conduct the migration to github actions. We will do this gradually; first enabling it only for pushes to the master branch to gather data, and then bit by bit extend it to cover PRs as well. You can expect this to conclude within the next 2-3 weeks. During thi

Re: [NOTICE] Migration to GitHub Actions

2022-04-04 Thread Martijn Visser
This is a massive improvement over the existing situation, thank you for driving this Chesnay! On Mon, 4 Apr 2022 at 14:49, Chesnay Schepler wrote: > Over the next few weeks we will conduct the migration to github actions. > > We will do this gradually; first enabling it only for pushes to the >

[jira] [Created] (FLINK-27051) CompletedCheckpoint.DiscardObject.discard is not idempotent

2022-04-04 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-27051: - Summary: CompletedCheckpoint.DiscardObject.discard is not idempotent Key: FLINK-27051 URL: https://issues.apache.org/jira/browse/FLINK-27051 Project: Flink

[jira] [Created] (FLINK-27052) FsCompletedCheckpointStorageLocation.disposeStorageLocation doesn't expose errors properly (not processing the return value)

2022-04-04 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-27052: - Summary: FsCompletedCheckpointStorageLocation.disposeStorageLocation doesn't expose errors properly (not processing the return value) Key: FLINK-27052 URL: https://issues.apach

[jira] [Created] (FLINK-27053) IncrementalRemoteKeyedStateHandle.discardState swallows errors

2022-04-04 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-27053: - Summary: IncrementalRemoteKeyedStateHandle.discardState swallows errors Key: FLINK-27053 URL: https://issues.apache.org/jira/browse/FLINK-27053 Project: Flink

Re: [NOTICE] Migration to GitHub Actions

2022-04-04 Thread Jing Ge
Thanks Chesnay for your effort! Really looking forward to it! On Mon, Apr 4, 2022 at 3:41 PM Martijn Visser wrote: > This is a massive improvement over the existing situation, thank you for > driving this Chesnay! > > On Mon, 4 Apr 2022 at 14:49, Chesnay Schepler wrote: > > > Over the next few

[jira] [Created] (FLINK-27054) Elasticsearch SQL connector SSL issue

2022-04-04 Thread ricardo (Jira)
ricardo created FLINK-27054: --- Summary: Elasticsearch SQL connector SSL issue Key: FLINK-27054 URL: https://issues.apache.org/jira/browse/FLINK-27054 Project: Flink Issue Type: Bug Repor

Pyflink + TABLE API + snowflake

2022-04-04 Thread Shameet Doshi
Hello, I have need to talk to snowflake from within pyflink preferably using the TABLE API We are running pyflink inside AWS Kinesis Data Analysis application. Installing any other python modules I was able to connect a mysql db but not able to connect to snowflake db import argparse

[jira] [Created] (FLINK-27055) java.lang.ArrayIndexOutOfBoundsException in BinarySegmentUtils

2022-04-04 Thread Kenny Ma (Jira)
Kenny Ma created FLINK-27055: Summary: java.lang.ArrayIndexOutOfBoundsException in BinarySegmentUtils Key: FLINK-27055 URL: https://issues.apache.org/jira/browse/FLINK-27055 Project: Flink Issue

Re: [NOTICE] Migration to GitHub Actions

2022-04-04 Thread Jingsong Li
+1 Thanks Chesnay for your effort. Github Actions is really convenient! Jing Ge 于2022年4月5日 周二00:01写道: > Thanks Chesnay for your effort! Really looking forward to it! > > On Mon, Apr 4, 2022 at 3:41 PM Martijn Visser > wrote: > > > This is a massive improvement over the existing situation, thank

[ANNOUNCE] Flink Table Store release-0.1 branch cut

2022-04-04 Thread Jingsong Li
Hi Flink devs! The release-0.1[1] branch has been forked from master and version numbers have been upgraded accordingly. We have written and posted the necessary documentation to the web. [2] The documentation has a quick start and general usage instructions. We are continuing to advance functi

[jira] [Created] (FLINK-27056) "pipeline.time-characteristic" should be deprecated and have EVENT_TIME as default value

2022-04-04 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-27056: - Summary: "pipeline.time-characteristic" should be deprecated and have EVENT_TIME as default value Key: FLINK-27056 URL: https://issues.apache.org/jira/browse/FLINK-27056

Re: [DISCUSS] Make Kubernetes Operator config "dynamic" and consider merging with flinkConfiguration

2022-04-04 Thread Thomas Weise
Hi Gyula, Can you please specify which of the current settings you see as candidates to expose to the user? Force upgrade definitely makes sense and there will likely be others going forward that govern the upgrade or shutdown behavior. The main consideration should probably be that settings that

Regarding java.lang.NullPointerException

2022-04-04 Thread Josemon Maliakal
Hello There, I started using pyflink recently, Have anyone know why I am getting java.lang.NullPointerException when I am trying to write an update function like the following tbl = tbl.select(update_tel(tbl.data)).execute_insert('result').wait() Caused by: java.lang.NullPointerException

Re: Flink 1.15 Stabilisation Sync

2022-04-04 Thread Robert Metzger
Thanks a lot for the update. >From the burndown board [1] it seems that there's only one blocker left, which has already a fix in review [2]. Are we also planning to address the open Critical tickets before opening the first voting release candidate? When do you expect 1.15 to be out? [1] https:/

Re: [DISCUSS] Make Kubernetes Operator config "dynamic" and consider merging with flinkConfiguration

2022-04-04 Thread Gyula Fóra
Hi Thomas! At the moment not many candidates for the existing options, probably: operator.observer.flink.client.timeout operator.reconciler.flink.cancel.job.timeout So the question is more regarding features that we are introducing going forward :) Cheers, Gyula On Tue, Apr 5, 2022 at 6:51 AM T

Re: [DISCUSS] Bumping operator CRD version to v1alpha2

2022-04-04 Thread Gyula Fóra
I agree that we can go with *v1beta1 .* Gyula On Mon, Apr 4, 2022 at 9:53 AM Őrhidi Mátyás wrote: > I prefer the 2nd option Gyula, shouldn't we target v1beta1 already? > > On Mon, Apr 4, 2022 at 8:47 AM Gyula Fóra wrote: > > > Hi all! > > > > With the preview release almost (hopefully today)