[jira] [Created] (FLINK-26535) Introduce StoreTableSource and StoreTableSink

Jane Chan created FLINK-26535: - Summary: Introduce StoreTableSource and StoreTableSink Key: FLINK-26535 URL: https://issues.apache.org/jira/browse/FLINK-26535 Project: Flink Issue Type: Sub-task

Re: Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for starting this discussion. I think it's great for the community to to reach a consensus on the roadmap of Hive query syntax. I agree that the Hive project is not actively developed nowadays. However, Hive still occupies the majority of the batch market and the Hive ecosystem

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Very well deserved. > On 08.03.2022, at 05:43, Lincoln Lee wrote: > > Congratulations David! > > Best, > Lincoln Lee > > > Yun Gao 于2022年3月8日周二 11:24写道： > >> Congratulations David! >> >> Best, >> Yun Gao >> >> >> -- >> From:

status of Apple Silicon (M1) as Flink dev platform?

What's the current status of using the Apple Silicon (M1) platform for Flink development? Have we reached the point where everything "just works", or do there remain lingering annoyances (or worse)? In the past, I've seen reports of issues involving, e.g., RocksDB, nodejs, protobuf, and pyflink. L

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for bringing this up. Hive SQL (using in Hive & Spark) plays an important role in batch processing, it has almost become de facto standard in batch processing. In our company, there are hundreds of thousands of spark jobs each day. IMO, if we want to promote Flink batch, Hive s

Re: Flink 1.15 Stabilisation Sync skipped tomorrow

Thanks so much Gabor and Galen. Very much appreciated. > On 07.03.2022, at 19:00, Galen Warren wrote: > > I just ran through the testing steps on [FLINK-26462] Release Testing: > Running Python UDF in different Execution Mode - ASF JIRA (apache.org) >

[jira] [Created] (FLINK-26536) PyFlink RemoteKeyedStateBackend#merge_namespaces bug

Juntao Hu created FLINK-26536: - Summary: PyFlink RemoteKeyedStateBackend#merge_namespaces bug Key: FLINK-26536 URL: https://issues.apache.org/jira/browse/FLINK-26536 Project: Flink Issue Type: Bu

Re: [DISCUSS] Enable scala formatting check

+1 For flink-training we initially tried cloning the scalastyle setup from flink, but we decided to use spotless + scalafmt instead. David On Mon, Mar 7, 2022 at 1:12 PM Timo Walther wrote: > Big +1 > > This will improve the contribution experience. Even though we stopped > adding more Scala c

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Thanks all for your discussions. I'll share my opinion here: 1. Hive SQL and Hive-like SQL are the absolute mainstay of current Batch ETL in China. Hive+Spark (HiveSQL-like)+Databricks also occupies a large market worldwide. - Unlike OLAP SQL (such as presto, which is ansi-sql rather than hive s

回复：[DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for driving this discussion. About your concerns, I would like to share my opinion. Actually, more exactly, FLIP-152 [1] is not to extend Flink SQL to support Hive query synax, it provides a Hive dialect option to enable users to switch to Hive dialect. From the commits about

Re:Re: [DISCUSS] The abstraction of cache lookupFunction and cache metric

Hi Qingsheng, Sorry for my wrong format. > If I understand correctly these are specified in DDL table options by users. It's inconvenient for user to checkout the options when they in front of a running task. And they don't know the real underlying options in effect if there are some bugs or

Why does Flink Table API not wait for job to complete?

Hi, I wrote a simple program using Flink Table API. There is a Table source reading from an avro file, after doing some operations the result is stored using a sink csv table using `executeInsert()` The program works fine and creates a csv file however the flink command does not wait for job t

Re: Why does Flink Table API not wait for job to complete?

I think what you need is something like: table.executeInsert("MySink").*await()* On Tue, Mar 8, 2022 at 8:24 PM Adesh Dsilva wrote: > Hi, > > I wrote a simple program using Flink Table API. > There is a Table source reading from an avro file, after doing some > operations the result is stored

Re: Flink 1.15 Stabilisation Sync skipped tomorrow

You're welcome. Fwiw, I've also run through testing steps on my contribution -- [FLINK-26451] Test GCS FileSystem w/ RecoverableWriter manually - ASF JIRA (apache.org) -- but I don't think I'm supposed to be officially doing manually testing on my

[jira] [Created] (FLINK-26537) Allow disabling StatefulFunctionsConfigValidator validation for classloader.parent-first-patterns.additional

Fil Karnicki created FLINK-26537: Summary: Allow disabling StatefulFunctionsConfigValidator validation for classloader.parent-first-patterns.additional Key: FLINK-26537 URL: https://issues.apache.org/jira/browse/F

[DISCUSS] (FLINK-26537) Allow disabling StatefulFunctionsConfigValidator validation for classloader.parent-first-patterns.additional

Hi, we're having trouble running statefun jobs on a shared cloudera flink cluster due to the presence of old protobuf-java classes on the classpath, which don't work with statefun, causing MethodNotFound exceptions. https://issues.apache.org/jira/browse/FLINK-26537 is to allow users to disable the

[jira] [Created] (FLINK-26538) Ability to restart deployment w/o spec change

Thomas Weise created FLINK-26538: Summary: Ability to restart deployment w/o spec change Key: FLINK-26538 URL: https://issues.apache.org/jira/browse/FLINK-26538 Project: Flink Issue Type: Sub

Re: [ANNOUNCE] New Apache Flink Committer - Martijn Visser

Congratulations, Martin! Best, Jing Zhang Zhilong Hong 于2022年3月5日周六 01:17写道： > Congratulations, Martin! Well deserved! > > Best, > Zhilong > > On Sat, Mar 5, 2022 at 1:09 AM Piotr Nowojski > wrote: > > > Congratulations! > > > > Piotrek > > > > pt., 4 mar 2022 o 16:05 Aitozi napisał(a): > > >

[jira] [Created] (FLINK-26539) Support dynamic partial features update in Cassandra connector

Zhenqiu Huang created FLINK-26539: - Summary: Support dynamic partial features update in Cassandra connector Key: FLINK-26539 URL: https://issues.apache.org/jira/browse/FLINK-26539 Project: Flink

[jira] [Created] (FLINK-26540) Support handle join involving complex types in on condition

luoyuxia created FLINK-26540: Summary: Support handle join involving complex types in on condition Key: FLINK-26540 URL: https://issues.apache.org/jira/browse/FLINK-26540 Project: Flink Issue Ty

[jira] [Created] (FLINK-26541) SQL Client should support submitting SQL jobs in application mode

Jark Wu created FLINK-26541: --- Summary: SQL Client should support submitting SQL jobs in application mode Key: FLINK-26541 URL: https://issues.apache.org/jira/browse/FLINK-26541 Project: Flink Issu

[jira] [Created] (FLINK-26542) Fix the issue that schema of both sides of union won't match when one side of union select fields with same names

luoyuxia created FLINK-26542: Summary: Fix the issue that schema of both sides of union won't match when one side of union select fields with same names Key: FLINK-26542 URL: https://issues.apache.org/jira/browse/FLI

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congrats, David! Best Regards, Yu On Tue, 8 Mar 2022 at 16:11, Johannes Moser wrote: > Very well deserved. > > > On 08.03.2022, at 05:43, Lincoln Lee wrote: > > > > Congratulations David! > > > > Best, > > Lincoln Lee > > > > > > Yun Gao 于2022年3月8日周二 11:24写道： > > > >> Congratulations David!

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congratulations, David. Best Liu Jiangang Yu Li 于2022年3月9日周三 14:23写道： > Congrats, David! > > Best Regards, > Yu > > > On Tue, 8 Mar 2022 at 16:11, Johannes Moser wrote: > > > Very well deserved. > > > > > On 08.03.2022, at 05:43, Lincoln Lee wrote: > > > > > > Congratulations David! > > > > >

[jira] [Created] (FLINK-26543) Fix the issue that exceptions generated in startup is missed in Python loopback mode

Huang Xingbo created FLINK-26543: Summary: Fix the issue that exceptions generated in startup is missed in Python loopback mode Key: FLINK-26543 URL: https://issues.apache.org/jira/browse/FLINK-26543

Re: status of Apple Silicon (M1) as Flink dev platform?

Hi David, For the problem of RocksDB running on M1 machines, RocksDB community has recently resolved this in RocksDB-6.29 [1], maybe we could involve this change in next Flink-1.16. [1] https://github.com/facebook/rocksdb/pull/9662 Best Yun Tang From: David An

[jira] [Created] (FLINK-26544) Apply key & value filter in FileStoreScanImpl

Caizhi Weng created FLINK-26544: --- Summary: Apply key & value filter in FileStoreScanImpl Key: FLINK-26544 URL: https://issues.apache.org/jira/browse/FLINK-26544 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-26545) Ingress rules should be created in the same namespace with FlinkDeployment CR

Yang Wang created FLINK-26545: - Summary: Ingress rules should be created in the same namespace with FlinkDeployment CR Key: FLINK-26545 URL: https://issues.apache.org/jira/browse/FLINK-26545 Project: Flin