[jira] [Created] (FLINK-34314) Update CI Node Actions from NodeJS 16 to NodeJS 20

2024-01-30 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34314: -- Summary: Update CI Node Actions from NodeJS 16 to NodeJS 20 Key: FLINK-34314 URL: https://issues.apache.org/jira/browse/FLINK-34314 Project: Flink Issue

[DISCUSS] Drop support for HBase v1

2024-01-29 Thread Martijn Visser
Hi all, While working on adding support for Flink 1.19 for HBase, we've run into a dependency convergence issue because HBase v1 relies on a really old version of Guava. HBase v2 has been made available since May 2018, and there have been no new releases of HBase v1 since August 2022. I would li

[jira] [Created] (FLINK-34260) Make flink-connector-aws compatible with SinkV2 changes

2024-01-29 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34260: -- Summary: Make flink-connector-aws compatible with SinkV2 changes Key: FLINK-34260 URL: https://issues.apache.org/jira/browse/FLINK-34260 Project: Flink

[jira] [Created] (FLINK-34259) flink-connector-jdbc fails to compile with NPE on hasGenericTypesDisabled

2024-01-29 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34259: -- Summary: flink-connector-jdbc fails to compile with NPE on hasGenericTypesDisabled Key: FLINK-34259 URL: https://issues.apache.org/jira/browse/FLINK-34259

Re: [VOTE] Release flink-connector-jdbc, release candidate #1

2024-01-27 Thread Martijn Visser
this week so will > be > > looking at it then, > >Kind regards, David. > > > > > > From: Martijn Visser > > Date: Friday, 5 January 2024 at 14:24 > > To: dev@flink.apache.org > > Subject: [EXTERNAL] Re: [VOTE] Release flink-connector-jdbc,

[ANNOUNCE] Community over Code EU 2024 Travel Assistance Applications now open!

2024-01-27 Thread Martijn Visser
exists to help those that would like to attend Community over Code events, but are unable to do so for financial reasons. I'm hoping that we'll have a wide variety of Flink community members over there! All the details and more information can be found in the message below. Best regards

[jira] [Created] (FLINK-34244) Upgrade Confluent Platform to latest compatible version

2024-01-26 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34244: -- Summary: Upgrade Confluent Platform to latest compatible version Key: FLINK-34244 URL: https://issues.apache.org/jira/browse/FLINK-34244 Project: Flink

[VOTE] Release flink-connector-kafka v3.1.0, release candidate #1

2024-01-26 Thread Martijn Visser
Hi everyone, Please review and vote on the release candidate #1 for the Flink Kafka connector version 3.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This release is compatible with Flink 1.17.* and Flink 1.18.* The complete sta

Re: [NOTICE] master branch cannot compile for now

2024-01-26 Thread Martijn Visser
Hi Benchao, Thanks for sending out the notification and the plan to fix it, much appreciate Best regards, Martijn On Fri, Jan 26, 2024 at 4:40 AM Benchao Li wrote: > Hi devs, > > I merged FLINK-33263[1] this morning (10:16 +8:00), and it based on an > old commit which uses older guava version

Re: [DISCUSS] Release new version of Flink's Kafka connector

2024-01-26 Thread Martijn Visser
upon for external connector versioning [1]. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development > > Best, > Mason > > On Thu, Jan 25, 2024 at 2:16 PM Martijn Visser > wrote: > > > Hi everyone, > > > > The latest v

[DISCUSS] Release new version of Flink's Kafka connector

2024-01-25 Thread Martijn Visser
Hi everyone, The latest version of the Flink Kafka connector that's available is currently v3.0.2, which is compatible with both Flink 1.17 and Flink 1.18. I would like to propose to create a release which is either v3.1, or v4.0 (see below), with compatibility for Flink 1.17 and Flink 1.18. This

Re: [DISCUSS] Proposing an LTS Release for the 1.x Line

2024-01-22 Thread Martijn Visser
rt new features of 2.0.0 to 1.21. > And 1.21.x is similar to 2.0.x, their features are same, but > 2.0.x removes deprecated apis. After 2.0.0 is released, > all new features in 2.1.x and above are only available in 2.x. > > Looking forward to your opinions~ > > Best, > Rui > >

Re: Confluence access

2024-01-22 Thread Martijn Visser
Hi, What's your Confluence user name? Best regards, Martijn On Fri, Jan 19, 2024 at 8:04 AM Сергей Парышев wrote: > > > Hi devs! Can I get access to confluence? I want suggest a FLIP.

[jira] [Created] (FLINK-34193) Remove usage of Flink-Shaded Jackson and Snakeyaml in flink-connector-kafka

2024-01-22 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34193: -- Summary: Remove usage of Flink-Shaded Jackson and Snakeyaml in flink-connector-kafka Key: FLINK-34193 URL: https://issues.apache.org/jira/browse/FLINK-34193

[jira] [Created] (FLINK-34192) Update flink-connector-kafka to be compatible with updated SinkV2 interfaces

2024-01-22 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34192: -- Summary: Update flink-connector-kafka to be compatible with updated SinkV2 interfaces Key: FLINK-34192 URL: https://issues.apache.org/jira/browse/FLINK-34192

[jira] [Created] (FLINK-34154) Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2 for Kafka connector

2024-01-18 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34154: -- Summary: Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2 for Kafka connector Key: FLINK-34154 URL: https://issues.apache.org/jira/browse/FLINK-34154

[jira] [Created] (FLINK-34149) Flink Kafka connector can't compile against 1.19-SNAPSHOT

2024-01-18 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34149: -- Summary: Flink Kafka connector can't compile against 1.19-SNAPSHOT Key: FLINK-34149 URL: https://issues.apache.org/jira/browse/FLINK-34149 Project:

[jira] [Created] (FLINK-34113) Update flink-connector-elasticsearch to be compatible with updated SinkV2 interfaces

2024-01-16 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34113: -- Summary: Update flink-connector-elasticsearch to be compatible with updated SinkV2 interfaces Key: FLINK-34113 URL: https://issues.apache.org/jira/browse/FLINK-34113

[jira] [Created] (FLINK-34111) Add JSON_QUOTE and JSON_UNQUOTE function

2024-01-16 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34111: -- Summary: Add JSON_QUOTE and JSON_UNQUOTE function Key: FLINK-34111 URL: https://issues.apache.org/jira/browse/FLINK-34111 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-34108) Add URL_ENCODE and URL_DECODE function

2024-01-16 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34108: -- Summary: Add URL_ENCODE and URL_DECODE function Key: FLINK-34108 URL: https://issues.apache.org/jira/browse/FLINK-34108 Project: Flink Issue Type: New

Re: [VOTE] Release flink-connector-opensearch v1.1.0, release candidate #1

2024-01-12 Thread Martijn Visser
One non blocking nit: the version for flink.version in the main POM is set to 1.17.1. I think this should be 1.17.0 (since that's the lowest possible Flink version that's supported). +1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Bui

[VOTE] Release flink-connector-rabbitmq, v3.0.2 release candidate #1

2024-01-12 Thread Martijn Visser
Hi everyone, Please review and vote on the release candidate #1 for the version 3.0.2, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This version is compatible with Flink 1.16.x, 1.17.x and 1.18.x. The complete staging area is availa

[VOTE] Release flink-connector-hbase v3.0.1, release candidate #2

2024-01-12 Thread Martijn Visser
Hi everyone, Please review and vote on the release candidate #2 for the flink-connector-hbase version 3.0.1, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This version is compatible with Flink 1.16.x, 1.17.x and 1.18.x The complete s

Re: [VOTE] Release flink-connector-hbase, release candidate #1

2024-01-12 Thread Martijn Visser
t was built with jdk11 > shouldn't we still use jdk8 for that? > > On Fri, Jan 5, 2024 at 4:03 PM Martijn Visser > wrote: > > > Hi everyone, > > Please review and vote on the release candidate #1 for the version > > 3.0.1, as follows: > > [ ] +1, Approve

Re: [DISCUSS] Proposing an LTS Release for the 1.x Line

2024-01-10 Thread Martijn Visser
Hi Alex, I saw that I missed replying to this topic. I do think that Xintong touched on an important topic when he mentioned that we should define what an LTS version means. From my point of view, I would state that an LTS version for Apache Flink means that bug fixes only will be made available f

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-10 Thread Martijn Visser
+1 (binding) On Wed, Jan 10, 2024 at 4:43 AM Xingbo Huang wrote: > > +1 (binding) > > Best, > Xingbo > > Dian Fu 于2024年1月10日周三 11:35写道: > > > +1 (binding) > > > > Regards, > > Dian > > > > On Wed, Jan 10, 2024 at 5:09 AM Sharath wrote: > > > > > > +1 (non-binding) > > > > > > Best, > > > Sharat

Re: [DISCUSS] Externalized Python Connector Release/Dependency Process

2024-01-08 Thread Martijn Visser
Thanks for investigating Danny. It looks like the best direction to go to :) On Mon, Jan 8, 2024 at 5:56 PM Péter Váry wrote: > > Thanks Danny for working on this! > > It would be good to do this in a way that the different connectors could > reuse as much code as possible, so if possible put mos

[jira] [Created] (FLINK-34020) Bump CI flink version on flink-connector-rabbitmq

2024-01-08 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34020: -- Summary: Bump CI flink version on flink-connector-rabbitmq Key: FLINK-34020 URL: https://issues.apache.org/jira/browse/FLINK-34020 Project: Flink Issue

[jira] [Created] (FLINK-34019) Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0

2024-01-08 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34019: -- Summary: Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0 Key: FLINK-34019 URL: https://issues.apache.org/jira/browse/FLINK-34019 Project: Flink

[VOTE] Release flink-connector-hbase, release candidate #1

2024-01-05 Thread Martijn Visser
Hi everyone, Please review and vote on the release candidate #1 for the version 3.0.1, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This version is compatible with Flink 1.16.x, 1.17.x and 1.18.x The complete staging area is availab

[jira] [Created] (FLINK-34003) Bump CI flink version on flink-connector-hbase

2024-01-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34003: -- Summary: Bump CI flink version on flink-connector-hbase Key: FLINK-34003 URL: https://issues.apache.org/jira/browse/FLINK-34003 Project: Flink Issue

[jira] [Created] (FLINK-34002) Bump CI flink version on flink-connector-elasticsearch

2024-01-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34002: -- Summary: Bump CI flink version on flink-connector-elasticsearch Key: FLINK-34002 URL: https://issues.apache.org/jira/browse/FLINK-34002 Project: Flink

Re: [VOTE] Release flink-connector-jdbc, release candidate #1

2024-01-05 Thread Martijn Visser
kg9cwc > > [3] https://issues.apache.org/jira/browse/FLINK-16024 > > On Fri, Jan 5, 2024 at 2:19 PM Martijn Visser > wrote: > > > Hi everyone, > > Please review and vote on the release candidate #1 for the version > > 3.1.2, as follows: > > [ ] +1, Approv

[VOTE] Release flink-connector-jdbc, release candidate #1

2024-01-05 Thread Martijn Visser
Hi everyone, Please review and vote on the release candidate #1 for the version 3.1.2, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This version is compatible with Flink 1.16.x, 1.17.x and 1.18.x. The complete staging area is availa

Re: [RESULT][VOTE] Release flink-connector-hbase v3.0.0, release candidate #2

2024-01-05 Thread Martijn Visser
renc > > > > > --- Original Message --- > On Tuesday, September 12th, 2023 at 10:47, Martijn Visser > wrote: > > > > > > > > I'm happy to announce that we have unanimously approved this release. > > > > There are 7 approving votes, 3

Re: [NOTICE] Hive connector externalization

2024-01-05 Thread Martijn Visser
Sounds good to me! Thanks On Fri, Jan 5, 2024 at 12:57 AM Sergey Nuyanzin wrote: > > Hi Martijn > thanks for reminding > yep, I think you are right we need a release for that. > > IIRC so far there is no volunteers for that, so I would volunteer > > On Thu, Dec 28, 2023 a

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Martijn Visser
gt; [3] > https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/highavailability/HighAvailabilityServicesUtils.java#L86 > > On Thu, Dec 28, 2023 at 1:07 PM Martijn Visser > wrote: >> >> Hi Oleksandr, >> >> The FL

Re: [RESULT][VOTE] FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

2024-01-03 Thread Martijn Visser
iabao Sun (non-binding) > - Hang Ruan (non-binding) > - Leonard Xu (binding) > - Martijn Visser (binding) > - Tzu-Li (Gordon) Tai (binding) > > Thanks to all involved! > > BR, > G > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-372%3A+Enhance+and+sync

[jira] [Created] (FLINK-33964) Flink documentation can't be build due to error in Pulsar docs

2024-01-02 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33964: -- Summary: Flink documentation can't be build due to error in Pulsar docs Key: FLINK-33964 URL: https://issues.apache.org/jira/browse/FLINK-33964 Project:

Re: Building Flink JDBC connector locally on M1 Mac

2023-12-28 Thread Martijn Visser
Hi David, I believe this is because the testcontainers rely on the log4j configuration settings. Github CI runs something like mvn clean install -Dlog4j.configurationFile=tools/ci/log4j.properties Best regards, Martijn On Fri, Dec 8, 2023 at 5:30 PM David Radley wrote: > > Hi, > When I build t

[jira] [Created] (FLINK-33956) Bump org.apache.zookeeper:zookeeper from 3.7.1 to 3.7.2

2023-12-28 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33956: -- Summary: Bump org.apache.zookeeper:zookeeper from 3.7.1 to 3.7.2 Key: FLINK-33956 URL: https://issues.apache.org/jira/browse/FLINK-33956 Project: Flink

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2023-12-28 Thread Martijn Visser
+1 for this :) On Thu, Dec 7, 2023 at 6:05 AM wudi <676366...@qq.com.invalid> wrote: > > > Hi all, > > As discussed in the previous email [1], about contributing the Flink Doris > Connector to the Flink community. > > > Apache Doris[2] is a high-performance, real-time analytical database based on

Re: [VOTE] Release flink-shaded 18.0, release candidate #1

2023-12-28 Thread Martijn Visser
Hi, +1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs Best regards, Martijn On Mon, Dec 11, 2023 at 12:11 AM Sergey Nuyanzin wrote: > > Hey everyone, > > The vote fo

Re: [NOTICE] Hive connector externalization

2023-12-28 Thread Martijn Visser
Flink main repo (master > branch) in order to make this smoother. Instead it would be better to > create/merge prs to connector's repo[3] > > Also huge shoutout to Yuxia Luo, Martijn Visser, Ryan Skraba for the review > > [1] https://issues.apache.org/jira/browse/FLINK-30064

[DISCUSS] Hadoop 2 vs Hadoop 3 usage

2023-12-28 Thread Martijn Visser
Hi all, I want to get some insights on how many users are still using Hadoop 2 vs how many users are using Hadoop 3. Flink currently requires a minimum version of Hadoop 2.10.2 for certain features, but also extensively uses Hadoop 3 (like for the file system implementations) Hadoop 2 has a large

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2023-12-28 Thread Martijn Visser
Hi Oleksandr, The FLIP talks about Curator, but outside of flink test utils, the usage of Curator is only for test purposes. I don't think there's anything preventing you right now from providing these additional parameters as values in the flink-conf.yaml ? Best regards, Martijn On Thu, Dec 14

Re: [DISCUSS] FLIP-404: Create a Redis HyperLogLog Connector for Flink

2023-12-27 Thread Martijn Visser
Hi Jinsui, Thanks for opening the discussion and creating the FLIP. My main concern isn't so much the connector, it's more that we're talking about yet another Redis connector implementation but we actually don't have a proper Redis connector overall. Ideally it would be great if we could get http

Re: [DISCUSS] Release flink-connector-mongodb v1.1.0

2023-12-27 Thread Martijn Visser
Thanks for helping out Leonard! On Thu, Dec 21, 2023 at 2:48 AM Leonard Xu wrote: > > Thanks Jiabao for driving this. > > +1 to release flink-connector-mongodb v1.1.0 which supports Flink 1.18 and > Flink 1.17. > > I’d like to help review the pending PRs and manage the release as well. > > Best

Re: Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-27 Thread Martijn Visser
Hi Xuyang, It's currently the holiday season in Europe so do expect some slow responses. > The key reason the original FLIP is called "Deprecate the Legacy Group Window > Aggregation" is that we also plan to automatically rewrite the group window > agg corresponding the old syntax into the wind

Re: [VOTE] FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2023-12-27 Thread Martijn Visser
+1 (binding) On Fri, Dec 22, 2023 at 1:44 AM Jim Hughes wrote: > > Hi Alan, > > +1 (non binding) > > Cheers, > > Jim > > On Wed, Dec 20, 2023 at 2:41 PM Alan Sheinberg > wrote: > > > Hi everyone, > > > > I'd like to start a vote on FLIP-400 [1]. It covers introducing a new UDF > > type, AsyncSca

Re: [VOTE] FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

2023-12-27 Thread Martijn Visser
Hi Peter, It would be good if Gordon can take a look, but overall this looks good to me +1 Best regards, Martijn On Fri, Dec 22, 2023 at 8:25 AM Péter Váry wrote: > > We have enough votes for the decision, but given that this is an important > change, and for many of us it is a holiday season,

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-12-27 Thread Martijn Visser
Thnx, +1 :) On Fri, Dec 22, 2023 at 10:15 AM Etienne Chauchot wrote: > > Thanks Max ! > > Etienne > > Le 21/12/2023 à 16:22, Maximilian Michels a écrit : > >> Anyone for pushing my pub key to apache dist ? > > Done. > > > > On Thu, Dec 21, 2023 at 2:36 PM Etienne Chauchot > > wrote: > >> Hello,

[jira] [Created] (FLINK-33953) Bump com.google.guava:guava from 31.1-jre to 33.0.0-jre

2023-12-27 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33953: -- Summary: Bump com.google.guava:guava from 31.1-jre to 33.0.0-jre Key: FLINK-33953 URL: https://issues.apache.org/jira/browse/FLINK-33953 Project: Flink

[jira] [Created] (FLINK-33952) Flink JDBC connector build fail on JDK 17

2023-12-27 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33952: -- Summary: Flink JDBC connector build fail on JDK 17 Key: FLINK-33952 URL: https://issues.apache.org/jira/browse/FLINK-33952 Project: Flink Issue Type

Re: [VOTE] Release 1.18.1, release candidate #2

2023-12-27 Thread Martijn Visser
Hi Jing, Thanks for driving this. +1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven via mvn clean install -Pcheck-convergence -Dflink.version=1.18.1 - Verified licenses - Verified web PR - Started a cluster

Re: Request permission for creating a new FLIP page

2023-12-18 Thread Martijn Visser
Hi Jinsui, You should now have permissions. Best regards, Martijn On Mon, Dec 18, 2023 at 1:56 PM Jinsui Chen wrote: > > hi, all > > I want to add a new connector for Flink (see FLINK-33873). For this level > of change a new FLIP page needs to be created, but I don't have the > corresponding p

Re: [DISCUSS] Should Configuration support getting value based on String key?

2023-12-13 Thread Martijn Visser
ethods shouldn't be deprecated. > WDYT? > > Please correct me if I'm wrong, thanks~ > > Best, > Rui > > On Wed, Dec 13, 2023 at 7:07 PM Martijn Visser > wrote: > > > Hi Rui, > > > > Are you thinking about this as part of Flink 2.0, since

Re: [DISCUSS] Should Configuration support getting value based on String key?

2023-12-13 Thread Martijn Visser
Hi Rui, Are you thinking about this as part of Flink 2.0, since that has the goal to introduce a completely clean configuration layer? [1] Best regards, Martijn [1] https://cwiki.apache.org/confluence/display/FLINK/2.0+Release On Wed, Dec 13, 2023 at 11:28 AM Maximilian Michels wrote: > > Hi

Re: [DISCUSS] Release Flink 1.18.1

2023-12-12 Thread Martijn Visser
Hi Jing, The only thing that was brought to my attention today was https://issues.apache.org/jira/browse/FLINK-33793. I've marked it as a Critical (I think we should have working checkpointing with GCS), but could also be considered a Blocker. There is a PR open for it, but I don't think it's the

Re: [DISCUSS] Release Flink 1.18.1

2023-12-08 Thread Martijn Visser
Hi Jing, +1 to get this release out asap. Thanks for volunteering! Best regards, Martijn On Fri, Dec 8, 2023 at 9:06 AM Jing Ge wrote: > > Hi all, > > I would like to discuss creating a new 1.18 patch release (1.18.1). The > last 1.18 release is nearly two months old, and since then, 37 ticket

Re: SQL return type change from 1.17 to 1.18

2023-12-07 Thread Martijn Visser
Hi all, Agree with what has been said already. I've marked https://issues.apache.org/jira/browse/FLINK-33523 as a blocker ticket for 1.18.1 Best regards, Martijn On Thu, Dec 7, 2023 at 4:25 PM Márton Balassi wrote: > > Thanks, for raising this Peter. +1 for reverting the change. > > Given the

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-07 Thread Martijn Visser
Hi Leonard, +1 for this. I think the CDC connectors are a great result and example of the Flink CDC community. Kudos to you all. Best regards, Martijn On Thu, Dec 7, 2023 at 10:40 AM Márton Balassi wrote: > > Hi Leonard, > > Thank you for the excellent work you and the team working on the CDC

Re: Re: Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-07 Thread Martijn Visser
Hi Xuyang, Thanks a lot for starting this discussion. At first, I was a bit confused because the FLIP talks about deprecating the Legacy Group Window Aggregations, but they have already been marked as deprecated in the documentation [1]. My understanding was that the big challenge was that we don

Re: Discussion: [FLINK-24150] Support to configure cpu resource request and limit in pod template

2023-12-05 Thread Martijn Visser
Hi Richard, Shouldn't the solution then be solving the glibc problem? Best regards, Martijn On Tue, Dec 5, 2023 at 1:49 PM richard.su wrote: > > Sorry, "To be clear, we need a container has memory larger than request, and > confirm this pod has Guarantee Qos." which need to be "To be clear, w

Re: [ANNOUNCE] Apache Flink Kafka Connectors 3.0.2 released

2023-12-04 Thread Martijn Visser
Hi Gordon, Thanks for the release! I've pushed one hotfix [1], to make sure that the Flink documentation shows the correct version number for the Flink version it's compatible with. Best regards, Martijn [1] https://github.com/apache/flink-connector-kafka/commit/6c3d3d06689336f2fd37bfa5a3b17a5

[jira] [Created] (FLINK-33704) Update GCS filesystems to latest available versions

2023-11-30 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33704: -- Summary: Update GCS filesystems to latest available versions Key: FLINK-33704 URL: https://issues.apache.org/jira/browse/FLINK-33704 Project: Flink

Re: [DISCUSS] Contribute Flink Doris Connector to the Flink community

2023-11-27 Thread Martijn Visser
Hi di.wu, Thanks for the proposal, +1 Best regards, Martijn On Mon, Nov 27, 2023 at 1:05 PM Zhanghao Chen wrote: > > Sounds great. Thanks for driving this. > > Best, > Zhanghao Chen > > From: wudi <676366...@qq.com.INVALID> > Sent: Sunday, November 26, 2023 18:2

[DISCUSS] Resolve diamond inheritance of Sink.createWriter

2023-11-27 Thread Martijn Visser
Hi all, I'm opening this discussion thread to bring a discussion that's happening on a completed Jira ticket back to the mailing list [1] In summary: * There was a discussion and a vote on FLIP-371 [2] * During implementation, it was determined that there's a diamond inheritance problem on the S

[jira] [Created] (FLINK-33662) Bump com.h2database:h2

2023-11-27 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33662: -- Summary: Bump com.h2database:h2 Key: FLINK-33662 URL: https://issues.apache.org/jira/browse/FLINK-33662 Project: Flink Issue Type: Technical Debt

Re: [VOTE] Apache Flink Kafka Connectors v3.0.2, RC #1

2023-11-27 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Mon, Nov 27, 2023 at 4:17 AM Leonard Xu wrote: > > +1 (binding) > > - checked the flink-connector-base dependency s

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.2, release candidate #2

2023-11-24 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Nov 24, 2023 at 12:38 PM Leonard Xu wrote: > > Thanks Danny for driving this. > > > +1 (binding) > > - built f

Re: [VOTE] Release 1.17.2, release candidate #1

2023-11-24 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Nov 24, 2023 at 7:25 AM Jing Ge wrote: > > +1(not-binding) > > - verified signatures and hash > - reviewed the

Re: [VOTE] Release flink-connector-aws, v4.2.0 release candidate #1

2023-11-24 Thread Martijn Visser
Hi Danny, Thanks for driving this. +1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Mon, Nov 20, 2023 at 12:29 PM Jiabao Sun wrote: > > Thanks Danny for driving t

Re: [VOTE] Release 1.16.3, release candidate #1

2023-11-24 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Nov 24, 2023 at 7:29 AM Jing Ge wrote: > > +1(not-binding) > > - verified signatures hash > - verified hash >

Re: Apicurio Avro format proposal

2023-11-22 Thread Martijn Visser
Hi David, Can you create a small FLIP for this? Best regards, Martijn On Wed, Nov 22, 2023 at 6:46 PM David Radley wrote: > > Hi, > I would like to propose a new Apicurio Avro format. > The Apicurio Avro Schema Registry (avro-apicurio) format would allow you to > read records that were serial

Re: [DISCUSS] Towards flink-shaded release 18.0

2023-11-22 Thread Martijn Visser
+1. More than happy to help :) On Wed, Nov 22, 2023 at 9:16 PM Sergey Nuyanzin wrote: > > Hi everyone, > > I would like to start discussion about creating a new 18 release for > flink-shaded[1]. > > Among others it brings fix for ZooKeeper CVE [2], > a couple of Guava CVEs [3], [4] > and support

Re: [VOTE] FLIP-393: Make QueryOperations SQL serializable

2023-11-22 Thread Martijn Visser
gt; > Xiangyu Feng > > > > > > > > > > > > > > > Ferenc Csaky 于2023年11月21日周二 20:07写道: > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > Lookgin forward to this! > > &

Re: [DISCUSS] FLIP-395: Migration to GitHub Actions

2023-11-21 Thread Martijn Visser
Hi Matthias, Thanks for the write-up and for the efforts on this. I really hope that we can move away from Azure towards GHA for a better integration as well (directly seeing if a PR can be merged due to CI passing for example). The one thing I'm missing in the FLIP is how we would setup the secr

Re: [VOTE] FLIP-393: Make QueryOperations SQL serializable

2023-11-21 Thread Martijn Visser
+1 (binding) Thanks for driving this. Best regards, Martijn On Tue, Nov 21, 2023 at 12:18 PM Benchao Li wrote: > > +1 (binding) > > Dawid Wysakowicz 于2023年11月21日周二 18:56写道: > > > > Hi everyone, > > > > Thank you to everyone for the feedback on FLIP-393: Make QueryOperations > > SQL serializab

[jira] [Created] (FLINK-33585) Upgrade Zookeeper to 3.7.1

2023-11-17 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33585: -- Summary: Upgrade Zookeeper to 3.7.1 Key: FLINK-33585 URL: https://issues.apache.org/jira/browse/FLINK-33585 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-33584) Update Hadoop Filesystems to 3.3.6

2023-11-17 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33584: -- Summary: Update Hadoop Filesystems to 3.3.6 Key: FLINK-33584 URL: https://issues.apache.org/jira/browse/FLINK-33584 Project: Flink Issue Type: Technical

Re: [VOTE] Release flink-shaded 16.2, release candidate #1

2023-11-16 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Thu, Nov 16, 2023 at 11:40 AM Zhu Zhu wrote: > > +1 (binding) > > - verified checksum and signature > - verified th

[jira] [Created] (FLINK-33567) Flink documentation should only display connector downloads links when a connector is available

2023-11-16 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33567: -- Summary: Flink documentation should only display connector downloads links when a connector is available Key: FLINK-33567 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-33544) Flink documentation fails to build

2023-11-14 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33544: -- Summary: Flink documentation fails to build Key: FLINK-33544 URL: https://issues.apache.org/jira/browse/FLINK-33544 Project: Flink Issue Type: Bug

Re: Slack invite expired, please share an active invite

2023-11-13 Thread Martijn Visser
Hi all, Thanks for reporting, the Slack invite link is now also updated on the website. Best regards, Martijn On Mon, Nov 13, 2023 at 12:20 PM wrote: > > Thanks Yun, the link worked. > > Best, > Chinmay > > > On Nov 13, 2023, at 4:46 PM, Yun Tang wrote: > > > > Hi Chinmay, > > > > You can try

Re: Request a release of flink-connector-kafka version 3.1.0 (to consume kafka 3.4.0 with Flink 1.18)

2023-11-10 Thread Martijn Visser
8 ? > > Kind regards > > Jean-Marc > ____ > From: Martijn Visser > Sent: Thursday, November 9, 2023 13:51 > To: dev@flink.apache.org ; Mason Chen > > Subject: [EXTERNAL] Re: Request a release of flink-connector-kafka version > 3.1.0 (to consume kafka 3.4.0 with

Re: Adding a new channel to Apache Flink slack workspace

2023-11-10 Thread Martijn Visser
Hi all, I've created https://issues.apache.org/jira/browse/FLINK-33516 and I'll work on this. Thanks! Cheers, Martijn On Fri, Nov 10, 2023 at 7:50 AM Yun Tang wrote: > > +1 and glad to see more guys are using PyFlink. > > Best > Yun Tang > > From: Jing Ge > Sen

[jira] [Created] (FLINK-33516) Create dedicated PyFlink channel

2023-11-10 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33516: -- Summary: Create dedicated PyFlink channel Key: FLINK-33516 URL: https://issues.apache.org/jira/browse/FLINK-33516 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-389: Annotate SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving

2023-11-09 Thread Martijn Visser
Hi all, I'm looking at the original Jira that introduced these stability designations [1] and I'm just curious if it was intended that these Internal classes would be used directly, or if we just haven't created the right abstractions? The reason for asking is because moving something from Interna

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.2, release candidate #1

2023-11-09 Thread Martijn Visser
I agree with Leonard. We should also not update 1.16.0 to 1.18.0, but to the lowest supported Flink version of this release (in this case, 1.17.0) On Thu, Nov 9, 2023 at 3:08 AM Leonard Xu wrote: > > Thanks Danny for the reply. > > -1 (binding) > > Let’s fix the outdated version in the source cod

Re: Request a release of flink-connector-kafka version 3.1.0 (to consume kafka 3.4.0 with Flink 1.18)

2023-11-09 Thread Martijn Visser
Hi, The CVE is related to the Kafka Connect API and I think of that as a false-positive for the Flink Kafka connector. I would be inclined to preferably get https://issues.apache.org/jira/browse/FLINK-32197 in, and then do a release afterwards. But I would like to understand from Mason if he think

Re: [DISCUSS] Release flink-connector-pulsar 4.1.0

2023-11-09 Thread Martijn Visser
Hi Tison, I would be +1 for releasing it, but does it include support for Flink 1.18? I think that the tests still failed for it, and I think that support should be in place before releasing a new version of the connector. What do you think? Best regards, Martijn On Thu, Nov 9, 2023 at 7:09 AM

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-06 Thread Martijn Visser
+1 (binding) Thanks for driving this Timo On Mon, Nov 6, 2023 at 12:40 PM Timo Walther wrote: > > Hi everyone, > > I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which > has been discussed in this thread [2]. > > The vote will be open for at least 72 hours unless there is an

Re: [DISCUSS] Connector releases for Flink 1.18

2023-11-03 Thread Martijn Visser
Hi Danny, Thanks a lot for starting the discussion on this topic! I know that Pulsar is failing because of Archunit, which I expect the same issue to be for Cassandra (I know that Etienne was working on this). Happy to help. Best regards, Martijn On Thu, Nov 2, 2023 at 9:08 PM Danny Cranmer wr

Re: [DISCUSS] FLIP-378: Support Avro timestamp with local timezone

2023-11-02 Thread Martijn Visser
+1 On Thu, Nov 2, 2023 at 12:44 PM Leonard Xu wrote: > > > > Thanks @Leonard Xu . Two minor versions are > > definitely needed for flip the configs. > > Sorry, Peter. I thought the next minor versions are 1.19、2.0, but actually it > should be 1.19、1.20、2.0 from current

Re: [DISCUSS] Confluent Avro support without Schema Registry access

2023-11-02 Thread Martijn Visser
rwise we’d need to update the table schema as well? > > > > > it wouldn't work when you actually want to > > > write avro-confluent, because that requires a > > > check when producing if you're still being compliant. > > > > I’m not sure wha

Re: [DISCUSS] FLIP-376: Add DISTRIBUTED BY clause

2023-11-02 Thread Martijn Visser
Hi all, >From a user point of view, I think it makes sense to go for DISTRIBUTED BY with how Timo explained it. +1 for his proposal Best regards, Martijn On Thu, Nov 2, 2023 at 11:00 AM Timo Walther wrote: > > Hi Jing, > > I agree this is confusing. THe Spark API calls it bucketBy in the > pr

[jira] [Created] (FLINK-33400) Pulsar connector doesn't compile for Flink 1.18 due to Archunit update

2023-10-30 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33400: -- Summary: Pulsar connector doesn't compile for Flink 1.18 due to Archunit update Key: FLINK-33400 URL: https://issues.apache.org/jira/browse/FLINK-33400 Pr

Re: [DISCUSS] Promote SinkV2 to @Public and deprecate SinkFunction

2023-10-30 Thread Martijn Visser
ffectively means the users > > > of > > > > > this > > > > > > > API > > > > > > > > > > > should start to migrate to another API (e.g. SinkV2) and > > we > > > > > might > > > > >

Re: [DISCUSS] Confluent Avro support without Schema Registry access

2023-10-27 Thread Martijn Visser
Hi Dale, I'm struggling to understand in what cases you want to read data serialized in connection with Confluent Schema Registry, but can't get access to the Schema Registry service. It seems like a rather exotic situation and it beats the purposes of using a Schema Registry in the first place? I

<    1   2   3   4   5   6   7   8   9   10   >