Re: [DISCUSS] FLIP-471: Fixing watermark idleness timeout accounting

2024-07-24 Thread Martijn Visser
Hi Piotr, We've talked offline about this proposal and I think it would be beneficial for users to get this fixed. +1 overall, and thanks for writing it down. Best regards, Martijn On Tue, Jul 23, 2024 at 5:45 PM Piotr Nowojski wrote: > Hi All, > > A bit unusual FLIP [1], as this is a bug

Re: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-07-18 Thread Martijn Visser
Hi David, The FLIP is updated. Cheers, Martijn On Tue, Jul 16, 2024 at 6:33 PM David Radley wrote: > Hello all, > > > > I have prototyped the new design and confirmed it works. I have documented > the design in google doc >

Re: Request to make ContinuousFileReaderOperator public

2024-07-18 Thread Martijn Visser
Hi Darin, Your comment "I think our use case is rather unique and I'm not sure who else would benefit" makes me think then why we should actually support it in Flink, given that you're mentioning the use case is rather unique? Especially since the SourceFunction has many flaws, and has been long

Re: PR review request for sql-gateway feature

2024-07-18 Thread Martijn Visser
Hi Dongwoo, I think this should first have been a FLIP [1], given that it proposes to make something pluggable with custom interfaces. Best regards, Martijn [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals On Thu, Jul 18, 2024 at 2:50 PM Dongwoo Kim wrote: >

Re: [VOTE] FLIP-465: Introduce DESCRIBE FUNCTION

2024-07-11 Thread Martijn Visser
gt; > > > > > On Thursday, 4 July 2024 at 16:20, Feng Jin > wrote: > > > > > > > > > > > +1 (non-binding) > > > > > > Best, > > > Feng Jin > > > > > > On Thu, Jul 4, 2024 at 6:02 PM Martijn Visser martijnvis...@apache.or

Re: Static OpenSSL lib licensing

2024-07-10 Thread Martijn Visser
Hi Rob, While Netty TCNative has upgraded to Openssl 3, there are still references to BoringSSL [1]. Do you know if TCNative still uses BoringSSL as well in this version? Best regards, Martijn [1]

Re: [ANNOUNCE] Release 1.20.0, release candidate #0

2024-07-08 Thread Martijn Visser
Hi all, I've closed my blocker ticket; after force killing all my Flink Java processes, it did work when I restarted it. Thanks, Martijn On Mon, Jul 8, 2024 at 6:13 PM Santwana Verma wrote: > Hi everyone, > > Thanks for creating the release candidate. I've successfully validated the > release

Re: [ANNOUNCE] Release 1.20.0, release candidate #0

2024-07-08 Thread Martijn Visser
Hi all, I've found that no query works in the SQL Client for RC0. See https://issues.apache.org/jira/browse/FLINK-35785 Best regards, Martijn On Fri, Jun 28, 2024 at 6:09 PM weijie guo wrote: > Hi everyone, > > > The release candidate #0(i.e. RC0) for Apache Flink 1.20.0 has been > created.

[jira] [Created] (FLINK-35785) Executing query in SQL client results in "java.lang.ClassNotFoundException: org.apache.flink.core.execution.RestoreMode"

2024-07-08 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35785: -- Summary: Executing query in SQL client results in "java.lang.ClassNotFoundException: org.apache.flink.core.execution.RestoreMode" Key: FLINK-35785

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-08 Thread Martijn Visser
Hi Kevin, I just want to double check, were you planning to send this proposal to the Kafka Dev mailing list? Because I don't see directly how this affects Flink :) Best regards, Martijn On Mon, Jul 8, 2024 at 8:05 AM Grace Grimwood wrote: > Hi Kevin, > > Thanks for starting this thread. > >

Re: [VOTE] FLIP-465: Introduce DESCRIBE FUNCTION

2024-07-04 Thread Martijn Visser
+1 (binding) On Thu, Jul 4, 2024 at 5:39 AM Yanquan Lv wrote: > Hi Natea, thanks for driving it. > +1 (non-binding). > > Jim Hughes 于2024年7月4日周四 04:41写道: > > > Hi Natea, > > > > Looks good to me! > > > > +1 (non-binding). > > > > Cheers, > > > > Jim > > > > On Wed, Jul 3, 2024 at 3:16 PM Natea

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2024-07-02 Thread Martijn Visser
pository ... be removed ... ? > > > > Yes, I would remove it once it is merged into a version of flink that is > > supported by GCP dataproc. It exists now (and I am creating releases and > > maven artifacts for it) to unblock users in the interim period. > > > > -Dani

Re: [VOTE] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-07-02 Thread Martijn Visser
+1 (binding) On Mon, Jul 1, 2024 at 7:00 PM Jim Hughes wrote: > Hi Alexey, > > +1 (non-binding) > > I'm looking forward to parity between streaming and batch bound for > compiled plans! > > Cheers, > > Jim > > On Mon, Jul 1, 2024 at 12:55 PM Alexey Leonov-Vendrovskiy < > vendrov...@gmail.com>

Re: [VOTE] Release flink-shaded 19.0, release candidate #1

2024-07-01 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Jun 28, 2024 at 2:02 PM Timo Walther wrote: > +1 (binding) > > Thanks for fixing the JSON functions! > >

Re: [VOTE] FLIP-444: Native file copy support

2024-06-27 Thread Martijn Visser
+1 (binding) On Thu, Jun 27, 2024 at 3:32 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Wed, Jun 26, 2024 at 10:22 PM Stefan Richter > wrote: > > > > > +1 (binding) > > > > Best, > > Stefan > > > > > > > > > On 26. Jun 2024, at 16:14, Hong wrote: > > > > > > +1

Re: [VOTE] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-25 Thread Martijn Visser
+1 (binding) On Sun, Jun 23, 2024 at 9:07 PM Ferenc Csaky wrote: > +1 (non-binding) > > Best, > Ferenc > > > > > On Sunday, June 23rd, 2024 at 05:13, Yanquan Lv > wrote: > > > > > > > Thnaks Sergio, +1 (non-binding) > > > > gongzhongqiang gongzhongqi...@apache.org 于2024年6月23日周日 10:06写道: > > >

Re: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1

2024-06-11 Thread Martijn Visser
Hi David, That's a blocker for a Flink Kafka connector 4.0, not for 3.2.0. It's not related to this release. Best regards, Martijn On Tue, Jun 11, 2024 at 3:54 PM David Radley wrote: > Hi, > Sorry I am a bit late. > I notice https://issues.apache.org/jira/browse/FLINK-35109 is open and a >

[jira] [Created] (FLINK-35566) Consider promoting TypeSerializer from PublicEvolving to Public

2024-06-11 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35566: -- Summary: Consider promoting TypeSerializer from PublicEvolving to Public Key: FLINK-35566 URL: https://issues.apache.org/jira/browse/FLINK-35566 Project: Flink

Re: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1

2024-06-06 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Tue, Jun 4, 2024 at 11:08 AM Fabian Paul wrote: > +1 (non-binding) > > - Verified signature > - Verified checksum

Re: [DISCUSS] Proposing an LTS Release for the 1.x Line

2024-05-24 Thread Martijn Visser
thing important that I might have missed. > > > > > > Best, > > > Alex > > > > > > [1] https://cwiki.apache.org/confluence/x/BApeEg > > > > > > > > > On Tue, 23 Jan 2024 at 03:30, Rui Fan <1996fan...@gmail.com> wrote: >

Re: [VOTE] FLIP-443: Interruptible watermark processing

2024-05-24 Thread Martijn Visser
+1 (binding) On Fri, May 24, 2024 at 7:31 AM weijie guo wrote: > +1(binding) > > Thanks for driving this! > > Best regards, > > Weijie > > > Rui Fan <1996fan...@gmail.com> 于2024年5月24日周五 13:03写道: > > > +1(binding) > > > > Best, > > Rui > > > > On Fri, May 24, 2024 at 12:01 PM Yanfei Lei wrote:

[RESULT][VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-17 Thread Martijn Visser
Hi all, I'm happy to announce that we have unanimously approved FLIP-453. There were 12 votes, of which 4 were binding. - weijie guo (binding) - Ferenc Csaky (non-binding) - Rui Fan (binding) - Zhongqiang Gong (non-binding) - Péter Váry (non-binding) - Rodrigo Meneses (non-binding) - lorenzo

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-17 Thread Martijn Visser
"Jing Ge" wrote: > >>> +1(binding) Thanks Martijn! > >>> > >>> Best regards, > >>> Jing > >>> > >>> On Wed, May 15, 2024 at 7:00 PM Muhammet Orazov > >>> wrote: > >>> > >>>&g

Re: [DISCUSS] FLINK-35369: Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option

2024-05-16 Thread Martijn Visser
; Keith Lee > > [1] > > https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=65145551#FlinkImprovementProposals-Whatisconsidereda%22majorchange%22thatneedsaFLIP > ? > > > On Thu, 16 May 2024 at 13:03, Martijn Visser > wrote: > > > Hi Keith Lee, > >

[jira] [Created] (FLINK-35378) [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunc

2024-05-16 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35378: -- Summary: [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunc Key: FLINK-35378 URL: https://issues.apache.org/jira/browse/FLINK-35378 Project

Re: [DISCUSS] FLINK-35369: Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option

2024-05-16 Thread Martijn Visser
Hi Keith Lee, There is actually an open and accepted FLIP [1] that was just never implemented. I think that needs to be taken into account as well, since it was voted on. I think it also makes more sense to have a proposal as a FLIP, instead of under a Jira. Best regards, Martijn [1]

[jira] [Created] (FLINK-35350) Add documentation for Kudu

2024-05-14 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35350: -- Summary: Add documentation for Kudu Key: FLINK-35350 URL: https://issues.apache.org/jira/browse/FLINK-35350 Project: Flink Issue Type: Sub-task

[VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Martijn Visser
Hi everyone, With no more discussions being open in the thread [1] I would like to start a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction [2] The vote will be open for at least 72 hours unless there is an objection or insufficient votes. Best regards,

Re: [jira] [Updated] (FLINK-35336) SQL failed to restore from savepoint after change in default-parallelism

2024-05-13 Thread Martijn Visser
rds > Keith Lee > > > On Mon, May 13, 2024 at 1:27 PM Martijn Visser (Jira) > wrote: > > > > > [ > > > https://issues.apache.org/jira/browse/FLINK-35336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel > > ] > > > > Martij

[jira] [Created] (FLINK-35333) JdbcXaSinkTestBase fails in weekly Flink JDBC Connector tests

2024-05-13 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35333: -- Summary: JdbcXaSinkTestBase fails in weekly Flink JDBC Connector tests Key: FLINK-35333 URL: https://issues.apache.org/jira/browse/FLINK-35333 Project: Flink

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-13 Thread Martijn Visser
> > > > Could you please clarify? > > Best Regards > Ahmed Hamdy > > > On Sun, 12 May 2024 at 14:07, Martijn Visser > wrote: > > > Hi all, > > > > If there are no more considerations, I'll open up a vote in the next > couple > > of

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-12 Thread Martijn Visser
;> With regards to FLINK-35149, the fix version indicates a change at > > Flink > > >> CDC; is that indeed correct, or does it require a change in the SinkV2 > > >> interface? > > >> > > >> The fix doesn't need change in SinkV2, so we are good ther

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-03 Thread Martijn Visser
, I volunteer to take updating the HBase sink, feel free to assign > that task to me. > > Best, > Ferenc > > > > > On Friday, May 3rd, 2024 at 10:20, Martijn Visser < > martijnvis...@apache.org> wrote: > > > > > > > Hi Peter, > > > &g

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-03 Thread Martijn Visser
10179 > [3] - https://issues.apache.org/jira/browse/FLINK-35149 > > > On Thu, May 2, 2024, 09:47 Muhammet Orazov > wrote: > > > Got it, thanks! > > > > On 2024-05-02 06:53, Martijn Visser wrote: > > > Hi Muhammet, > > > > > > Thanks for

Re: FW: RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-05-02 Thread Martijn Visser
4-eCHWLgE/edit?usp=sharing > > The original version you have copied is a bit out-dated and verbose. > Please could you replace the Flip with content from the above link, > Kind regards, David, > > From: Martijn Visser > Date: Wednesday, 1 May 2

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-02 Thread Martijn Visser
detailed history of changes, +1. > > Would FLIP changes target for 2.0? I think it would be good > to have clear APIs on 2.0 release. > > Best, > Muhammet > > On 2024-05-01 15:30, Martijn Visser wrote: > > Hi everyone, > > > > I would like to start a disc

[DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-01 Thread Martijn Visser
Hi everyone, I would like to start a discussion on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction https://cwiki.apache.org/confluence/x/rIobEg This FLIP proposes to promote the Unified Sink API V2 from PublicEvolving to Public and to mark the SinkFunction as

Re: FW: RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-05-01 Thread Martijn Visser
late in a new Google Doc > https://docs.google.com/document/d/1J1E-cE-X2H3-kw4rNjLn71OGPQk_Yl1iGX4-eCHWLgE/edit?usp=sharing. > I have significantly reduced the content in the Flip, in line with what I > see as the template and its usage. If this it too much or too little, I can > amen

[jira] [Created] (FLINK-35280) Migrate HBase Sink connector to use the ASync Sink API

2024-05-01 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35280: -- Summary: Migrate HBase Sink connector to use the ASync Sink API Key: FLINK-35280 URL: https://issues.apache.org/jira/browse/FLINK-35280 Project: Flink

Re: [ DISCUSS ] FLIP-XXX : [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-25 Thread Martijn Visser
if it is related to pluggable enricher FLIP or anyway we can > use pluggable enricker FLIP here for CRUD failures. > > Regards, > Swathi C > > ------ Forwarded message - > From: Martijn Visser > Date: Thu, Apr 25, 2024 at 2:46 AM > Subject: Re: [ DISCUSS ]

Re: [ DISCUSS ] FLIP-XXX : [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-24 Thread Martijn Visser
> > of work is a subset (Further implementation) we can just add a Jira > ticket > > for it. IMO this will also help with implementation taking the existing > > enrichers into reference. > > Best Regards > > Ahmed Hamdy > > > > > > On Tue, 23 Apr 2

Re: [DISCUSS] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-04-24 Thread Martijn Visser
+1 On Wed, Apr 24, 2024 at 5:31 PM Congxian Qiu wrote: > Thanks for driving this, yue > > We also observed significant performance improvements in some cases after > bumped the Rocksdb version, +1 for this work > > Best, > Congxian > > > yue ma 于2024年4月24日周三 19:16写道: > > > hi Yanfei, > > > >

Re: [ DISCUSS ] FLIP-XXX : [Plugin] Enhancing Flink Failure Management in Kubernetes with Dynamic Termination Log Integration

2024-04-23 Thread Martijn Visser
>From a procedural point of view, we shouldn't make FLIPs sub-tasks for existing FLIPs that have been voted/are released. That will only cause confusion down the line. A new FLIP should take existing functionality (like FLIP-304) into account, and propose how to improve on what that original FLIP

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-19 Thread Martijn Visser
+1 (binding) On Fri, Apr 19, 2024 at 10:07 AM Yuepeng Pan wrote: > +1(non-binding) > > Best, > Yuepeng Pan > > At 2024-04-19 15:22:04, "gongzhongqiang" > wrote: > >+1(non-binding) > > > > > >Best, > > > >Zhongqiang Gong > > > >Ron liu 于2024年4月17日周三 14:28写道: > > > >> Hi Dev, > >> > >> Thank

[jira] [Created] (FLINK-35109) Drop support for Flink 1.17 and 1.18 in Flink Kafka connector

2024-04-15 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35109: -- Summary: Drop support for Flink 1.17 and 1.18 in Flink Kafka connector Key: FLINK-35109 URL: https://issues.apache.org/jira/browse/FLINK-35109 Project: Flink

Re: [EXTERNAL] RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-04-12 Thread Martijn Visser
Hi David, I tried, but the format wasn't as the FLIP template expects, so I ended up needing to change the entire formatting and that was just too much work to be honest. If you could make sure that especially the headers match with the FLIP template, and that all of the contents from the FLIP

Re: Proposal: I hope the official documentation can provide an "Integrations" section.

2024-04-12 Thread Martijn Visser
Hi Kaiming, Since AutoMQ isn't part of the ASF Flink project, I'm not sure if it makes sense to document this in the Flink documentation. There are many technologies compatible with the Kafka API, but we also don't have those listed in our docs and I don't think we should. Best regards, Martijn

Re: [VOTE] FLIP-399: Flink Connector Doris

2024-04-11 Thread Martijn Visser
+1 (binding) On Wed, Apr 10, 2024 at 4:34 AM Jing Ge wrote: > +1(binding) > > Best regards, > Jing > > On Tue, Apr 9, 2024 at 8:54 PM Feng Jin wrote: > > > +1 (non-binding) > > > > Best, > > Feng > > > > On Tue, Apr 9, 2024 at 5:56 PM gongzhongqiang > > > wrote: > > > > > +1 (non-binding) > >

[jira] [Created] (FLINK-35009) Change on getTransitivePredecessors breaks connectors

2024-04-04 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35009: -- Summary: Change on getTransitivePredecessors breaks connectors Key: FLINK-35009 URL: https://issues.apache.org/jira/browse/FLINK-35009 Project: Flink

[jira] [Created] (FLINK-35008) Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.0 for Flink Kafka connector

2024-04-04 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35008: -- Summary: Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.0 for Flink Kafka connector Key: FLINK-35008 URL: https://issues.apache.org/jira/browse/FLINK-35008

[jira] [Created] (FLINK-35007) Update Flink Kafka connector to support 1.19 and test 1.20-SNAPSHOT

2024-04-04 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35007: -- Summary: Update Flink Kafka connector to support 1.19 and test 1.20-SNAPSHOT Key: FLINK-35007 URL: https://issues.apache.org/jira/browse/FLINK-35007 Project

Re: [DISCUSS] Externalized Google Cloud Connectors

2024-04-04 Thread Martijn Visser
Hi Lorenzo, Bahir is retired, see the homepage. It plays no role (anymore). > This, unfortunately, is the tradeoff for developing the connectors outside of Apache in exchange for development velocity. I understand that. It can be considered to develop the connectors outside of the Flink

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-03 Thread Martijn Visser
Hi all, Thanks for the proposal. While the FLIP talks extensively on how Snowflake has Dynamic Tables and Databricks has Delta Live Tables, my understanding is that Databricks has CREATE STREAMING TABLE [1] which relates with this proposal. I do have concerns about using CREATE DYNAMIC TABLE,

Re: [VOTE] FLIP-437: Support ML Models in Flink SQL

2024-04-03 Thread Martijn Visser
+1 (binding) On Wed, Apr 3, 2024 at 9:52 AM Leonard Xu wrote: > +1(binding) > > Best, > Leonard > > > 2024年4月3日 下午3:37,Piotr Nowojski 写道: > > > > +1 (binding) > > > > Best, > > Piotrek > > > > śr., 3 kwi 2024 o 04:29 Yu Chen napisał(a): > > > >> +1 (non-binding) > >> > >> Looking forward to

Re: [DISCUSS] Flink Website Menu Adjustment

2024-03-25 Thread Martijn Visser
Hi Zhongqiang Gong, Are you suggesting to continuously update the menu based on the number of releases, or just this one time? I wouldn't be in favor of continuously updating: returning customers expect a certain order in the menu, and I don't see a lot of value in continuously changing that. I

Re: [VOTE] FLIP-402: Extend ZooKeeper Curator configurations

2024-03-21 Thread Martijn Visser
+1 (binding) On Wed, Mar 20, 2024 at 1:19 PM Ferenc Csaky wrote: > +1 (non-binding), thanks for driving this! > > Best, > Ferenc > > > On Wednesday, March 20th, 2024 at 10:57, Yang Wang < > wangyang0...@apache.org> wrote: > > > > > > > +1 (binding) since ZK HA is still widely used. > > > > > >

Re: [VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-21 Thread Martijn Visser
+1 (binding) On Thu, Mar 21, 2024 at 8:01 AM gongzhongqiang wrote: > +1 (non-binding) > > Bests, > Zhongqiang Gong > > Ferenc Csaky 于2024年3月20日周三 22:11写道: > > > Hello devs, > > > > I would like to start a vote about FLIP-439 [1]. The FLIP is about to > > externalize the Kudu > > connector from

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-14 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven via mvn clean install -Pcheck-convergence -Dflink.version=1.19.0 - Verified licenses - Verified web PR - Started a cluster and the Flink SQL client,

Re: [DISCUSS] Externalized Google Cloud Connectors

2024-03-08 Thread Martijn Visser
Hi Claire, I don't think it's a good idea to actually develop outside of Apache; contributions that have happened outside of the Apache realm do not play a role when evaluating potential new committers. I think the best course of action would be to create a FLIP to add these connectors to the

Re: [DISCUSS] FLIP-419: Optimize multi-sink query plan generation

2024-03-08 Thread Martijn Visser
Hi Jeyhun Karimov, I see that you've already opened up a VOTE thread, but since you're talking about having a prototype already and results, I wondered if you could include the POC and how you've tested these results in the FLIP? Best regards, Martijn On Tue, Jan 30, 2024 at 4:47 AM Jeyhun

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-08 Thread Martijn Visser
Hi all, I'm +1 on it. As long as we follow the ASF rules on this, we can thank those that are/have made contributions. Best regards, Martijn On Wed, Mar 6, 2024 at 7:45 AM Jark Wu wrote: > Hi Matthias, > > Thanks for your comments! Please see my reply inline. > > > What do we do if we have

Re: [DISCUSS] Support the Ozone Filesystem

2024-03-08 Thread Martijn Visser
Hi Ferenc, I'm +0: I have seen no demand for Ozone, but if the community is OK with it, why not. Best regards, Martijn On Mon, Feb 26, 2024 at 6:08 AM Ferenc Csaky wrote: > Hi, > > gentle reminder on this thread, any opinions or thoughts? > > Regards, > Ferenc > > > > > On Thursday, February

[jira] [Created] (FLINK-34621) Bump com.google.guava:guava from 31.1-jre to 32.0.0-jre in /flink-connector-hbase-base

2024-03-07 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34621: -- Summary: Bump com.google.guava:guava from 31.1-jre to 32.0.0-jre in /flink-connector-hbase-base Key: FLINK-34621 URL: https://issues.apache.org/jira/browse/FLINK-34621

Re: Default scale and precision SQL data types

2024-03-03 Thread Martijn Visser
Hi, I think it would first require a FLIP, given it touches on the core type system of SQL. Best regards, Martijn On Sat, Mar 2, 2024 at 5:34 PM Sergei Morozov wrote: > Hi there, > > org.apache.flink.table.api.DataTypes allows the creation of temporal data > types by specifying precision

Re: [DISCUSS] Apache Bahir retired

2024-02-28 Thread Martijn Visser
Hi all, +1 to have a connector FLIP to propose a Kudu connector. I'm +0 overall because I don't see a lot of activity happening in newly proposed connectors, but if there's demand for it and people want to volunteer with contributions, there's no reason to block it. Best regards, Martijn On

Re: [DISCUSS] Alternative way of posting FLIPs

2024-02-26 Thread Martijn Visser
Hi all, I've created https://issues.apache.org/jira/browse/FLINK-34515 and updated https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals to update the instructions for the community. Best regards, Martijn On Thu, Feb 15, 2024 at 10:04 AM Martijn Visser wrote: > &

[jira] [Created] (FLINK-34515) Document new FLIP process

2024-02-26 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34515: -- Summary: Document new FLIP process Key: FLINK-34515 URL: https://issues.apache.org/jira/browse/FLINK-34515 Project: Flink Issue Type: New Feature

Re: FW: RE: [DISCUSS] FLIP-314: Support Customized Job Lineage Listener

2024-02-19 Thread Martijn Visser
I'm a bit confused: did we add new interfaces after FLIP-314 was accepted? If so, please move the new interfaces to a new FLIP and start a separate vote. We can't retrospectively change an accepted FLIP with new interfaces and a new vote. On Mon, Feb 19, 2024 at 3:22 AM Yong Fang wrote: > > Hi

[jira] [Created] (FLINK-34461) MongoDB weekly builds fail with time out on Flink 1.18.1 for JDK17

2024-02-19 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34461: -- Summary: MongoDB weekly builds fail with time out on Flink 1.18.1 for JDK17 Key: FLINK-34461 URL: https://issues.apache.org/jira/browse/FLINK-34461 Project

Re: FLINK-21672

2024-02-16 Thread Martijn Visser
it may not be considered a feature > right Martijn? > If it's a test improvement, can it still be part of the release? > > Gyula > > On Fri, Feb 16, 2024 at 4:45 PM Martijn Visser > wrote: > > > Hi David, > > > > Happy to assign it to you. It can't be merged for F

Re: FLINK-21672

2024-02-16 Thread Martijn Visser
Hi David, Happy to assign it to you. It can't be merged for Flink 1.19 anymore though: feature freeze has started for that one, as announced previously on the mailing list. Best regards, Martijn On Fri, Feb 16, 2024 at 4:32 PM David Radley wrote: > > Hi, > I see

Re: [VOTE] Release flink-connector-parent, release candidate #1

2024-02-15 Thread Martijn Visser
Hi Etienne, > I fixed the source release [1] as requested, it no more contains > tools/release/shared directory. I don't think that is the correct way: my understanding is that this invalidates basically all the votes, because now the checked artifact has changed. It was requested to file a

Re: [DISCUSS] Alternative way of posting FLIPs

2024-02-15 Thread Martijn Visser
t convenient to use in my opinion. > > > > > > Anyway, > > > > > > that's a minor issue, I guess. > > > > > > > > > > > > Matthias > > > > > > > > > > > > [1] > > > > > > > > >

[jira] [Created] (FLINK-34435) Bump org.yaml:snakeyaml from 1.31 to 2.2 for flink-connector-elasticsearch

2024-02-13 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34435: -- Summary: Bump org.yaml:snakeyaml from 1.31 to 2.2 for flink-connector-elasticsearch Key: FLINK-34435 URL: https://issues.apache.org/jira/browse/FLINK-34435

[jira] [Created] (FLINK-34432) Re-enable forkReuse for flink-table-planner

2024-02-13 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34432: -- Summary: Re-enable forkReuse for flink-table-planner Key: FLINK-34432 URL: https://issues.apache.org/jira/browse/FLINK-34432 Project: Flink Issue Type

Re: Issues running with Flink 1.20-SNAPSHOT

2024-02-09 Thread Martijn Visser
Hi, There's never a flink_dist, this is most likely because of a local build problem. See https://repository.apache.org/content/groups/snapshots/org/apache/flink/flink-dist/1.19-SNAPSHOT/ which also doesn't exist. This is most likely a local build problem; are you using the Maven wrapper? Best

[jira] [Created] (FLINK-34415) Move away from Kafka-Zookeeper based tests in favor of Kafka-KRaft

2024-02-08 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34415: -- Summary: Move away from Kafka-Zookeeper based tests in favor of Kafka-KRaft Key: FLINK-34415 URL: https://issues.apache.org/jira/browse/FLINK-34415 Project

Re: [VOTE] Release flink-connector-mongodb v1.1.0, release candidate #2

2024-02-08 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Wed, Jan 31, 2024 at 10:41 AM Danny Cranmer wrote: > > Thanks for driving this Leonard! > > +1 (binding) > > -

[jira] [Created] (FLINK-34413) Drop support for HBase v1

2024-02-08 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34413: -- Summary: Drop support for HBase v1 Key: FLINK-34413 URL: https://issues.apache.org/jira/browse/FLINK-34413 Project: Flink Issue Type: Technical Debt

Re: [DISCUSS] Drop support for HBase v1

2024-02-08 Thread Martijn Visser
Drop support for HBase v1 > Hi Martijn, > > thanks for starting the discussion. Let me link the older discussion > regarding the same topic [1]. My opinion did not change, so +1. > > BR, > Ferenc > > [1] https://lists.apache.org/thread/x7l2gj8g93r4v6x6953cyt6jrs8c4r1b &g

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

2024-02-08 Thread Martijn Visser
Hi, > However, compiled plan is still too complicated for Flink newbies from my > point of view. I don't think that the compiled plan was ever positioned to be a simple solution. If you want to have an easy approach, we have a declarative solution in place with SQL and/or the Table API imho.

Re: jira permission request

2024-02-07 Thread Martijn Visser
Hi, In order to contribute to Apache Flink, please ping the author of the Jira ticket that you would like to work on, so it can be assigned to you. There are no other permissions required. Best regards, Martijn On Tue, Feb 6, 2024 at 2:25 AM 李游 wrote: > > HI, > I want to contribute to Apache

Re: Confluence access request

2024-02-07 Thread Martijn Visser
Hi, Sorry for the late reply, but this has been recently been disabled by the ASF. There's an open discussion thread at https://lists.apache.org/thread/rkpvlnwj9gv1hvx1dyklx6k88qpnvk2t on how to deal with this. Best regards, Martijn On Tue, Jan 30, 2024 at 10:16 AM tanjialiang wrote: > > Hi,

Re: Confluence access

2024-02-07 Thread Martijn Visser
Hi, Sorry for the late reply, but this has been recently been disabled by the ASF. There's an open discussion thread at https://lists.apache.org/thread/rkpvlnwj9gv1hvx1dyklx6k88qpnvk2t on how to deal with this. Best regards, Martijn On Tue, Jan 23, 2024 at 4:03 AM jufang he wrote: > > Hi

[DISCUSS] Alternative way of posting FLIPs

2024-02-07 Thread Martijn Visser
Hi all, ASF Infra has confirmed to me that only ASF committers can access the ASF Confluence site since a recent change. One of the results of this decision is that users can't signup and access Confluence, so only committers+ can create FLIPs. ASF Infra hopes to improve this situation when they

[ANNOUNCE] Apache flink-connector-kafka v3.1.0 released

2024-02-07 Thread Martijn Visser
The Apache Flink community is very happy to announce the release of Apache flink-connector-kafka v3.1.0. This release is compatible with Apache Flink 1.17 and 1.18. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data

[RESULT][VOTE] Release flink-connector-kafka v3.1.0, release candidate #1

2024-02-07 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Hang Ruan (non-binding) * Mason Chen (non-binding) * Qingsheng Ren (binding) * Maximilian Michels (binding) * Martijn Visser (binding) There are no disapproving votes

Re: [VOTE] Release flink-connector-kafka v3.1.0, release candidate #1

2024-02-06 Thread Martijn Visser
Thanks all, this vote is now closed, I will announce the results on a separate thread! On Tue, Feb 6, 2024 at 4:48 PM Martijn Visser wrote: > +1 (binding) > > - Validated hashes > - Verified signature > - Verified that no binaries exist in the source archive > - Build the

Re: [VOTE] Release flink-connector-kafka v3.1.0, release candidate #1

2024-02-06 Thread Martijn Visser
tps://github.com/apache/flink-connector-kafka/blob/d89a082180232bb79e3c764228c4e7dbb9eb6b8b/docs/content/docs/connectors/datastream/kafka.md#L39 > > > > > > Best, > > > Mason > > > > > > On Sun, Jan 28, 2024 at 11:41 PM Hang Ruan > wrote: > > >

[jira] [Created] (FLINK-34368) Update GCS filesystems to latest available version v3.0

2024-02-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34368: -- Summary: Update GCS filesystems to latest available version v3.0 Key: FLINK-34368 URL: https://issues.apache.org/jira/browse/FLINK-34368 Project: Flink

[jira] [Created] (FLINK-34366) Add support to group rows by column ordinals

2024-02-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34366: -- Summary: Add support to group rows by column ordinals Key: FLINK-34366 URL: https://issues.apache.org/jira/browse/FLINK-34366 Project: Flink Issue Type

[jira] [Created] (FLINK-34358) flink-connector-jdbc nightly fails with "Expecting code to raise a throwable"

2024-02-04 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34358: -- Summary: flink-connector-jdbc nightly fails with "Expecting code to raise a throwable" Key: FLINK-34358 URL: https://issues.apache.org/jira/browse/F

Re: Security fixes for Flink 1.18 (flink-shaded)

2024-02-02 Thread Martijn Visser
To add to this: we can't upgrade to flink-shaded 18.0, since we've just reverted that for Flink 1.19 because of the performance regression. We will need a new flink-shaded version to deal with these performance regressions. On Fri, Feb 2, 2024 at 9:39 AM Martijn Visser wrote: > Hi Hong, &g

Re: Security fixes for Flink 1.18 (flink-shaded)

2024-02-02 Thread Martijn Visser
Hi Hong, I do have objections: upgrading Flink-Shaded in a patch version is something that we should not take lightly, since it involves components that are used in the core functionality of Flink. We've seen in the past that changes in Flink Shaded have an impact on stability and performance. I

Re: [VOTE] Release flink-connector-jdbc, release candidate #3

2024-02-02 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Feb 2, 2024 at 9:31 AM Yanquan Lv wrote: > +1 (non-binding) > > - Validated checksum hash > - Verified

[jira] [Created] (FLINK-34320) Flink Kafka connector tests time out

2024-01-31 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34320: -- Summary: Flink Kafka connector tests time out Key: FLINK-34320 URL: https://issues.apache.org/jira/browse/FLINK-34320 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34314) Update CI Node Actions from NodeJS 16 to NodeJS 20

2024-01-30 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34314: -- Summary: Update CI Node Actions from NodeJS 16 to NodeJS 20 Key: FLINK-34314 URL: https://issues.apache.org/jira/browse/FLINK-34314 Project: Flink Issue

[DISCUSS] Drop support for HBase v1

2024-01-29 Thread Martijn Visser
Hi all, While working on adding support for Flink 1.19 for HBase, we've run into a dependency convergence issue because HBase v1 relies on a really old version of Guava. HBase v2 has been made available since May 2018, and there have been no new releases of HBase v1 since August 2022. I would

[jira] [Created] (FLINK-34260) Make flink-connector-aws compatible with SinkV2 changes

2024-01-29 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34260: -- Summary: Make flink-connector-aws compatible with SinkV2 changes Key: FLINK-34260 URL: https://issues.apache.org/jira/browse/FLINK-34260 Project: Flink

[jira] [Created] (FLINK-34259) flink-connector-jdbc fails to compile with NPE on hasGenericTypesDisabled

2024-01-29 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34259: -- Summary: flink-connector-jdbc fails to compile with NPE on hasGenericTypesDisabled Key: FLINK-34259 URL: https://issues.apache.org/jira/browse/FLINK-34259

  1   2   3   4   5   6   7   8   9   10   >