Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Martijn Visser
Hi Jing, Looking at the defined process for Creating A Flink Release [1], it states "If there are any issues found in the release candidate, reply on the vote thread to cancel the vote". With emphasis on the "any issues", I think we should cancel this RC and create a new one. Best regards, Marti

[jira] [Created] (FLINK-33299) CLONE - Add checks to guarantee the non-deprecated options not conflicting with standard YAML

2023-10-17 Thread Junrui Li (Jira)
Junrui Li created FLINK-33299: - Summary: CLONE - Add checks to guarantee the non-deprecated options not conflicting with standard YAML Key: FLINK-33299 URL: https://issues.apache.org/jira/browse/FLINK-33299

[jira] [Created] (FLINK-33297) CLONE - Introduce proper YAML parsing to Flink's configuration

2023-10-17 Thread Junrui Li (Jira)
Junrui Li created FLINK-33297: - Summary: CLONE - Introduce proper YAML parsing to Flink's configuration Key: FLINK-33297 URL: https://issues.apache.org/jira/browse/FLINK-33297 Project: Flink Iss

[jira] [Created] (FLINK-33298) CLONE - Add a suffix to keys that violate YAML spec

2023-10-17 Thread Junrui Li (Jira)
Junrui Li created FLINK-33298: - Summary: CLONE - Add a suffix to keys that violate YAML spec Key: FLINK-33298 URL: https://issues.apache.org/jira/browse/FLINK-33298 Project: Flink Issue Type: Sub

Re: FW: RE: Close orphaned/stale PRs

2023-10-17 Thread Venkatakrishnan Sowrirajan
Thanks Martijn, David, Ryan and others for contributing to this great discussion! 1. From a project perspective, we can have a discussion about closing > PRs automatically that a) are not followed-up within X number of days > after a review and/or b) PRs that don't have a passing build and/or > do

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Xianxun Ye
Hi Jing, I also found the exception about the java.lang.NoSuchMethodError when I ran the Kyuubi Flink Tests on Flink1.18-rc2. These are the steps, ran the below sql in the Flink SQL Client: create table tbl_src (a int) with ('connector' = 'datagen', 'number-of-rows' = '100’); select count(a)

[VOTE] FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag

2023-10-17 Thread Xuannan Su
Hi all, We would like to start the vote for FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag [1]. This FLIP was discussed in this thread [2]. The vote will be open until at least Oct 21st (at least 72 hours), following the consensus voting process. Cheers,

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Yun Tang
Hi Jing, Thanks for the update, I checked the new maven repo, and the artifacts were built with JDK8 correctly. Best Yun Tang From: Jing Ge Sent: Tuesday, October 17, 2023 23:31 To: dev@flink.apache.org Cc: Matthias Pohl ; sergey.nuyan...@aiven.io Subject: R

[jira] [Created] (FLINK-33296) Split flink-dist.jar into independent dependency packages

2023-10-17 Thread JieFang.He (Jira)
JieFang.He created FLINK-33296: -- Summary: Split flink-dist.jar into independent dependency packages Key: FLINK-33296 URL: https://issues.apache.org/jira/browse/FLINK-33296 Project: Flink Issue T

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Alexander Fedulov
+1 (non-binding) Thanks for explicitly addressing my concerns from the previous attempt of integrating the async-profiler ( FLIP-213 [1] ). Best, Alexander Fedulov [1] https://lists.apache.org/thread/b5dpk4g6xgx0ysgnjphlnsvxftl17lqj On Tue, 17 Oct 2023 at 12:57, Jing Ge wrote: > +1(binding) >

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-17 Thread Venkatakrishnan Sowrirajan
Congratulations Jane! Regards Venkata krishnan On Tue, Oct 17, 2023 at 6:45 AM Matthias Pohl wrote: > Congratulations :) > > On Mon, Oct 16, 2023 at 1:04 PM Jing Ge > wrote: > > > Congrats! > > > > Best regards, > > Jing > > > > On Mon, Oct 16, 2023 at 10:33 AM Yuepeng Pan > > wrote: > > > >

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Jing Ge
Hi Yun, I have created a new maven repo[5]. Would you like to check it out? Thanks for your support! Once I get your confirmation, I will start the second voting thread with the title "[VOTE][2] Release 1.18.0, release candidate #2", because the source code is not changed. All Devs: please ignore

[jira] [Created] (FLINK-33295) Separate SinkV2 and SinkV1Adapter tests

2023-10-17 Thread Peter Vary (Jira)
Peter Vary created FLINK-33295: -- Summary: Separate SinkV2 and SinkV1Adapter tests Key: FLINK-33295 URL: https://issues.apache.org/jira/browse/FLINK-33295 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33294) PyFlink minicluster is shut down after every job completion

2023-10-17 Thread Mehmet Aktas (Jira)
Mehmet Aktas created FLINK-33294: Summary: PyFlink minicluster is shut down after every job completion Key: FLINK-33294 URL: https://issues.apache.org/jira/browse/FLINK-33294 Project: Flink

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Jing Ge
Hi Yun, Thanks for the feedback. Appreciate it! I will update them accordingly and then ask you for double checking. Thanks in advance. Best regards, Jing On Tue, Oct 17, 2023 at 2:42 PM Yun Tang wrote: > Hi Jing, > > Thanks for the update. I checked the new pre-built binary release, and it >

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Jing Ge
Hi Matthias, Since there is no change in the source code, we could still stick to RC2. I am updating the pre-built binary release at repository.apache.org and will start a new voting mail like [VOTE][2] Release 1.18.0, release candidate #2. I think this approach is leaner than starting with RC3. W

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

2023-10-17 Thread Matthias Pohl
Congratulations :) On Mon, Oct 16, 2023 at 11:55 PM Venkatakrishnan Sowrirajan < vsowr...@asu.edu> wrote: > Congrats Ron! > > On Mon, Oct 16, 2023, 9:34 AM David Radley > wrote: > > > Congratulations Ron! > > > > From: Jark Wu > > Date: Sunday, 15 October 2023 at 18:57 > > To: dev > > Cc: ron9

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-17 Thread Matthias Pohl
Congratulations :) On Mon, Oct 16, 2023 at 1:04 PM Jing Ge wrote: > Congrats! > > Best regards, > Jing > > On Mon, Oct 16, 2023 at 10:33 AM Yuepeng Pan > wrote: > > > Congratulations, Jane ! > > > > > > > > Best, > > Yuepeng Pan > > > > At 2023-10-16 09:58:02, "Jark Wu" wrote: > > >Hi, everyon

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Matthias Pohl
Shouldn't we cancel the RC2 and do a proper RC3 to follow the release process properly, anyway? ...to make it easier to understand the release history of 1.18 in the future. On Tue, Oct 17, 2023 at 2:42 PM Yun Tang wrote: > Hi Jing, > > Thanks for the update. I checked the new pre-built binary r

[jira] [Created] (FLINK-33293) Data loss with Kafka Sink

2023-10-17 Thread Jasmin Redzepovic (Jira)
Jasmin Redzepovic created FLINK-33293: - Summary: Data loss with Kafka Sink Key: FLINK-33293 URL: https://issues.apache.org/jira/browse/FLINK-33293 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-33292) OpenSearch connector release

2023-10-17 Thread Rasmus Thygesen (Jira)
Rasmus Thygesen created FLINK-33292: --- Summary: OpenSearch connector release Key: FLINK-33292 URL: https://issues.apache.org/jira/browse/FLINK-33292 Project: Flink Issue Type: Technical Debt

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Yun Tang
Hi Jing, Thanks for the update. I checked the new pre-built binary release, and it works fine now. However, I then checked the pre-built jar packages and found they are also built with JDK17, e.g., flink-runtime.jar [1]. I think we also need to update all artifacts to be deployed. [1] https:

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Matthias Pohl
Great catch, Yun Tang. I created FLINK-33291 [1] to cover the issue of enforcing the JDK (and Maven) version in the release profile. [1] https://issues.apache.org/jira/browse/FLINK-33291 On Tue, Oct 17, 2023 at 1:28 PM Jing Ge wrote: > Hi Folks, > > I have rebuilt Flink with Java 8 and replaced

[jira] [Created] (FLINK-33291) The release profile of Flink does include enforcing the Java version only in a "soft" way

2023-10-17 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33291: - Summary: The release profile of Flink does include enforcing the Java version only in a "soft" way Key: FLINK-33291 URL: https://issues.apache.org/jira/browse/FLINK-33291

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Jing Ge
Hi Folks, I have rebuilt Flink with Java 8 and replaced all binary artifacts at[3]. @Yun Tang Would you please check it again? Thanks! BTW, there was a typo in the voting mail: >> * source code tag "release-1.17.0-rc2" [6] it should be: source code tag "release-1.18.0-rc2" [6] Sorry for the in

Re: [DISCUSS] Remove legacy Paimon (TableStore) doc link from Flink web navigation

2023-10-17 Thread Jing Ge
+1 On Tue, Oct 17, 2023 at 11:13 AM Yong Fang wrote: > +1 > > On Tue, Oct 17, 2023 at 4:52 PM Leonard Xu wrote: > > > +1 > > > > > > > 2023年10月17日 下午4:50,Martijn Visser 写道: > > > > > > +1 > > > > > > On Tue, Oct 17, 2023 at 10:34 AM Jingsong Li > > wrote: > > >> > > >> Hi marton, > > >> > > >

[RESULT][VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-17 Thread Junrui Lee
Hi all, The voting time of FLIP-366 [1]:Support standard YAML for FLINK configuration has passed. I'm closing the vote now. There were 18 +1 votes, 9 of which are binding: Rui Fan (binding) Weijie Guo (binding) Yangze Guo (binding) Lijie Wang (binding) Jing Ge (binding) Zhu Zhu (binding) Chesnay

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Jing Ge
+1(binding) Best regards, Jing On Tue, Oct 17, 2023 at 10:01 AM Yuepeng Pan wrote: > +1 (non-binding) > > Best,Yuepeng Pan > > > At 2023-10-17 15:51:59, "Yu Chen" wrote: > >Hi all, > > > >Thank you to everyone for the feedback and detailed comments on > FLIP-375[1]. > >Based on the discussion

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Jing Ge
Thanks Chesnay for the hint! Appreciate it! Best regards, Jing On Tue, Oct 17, 2023 at 11:21 AM Chesnay Schepler wrote: > IIRC releases MUST be built with JDK 8. > > @Yun Tang how did you discover this? > > There is supposed to be a check to enforce this, but weirdly enough it > isn't rejecting

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Jing Ge
Hi Yun, Thanks for the feedback. I will rebuild the binary artifacts with Java 8 and upload them to replace the old files. Best regards, Jing On Tue, Oct 17, 2023 at 7:56 AM Yun Tang wrote: > Hi Jing, > > I found the pre-built Flink binary release is built with JDK17[1]. Since > the default ta

[jira] [Created] (FLINK-33290) Custom counters to capture encoding/decoding failure in flink

2023-10-17 Thread Chirag Dewan (Jira)
Chirag Dewan created FLINK-33290: Summary: Custom counters to capture encoding/decoding failure in flink Key: FLINK-33290 URL: https://issues.apache.org/jira/browse/FLINK-33290 Project: Flink

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Yun Tang
Hi Chesnay, I ran the StateMachine example, and it failed with the exceptions below: java.lang.NoSuchMethodError: java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer; at org.apache.flink.core.memory.DataOutputSerializer.wrapAsByteBuffer(DataOutputSerializer.java:51) ~[flink-dist-1.18.0

[jira] [Created] (FLINK-33289) SQL Gateway supports IPv6 addresses.

2023-10-17 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33289: -- Summary: SQL Gateway supports IPv6 addresses. Key: FLINK-33289 URL: https://issues.apache.org/jira/browse/FLINK-33289 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-10-17 Thread Yuepeng Pan
Hi, Rui. Thank you for the update. +1 for the updated edition of the FLIP page. And thanks Zhu Zhu, Yangze Guo for the discussion. Best Regards. Yuepeng Pan On 2023/10/17 03:45:08 Rui Fan wrote: > Hi all, > > Offline discussed with Zhu Zhu, Yangze Guo, Yuepeng Pan. > We reached consensus on sl

Re: [VOTE] Release 1.18.0, release candidate #2

2023-10-17 Thread Chesnay Schepler
IIRC releases MUST be built with JDK 8. @Yun Tang how did you discover this? There is supposed to be a check to enforce this, but weirdly enough it isn't rejecting my JDK 11 installation :/ Ah, we didn't set up the enforcer plugin correctly; while we do set a required JDK version by default th

Re: [DISCUSS] Remove legacy Paimon (TableStore) doc link from Flink web navigation

2023-10-17 Thread Yong Fang
+1 On Tue, Oct 17, 2023 at 4:52 PM Leonard Xu wrote: > +1 > > > > 2023年10月17日 下午4:50,Martijn Visser 写道: > > > > +1 > > > > On Tue, Oct 17, 2023 at 10:34 AM Jingsong Li > wrote: > >> > >> Hi marton, > >> > >> Thanks for driving. +1 > >> > >> There is a PR to remove legacy Paimon > >> https://gi

Re: [DISCUSS] Remove legacy Paimon (TableStore) doc link from Flink web navigation

2023-10-17 Thread Leonard Xu
+1 > 2023年10月17日 下午4:50,Martijn Visser 写道: > > +1 > > On Tue, Oct 17, 2023 at 10:34 AM Jingsong Li wrote: >> >> Hi marton, >> >> Thanks for driving. +1 >> >> There is a PR to remove legacy Paimon >> https://github.com/apache/flink-web/pull/665 , but it hasn't been >> updated for a long tim

Re: [DISCUSS] Remove legacy Paimon (TableStore) doc link from Flink web navigation

2023-10-17 Thread Martijn Visser
+1 On Tue, Oct 17, 2023 at 10:34 AM Jingsong Li wrote: > > Hi marton, > > Thanks for driving. +1 > > There is a PR to remove legacy Paimon > https://github.com/apache/flink-web/pull/665 , but it hasn't been > updated for a long time. > > Best, > Jingsong > > On Tue, Oct 17, 2023 at 4:28 PM Márton

Re: [DISCUSS] Remove legacy Paimon (TableStore) doc link from Flink web navigation

2023-10-17 Thread Jingsong Li
Hi marton, Thanks for driving. +1 There is a PR to remove legacy Paimon https://github.com/apache/flink-web/pull/665 , but it hasn't been updated for a long time. Best, Jingsong On Tue, Oct 17, 2023 at 4:28 PM Márton Balassi wrote: > > Hi Flink & Paimon devs, > > The Flink webpage documentatio

[DISCUSS] Remove legacy Paimon (TableStore) doc link from Flink web navigation

2023-10-17 Thread Márton Balassi
Hi Flink & Paimon devs, The Flink webpage documentation navigation section still lists the outdated TableStore 0.3 and master docs as subproject docs (see attachment). I am all for advertising Paimon as a sister project of Flink, but the current state is misleading in multiple ways. I would like

[RESULT][VOTE] FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink

2023-10-17 Thread Péter Váry
Hi all, I am happy to announce that FLIP-371: FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink[1] has been accepted. There are 7 approving votes, 6 of which are binding: - Gyula Fóra(binding) - Márton Balassi (binding) - Leonard Xu (binding) - Gabor Somogyi

Re:[VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Yuepeng Pan
+1 (non-binding) Best,Yuepeng Pan At 2023-10-17 15:51:59, "Yu Chen" wrote: >Hi all, > >Thank you to everyone for the feedback and detailed comments on FLIP-375[1]. >Based on the discussion thread [2], I think we are ready to take a vote to >contribute this to Flink. >I'd like to start a vote fo

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Yun Tang
+1 (binding) Best, Yun Tang From: Zhanghao Chen Sent: Tuesday, October 17, 2023 15:57 To: dev@flink.apache.org Cc: myas...@live.com Subject: Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler +1 (non-binding) Best, Zhanghao Chen __

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Yu Chen Sent: Tuesday, October 17, 2023 15:51 To: dev@flink.apache.org Cc: myas...@live.com Subject: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler Hi all, Thank you to everyone for the feedback and d

Re: [VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Rui Fan
+1(binding) Best, Rui On Tue, Oct 17, 2023 at 3:52 PM Yu Chen wrote: > Hi all, > > Thank you to everyone for the feedback and detailed comments on > FLIP-375[1]. > Based on the discussion thread [2], I think we are ready to take a vote to > contribute this to Flink. > I'd like to start a vote f

[VOTE] FLIP-375: Built-in cross-platform powerful java profiler

2023-10-17 Thread Yu Chen
Hi all, Thank you to everyone for the feedback and detailed comments on FLIP-375[1]. Based on the discussion thread [2], I think we are ready to take a vote to contribute this to Flink. I'd like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends, unless there i

[jira] [Created] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
Xin Chen created FLINK-33288: Summary: Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned Key: FLINK-33288 URL: https://issues.apache.org/jira/browse/FLINK-33288