[off for 3 months]

2024-05-25 Thread Etienne Chauchot
Hi all, I'll be off for 3 months backpacking in Asia. So I'll be unavailable during that time. See you when I get back. Best Etienne

Re: [connectors] Notice to connector authors

2024-03-04 Thread Etienne Chauchot
on their own? Thank you! On Mar 4, 2024 at 10:23 +0100, Etienne Chauchot , wrote: Hi connector authors, I'd like to bring a piece of information about the CI of connectors: With the release of flink-connector-parent 1.1.0, you can now skip the archunit tests for a particular CI build as described

[connectors] Notice to connector authors

2024-03-04 Thread Etienne Chauchot
Hi connector authors, I'd like to bring a piece of information about the CI of connectors: With the release of flink-connector-parent 1.1.0, you can now skip the archunit tests for a particular CI build as described here [1]. Indeed, each connector needs to be tested against last 2 minor

[ANNOUNCE] Apache flink-connector-parent 1.1.0 released

2024-02-29 Thread Etienne Chauchot
, Etienne Chauchot

[RESULT] [VOTE] flink-connector-parent 1.1.0, release candidate #2

2024-02-28 Thread Etienne Chauchot
Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 8 approving votes, 3 of which are binding: * Qingsheng Ren (binding) * Rui Fan (non-binding) * Leonard Xu (binding) * Hang Ruan (non-binding) * Sergey Nuyanzin (non-binding) * Zhongqiang Gong

Re: [VOTE] Release flink-connector-parent 1.1.0 release candidate #2

2024-02-28 Thread Etienne Chauchot
Hi all, The vote on flink-connector-parent 1.1.0 RC2 is now closed. The result will be announced in a separate email. Best Etienne Le 27/02/2024 à 12:23, Chesnay Schepler a écrit : +1 - pom contents - source contents - Website PR On 19/02/2024 18:33, Etienne Chauchot wrote: Hi everyone

Re: [VOTE] Release flink-connector-parent 1.1.0 release candidate #2

2024-02-22 Thread Etienne Chauchot
Feb 20, 2024 at 1:34 AM Etienne Chauchot < echauc...@apache.org> wrote: Hi everyone, Please review and vote on the release candidate #2 for the version 1.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete

[VOTE] Release flink-connector-parent 1.1.0 release candidate #2

2024-02-19 Thread Etienne Chauchot
Hi everyone, Please review and vote on the release candidate #2 for the version 1.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes

Re: [VOTE] Release flink-connector-parent, release candidate #1

2024-02-16 Thread Etienne Chauchot
nvalidates basically all the votes, because now the checked artifact has changed. It was requested to file a ticket as a follow-up, not to immediately change the binary. We can't have a lazy consensus on a release topic, with a changed artifact. Best regards, Martijn On Thu, Feb 15, 2024 at 2:32 

Re: [VOTE] Release flink-connector-parent, release candidate #1

2024-02-15 Thread Etienne Chauchot
since last change. Best Etienne Le 13/02/2024 à 13:24, Etienne Chauchot a écrit : Hi all, I fixed the source release [1] as requested, it no more contains tools/release/shared directory. I found out why it contained that directory, it was because parent_pom branch was referring

Re: [VOTE] Release flink-connector-parent, release candidate #1

2024-02-13 Thread Etienne Chauchot
-connector-shared-utils/releases/tag/v1.1.0-rc1 Le 05/02/2024 à 12:36, Etienne Chauchot a écrit : Hi, I just got back from vacations. I'll close the vote thread and proceed to the release later this week. Here is the ticket: https://issues.apache.org/jira/browse/FLINK-34364 Best Etienne Le

Re: [VOTE] Release flink-connector-parent, release candidate #1

2024-02-05 Thread Etienne Chauchot
/2024 15:59, Maximilian Michels wrote: - Inspected the source for licenses and corresponding headers - Checksums and signature OK +1 (binding) On Tue, Jan 23, 2024 at 4:08 PM Etienne Chauchot wrote: Hi everyone, Please review and vote on the release candidate #1 for the version 1.1.0

[jira] [Created] (FLINK-34364) stage_source_release.sh should exclude tools/release directory from the source release

2024-02-05 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-34364: Summary: stage_source_release.sh should exclude tools/release directory from the source release Key: FLINK-34364 URL: https://issues.apache.org/jira/browse/FLINK-34364

[jira] [Created] (FLINK-34363) Connectors release utils should allow to not specify flink version in stage_jars.sh

2024-02-05 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-34363: Summary: Connectors release utils should allow to not specify flink version in stage_jars.sh Key: FLINK-34363 URL: https://issues.apache.org/jira/browse/FLINK-34363

[VOTE] Release flink-connector-parent, release candidate #1

2024-01-23 Thread Etienne Chauchot
Hi everyone, Please review and vote on the release candidate #1 for the version 1.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes

[jira] [Created] (FLINK-34137) Update CI to test archunit configuration

2024-01-17 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-34137: Summary: Update CI to test archunit configuration Key: FLINK-34137 URL: https://issues.apache.org/jira/browse/FLINK-34137 Project: Flink Issue Type

[jira] [Created] (FLINK-34136) Execute archunit tests only with Flink version that connectors were built against

2024-01-17 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-34136: Summary: Execute archunit tests only with Flink version that connectors were built against Key: FLINK-34136 URL: https://issues.apache.org/jira/browse/FLINK-34136

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-04 Thread Etienne Chauchot
Congrats! Welcome onboard. Best Etienne Le 04/01/2024 à 03:14, Jane Chan a écrit : Congratulations, Alex! Best, Jane On Thu, Jan 4, 2024 at 10:03 AM Junrui Lee wrote: Congratulations, Alex! Best, Junrui weijie guo 于2024年1月4日周四 09:57写道: Congratulations, Alex! Best regards, Weijie

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-12-22 Thread Etienne Chauchot
Thanks Max ! Etienne Le 21/12/2023 à 16:22, Maximilian Michels a écrit : Anyone for pushing my pub key to apache dist ? Done. On Thu, Dec 21, 2023 at 2:36 PM Etienne Chauchot wrote: Hello, All the ongoing PRs on this repo were merged. But, I'd like to leave some more days until feature

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-12-21 Thread Etienne Chauchot
! I've been following this discussion (while looking and building a lot of the connectors): +1 (non-binding) to doing a 1.1.0 release adding the configurability of surefire and jvm flags. Thanks for driving this! Ryan On Fri, Dec 15, 2023 at 2:06 PM Etienne Chauchot wrote: Hi PMC members

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-12-15 Thread Etienne Chauchot
Hi PMC members, Version will be 1.1.0 and not 1.0.1 as one of the PMC members already created this version tag in jira and tickets are targeted to this version. Anyone for pushing my pub key to apache dist ? Thanks Etienne Le 14/12/2023 à 17:51, Etienne Chauchot a écrit : Hi all, It has

Re: [VOTE] FLIP-396: Trial to test GitHub Actions as an alternative for Flink's current Azure CI infrastructure

2023-12-13 Thread Etienne Chauchot
Thanks Matthias for your hard work ! +1 (binding) Best Etienne Le 12/12/2023 à 11:23, Lincoln Lee a écrit : +1 (binding) Thanks for driving this! Best, Lincoln Lee Yun Tang 于2023年12月12日周二 17:52写道: Thanks for Matthias driving this work! +1 (binding) Best Yun Tang

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-07 Thread Etienne Chauchot
Big +1, thanks this will be a very useful addition to Flink. Best Etienne Le 07/12/2023 à 09:26, Hang Ruan a écrit : +1 for contributing CDC Connectors to Apache Flink. Best, Hang Yuxin Tan 于2023年12月7日周四 16:05写道: Cool, +1 for contributing CDC Connectors to Apache Flink. Best, Yuxin

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-12-05 Thread Etienne Chauchot
, 16:55 Etienne Chauchot wrote: Thanks Sergey for your vote. Indeed I have listed only the PRs merged since last release but there are these 2 open PRs that could be worth reviewing/merging before release. https://github.com/apache/flink-connector-shared-utils/pull/25 https://github.com/apache

Re: [VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-12-04 Thread Etienne Chauchot
Correct, I forgot that in the bylaws, committer vote is binding for FLIPs thanks for the reminder. Best Etienne Le 30/11/2023 à 10:43, Leonard Xu a écrit : +1(binding) Btw, @Etienne, IIRC, your vote should be a binding one. Best, Leonard 2023年11月30日 下午5:03,Etienne Chauchot 写道: +1

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-11-30 Thread Etienne Chauchot
could we have this as well in the coming release? On Wed, Nov 29, 2023 at 11:40 AM Etienne Chauchot wrote: Hi all, I would like to discuss making a v1.0.1 release of flink-connector-parent. Since last release, there were only 2 changes: -https://github.com/apache/flink-connector-shared-utils

Re: [VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-30 Thread Etienne Chauchot
+1 (non-biding) Etienne Le 30/11/2023 à 09:13, Rui Fan a écrit : +1(binding) Best, Rui On Thu, Nov 30, 2023 at 3:56 PM Lijie Wang wrote: +1 (binding) Best, Lijie Zhu Zhu 于2023年11月30日周四 13:13写道: +1 Thanks, Zhu Xia Sun 于2023年11月30日周四 11:41写道: Hi everyone, I'd like to start a vote

[DISCUSS] Release flink-connector-parent v1.01

2023-11-29 Thread Etienne Chauchot
Hi all, I would like to discuss making a v1.0.1 release of flink-connector-parent. Since last release, there were only 2 changes: - https://github.com/apache/flink-connector-shared-utils/pull/19 (spotless addition) - https://github.com/apache/flink-connector-shared-utils/pull/26 (surefire

Re: [DISCUSSION] flink-connector-shared-utils release process

2023-11-29 Thread Etienne Chauchot
Thanks Leonard for the review. Best, Etienne Le 29/11/2023 à 08:25, Leonard Xu a écrit : Thanks Etienne for update the wiki, I just checked the change by comparing with history version, LGTM Best, Leonard 2023年11月28日 下午10:43,Etienne Chauchot 写道: Hi all, I just updated the doc:https

Re: [DISCUSS] FLIP-395: Migration to GitHub Actions

2023-11-28 Thread Etienne Chauchot
Hi all, FYI there is the ASF infra roundtable soon. One of the subjects for this session is GitHub Actions. It could be worth passing by: December 6th, 2023 at 1700 UTC on the #Roundtablechannel on Slack. For information about theroundtables, and about how to join,

Re: [DISCUSSION] flink-connector-shared-utils release process

2023-11-28 Thread Etienne Chauchot
Hi all, I just updated the doc: https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development Best Etienne Le 27/11/2023 à 12:43, Etienne Chauchot a écrit : Sure! Le 23/11/2023 à 02:57, Leonard Xu a écrit : Thanks Etienne for driving this. - a flink-connector

Re: [DISCUSS] Contribute Flink Doris Connector to the Flink community

2023-11-27 Thread Etienne Chauchot
+1 as well Best Etienne Le 27/11/2023 à 06:22, Jing Ge a écrit : That sounds great! +1 Best regards Jing On Mon, Nov 27, 2023 at 3:38 AM Leonard Xu wrote: Thanks wudi for kicking off the discussion, +1 for the idea from my side. A FLIP like Yun posted is required if no other

Re: Sending a hi!

2023-11-27 Thread Etienne Chauchot
Welcome to the community Pranav ! Best Etienne Le 25/11/2023 à 17:59, Pranav Sharma a écrit : Hi everyone, I am Pranav, and I am getting started to contribute to the Apache Flink project. I have been previously contributing to another Apache project, Allura. I came across flink during my

Re: [DISCUSSION] flink-connector-shared-utils release process

2023-11-27 Thread Etienne Chauchot
Sure! Le 23/11/2023 à 02:57, Leonard Xu a écrit : Thanks Etienne for driving this. - a flink-connector-shared-utils-*test* clone repo and a *io.github.user.flink*:flink-connector-parent custom artifact to be able to directly commit and install the artifact in the CI - a custom ci script

Re: [DISCUSSION] flink-connector-shared-utils release process

2023-11-22 Thread Etienne Chauchot
I tested my changes thanks for confirming that it's ok I wonder whether it should be documented somewhere, since it is not very obvious? On Wed, Nov 22, 2023 at 10:35 AM Etienne Chauchot wrote: Hi Sergey, The other alternative that allows for autonomous testing of ci changes (thanks @Chesnay

Re: [DISCUSSION] flink-connector-shared-utils release process

2023-11-22 Thread Etienne Chauchot
it helps, Best Etienne Le 22/11/2023 à 00:52, Sergey Nuyanzin a écrit : Hi Etienne thanks for starting this discussion +1 from my side for snapshots since I also faced same issue On Thu, Nov 9, 2023 at 11:21 AM Etienne Chauchot wrote: Hi all, flink-connector-shared-utils contains

[DISCUSSION] flink-connector-shared-utils release process

2023-11-09 Thread Etienne Chauchot
Hi all, flink-connector-shared-utils contains utilities for connectors (parent pom, ci scripts, template test connector project etc...). It is divided into 2 main branches: - parent_pom (1) containing just a pom.xml - ci_utils (2) containing the test project using the parent pom and the ci

Re: [DISCUSS] Connector releases for Flink 1.18

2023-11-08 Thread Etienne Chauchot
Hi, Thanks for starting the discussion, I already started testing Cassandra connector on Flink 1.18. The error in the nightly build linked here is a known issue tracked by FLINK-32353. To fix it, it needs a change in connector-parent and in the ci utils that are tracked by FLINK-32563. Best

Review request

2023-11-06 Thread Etienne Chauchot
Hi everyone, Is there anyone available to review this PR (1) that I opened 1,5 month ago ? People I've pinged seem to be unavailable at the moment. Thanks [1] https://github.com/apache/flink/pull/23443 Best Etienne

Re: off for a week

2023-10-27 Thread Etienne Chauchot
Thanks Max ! Le 26/10/2023 à 15:44, Maximilian Michels a écrit : Have a great time off, Etienne! On Thu, Oct 26, 2023 at 3:38 PM Etienne Chauchot wrote: Hi, FYI, I'll be off and unresponsive for a week starting tomorrow evening. For ongoing work, please ping me before tomorrow evening

off for a week

2023-10-26 Thread Etienne Chauchot
Hi, FYI, I'll be off and unresponsive for a week starting tomorrow evening. For ongoing work, please ping me before tomorrow evening or within a week Best Etienne

Re: [ANNOUNCE] The Flink Speed Center and benchmark daily run are back online

2023-10-25 Thread Etienne Chauchot
Nice ! Thank you and everyone involved for the hard work. Etienne Le 19/10/2023 à 10:24, Zakelly Lan a écrit : Hi everyone, Flink benchmarks [1] generate daily performance reports in the Apache Flink slack channel (#flink-dev-benchmarks) to detect performance regression [2]. Those benchmarks

Re: [DISCUSSION] test connectors against Flink master in PRs

2023-10-11 Thread Etienne Chauchot
Hi, Cross-posting in that thread too: FYI, build issues for connectors related to architecture tests adding or removing violations is under fixing and tracked here (1) [1] https://issues.apache.org/jira/browse/FLINK-32563 Best Etienne Le 03/07/2023 à 10:05, Etienne Chauchot a écrit

Re: [ANNOUNCE] Release 1.18.0, release candidate #1

2023-10-11 Thread Etienne Chauchot
+1 (binding) On Fri, Sep 29, 2023 at 10:34 AM Etienne Chauchot echauc...@apache.org wrote: Hi all, Thanks to the team for this RC. I did a quick check of this RC against user pipelines (1) coded with DataSet (even if deprecated and soon removed), DataStream and SQL APIs based on the

Re: [ANNOUNCE] Release 1.18.0, release candidate #1

2023-09-29 Thread Etienne Chauchot
Hi all, Thanks to the team for this RC. I did a quick check of this RC against user pipelines (1) coded with DataSet (even if deprecated and soon removed), DataStream and SQL APIs based on the small scope of this test, LGTM +1 (non-binding) [1]

[jira] [Created] (FLINK-33059) Support transparent compression for file-connector for all file input formats

2023-09-07 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-33059: Summary: Support transparent compression for file-connector for all file input formats Key: FLINK-33059 URL: https://issues.apache.org/jira/browse/FLINK-33059

Re: [ANNOUNCE] Updates to Flink's external connector CI workflows

2023-08-16 Thread Etienne Chauchot
This is great! Thanks for working on this. Best Etienne Le 15/06/2023 à 13:19, Martijn Visser a écrit : Hi all, I would like to inform you of two changes that have been made to the shared CI workflow that's used for Flink's externalized connectors. 1. Up until now, weekly builds were

[RESULT][VOTE] FLIP-322 Cooldown period for adaptive scheduler

2023-08-10 Thread Etienne Chauchot
Hi, The vote has been closed. Thank you for your votes. Here is the result: Binding votes (3 in total): - Martijn Visser - Rui Fan - Maximilian Michels Non-binding votes (1 in total): - Prabhu Joseph According to the Flink Bylaws [1], consensus + three committer votes are required to accept

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

2023-08-10 Thread Etienne Chauchot
Thanks Max! Etienne Le 09/08/2023 à 12:53, Maximilian Michels a écrit : +1 (binding) -Max On Tue, Aug 8, 2023 at 10:56 AM Etienne Chauchot wrote: Hi all, As part of Flink bylaws, binding votes for FLIP changes are active committer votes. Up to now, we have only 2 binding votes. Can one

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

2023-08-08 Thread Etienne Chauchot
Hi all, As part of Flink bylaws, binding votes for FLIP changes are active committer votes. Up to now, we have only 2 binding votes. Can one of the committers/PMC members vote on this FLIP ? Thanks Etienne Le 08/08/2023 à 10:19, Etienne Chauchot a écrit : Hi Joseph, Thanks

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

2023-08-08 Thread Etienne Chauchot
during the restart. 2. There is only one restart with Cool Down Period which happened when the 8th node got added back. Job Parallelism 13 -> 20 -> 27 -> 34 -> 41 -> 48 -> 55 → 62 → 69 13 → 69 NumRestarts 8 1 On Wed, Jul 12, 2023 at 8:03 PM Etienne Chauchot wrote:

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

2023-07-12 Thread Etienne Chauchot
/22985 Best Etienne Le 12/07/2023 à 09:56, Etienne Chauchot a écrit : Hi all, Would you mind casting your vote to this second vote thread (opened after new discussions) so that the subject can move forward ? @David, @Chesnay, @Robert you took part to the discussions, can you please sent your

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

2023-07-12 Thread Etienne Chauchot
, Etienne Chauchot a écrit : Hi all, Thanks for your feedback about the FLIP-322: Cooldown period for adaptive scheduler [1]. This FLIP was discussed in [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until July 9th 15:00 GMT) unless there is an objection

[jira] [Created] (FLINK-32563) Allow connectors CI to specify the main supported Flink version

2023-07-07 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-32563: Summary: Allow connectors CI to specify the main supported Flink version Key: FLINK-32563 URL: https://issues.apache.org/jira/browse/FLINK-32563 Project

[VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

2023-07-06 Thread Etienne Chauchot
Hi all, Thanks for your feedback about the FLIP-322: Cooldown period for adaptive scheduler [1]. This FLIP was discussed in [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until July 9th 15:00 GMT) unless there is an objection or insufficient votes. [1]

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-07-06 Thread Etienne Chauchot
Hi, I think we have reached a consensus here. I have updated the FLIP to reflect recent suggestions. I will start a new vote. Best Etienne Le 05/07/2023 à 14:42, Etienne Chauchot a écrit : Hi all, Thanks David for your suggestions. Comments inline. Le 04/07/2023 à 13:35, David Morávek

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-07-05 Thread Etienne Chauchot
ignore all of shouldRescale, yes, but you shouldn't do that in the first place. I agree, this is not what I planned to implement. That sounds great; let's go ahead and outline this in the FLIP. Best, D. On Tue, Jul 4, 2023 at 12:30 PM Etienne Chauchot wrote: Hi all, Thanks David fo

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-07-04 Thread Etienne Chauchot
the new behavior nothing happens unless the addition arrives after scaling-interval.max. Best Etienne Best, D. On Thu, Jun 29, 2023 at 3:43 PM Etienne Chauchot wrote: Thanks Chesnay for your feedback. I have updated the FLIP. I'll start a vote thread. Best Etienne Le 28/06/2023 à 11:49

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler

2023-07-04 Thread Etienne Chauchot
Hi all, @David, I just saw your comments on the [DISCUSSION] thread. I'll close this vote for now and open a new voting thread when the discussion reaches a consensus. Best Etienne Le 04/07/2023 à 10:49, Etienne Chauchot a écrit : Hi David, Indeed, this thread was a proper separate

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler

2023-07-04 Thread Etienne Chauchot
until there is a proper voting thread. Best, D. On Mon, Jul 3, 2023 at 4:40 PM ConradJam wrote: +1 (no-binding) Etienne Chauchot 于2023年7月3日周一 15:57写道: Hi all, The vote closes within 6 hours and, as for now, there was no vote. This is a very short FLIP, that takes a few minutes to read

Re: [DISCUSSION] test connectors against Flink master in PRs

2023-07-03 Thread Etienne Chauchot
/2023 à 15:57, Etienne Chauchot a écrit : Hi Martijn, Thanks for your feedback. I makes total sense to me. I'll enable it for Cassandra. Best Etienne Le 29/06/2023 à 10:54, Martijn Visser a écrit : Hi Etienne, I think it all depends on the actual maintainers of the connector to make

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler

2023-07-03 Thread Etienne Chauchot
Hi all, The vote closes within 6 hours and, as for now, there was no vote. This is a very short FLIP, that takes a few minutes to read. Please cast your vote so that the development could start. Thanks. Best Etienne Le 29/06/2023 à 15:51, Etienne Chauchot a écrit : Hi all, Thanks

Re: [DISCUSSION] test connectors against Flink master in PRs

2023-06-29 Thread Etienne Chauchot
/push_pr.yml On Wed, Jun 28, 2023 at 6:09 PM Etienne Chauchot wrote: Hi all, Connectors are external to flink. As such, they need to be tested against stable (released) versions of Flink. But I was wondering if it would make sense to test connectors in PRs also against latest flink master

[VOTE] FLIP-322 Cooldown period for adaptive scheduler

2023-06-29 Thread Etienne Chauchot
Hi all, Thanks for all the feedback about the FLIP-322: Cooldown period for adaptive scheduler [1]. This FLIP was discussed in [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until July 3rd 14:00 GMT) unless there is an objection or insufficient votes. [1]

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-29 Thread Etienne Chauchot
n a rescale happens". You can't express this with only one of the options. On 20/06/2023 14:41, Etienne Chauchot wrote: Hi Chesnay, Thanks for your feedback. Comments inline Le 16/06/2023 à 17:24, Chesnay Schepler a écrit : 1) Options specific to the adaptive schedu

[DISCUSSION] test connectors against Flink master in PRs

2023-06-28 Thread Etienne Chauchot
Hi all, Connectors are external to flink. As such, they need to be tested against stable (released) versions of Flink. But I was wondering if it would make sense to test connectors in PRs also against latest flink master snapshot to allow to discover failures before merging the PRs, **

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-20 Thread Etienne Chauchot
o just reset the cooldown period, so after recovery of a JobManager, we have to wait at least for the cooldown period until further scaling operations are done. 4. What's the relationship to the "jobmanager.adaptive-scheduler.resource-stabilization-timeout" configuration? Thanks a lo

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-16 Thread Etienne Chauchot
very of a JobManager, we have to wait at least for the cooldown period until further scaling operations are done. 4. What's the relationship to the "jobmanager.adaptive-scheduler.resource-stabilization-timeout" configuration? Thanks a lot for working on this! Best, Robert On Wed, Jun 14, 2

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-14 Thread Etienne Chauchot
Hi all, @Yukia,I updated the FLIP to include the aggregation of the staked operations that we discussed below PTAL. Best Etienne Le 13/06/2023 à 16:31, Etienne Chauchot a écrit : Hi Yuxia, Thanks for your feedback. The number of potentially stacked operations depends on the configured

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-13 Thread Etienne Chauchot
ing event and it'll be stacked with many scale up event which causes it'll take a long time to finish all? Can we just take the last one event? [1]: https://issues.apache.org/jira/browse/FLINK-21883 Best regards, Yuxia - 原始邮件 - 发件人: "Etienne Chauchot" 收件人: "dev" , "R

[DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-12 Thread Etienne Chauchot
Hi, I’d like to start a discussion about FLIP-322 [1] which introduces a cooldown period for the adaptive scheduler. I'd like to get your feedback especially @Robert as you opened the related ticket and worked on the reactive mode a lot. [1]

[DISCUSS] Make Preconditions/VisibleForTesting public

2023-06-05 Thread Etienne Chauchot
Hi all, As part of fixing the architecture-tests-production Connector rule in this PR [1], it appeared that (external) connectors depending on the non-public Preconditions/VisibleForTesting classes was a violation to the "connectors should not depend on non-public classes that are not in the

[jira] [Created] (FLINK-32222) Cassandra Source uses DataInputDeserializer and DataOutputSerializer non public apis

2023-05-31 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-3: Summary: Cassandra Source uses DataInputDeserializer and DataOutputSerializer non public apis Key: FLINK-3 URL: https://issues.apache.org/jira/browse/FLINK-3

Re: [VOTE] Release flink-connector-cassandra 3.1.0, release candidate #2

2023-05-09 Thread Etienne Chauchot
Hi everyone, +1 (non-binding) I checked: - release notes - tag - tested the prod artifact with https://github.com/echauchot/flink-samples Best Etienne Le 05/05/2023 à 11:39, Danny Cranmer a écrit : Hi everyone, Please review and vote on the release candidate #2 for the version 3.1.0, as

[jira] [Created] (FLINK-32014) Cassandra source documentation is missing

2023-05-05 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-32014: Summary: Cassandra source documentation is missing Key: FLINK-32014 URL: https://issues.apache.org/jira/browse/FLINK-32014 Project: Flink Issue Type

Re: [VOTE] Release flink-connector-cassandra v3.1.0, release candidate #1

2023-05-04 Thread Etienne Chauchot
, Leonard [1] https://issues.apache.org/jira/browse/FLINK-31927 [2] https://github.com/apache/flink-connector-cassandra/pull/13 2023年5月3日 下午5:26,Etienne Chauchot 写道: Hi all, @Danny, I just submitted the fix PR to unblock the release: https://github.com/apache/flink-connector-cassandra/pull/13

Re: [VOTE] Release flink-connector-cassandra v3.1.0, release candidate #1

2023-05-03 Thread Etienne Chauchot
/30c3yhd561o57x0prt7jqt055r4xd6lf On Mon, Apr 24, 2023 at 7:28 PM Etienne Chauchot wrote: Hi, Thanks Danny for driving this new release. It now contains the new source, thanks. I'm off but I wanted to test this release still. I made a very quick job (1) to read from a Cassandra cluster with the new source. I found an issue

Re: [VOTE] Release flink-connector-cassandra v3.1.0, release candidate #1

2023-04-24 Thread Etienne Chauchot
Hi, Thanks Danny for driving this new release. It now contains the new source, thanks. I'm off but I wanted to test this release still. I made a very quick job (1) to read from a Cassandra cluster with the new source. I found an issue: the source raises a j"ava.lang.NoClassDefFoundError:

[jira] [Created] (FLINK-31927) Cassandra source raises an exception on Flink 1.16.0 on a real Cassandra cluster

2023-04-24 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-31927: Summary: Cassandra source raises an exception on Flink 1.16.0 on a real Cassandra cluster Key: FLINK-31927 URL: https://issues.apache.org/jira/browse/FLINK-31927

Off for a week

2023-04-21 Thread Etienne Chauchot
Hi all, Just to let you know, I'll be off and unresponsive for a week starting tonight. Best Etienne

[jira] [Created] (FLINK-31870) Cassandra input/output formats documentation is missing

2023-04-20 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-31870: Summary: Cassandra input/output formats documentation is missing Key: FLINK-31870 URL: https://issues.apache.org/jira/browse/FLINK-31870 Project: Flink

Re: [VOTE] Release flink-connector-cassandra v3.0.1, release candidate #1

2023-04-13 Thread Etienne Chauchot
Hi, Thanks for driving this. Why is this release not including the latest changes mainly the new source connector merged in March 22nd? Unless I'm missing something here, I would vote -1 (not binding) on the current state. Best Etienne Le 13/04/2023 à 13:31, Danny Cranmer a écrit : Hi

Re: [blog article] Howto create a batch source with the new Source framework

2023-04-03 Thread Etienne Chauchot
documentation ? Thanks Etienne [1] https://echauchot.blogspot.com/2023/04/flink-howto-test-batch-source-with-new.html Le 03/04/2023 à 03:37, yuxia a écrit : Thanks Etienne for detail explanation. Best regards, Yuxia - 原始邮件 - 发件人: "Etienne Chauchot" 收件人: "dev"

Re: [blog article] Howto create a batch source with the new Source framework

2023-03-31 Thread Etienne Chauchot
ser is the one knowing the repartition of the partitions of the backend data. Best Etienne Welcome other devs to share opinion. [1]: https://issues.apache.org/jira/browse/FLINK-31065 Also as for split assigner . Best regards, Yuxia - 原始邮件 - 发件人: "Etienne Chauchot" 收件人: "dev&

[blog article] Howto create a batch source with the new Source framework

2023-03-30 Thread Etienne Chauchot
Hi all, After creating the Cassandra source connector (thanks Chesnay for the review!), I wrote a blog article about how to create a batch source with the new Source framework [1]. It gives field feedback on how to implement the different components. I felt it could be useful to people

Re: [ANNOUNCE] Apache Flink 1.17.0 released

2023-03-24 Thread Etienne Chauchot
Congrats to all the people involved! Best Etienne Le 23/03/2023 à 10:19, Leonard Xu a écrit : The Apache Flink community is very happy to announce the release of Apache Flink 1.17.0, which is the first release for the Apache Flink 1.17 series. Apache Flink® is an open-source unified stream

Re: [ANNOUNCE[ flink-connector-parent 1.0.0 released

2023-03-22 Thread Etienne Chauchot
Hi Chesnay, Thanks for the release and for upgrading the Cassandra connector parent. Best Etienne Le 22/03/2023 à 10:21, Chesnay Schepler a écrit : The release of flink-connector-parent 1.0.0 is complete. Update your connectors everyone. Let's get rid of the strange "zentol" thing.

Re: [VOTE] Release 1.17.0, release candidate #3

2023-03-22 Thread Etienne Chauchot
Hi Qingshen again, I just did an in-depth review of the release notes as promised. I have not opened the jira tickets though. PTAL Best Etienne Le 22/03/2023 à 08:43, Qingsheng Ren a écrit : Hi Jakub, Thanks for reviewing the release note and welcome to the Flink community! We will

Re: [VOTE] Release 1.17.0, release candidate #3

2023-03-22 Thread Etienne Chauchot
ent, which highlights breaking changes in this version. [1] https://github.com/apache/flink/pull/22146 Best, Qingsheng On Tue, Mar 21, 2023 at 6:15 PM Etienne Chauchot wrote: Hi all, - I read the release notes: I'd suggest if possible that we group the subtasks by main task and sho

Re: [VOTE] Release 1.17.0, release candidate #3

2023-03-21 Thread Etienne Chauchot
Hi all, - I read the release notes: I'd suggest if possible that we group the subtasks by main task and show the main tasks to give better understanding to the reader. - tested RC3 on a standalone cluster with this user code: https://github.com/echauchot/tpcds-benchmark-flink +1

Re: [VOTE] Release flink-connector-parent10.0, release candidate #1

2023-03-16 Thread Etienne Chauchot
Hi all, - checked the release notes - tested the connector-parent with under development Cassandra connector. +1 (non-biding) Best Etienne Le 15/03/2023 à 16:40, Chesnay Schepler a écrit : Hi everyone, Please review and vote on the release candidate, as follows: [ ] +1, Approve the release

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

2023-03-15 Thread Etienne Chauchot
Hi, Why not track this in a FLIP and a ticket and link this discussion thread. My 2 cents Etienne Le 15/03/2023 à 10:01, Hongshun Wang a écrit : Hi devs, I’d like to join this discussion. CC:Qingsheng As discussed above, new partitions after the first discovery should be consumed from

Re: [VOTE] Release 1.17.0, release candidate #2

2023-03-14 Thread Etienne Chauchot
Hi all, As promised, I ran the same tests on 1.17.0 RC2 I also verified the release notes. Based on the scope of these tests : +1 (non-binding) Etienne Le 14/03/2023 à 07:44, Qingsheng Ren a écrit : Hi everyone, Please review and vote on the release candidate #2 for the version 1.17.0, as

Re: [ANNOUNCE] Release 1.17.0, release candidate #1

2023-03-13 Thread Etienne Chauchot
Hi, Thanks Martijn and release managers for this RC. I tested it in a standalone cluster on this (1) benchmark / user code [1] https://github.com/echauchot/tpcds-benchmark-flink The RC works on this tested scope. I'll test again on RC2. Best Etienne Le 09/03/2023 à 20:31, Martijn Visser a

Re: [Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-13 Thread Etienne Chauchot
+1 (not binding) Etienne Le 11/03/2023 à 07:37, Yangze Guo a écrit : +1 (binding) Zhanghao Chen 于 2023年3月10日周五 下午5:07写道: Thanks Weihua. +1 (non-binding) Best, Zhanghao Chen From: Weihua Hu Sent: Thursday, March 9, 2023 13:27 To: dev Subject: [Vote]

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2023-03-13 Thread Etienne Chauchot
PubSub Connector [1]. Best, Konstantin [1] https://issues.apache.org/jira/browse/FLINK-22380 Am Mi., 8. März 2023 um 14:45 Uhr schrieb Etienne Chauchot < echauc...@apache.org>: Hi, I agree with Ryan, even if clients might be totally different the backend technologies are the same so h

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2023-03-08 Thread Etienne Chauchot
Hi, I agree with Ryan, even if clients might be totally different the backend technologies are the same so hosting them in the same repo makes sense. Similar thinking made us put all the Cassandra related connectors in the same cassandra repo. Etienne Le 02/03/2023 à 14:43, Daniel Collins

Re: [ANNOUNCE] Apache Flink 1.16.1 released

2023-02-06 Thread Etienne Chauchot
Hi, Thanks to everyone involved. Best Etienne Le 02/02/2023 à 03:55, weijie guo a écrit : Thank Martin for managing the release and all the people involved. Best regards, Weijie Konstantin Knauf 于2023年2月2日周四 06:40写道: Great. Thanks, Martijn for managing the release. Am Mi., 1. Feb.

[jira] [Created] (FLINK-30805) SplitEnumerator#handleSplitRequest() should be called automatically

2023-01-27 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-30805: Summary: SplitEnumerator#handleSplitRequest() should be called automatically Key: FLINK-30805 URL: https://issues.apache.org/jira/browse/FLINK-30805 Project

[jira] [Created] (FLINK-30802) Improve SplitReader#fetch() documentation

2023-01-27 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-30802: Summary: Improve SplitReader#fetch() documentation Key: FLINK-30802 URL: https://issues.apache.org/jira/browse/FLINK-30802 Project: Flink Issue Type

  1   2   >