"Introduction to Apache Flink" presentation

2022-11-17 Thread Johannes Moser
Hi all, I was talking at a meetup yesterday about Apache Flink. There is this Google Presentation that was created earlier and never has been updated. As I had to come up with a presentation anyhow I used this and updated it. See the result in [1]. First, I'd like to get feedback on the updated

Re: [DISCUSS] Flink release retro

2022-11-03 Thread Johannes Moser
Hi, We did something like this for the 1.14 release [1]. We did that in an async survey-style way approaching key contributors directly. I also think the output was quite nice and we got positive feedback for what we published. I think Robert mentioned they did something similar in the past, with

Re: [DISCUSS] Planning Flink 1.16 with the community

2022-05-09 Thread Johannes Moser
Thanks Chesnay, Godfrey, Xingbo and Martijn for volunteering as release managers. I would also recommend to have an eye on the "Release Notes:" fields in JIRA for related issues early, as this is used to assemble the final release notes. I'd also like to take the chance to ask contributors to

Re: [ANNOUNCE] Apache Flink 1.15.0 released

2022-05-06 Thread Johannes Moser
Yes!  Thanks to the whole community. All this involvement keeps impressing me. > On 06.05.2022, at 01:42, Thomas Weise wrote: > > Thank you to all who contributed for making this release happen! > > Thomas > > On Thu, May 5, 2022 at 7:41 AM Zhu Zhu wrote: >> >> Thanks Yun, Till and Joe

Re: [DISCUSS] Planning Flink 1.16

2022-04-27 Thread Johannes Moser
Hi Konstantin, Feature freeze end of July sounds reasonable. I think what we learned with the 1.15 release pushing it to a later point in time due to holidays etc., might set the tone early. Best, Joe > On 26.04.2022, at 12:23, Konstantin Knauf wrote: > > Hi everyone, > > With Flink 1.15

Re: [DISCUSS] Roadmap update for 1.15

2022-04-13 Thread Johannes Moser
er/ > [3] https://github.com/apache/flink-web/pull/526 > > Best, > Jingsong > > On Wed, Apr 13, 2022 at 3:06 PM Johannes Moser wrote: >> >> Dear Flink Community, >> >> I created a PR to update the roadmap. >> >> Please have a look at the new

[DISCUSS] Roadmap update for 1.15

2022-04-13 Thread Johannes Moser
Dear Flink Community, I created a PR to update the roadmap. Please have a look at the new feature radar as well as on the overview of the most important efforts that are coming up. https://github.com/apache/flink-web/pull/527 Best, Joe

Re: [VOTE] Release 1.15.0, release candidate #1

2022-04-12 Thread Johannes Moser
Here is the missing link to the announcement blogpost [6] [6] https://github.com/apache/flink-web/pull/526 > On 11.04.2022, at 20:12, Yun Gao wrote: > > Hi everyone, > > Please review and vote on the release candidate #1 for the version 1.15.0, as > follows: > [ ] +1, Approve the release > [

Flink 1.15 Stabilisation Sync

2022-03-28 Thread Johannes Moser
Dear Community, We are fairly on track with stabilising the 1.15 release, that’s why Yun Gao and me think we don’t need the sync anymore. So we skip it for now, starting from tomorrow. If the situation might change. We will let you know. Best, Joe

Apache Flink 1.15 Meetup

2022-03-23 Thread Johannes Moser
Dear Flink community, On the 30th of March we will host a meetup on the upcoming Flink 1.15 release. Get all the information here [1]. There will also be an AMA with Matthias and Chesnay. If you already got a question on your mind, let me know. You might want to have a look at the release wiki

Weekly 1.15 Sync tomorrow cancelled

2022-03-21 Thread Johannes Moser
Hello, As all relevant issues are assigned and worked on there’s no need to sync tomorrow. Therefor we decided to cancel the sync. Best, Joe

Re: Flink 1.15 Stabilisation Sync skipped tomorrow

2022-03-14 Thread Johannes Moser
ng manually testing on my own stuff. >> >> On Tue, Mar 8, 2022 at 3:46 AM Johannes Moser wrote: >> >>> Thanks so much Gabor and Galen. >>> >>> Very much appreciated. >>> >>>> On 07.03.2022, at 19:00, Galen Warren wrote: >>&g

Re: [ANNOUNCE] New PMC member: Yuan Mei

2022-03-14 Thread Johannes Moser
Congrats Yuan. > On 14.03.2022, at 09:45, Arvid Heise wrote: > > Congratulations and well deserved! > > On Mon, Mar 14, 2022 at 9:30 AM Matthias Pohl wrote: > >> Congratulations, Yuan. >> >> On Mon, Mar 14, 2022 at 9:25 AM Shuo Cheng wrote: >> >>> Congratulations, Yuan! >>> >>> On Mon,

Cutting the 1.15 branch and releasing RC0

2022-03-10 Thread Johannes Moser
Dear Apache Flink community, It looks like we are closing in on the blockers. [1] We talked today to the contributors working on the issues and it looks like we can get them done this week. There are still some issues for manual testing in progress. [2] Please complete that as soon as possible

Re: Flink 1.15 Stabilisation Sync skipped tomorrow

2022-03-08 Thread Johannes Moser
>> <https://issues.apache.org/jira/browse/FLINK-26468>. >> >> G >> >> On Mon, Mar 7, 2022 at 5:15 PM Johannes Moser wrote: >> >>> Hello, >>> >>> We will skip tomorrows weekly stabilisation sync. >>> It looks like al

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

2022-03-08 Thread Johannes Moser
Very well deserved. > On 08.03.2022, at 05:43, Lincoln Lee wrote: > > Congratulations David! > > Best, > Lincoln Lee > > > Yun Gao 于2022年3月8日周二 11:24写道: > >> Congratulations David! >> >> Best, >> Yun Gao >> >> >> -- >>

Flink 1.15 Stabilisation Sync skipped tomorrow

2022-03-07 Thread Johannes Moser
Hello, We will skip tomorrows weekly stabilisation sync. It looks like all blockers are assigned and worked on. A significant number of contributors are on holiday tomorrow. Currently we plan to cut off the 1.15 branch on Wednesday of Thursday this week. In case you want to contribute

Re: [ANNOUNCE] New Apache Flink Committer - Martijn Visser

2022-03-04 Thread Johannes Moser
Congratulations Martijn, Well deserved. > On 03.03.2022, at 16:49, Robert Metzger wrote: > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Martijn Visser as a new > Flink committer. > > Martijn is a very active Flink community member, driving a lot of efforts > on the

Flink 1.15 Stabilisation Weekly Update

2022-03-01 Thread Johannes Moser
Dear Apache Flink Community, Today we had another weekly. It looks like we are getting closer to the release. **Cutting off the feature branch** We decided to push the cut of the feature branch by another week as this makes adding fixes easier and there is no pressure in regards of new features

Re: [DISCUSS] Plan to externalize connectors and versioning

2022-02-18 Thread Johannes Moser
+1 (non-binding) > On 18.02.2022, at 15:12, Konstantin Knauf wrote: > > +1 to the approach. > > I expect that we will encounter more questions and challenges as we go, > but these are best discussed and addressed in the context of a specific > connector like ElasticSearch. > > On Fri, Feb 18,

Re: [ANNOUNCE] Apache Flink 1.13.6 released

2022-02-18 Thread Johannes Moser
Thanks. Great job. > On 18.02.2022, at 14:36, Martijn Visser wrote: > > Hi Konstantin, > > Thanks for driving the release. Thanks to everyone that has contributed > with bug fixes and other improvements! > > Best regards, > > Martijn Visser > https://twitter.com/MartijnVisser82 > > > On

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-17 Thread Johannes Moser
 > On 17.02.2022, at 10:19, Yuan Mei wrote: > > Congratulations! > > Best Regards, > Yuan > > On Thu, Feb 17, 2022 at 5:17 PM Aitozi wrote: > >> Congratulations! >> >> Best, >> Aitozi >> >> >> Guowei Ma 于2022年2月17日周四 15:53写道: >> >>> Congratulations >>> >>> Best, >>> Guowei >>> >>>

Re: [ANNOUNCE] Pushing the feature freeze by a couple of days

2022-02-14 Thread Johannes Moser
> On 11.02.2022, at 09:54, Johannes Moser wrote: > > Dear Apache Flink Community, > > As we have been facing some CI instabilities due to some infrastructure > issues in the last couple of days we might push the feature freeze for 1.15. > by a couple of days. > We wil

Re: Azure Pipelines are dealing with an incident, causing pipeline runs to fail

2022-02-11 Thread Johannes Moser
Thanks Martijn and everyone involved. > On 11.02.2022, at 09:02, Martijn Visser wrote: > > Hi all, > > The issue has been resolved now indeed. The cause was the following: > > - Azure had an outage [1] > - When that outage was resolved, all of Flink's free build agents were > gone. > - A

[ANNOUNCE] Pushing the feature freeze by a couple of days

2022-02-11 Thread Johannes Moser
Dear Apache Flink Community, As we have been facing some CI instabilities due to some infrastructure issues in the last couple of days we might push the feature freeze for 1.15. by a couple of days. We will evaluate the situation on the go and will keep you up to date. Best, Joe

Re: [DISCUSS] Pushing Apache Flink 1.15 Feature Freeze

2022-01-27 Thread Johannes Moser
;>>> >>>> Thanks Joe for driving. >>>> >>>> Best, >>>> Jingsong >>>> >>>> On Wed, Jan 26, 2022 at 12:04 AM Martijn Visser >> >>>> wrote: >>>>> >>>>> Hi all, >

[DISCUSS] Pushing Apache Flink 1.15 Feature Freeze

2022-01-25 Thread Johannes Moser
Dear Flink community, as mentioned in the summary mail earlier some contributors voiced that they would benefit from pushing the feature freeze for 1.15. by a week. This would mean Monday, 14th of February 2022, end of business CEST. Please let us know in case you got any concerns. Best,

Flink 1.15. Bi-weekly 2022-01-25

2022-01-25 Thread Johannes Moser
Dear Flink community, Today we had another bi-weekly for the Apache Flink 1.15 release. The planned feature freeze is just 2 weeks in. In the last two weeks there some progress and some features have been moved to “done”. We are now at 70 % according to the assessments of the responsible ICs.

Flink 1.15. Bi-weekly 2021-12-14

2021-12-14 Thread Johannes Moser
Dear Flink Community, Today we had the third release sync for the 1.15 release. Overview There are 8 weeks left until the feature freeze. Since the last sync the progress percentage went from 20% to 36%. Two more items have been completed making it a total of 5 out of 43 items on the

Re: [ANNOUNCE] New Apache Flink Committer - Matthias Pohl

2021-12-02 Thread Johannes Moser
Congrats Matthias. > On 02.12.2021, at 18:32, Martijn Visser wrote: > > Congratulations Matthias! > > Op do 2 dec. 2021 om 18:12 schreef Mika Naylor > >> Congratulations Matthias! >> >> Best, >> Mika >> >> On 02.12.2021 17:27, David Morávek wrote: >>> Congrats Matthias, well deserved ;)

Re: [ANNOUNCE] New Apache Flink Committer - Ingo Bürk

2021-12-02 Thread Johannes Moser
What Martijn said,  > On 02.12.2021, at 18:32, Martijn Visser wrote: > > Congrats Ingo, well deserved! > > Op do 2 dec. 2021 om 18:13 schreef Mika Naylor > >> Congratulations, Ingo! >> >> Best, >> Mika >> >> On 02.12.2021 17:37, Matthias Pohl wrote: >>> Congratulations, Ingo! Good job! :)

Re: [DISCUSS] Definition of Done for Apache Flink

2021-12-01 Thread Johannes Moser
; think that should be short and easily understandable, >> preferably >>>>> with as >>>>>>>> many automated checks as possible. >>>>>>>> >>>>>>>> I would propose something like this to cond

Flink 1.15. Bi-weekly 2021-11-30

2021-12-01 Thread Johannes Moser
Dear Flink Community, Today we had the second release sync for the 1.15 release. Some hard facts: There are 43 features listed, 3 of them are already done. We now introduced the progress percentage for each feature and building the average of it (neglecting the size of each

Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul

2021-11-15 Thread Johannes Moser
Congratulations Fabian. > On 15.11.2021, at 18:58, David Morávek wrote: > > Congratulations Fabian!! > > Best, > D. > > On Mon, Nov 15, 2021 at 5:10 PM Leonard Xu wrote: > >> Congratulations Fabian! >> >>> 在 2021年11月15日,22:50,Roman Khachatryan 写道: >>> >>> Congratulations Fabian! >>> >>>

1.15 release cycle feature overview

2021-11-15 Thread Johannes Moser
Dear Flink Community. In case you want to contribute something to the 1.15 Flink release I’d kindly asking you to add your features/changes to the 1.15 release overview page [1]. I, as one of the release managers, will keep track of the state of the changes. In case you have questions or need

[DISCUSS] Definition of Done for Apache Flink

2021-11-15 Thread Johannes Moser
Dear Flink Community, We as the release managers of the 1.15 release are suggesting to introduce a “Definition of Done". Let me elaborate a bit on the reasons: * During the release process for 1.14 the stability of master was sometimes in a state that made contributing to Apache Flink a bad

[Discuss] Planning Flink 1.15

2021-10-25 Thread Johannes Moser
Hi all, As people have already started working on their 1.15. contribution, we'd like to start the discussion for the release setup. - Release managers: As a team of three seems to have worked perfectly fine, we'd like to suggest Till, Yun Gao & Joe as the release managers for 1.15. -

Looking back at the Apache Flink 1.14 development cycle / getting better for 1.15

2021-10-20 Thread Johannes Moser
Dear Flink community, In preparation for the 1.15 development cycle of Apache Flink (it already started) and preparing the release management we are collecting feedback from the community. If you didn’t have a chance to look at the release announcement you might want to do that now [1] Also

Re: [ANNOUNCE] Apache Flink Stateful Functions 3.1.0 released

2021-09-01 Thread Johannes Moser
Congratulations, great job.  > On 31.08.2021, at 17:09, Igal Shilman wrote: > > The Apache Flink community is very happy to announce the release of Apache > Flink Stateful Functions (StateFun) 3.1.0. > > StateFun is a cross-platform stack for building Stateful Serverless > applications,

Flink 1.14 Weekly 2021-08-31

2021-08-31 Thread Johannes Moser
Dear Apache Flink community, Today was another update and more and more features are moving into the glorious state of “done done”. *RC0* Xintong did a great job in cutting of the 1.14 branch and releasing the first release candidate that is available [1][2][3][3]. So from now on bug fixes

Flink 1.14 Weekly 2021-08-24

2021-08-24 Thread Johannes Moser
Dear Apache Flink community, Today we moved from the two week sync rhythm to a one week one as we entered the stabilisation phase last week. *Status check:* All features got the state of "done" or "done done". There have been two features that have no cross team testing ticket, but they will

Flink 1.14 Bi-weekly 2021-08-17 Feature Freeze done, now stabilise!

2021-08-18 Thread Johannes Moser
Dear Flink Community, Thanks for putting all that effort into the 1.14 release. We are now post feature freeze and it looks like most of the features made it. This will be a decent release. Here's a summary of today's bi-weekly, which has been a bit longer. *Exception for feature freeze*

Flink 1.14. Bi-weekly 2021-07-20

2021-07-21 Thread Johannes Moser
Dear Flink Community, here's the latest update from the bi-weekly. Short summary: still a lot of stuff is going on, the feature freeze has been pushed by two weeks to the >>>16th of August<<< and we are working on the release communication. Good stuff: the test and blockers are looking very good.

Flink 1.14. Bi-weekly 2021-07-206

2021-07-14 Thread Johannes Moser
Hi, Here's an update from last weeks Bi-weekly. For sure the page is up to date [1]. *Feature freeze date* The feature freeze date is getting closer (only ~4 weeks left) and having a look at the features list there's still a lot to do. We went through all features and it looks like it will be

Re: [Discuss] Planning Flink 1.14

2021-06-28 Thread Johannes Moser
Hi all, We discussed the matter again in our latest release planning (see [1]). We see a lot of valid points in this thread. As we were not able to come to a clear conclusion within the meeting and most of the arguments mentioned will still be valid even if we extend the feature freeze by a

Flink 1.14. Bi-weekly 2021-06-22

2021-06-28 Thread Johannes Moser
Hello, Last Tuesday was our second bi-weekly. You can read up the outcome in the confluence wiki page [1]. *Feature freeze date* As we didn't come to a clear agreement, we will keep the anticipated feature freeze date as it is at early August. *Build stability* The good thing: we decreased

[jira] [Created] (FLINK-23025) sink-buffer-max-rows and sink-buffer-flush-interval options produce a lot of duplicates

2021-06-17 Thread Johannes Moser (Jira)
Johannes Moser created FLINK-23025: -- Summary: sink-buffer-max-rows and sink-buffer-flush-interval options produce a lot of duplicates Key: FLINK-23025 URL: https://issues.apache.org/jira/browse/FLINK-23025

Flink 1.14. Bi-weekly 2021-06-08

2021-06-08 Thread Johannes Moser
Hi, Today we had our first bi-weekly. Here’s a short summary of what has been discussed. Please watch the 1.14. Release page [1] to stay up to date. * Feature freeze date * As response to our last email the question was risen to push the feature freeze date back by a month, which would mean

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-25 Thread Johannes Moser
ering to investigate the user data on this topic. Do you > have any progress here? > > Thanks, > Leonard > > On Thu, Feb 4, 2021 at 3:08 PM Johannes Moser wrote: > >> Hello, >> >> I will work with some users to get data on that. >> >> Thanks, Joe &g

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-03 Thread Johannes Moser
Hello, I will work with some users to get data on that. Thanks, Joe > On 03.02.2021, at 14:58, Stephan Ewen wrote: > > Hi all! > > A quick thought on this thread: We see a typical stalemate here, as in so > many discussions recently. > One developer prefers it this way, another one another