Re: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

[Xintong Song]

+1 (binding)

Best,

Xintong



On Mon, Jun 17, 2024 at 11:41 AM Zhanghao Chen 
wrote:

> +1 (unbinding)
>
> Best,
> Zhanghao Chen
> 
> From: weijie guo 
> Sent: Monday, June 17, 2024 10:13
> To: dev 
> Subject: [VOTE] FLIP-462: Support Custom Data Distribution for Input
> Stream of Lookup Join
>
> Hi everyone,
>
>
> Thanks for all the feedback about the FLIP-462: Support Custom Data
> Distribution for Input Stream of Lookup Join [1]. The discussion
> thread is here [2].
>
>
> The vote will be open for at least 72 hours unless there is an
> objection or insufficient votes.
>
>
> Best,
>
> Weijie
>
>
>
> [1]
>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-462+Support+Custom+Data+Distribution+for+Input+Stream+of+Lookup+Join
>
>
> [2] https://lists.apache.org/thread/kds2zrcdmykrz5lmn0hf9m4phdl60nfb
>

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Geng Biao]

Congrats, Hang!
Best,
Biao Geng

发送自 Outlook for iOS

发件人: Zakelly Lan 
发送时间: Monday, June 17, 2024 12:12:10 PM
收件人: dev@flink.apache.org 
主题: Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

Congratulations, Hang!


Best,
Zakelly

On Mon, Jun 17, 2024 at 12:07 PM Yanquan Lv  wrote:

> Congratulations, Hang!
>
> Samrat Deb  于2024年6月17日周一 11:32写道：
>
> > Congratulations Hang Ruan !
> >
> > Bests,
> > Samrat
> >
> > On Mon, Jun 17, 2024 at 8:47 AM Leonard Xu  wrote:
> >
> > > Hi everyone,
> > > On behalf of the PMC, I'm happy to let you know that Hang Ruan has
> become
> > > a new Flink Committer !
> > >
> > > Hang Ruan has been continuously contributing to the Flink project since
> > > August 2021. Since then, he has continuously contributed to Flink,
> Flink
> > > CDC, and various Flink connector repositories, including
> > > flink-connector-kafka, flink-connector-elasticsearch,
> > flink-connector-aws,
> > > flink-connector-rabbitmq, flink-connector-pulsar, and
> > > flink-connector-mongodb. Hang Ruan focuses on the improvements related
> to
> > > connectors and catalogs and initiated FLIP-274. He is most recognized
> as
> > a
> > > core contributor and maintainer for the Flink CDC project, contributing
> > > many features such as MySQL CDC newly table addition and the Schema
> > > Evolution feature.
> > >
> > > Beyond his technical contributions, Hang Ruan is an active member of
> the
> > > Flink community. He regularly engages in discussions on the Flink dev
> > > mailing list and the user-zh and user mailing lists, participates in
> FLIP
> > > discussions, assists with user Q, and consistently volunteers for
> > release
> > > verifications.
> > >
> > > Please join me in congratulating Hang Ruan for becoming an Apache Flink
> > > committer!
> > >
> > > Best,
> > > Leonard (on behalf of the Flink PMC)
> >
>

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Geng Biao]

Congratulations, Zhongqiang!
Best,
Biao Geng

发送自 Outlook for iOS

发件人: Zakelly Lan 
发送时间: Monday, June 17, 2024 12:11:47 PM
收件人: dev@flink.apache.org 
主题: Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

Congratulations, Zhongqiang!


Best,
Zakelly

On Mon, Jun 17, 2024 at 12:05 PM Shawn Huang  wrote:

> Congratulations !
>
> Best,
> Shawn Huang
>
>
> Yuepeng Pan  于2024年6月17日周一 12:03写道：
>
> > Congratulations ! Best regards Yuepeng Pan
> >
> >
> >
> >
> >
> > At 2024-06-17 11:20:30, "Leonard Xu"  wrote:
> > >Hi everyone,
> > >On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
> > become a new Flink Committer!
> > >
> > >Zhongqiang has been an active Flink community member since November
> 2021,
> > contributing numerous PRs to both the Flink and Flink CDC repositories.
> As
> > a core contributor to Flink CDC, he developed the Oracle and SQL Server
> CDC
> > Connectors and managed essential website and CI migrations during the
> > donation of Flink CDC to Apache Flink.
> > >
> > >Beyond his technical contributions, Zhongqiang actively participates in
> > discussions on the Flink dev mailing list and responds to threads on the
> > user and user-zh mailing lists. As an Apache StreamPark (incubating)
> > Committer, he promotes Flink SQL and Flink CDC technologies at meetups
> and
> > within the StreamPark community.
> > >
> > >Please join me in congratulating Zhongqiang Gong for becoming an Apache
> > Flink committer!
> > >
> > >Best,
> > >Leonard (on behalf of the Flink PMC)
> >
>

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Zakelly Lan]

Congratulations, Hang!


Best,
Zakelly

On Mon, Jun 17, 2024 at 12:07 PM Yanquan Lv  wrote:

> Congratulations, Hang!
>
> Samrat Deb  于2024年6月17日周一 11:32写道：
>
> > Congratulations Hang Ruan !
> >
> > Bests,
> > Samrat
> >
> > On Mon, Jun 17, 2024 at 8:47 AM Leonard Xu  wrote:
> >
> > > Hi everyone,
> > > On behalf of the PMC, I'm happy to let you know that Hang Ruan has
> become
> > > a new Flink Committer !
> > >
> > > Hang Ruan has been continuously contributing to the Flink project since
> > > August 2021. Since then, he has continuously contributed to Flink,
> Flink
> > > CDC, and various Flink connector repositories, including
> > > flink-connector-kafka, flink-connector-elasticsearch,
> > flink-connector-aws,
> > > flink-connector-rabbitmq, flink-connector-pulsar, and
> > > flink-connector-mongodb. Hang Ruan focuses on the improvements related
> to
> > > connectors and catalogs and initiated FLIP-274. He is most recognized
> as
> > a
> > > core contributor and maintainer for the Flink CDC project, contributing
> > > many features such as MySQL CDC newly table addition and the Schema
> > > Evolution feature.
> > >
> > > Beyond his technical contributions, Hang Ruan is an active member of
> the
> > > Flink community. He regularly engages in discussions on the Flink dev
> > > mailing list and the user-zh and user mailing lists, participates in
> FLIP
> > > discussions, assists with user Q, and consistently volunteers for
> > release
> > > verifications.
> > >
> > > Please join me in congratulating Hang Ruan for becoming an Apache Flink
> > > committer!
> > >
> > > Best,
> > > Leonard (on behalf of the Flink PMC)
> >
>

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Yanquan Lv]

Congratulations, Zhongqiang!

Shawn Huang  于2024年6月17日周一 12:05写道：

> Congratulations !
>
> Best,
> Shawn Huang
>
>
> Yuepeng Pan  于2024年6月17日周一 12:03写道：
>
> > Congratulations ! Best regards Yuepeng Pan
> >
> >
> >
> >
> >
> > At 2024-06-17 11:20:30, "Leonard Xu"  wrote:
> > >Hi everyone,
> > >On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
> > become a new Flink Committer!
> > >
> > >Zhongqiang has been an active Flink community member since November
> 2021,
> > contributing numerous PRs to both the Flink and Flink CDC repositories.
> As
> > a core contributor to Flink CDC, he developed the Oracle and SQL Server
> CDC
> > Connectors and managed essential website and CI migrations during the
> > donation of Flink CDC to Apache Flink.
> > >
> > >Beyond his technical contributions, Zhongqiang actively participates in
> > discussions on the Flink dev mailing list and responds to threads on the
> > user and user-zh mailing lists. As an Apache StreamPark (incubating)
> > Committer, he promotes Flink SQL and Flink CDC technologies at meetups
> and
> > within the StreamPark community.
> > >
> > >Please join me in congratulating Zhongqiang Gong for becoming an Apache
> > Flink committer!
> > >
> > >Best,
> > >Leonard (on behalf of the Flink PMC)
> >
>

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Zakelly Lan]

Congratulations, Zhongqiang!


Best,
Zakelly

On Mon, Jun 17, 2024 at 12:05 PM Shawn Huang  wrote:

> Congratulations !
>
> Best,
> Shawn Huang
>
>
> Yuepeng Pan  于2024年6月17日周一 12:03写道：
>
> > Congratulations ! Best regards Yuepeng Pan
> >
> >
> >
> >
> >
> > At 2024-06-17 11:20:30, "Leonard Xu"  wrote:
> > >Hi everyone,
> > >On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
> > become a new Flink Committer!
> > >
> > >Zhongqiang has been an active Flink community member since November
> 2021,
> > contributing numerous PRs to both the Flink and Flink CDC repositories.
> As
> > a core contributor to Flink CDC, he developed the Oracle and SQL Server
> CDC
> > Connectors and managed essential website and CI migrations during the
> > donation of Flink CDC to Apache Flink.
> > >
> > >Beyond his technical contributions, Zhongqiang actively participates in
> > discussions on the Flink dev mailing list and responds to threads on the
> > user and user-zh mailing lists. As an Apache StreamPark (incubating)
> > Committer, he promotes Flink SQL and Flink CDC technologies at meetups
> and
> > within the StreamPark community.
> > >
> > >Please join me in congratulating Zhongqiang Gong for becoming an Apache
> > Flink committer!
> > >
> > >Best,
> > >Leonard (on behalf of the Flink PMC)
> >
>

[jira] [Created] (FLINK-35624) Release Testing: Verify FLIP-306 Unified File Merging Mechanism for Checkpoints

[Zakelly Lan (Jira)]

Zakelly Lan created FLINK-35624:
---

 Summary: Release Testing: Verify FLIP-306 Unified File Merging 
Mechanism for Checkpoints
 Key: FLINK-35624
 URL: https://issues.apache.org/jira/browse/FLINK-35624
 Project: Flink
  Issue Type: Sub-task
  Components: Runtime / Checkpointing
Reporter: Zakelly Lan
 Fix For: 1.20.0


Follow up the test for https://issues.apache.org/jira/browse/FLINK-32070

 

1.20 is the MVP version for FLIP-306. It is a little bit complex and should be 
tested carefully. The main idea of FLIP-306 is to merge checkpoint files in TM 
side, and provide new {{{}StateHandle{}}}s to the JM. There will be a 
TM-managed directory under the 'shared' checkpoint directory for each subtask, 
and a TM-managed directory under the 'taskowned' checkpoint directory for each 
Task Manager. Under those new introduced directories, the checkpoint files will 
be merged into smaller file set. The following scenarios need to be tested, 
including but not limited to:
 # With the file merging enabled, periodic checkpoints perform properly, and 
the failover, restore and rescale would also work well.
 # Switch the file merging on and off across jobs, checkpoints and recovery 
also work properly.
 # There will be no left-over TM-managed directory, especially when there is no 
cp complete before the job cancellation.
 # File merging takes no effect in (native) savepoints.

Besides the behaviors above, it is better to validate the function of space 
amplification control and metrics. All the config options can be found under 
'execution.checkpointing.file-merging'.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Yanquan Lv]

Congratulations, Hang!

Samrat Deb  于2024年6月17日周一 11:32写道：

> Congratulations Hang Ruan !
>
> Bests,
> Samrat
>
> On Mon, Jun 17, 2024 at 8:47 AM Leonard Xu  wrote:
>
> > Hi everyone,
> > On behalf of the PMC, I'm happy to let you know that Hang Ruan has become
> > a new Flink Committer !
> >
> > Hang Ruan has been continuously contributing to the Flink project since
> > August 2021. Since then, he has continuously contributed to Flink, Flink
> > CDC, and various Flink connector repositories, including
> > flink-connector-kafka, flink-connector-elasticsearch,
> flink-connector-aws,
> > flink-connector-rabbitmq, flink-connector-pulsar, and
> > flink-connector-mongodb. Hang Ruan focuses on the improvements related to
> > connectors and catalogs and initiated FLIP-274. He is most recognized as
> a
> > core contributor and maintainer for the Flink CDC project, contributing
> > many features such as MySQL CDC newly table addition and the Schema
> > Evolution feature.
> >
> > Beyond his technical contributions, Hang Ruan is an active member of the
> > Flink community. He regularly engages in discussions on the Flink dev
> > mailing list and the user-zh and user mailing lists, participates in FLIP
> > discussions, assists with user Q, and consistently volunteers for
> release
> > verifications.
> >
> > Please join me in congratulating Hang Ruan for becoming an Apache Flink
> > committer!
> >
> > Best,
> > Leonard (on behalf of the Flink PMC)
>

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Shawn Huang]

Congratulations !

Best,
Shawn Huang


Yuepeng Pan  于2024年6月17日周一 12:03写道：

> Congratulations ! Best regards Yuepeng Pan
>
>
>
>
>
> At 2024-06-17 11:20:30, "Leonard Xu"  wrote:
> >Hi everyone,
> >On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
> become a new Flink Committer!
> >
> >Zhongqiang has been an active Flink community member since November 2021,
> contributing numerous PRs to both the Flink and Flink CDC repositories. As
> a core contributor to Flink CDC, he developed the Oracle and SQL Server CDC
> Connectors and managed essential website and CI migrations during the
> donation of Flink CDC to Apache Flink.
> >
> >Beyond his technical contributions, Zhongqiang actively participates in
> discussions on the Flink dev mailing list and responds to threads on the
> user and user-zh mailing lists. As an Apache StreamPark (incubating)
> Committer, he promotes Flink SQL and Flink CDC technologies at meetups and
> within the StreamPark community.
> >
> >Please join me in congratulating Zhongqiang Gong for becoming an Apache
> Flink committer!
> >
> >Best,
> >Leonard (on behalf of the Flink PMC)
>

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Shawn Huang]

Congratulations!

Best,
Shawn Huang


Xiqian YU  于2024年6月17日周一 11:25写道：

> Congratulations Hang! 拾
>
> Best Regards,
> Xiqian
>
> De : Jiabao Sun 
> Date : lundi, 17 juin 2024 à 11:24
> À : dev@flink.apache.org 
> Objet : Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan
> Congrats Hang, well deserved!
>
> Best,
> Jiabao
>
> Leonard Xu  于2024年6月17日周一 11:19写道：
>
> > Hi everyone,
> > On behalf of the PMC, I'm happy to let you know that Hang Ruan has become
> > a new Flink Committer !
> >
> > Hang Ruan has been continuously contributing to the Flink project since
> > August 2021. Since then, he has continuously contributed to Flink, Flink
> > CDC, and various Flink connector repositories, including
> > flink-connector-kafka, flink-connector-elasticsearch,
> flink-connector-aws,
> > flink-connector-rabbitmq, flink-connector-pulsar, and
> > flink-connector-mongodb. Hang Ruan focuses on the improvements related to
> > connectors and catalogs and initiated FLIP-274. He is most recognized as
> a
> > core contributor and maintainer for the Flink CDC project, contributing
> > many features such as MySQL CDC newly table addition and the Schema
> > Evolution feature.
> >
> > Beyond his technical contributions, Hang Ruan is an active member of the
> > Flink community. He regularly engages in discussions on the Flink dev
> > mailing list and the user-zh and user mailing lists, participates in FLIP
> > discussions, assists with user Q, and consistently volunteers for
> release
> > verifications.
> >
> > Please join me in congratulating Hang Ruan for becoming an Apache Flink
> > committer!
> >
> > Best,
> > Leonard (on behalf of the Flink PMC)
>

Re:[ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Yuepeng Pan]

Congratulations !


Best regards Yuepeng Pan














At 2024-06-17 11:17:13, "Leonard Xu"  wrote:
>Hi everyone,
>On behalf of the PMC, I'm happy to let you know that Hang Ruan has become a 
>new Flink Committer !
>
>Hang Ruan has been continuously contributing to the Flink project since August 
>2021. Since then, he has continuously contributed to Flink, Flink CDC, and 
>various Flink connector repositories, including flink-connector-kafka, 
>flink-connector-elasticsearch, flink-connector-aws, flink-connector-rabbitmq, 
>flink-connector-pulsar, and flink-connector-mongodb. Hang Ruan focuses on the 
>improvements related to connectors and catalogs and initiated FLIP-274. He is 
>most recognized as a core contributor and maintainer for the Flink CDC 
>project, contributing many features such as MySQL CDC newly table addition and 
>the Schema Evolution feature.
>
>Beyond his technical contributions, Hang Ruan is an active member of the Flink 
>community. He regularly engages in discussions on the Flink dev mailing list 
>and the user-zh and user mailing lists, participates in FLIP discussions, 
>assists with user Q, and consistently volunteers for release verifications.
>
>Please join me in congratulating Hang Ruan for becoming an Apache Flink 
>committer!
>
>Best,
>Leonard (on behalf of the Flink PMC)

Re:[ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Yuepeng Pan]

Congratulations ! Best regards Yuepeng Pan





At 2024-06-17 11:20:30, "Leonard Xu"  wrote:
>Hi everyone,
>On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has become a 
>new Flink Committer!
>
>Zhongqiang has been an active Flink community member since November 2021, 
>contributing numerous PRs to both the Flink and Flink CDC repositories. As a 
>core contributor to Flink CDC, he developed the Oracle and SQL Server CDC 
>Connectors and managed essential website and CI migrations during the donation 
>of Flink CDC to Apache Flink.
>
>Beyond his technical contributions, Zhongqiang actively participates in 
>discussions on the Flink dev mailing list and responds to threads on the user 
>and user-zh mailing lists. As an Apache StreamPark (incubating) Committer, he 
>promotes Flink SQL and Flink CDC technologies at meetups and within the 
>StreamPark community.
>
>Please join me in congratulating Zhongqiang Gong for becoming an Apache Flink 
>committer!
>
>Best,
>Leonard (on behalf of the Flink PMC)

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Shiwei Wang]

Congratulations Zhongqiang!

> On Jun 17, 2024, at 11:25, Xiqian YU  wrote:
> 
> Congratulations, Zhongqiang!
> 
> Best Regards,
> Xiqian
> 
> De : Samrat Deb 
> Date : lundi, 17 juin 2024 à 11:24
> À : dev@flink.apache.org 
> Cc : gongzhongqi...@apache.org 
> Objet : Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong
> Congratulations Zhongqiang Gong !
> 
> Bests,
> Samrat
> 
> On Mon, Jun 17, 2024 at 8:50 AM Leonard Xu  wrote:
> 
>> Hi everyone,
>> On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
>> become a new Flink Committer!
>> 
>> Zhongqiang has been an active Flink community member since November 2021,
>> contributing numerous PRs to both the Flink and Flink CDC repositories. As
>> a core contributor to Flink CDC, he developed the Oracle and SQL Server CDC
>> Connectors and managed essential website and CI migrations during the
>> donation of Flink CDC to Apache Flink.
>> 
>> Beyond his technical contributions, Zhongqiang actively participates in
>> discussions on the Flink dev mailing list and responds to threads on the
>> user and user-zh mailing lists. As an Apache StreamPark (incubating)
>> Committer, he promotes Flink SQL and Flink CDC technologies at meetups and
>> within the StreamPark community.
>> 
>> Please join me in congratulating Zhongqiang Gong for becoming an Apache
>> Flink committer!
>> 
>> Best,
>> Leonard (on behalf of the Flink PMC)

Re: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

[Zhanghao Chen]

+1 (unbinding)

Best,
Zhanghao Chen

From: weijie guo 
Sent: Monday, June 17, 2024 10:13
To: dev 
Subject: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of 
Lookup Join

Hi everyone,


Thanks for all the feedback about the FLIP-462: Support Custom Data
Distribution for Input Stream of Lookup Join [1]. The discussion
thread is here [2].


The vote will be open for at least 72 hours unless there is an
objection or insufficient votes.


Best,

Weijie



[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-462+Support+Custom+Data+Distribution+for+Input+Stream+of+Lookup+Join


[2] https://lists.apache.org/thread/kds2zrcdmykrz5lmn0hf9m4phdl60nfb

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Xiqian YU]

Congratulations, Zhongqiang!

Best Regards,
Xiqian

De : Samrat Deb 
Date : lundi, 17 juin 2024 à 11:24
À : dev@flink.apache.org 
Cc : gongzhongqi...@apache.org 
Objet : Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong
Congratulations Zhongqiang Gong !

Bests,
Samrat

On Mon, Jun 17, 2024 at 8:50 AM Leonard Xu  wrote:

> Hi everyone,
> On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
> become a new Flink Committer!
>
> Zhongqiang has been an active Flink community member since November 2021,
> contributing numerous PRs to both the Flink and Flink CDC repositories. As
> a core contributor to Flink CDC, he developed the Oracle and SQL Server CDC
> Connectors and managed essential website and CI migrations during the
> donation of Flink CDC to Apache Flink.
>
> Beyond his technical contributions, Zhongqiang actively participates in
> discussions on the Flink dev mailing list and responds to threads on the
> user and user-zh mailing lists. As an Apache StreamPark (incubating)
> Committer, he promotes Flink SQL and Flink CDC technologies at meetups and
> within the StreamPark community.
>
> Please join me in congratulating Zhongqiang Gong for becoming an Apache
> Flink committer!
>
> Best,
> Leonard (on behalf of the Flink PMC)

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Xiqian YU]

Congratulations Hang! 拾

Best Regards,
Xiqian

De : Jiabao Sun 
Date : lundi, 17 juin 2024 à 11:24
À : dev@flink.apache.org 
Objet : Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan
Congrats Hang, well deserved!

Best,
Jiabao

Leonard Xu  于2024年6月17日周一 11:19写道：

> Hi everyone,
> On behalf of the PMC, I'm happy to let you know that Hang Ruan has become
> a new Flink Committer !
>
> Hang Ruan has been continuously contributing to the Flink project since
> August 2021. Since then, he has continuously contributed to Flink, Flink
> CDC, and various Flink connector repositories, including
> flink-connector-kafka, flink-connector-elasticsearch, flink-connector-aws,
> flink-connector-rabbitmq, flink-connector-pulsar, and
> flink-connector-mongodb. Hang Ruan focuses on the improvements related to
> connectors and catalogs and initiated FLIP-274. He is most recognized as a
> core contributor and maintainer for the Flink CDC project, contributing
> many features such as MySQL CDC newly table addition and the Schema
> Evolution feature.
>
> Beyond his technical contributions, Hang Ruan is an active member of the
> Flink community. He regularly engages in discussions on the Flink dev
> mailing list and the user-zh and user mailing lists, participates in FLIP
> discussions, assists with user Q, and consistently volunteers for release
> verifications.
>
> Please join me in congratulating Hang Ruan for becoming an Apache Flink
> committer!
>
> Best,
> Leonard (on behalf of the Flink PMC)

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Samrat Deb]

Congratulations Zhongqiang Gong !

Bests,
Samrat

On Mon, Jun 17, 2024 at 8:50 AM Leonard Xu  wrote:

> Hi everyone,
> On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
> become a new Flink Committer!
>
> Zhongqiang has been an active Flink community member since November 2021,
> contributing numerous PRs to both the Flink and Flink CDC repositories. As
> a core contributor to Flink CDC, he developed the Oracle and SQL Server CDC
> Connectors and managed essential website and CI migrations during the
> donation of Flink CDC to Apache Flink.
>
> Beyond his technical contributions, Zhongqiang actively participates in
> discussions on the Flink dev mailing list and responds to threads on the
> user and user-zh mailing lists. As an Apache StreamPark (incubating)
> Committer, he promotes Flink SQL and Flink CDC technologies at meetups and
> within the StreamPark community.
>
> Please join me in congratulating Zhongqiang Gong for becoming an Apache
> Flink committer!
>
> Best,
> Leonard (on behalf of the Flink PMC)

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Jiabao Sun]

Congrats Hang, well deserved!

Best,
Jiabao

Leonard Xu  于2024年6月17日周一 11:19写道：

> Hi everyone,
> On behalf of the PMC, I'm happy to let you know that Hang Ruan has become
> a new Flink Committer !
>
> Hang Ruan has been continuously contributing to the Flink project since
> August 2021. Since then, he has continuously contributed to Flink, Flink
> CDC, and various Flink connector repositories, including
> flink-connector-kafka, flink-connector-elasticsearch, flink-connector-aws,
> flink-connector-rabbitmq, flink-connector-pulsar, and
> flink-connector-mongodb. Hang Ruan focuses on the improvements related to
> connectors and catalogs and initiated FLIP-274. He is most recognized as a
> core contributor and maintainer for the Flink CDC project, contributing
> many features such as MySQL CDC newly table addition and the Schema
> Evolution feature.
>
> Beyond his technical contributions, Hang Ruan is an active member of the
> Flink community. He regularly engages in discussions on the Flink dev
> mailing list and the user-zh and user mailing lists, participates in FLIP
> discussions, assists with user Q, and consistently volunteers for release
> verifications.
>
> Please join me in congratulating Hang Ruan for becoming an Apache Flink
> committer!
>
> Best,
> Leonard (on behalf of the Flink PMC)

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Samrat Deb]

Congratulations Hang Ruan !

Bests,
Samrat

On Mon, Jun 17, 2024 at 8:47 AM Leonard Xu  wrote:

> Hi everyone,
> On behalf of the PMC, I'm happy to let you know that Hang Ruan has become
> a new Flink Committer !
>
> Hang Ruan has been continuously contributing to the Flink project since
> August 2021. Since then, he has continuously contributed to Flink, Flink
> CDC, and various Flink connector repositories, including
> flink-connector-kafka, flink-connector-elasticsearch, flink-connector-aws,
> flink-connector-rabbitmq, flink-connector-pulsar, and
> flink-connector-mongodb. Hang Ruan focuses on the improvements related to
> connectors and catalogs and initiated FLIP-274. He is most recognized as a
> core contributor and maintainer for the Flink CDC project, contributing
> many features such as MySQL CDC newly table addition and the Schema
> Evolution feature.
>
> Beyond his technical contributions, Hang Ruan is an active member of the
> Flink community. He regularly engages in discussions on the Flink dev
> mailing list and the user-zh and user mailing lists, participates in FLIP
> discussions, assists with user Q, and consistently volunteers for release
> verifications.
>
> Please join me in congratulating Hang Ruan for becoming an Apache Flink
> committer!
>
> Best,
> Leonard (on behalf of the Flink PMC)

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Jiabao Sun]

Congrats Zhongqiang, well deserved!

Best,
Jiabao

Leonard Xu  于2024年6月17日周一 11:21写道：

> Hi everyone,
> On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has
> become a new Flink Committer!
>
> Zhongqiang has been an active Flink community member since November 2021,
> contributing numerous PRs to both the Flink and Flink CDC repositories. As
> a core contributor to Flink CDC, he developed the Oracle and SQL Server CDC
> Connectors and managed essential website and CI migrations during the
> donation of Flink CDC to Apache Flink.
>
> Beyond his technical contributions, Zhongqiang actively participates in
> discussions on the Flink dev mailing list and responds to threads on the
> user and user-zh mailing lists. As an Apache StreamPark (incubating)
> Committer, he promotes Flink SQL and Flink CDC technologies at meetups and
> within the StreamPark community.
>
> Please join me in congratulating Zhongqiang Gong for becoming an Apache
> Flink committer!
>
> Best,
> Leonard (on behalf of the Flink PMC)

[ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

[Leonard Xu]

Hi everyone,
On behalf of the PMC, I'm happy to announce that Zhongqiang Gong has become a 
new Flink Committer!

Zhongqiang has been an active Flink community member since November 2021, 
contributing numerous PRs to both the Flink and Flink CDC repositories. As a 
core contributor to Flink CDC, he developed the Oracle and SQL Server CDC 
Connectors and managed essential website and CI migrations during the donation 
of Flink CDC to Apache Flink.

Beyond his technical contributions, Zhongqiang actively participates in 
discussions on the Flink dev mailing list and responds to threads on the user 
and user-zh mailing lists. As an Apache StreamPark (incubating) Committer, he 
promotes Flink SQL and Flink CDC technologies at meetups and within the 
StreamPark community.

Please join me in congratulating Zhongqiang Gong for becoming an Apache Flink 
committer!

Best,
Leonard (on behalf of the Flink PMC)

[ANNOUNCE] New Apache Flink Committer - Hang Ruan

[Leonard Xu]

Hi everyone,
On behalf of the PMC, I'm happy to let you know that Hang Ruan has become a new 
Flink Committer !

Hang Ruan has been continuously contributing to the Flink project since August 
2021. Since then, he has continuously contributed to Flink, Flink CDC, and 
various Flink connector repositories, including flink-connector-kafka, 
flink-connector-elasticsearch, flink-connector-aws, flink-connector-rabbitmq, 
flink-connector-pulsar, and flink-connector-mongodb. Hang Ruan focuses on the 
improvements related to connectors and catalogs and initiated FLIP-274. He is 
most recognized as a core contributor and maintainer for the Flink CDC project, 
contributing many features such as MySQL CDC newly table addition and the 
Schema Evolution feature.

Beyond his technical contributions, Hang Ruan is an active member of the Flink 
community. He regularly engages in discussions on the Flink dev mailing list 
and the user-zh and user mailing lists, participates in FLIP discussions, 
assists with user Q, and consistently volunteers for release verifications.

Please join me in congratulating Hang Ruan for becoming an Apache Flink 
committer!

Best,
Leonard (on behalf of the Flink PMC)

Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS Statement

[Ron Liu]

Hi, Sergio

Sorry for later joining this thread.

Thanks for driving this proposal, it looks great.

I have a few questions:

1. Many SQL-based data processing systems, however, support schema
definitions within their CTAS statements

Is it possible for you to list these systems and make it part of the
Reference chapter? Which would make it easier for everyone to understand.


2. This proposal proposes to support defining primary keys in CTAS, then
there are two possible issues here. One is whether Nullable columns are
allowed to be referenced in the primary key definition, because all the
columns deduced based on Select Query may be Nullable; and the second is
that if the UNIQUE KEY cannot be deduced based on Select Query, or the
deduced UNIQUE KEY does not match the defined primary key, which will lead
to data duplication, the engine needs to what to ensure the uniqueness of
the data?


Best
Ron


Jeyhun Karimov  于2024年6月14日周五 01:51写道：

> Thanks Sergio and Timo for your answers.
> Sounds good to me.
> Looking forward for this feature.
>
> Regards,
> Jeyhun
>
> On Thu, Jun 13, 2024 at 4:48 PM Sergio Pena 
> wrote:
>
> > Sure Yuxia, I just added the support for RTAS statements too.
> >
> > - Sergio
> >
> > On Wed, Jun 12, 2024 at 8:22 PM yuxia 
> wrote:
> >
> > > Hi, Sergio.
> > > Thanks for driving the FLIP. Given we also has REPLACE TABLE AS
> > > Statement[1] and it's almost same with CREATE TABLE AS Statement,
> > > would you mind also supporting schema definition for REPLACE TABLE AS
> > > Statement in this FLIP? It'll be a great to align REPLACE TABLE AS
> > Statement
> > > to CREATE TABLE AS Statement
> > >
> > >
> > > [1]
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-303%3A+Support+REPLACE+TABLE+AS+SELECT+statement
> > >
> > > Best regards,
> > > Yuxia
> > >
> > > - 原始邮件 -
> > > 发件人: "Timo Walther" 
> > > 收件人: "dev" 
> > > 发送时间: 星期三, 2024年 6 月 12日 下午 10:19:14
> > > 主题: Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS
> > Statement
> > >
> > > > I just noticed the CREATE TABLE LIKE statement allows the definition
> > >  > of new columns in the CREATE part. The difference
> > >  > with this CTAS proposal is that TABLE LIKE appends the new columns
> at
> > >  > the end of the schema instead of adding them
> > >  > at the beginning like this proposal and Mysql do.
> > >
> > > This should be fine. The LIKE rather "extends from" the right table.
> > > Whereas the SELECT in CTAS rather extends the left schema definition.
> > > Given that "the extended part" is always appended, we could argue that
> > > the current CTAS behavior in the FLIP is acceptable.
> > >
> > >  > If you want to rename a column in the create part, then that column
> > >  > position must be in the same position as the query column.
> > >  > I didn't like the Postgres approach because it does not let us add
> > >  > columns that do not exist in the query schema.
> > >
> > > Flink offers similar functionality in INSERT INTO. INSERT INTO also
> > > allows syntax like: `INSERT INTO (b, c) SELECT * FROM t`. So given that
> > > our CTAS can be seen as a CREATE TABLE + INSERT INTO. I would adopt
> > > Jeyhun comment in the FLIP. If users don't want to add additional
> schema
> > > parts, the same column reordering should be available as if one would
> > > write a INSERT INTO.
> > >
> > > Regards,
> > > Timo
> > >
> > >
> > >
> > >
> > > On 12.06.24 04:30, Yanquan Lv wrote:
> > > > Hi Sergio, thanks for driving it, +1 for this.
> > > >
> > > > I have some comments:
> > > > 1. If we have a source table with primary keys and partition keys
> > > defined,
> > > > what is the default behavior if PARTITIONED and DISTRIBUTED not
> > specified
> > > > in the CTAS statement, It should not be inherited by default？
> > > > 2. I suggest providing a complete syntax that includes
> table_properties
> > > > like FLIP-218.
> > > >
> > > >
> > > > Sergio Pena  于2024年6月12日周三 03:54写道：
> > > >
> > > >> I just noticed the CREATE TABLE LIKE statement allows the definition
> > of
> > > new
> > > >> columns in the CREATE part. The difference
> > > >> with this CTAS proposal is that TABLE LIKE appends the new columns
> at
> > > the
> > > >> end of the schema instead of adding them
> > > >> at the beginning like this proposal and Mysql do.
> > > >>
> > > >>> create table t1(id int, name string);
> > >  create table s1(a int, b string) like t1;
> > >  describe s1;
> > > >>
> > > >> +-+---+--++
> > > >>> | Column Name | Data Type | Nullable | Extras |
> > > >>> +-+---+--++
> > > >>> | id  | INT   | NULL ||
> > > >>> | name| STRING| NULL ||
> > > >>> | a   | INT   | NULL ||
> > > >>> | b   | STRING| NULL ||
> > > >>> +-+---+--++
> > > >>
> > > >>
> > > >>
> > > >> The CREATE TABLE LIKE also does not let the definition of 

[jira] [Created] (FLINK-35623) Bump mongo-driver version from 4.7.2 to 5.1.1 to support MongoDB 7.0

[Jiabao Sun (Jira)]

Jiabao Sun created FLINK-35623:
--

 Summary: Bump mongo-driver version from 4.7.2 to 5.1.1 to support 
MongoDB 7.0
 Key: FLINK-35623
 URL: https://issues.apache.org/jira/browse/FLINK-35623
 Project: Flink
  Issue Type: New Feature
  Components: Connectors / MongoDB
Affects Versions: mongodb-1.2.0
Reporter: Jiabao Sun
Assignee: Jiabao Sun
 Fix For: mongodb-1.3.0


Bump mongo-driver version from 4.7.2 to 5.1.1 to support MongoDB 7.0

 

[https://www.mongodb.com/docs/drivers/java/sync/current/compatibility/]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

[weijie guo]

Hi everyone,


Thanks for all the feedback about the FLIP-462: Support Custom Data
Distribution for Input Stream of Lookup Join [1]. The discussion
thread is here [2].


The vote will be open for at least 72 hours unless there is an
objection or insufficient votes.


Best,

Weijie



[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-462+Support+Custom+Data+Distribution+for+Input+Stream+of+Lookup+Join


[2] https://lists.apache.org/thread/kds2zrcdmykrz5lmn0hf9m4phdl60nfb

Re: Request for unsubscribing

[Hang Ruan]

Hi,

I think you have unsubscribed user mail list.
For the dev mail list, please send email to dev-unsubscr...@flink.apache.org if
you want to unsubscribe the mail from dev@flink.apache.org.

You can refer [1] for more details.

Best,
Hang

[1] https://flink.apache.org/community.html#mailing-lists

Harshodai kolluru  于2024年6月16日周日 04:04写道：

> Hey Admin, I am getting a bunch of emails from Apache flink , please remove
> my subscription.
>
> Thanks!
>

Re: [VOTE] FLIP-464: Merge "flink run" and "flink run-application"

[Hang Ruan]

Thanks for the FLIP.

+1 (non-binding)

Best,
Hang

Venkatakrishnan Sowrirajan  于2024年6月17日周一 02:00写道：

> +1. Thanks for driving this proposal, Ferenc!
>
> Regards
> Venkata krishnan
>
>
> On Thu, Jun 13, 2024 at 10:54 AM Jeyhun Karimov 
> wrote:
>
> > Thanks for driving this.
> > +1 (non-binding)
> >
> > Regards,
> > Jeyhun
> >
> > On Thu, Jun 13, 2024 at 5:23 PM Gabor Somogyi  >
> > wrote:
> >
> > > +1 (binding)
> > >
> > > G
> > >
> > >
> > > On Wed, Jun 12, 2024 at 5:23 PM Ferenc Csaky
>  > >
> > > wrote:
> > >
> > > > Hello devs,
> > > >
> > > > I would like to start a vote about FLIP-464 [1]. The FLIP is about to
> > > > merge back the
> > > > "flink run-application" functionality to "flink run", so the latter
> > will
> > > > be capable to deploy jobs in
> > > > all deployment modes. More details in the FLIP. Discussion thread
> [2].
> > > >
> > > > The vote will be open for at least 72 hours (until 2024 March 23
> 14:03
> > > > UTC) unless there
> > > > are any objections or insufficient votes.
> > > >
> > > > Thanks,Ferenc
> > > >
> > > > [1]
> > > >
> > >
> >
> https://urldefense.com/v3/__https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=311626179__;!!IKRxdwAv5BmarQ!fw7_SWUS3G8imqL4w4z0MejMShCR1pHlYxeTnLFJqIu6sI05EF1rM_n1kw8lESNgRzxPqstJC3ITNwDSp1Jf-aA$
> > > > [2]
> >
> https://urldefense.com/v3/__https://lists.apache.org/thread/xh58xs0y58kqjmfvd4yor79rv6dlcg5g__;!!IKRxdwAv5BmarQ!fw7_SWUS3G8imqL4w4z0MejMShCR1pHlYxeTnLFJqIu6sI05EF1rM_n1kw8lESNgRzxPqstJC3ITNwDSOIWCchM$
> > >
> >
>

Re: [VOTE] FLIP-464: Merge "flink run" and "flink run-application"

[Venkatakrishnan Sowrirajan]

+1. Thanks for driving this proposal, Ferenc!

Regards
Venkata krishnan


On Thu, Jun 13, 2024 at 10:54 AM Jeyhun Karimov 
wrote:

> Thanks for driving this.
> +1 (non-binding)
>
> Regards,
> Jeyhun
>
> On Thu, Jun 13, 2024 at 5:23 PM Gabor Somogyi 
> wrote:
>
> > +1 (binding)
> >
> > G
> >
> >
> > On Wed, Jun 12, 2024 at 5:23 PM Ferenc Csaky  >
> > wrote:
> >
> > > Hello devs,
> > >
> > > I would like to start a vote about FLIP-464 [1]. The FLIP is about to
> > > merge back the
> > > "flink run-application" functionality to "flink run", so the latter
> will
> > > be capable to deploy jobs in
> > > all deployment modes. More details in the FLIP. Discussion thread [2].
> > >
> > > The vote will be open for at least 72 hours (until 2024 March 23 14:03
> > > UTC) unless there
> > > are any objections or insufficient votes.
> > >
> > > Thanks,Ferenc
> > >
> > > [1]
> > >
> >
> https://urldefense.com/v3/__https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=311626179__;!!IKRxdwAv5BmarQ!fw7_SWUS3G8imqL4w4z0MejMShCR1pHlYxeTnLFJqIu6sI05EF1rM_n1kw8lESNgRzxPqstJC3ITNwDSp1Jf-aA$
> > > [2]
> https://urldefense.com/v3/__https://lists.apache.org/thread/xh58xs0y58kqjmfvd4yor79rv6dlcg5g__;!!IKRxdwAv5BmarQ!fw7_SWUS3G8imqL4w4z0MejMShCR1pHlYxeTnLFJqIu6sI05EF1rM_n1kw8lESNgRzxPqstJC3ITNwDSOIWCchM$
> >
>

[jira] [Created] (FLINK-35622) Filter out noisy "Coordinator of operator xxxx does not exist" exceptions in batch mode

[Junrui Li (Jira)]

Junrui Li created FLINK-35622:
-

 Summary: Filter out noisy "Coordinator of operator  does not 
exist" exceptions in batch mode
 Key: FLINK-35622
 URL: https://issues.apache.org/jira/browse/FLINK-35622
 Project: Flink
  Issue Type: Technical Debt
  Components: Runtime / Coordination
Reporter: Junrui Li


In batch mode, the Flink JobManager logs frequently print "Coordinator of 
operator  does not exist or the job vertex this operator belongs to is not 
initialized." exceptions when using the collect() method.

This exception is caused by the collect sink attempting to fetch data from the 
corresponding operator coordinator on the JM based on the operator ID. However, 
batch jobs do not initialize all job vertices at the beginning, and instead, 
initialize them in a sequential manner. If a job vertex has not been 
initialized yet, the corresponding coordinator cannot be found, leading to the 
printing of this message.

These exceptions are harmless and do not affect the job execution, but they can 
clutter the logs and make it difficult to find relevant information, especially 
for large-scale batch jobs.
 
 
 
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)