Re: [VOTE] Release 1.12.5, release candidate #1

2021-07-06 Thread JING ZHANG
+1 (non-binding)

1. built from source code flink-1.12.5-src.tgz

succeeded
2. Started a local Flink cluster, ran the WordCount example, WebUI looks
good,  no suspicious output/log
3. started cluster and run some e2e sql queries using SQL Client, query
result is expected.
4. Repeat Step 2 and 3 with flink-1.12.5-bin-scala_2.11.tgz


Best,
JING ZHANG

Yang Wang  于2021年7月7日周三 上午11:36写道:

> +1 (non-binding)
>
> - verified checksums & signatures
> - start a session cluster and verify HA data cleanup once job reached to
> globally terminal state, FLINK-20695
> - start a local standalone cluster, check the webUI good and JM/TM
> without suspicious logs
>
>
> Best,
> Yang
>
> Leonard Xu  于2021年7月7日周三 上午10:52写道:
>
> > +1 (non-binding)
> >
> > - verified signatures and hashsums
> > - built from source code with scala 2.11 succeeded
> > - checked all denpendency artifacts are 1.12.5
> > - started a cluster, ran a wordcount job, the result is expected
> > - started SQL Client, ran a simple query, the result is expected
> > - reviewed the web PR, left one minor name comment
> >
> > Best,
> > Leonard
> >
> > > 在 2021年7月6日,10:02,Xintong Song  写道:
> > >
> > > +1 (binding)
> > >
> > > - verified checksums & signatures
> > > - built from sources
> > > - run example jobs with standalone and native k8s deployments
> > >
> > > Thank you~
> > >
> > > Xintong Song
> > >
> > >
> > >
> > > On Mon, Jul 5, 2021 at 11:18 AM Jingsong Li 
> > wrote:
> > >
> > >> Hi everyone,
> > >>
> > >> Please review and vote on the release candidate #1 for the version
> > 1.12.5,
> > >> as follows:
> > >> [ ] +1, Approve the release
> > >> [ ] -1, Do not approve the release (please provide specific comments)
> > >>
> > >> The complete staging area is available for your review, which
> includes:
> > >> * JIRA release notes [1],
> > >> * the official Apache source release and binary convenience releases
> to
> > be
> > >> deployed to dist.apache.org [2], which are signed with the key with
> > >> fingerprint FBB83C0A4FFB9CA8 [3],
> > >> * all artifacts to be deployed to the Maven Central Repository [4],
> > >> * source code tag "release-1.12.5-rc1" [5],
> > >> * website pull request listing the new release and adding announcement
> > blog
> > >> post [6].
> > >>
> > >> The vote will be open for at least 72 hours. It is adopted by majority
> > >> approval, with at least 3 PMC affirmative votes.
> > >>
> > >> Best,
> > >> Jingsong Lee
> > >>
> > >> [1]
> > >>
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12350166
> > >> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.12.5-rc1/
> > >> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> > >> [4]
> > https://repository.apache.org/content/repositories/orgapacheflink-1430
> > >> [5] https://github.com/apache/flink/releases/tag/release-1.12.5-rc1
> > >> [6] https://github.com/apache/flink-web/pull/455
> > >>
> >
> >
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Benchao Li
Congratulations!

Peter Huang  于2021年7月7日周三 下午12:54写道:

> Congratulations, Yang.
>
> Best Regards
> Peter Huang
>
> On Tue, Jul 6, 2021 at 9:48 PM Dian Fu  wrote:
>
> > Congratulations, Yang,
> >
> > Regards,
> > Dian
> >
> > > 2021年7月7日 上午10:46,Jary Zhen  写道:
> > >
> > > Congratulations, Yang Wang.
> > >
> > > Best
> > > Jary
> > >
> > > Yun Gao  于2021年7月7日周三 上午10:38写道:
> > >
> > >> Congratulations Yang!
> > >>
> > >> Best,
> > >> Yun
> > >>
> > >>
> > >> --
> > >> Sender:Jark Wu
> > >> Date:2021/07/07 10:20:27
> > >> Recipient:dev
> > >> Cc:Yang Wang; 
> > >> Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang
> > >>
> > >> Congratulations Yang Wang!
> > >>
> > >> Best,
> > >> Jark
> > >>
> > >> On Wed, 7 Jul 2021 at 10:09, Xintong Song 
> > wrote:
> > >>
> > >>> Hi everyone,
> > >>>
> > >>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> > Flink
> > >>> committer.
> > >>>
> > >>> Yang has been a very active contributor for more than two years,
> mainly
> > >>> focusing on Flink's deployment components. He's a main contributor
> and
> > >>> maintainer of Flink's native Kubernetes deployment and native
> > Kubernetes
> > >>> HA. He's also very active on the mailing lists, participating in
> > >>> discussions and helping with user questions.
> > >>>
> > >>> Please join me in congratulating Yang Wang for becoming a Flink
> > >> committer!
> > >>>
> > >>> Thank you~
> > >>>
> > >>> Xintong Song
> > >>>
> > >>
> > >>
> >
> >
>


-- 

Best,
Benchao Li


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Benchao Li
Congratulations!

Dian Fu  于2021年7月7日周三 下午12:46写道:

> Congratulations, Guowei!
>
> Regards,
> Dian
>
> > 2021年7月7日 上午10:37,Yun Gao  写道:
> >
> > Congratulations Guowei!
> >
> >
> > Best,
> > Yun
> >
> >
> > --
> > Sender:JING ZHANG
> > Date:2021/07/07 10:33:51
> > Recipient:dev
> > Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma
> >
> > Congratulations,  Guowei Ma!
> >
> > Best regards,
> > JING ZHANG
> >
> > Zakelly Lan  于2021年7月7日周三 上午10:30写道:
> >
> >> Congratulations, Guowei!
> >>
> >> Best,
> >> Zakelly
> >>
> >> On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
> >>
> >>> Congrats! NB.
> >>>
> >>> Best,
> >>> tison.
> >>>
> >>>
> >>> Jark Wu  于2021年7月7日周三 上午10:20写道:
> >>>
>  Congratulations Guowei!
> 
>  Best,
>  Jark
> 
>  On Wed, 7 Jul 2021 at 09:54, XING JIN 
> wrote:
> 
> > Congratulations, Guowei~ !
> >
> > Best,
> > Jin
> >
> > Xintong Song  于2021年7月7日周三 上午9:37写道:
> >
> >> Congratulations, Guowei~!
> >>
> >> Thank you~
> >>
> >> Xintong Song
> >>
> >>
> >>
> >> On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
>  wrote:
> >>
> >>> Congratulations Guowei!
> >>>
> >>> --
> >>> Best Regards,
> >>>
> >>> Qingsheng Ren
> >>> Email: renqs...@gmail.com
> >>> 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
>  Congratulations! Guowei Ma
> 
>  Best,
>  Leonard
> 
> > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> >
> > Hi all!
> >
> > I'm very happy to announce that Guowei Ma has joined the
> >> Flink
>  PMC!
> >
> > Congratulations and welcome Guowei!
> >
> > Best,
> > Kurt
> 
> >>>
> >>
> >
> 
> >>>
> >>
> >
>
>

-- 

Best,
Benchao Li


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Peter Huang
Congratulations, Yang.

Best Regards
Peter Huang

On Tue, Jul 6, 2021 at 9:48 PM Dian Fu  wrote:

> Congratulations, Yang,
>
> Regards,
> Dian
>
> > 2021年7月7日 上午10:46,Jary Zhen  写道:
> >
> > Congratulations, Yang Wang.
> >
> > Best
> > Jary
> >
> > Yun Gao  于2021年7月7日周三 上午10:38写道:
> >
> >> Congratulations Yang!
> >>
> >> Best,
> >> Yun
> >>
> >>
> >> --
> >> Sender:Jark Wu
> >> Date:2021/07/07 10:20:27
> >> Recipient:dev
> >> Cc:Yang Wang; 
> >> Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang
> >>
> >> Congratulations Yang Wang!
> >>
> >> Best,
> >> Jark
> >>
> >> On Wed, 7 Jul 2021 at 10:09, Xintong Song 
> wrote:
> >>
> >>> Hi everyone,
> >>>
> >>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> Flink
> >>> committer.
> >>>
> >>> Yang has been a very active contributor for more than two years, mainly
> >>> focusing on Flink's deployment components. He's a main contributor and
> >>> maintainer of Flink's native Kubernetes deployment and native
> Kubernetes
> >>> HA. He's also very active on the mailing lists, participating in
> >>> discussions and helping with user questions.
> >>>
> >>> Please join me in congratulating Yang Wang for becoming a Flink
> >> committer!
> >>>
> >>> Thank you~
> >>>
> >>> Xintong Song
> >>>
> >>
> >>
>
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Dian Fu
Congratulations, Yang,

Regards,
Dian

> 2021年7月7日 上午10:46,Jary Zhen  写道:
> 
> Congratulations, Yang Wang.
> 
> Best
> Jary
> 
> Yun Gao  于2021年7月7日周三 上午10:38写道:
> 
>> Congratulations Yang!
>> 
>> Best,
>> Yun
>> 
>> 
>> --
>> Sender:Jark Wu
>> Date:2021/07/07 10:20:27
>> Recipient:dev
>> Cc:Yang Wang; 
>> Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang
>> 
>> Congratulations Yang Wang!
>> 
>> Best,
>> Jark
>> 
>> On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:
>> 
>>> Hi everyone,
>>> 
>>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
>>> committer.
>>> 
>>> Yang has been a very active contributor for more than two years, mainly
>>> focusing on Flink's deployment components. He's a main contributor and
>>> maintainer of Flink's native Kubernetes deployment and native Kubernetes
>>> HA. He's also very active on the mailing lists, participating in
>>> discussions and helping with user questions.
>>> 
>>> Please join me in congratulating Yang Wang for becoming a Flink
>> committer!
>>> 
>>> Thank you~
>>> 
>>> Xintong Song
>>> 
>> 
>> 



Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Dian Fu
Congratulations, Guowei!

Regards,
Dian

> 2021年7月7日 上午10:37,Yun Gao  写道:
> 
> Congratulations Guowei!
> 
> 
> Best,
> Yun
> 
> 
> --
> Sender:JING ZHANG
> Date:2021/07/07 10:33:51
> Recipient:dev
> Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma
> 
> Congratulations,  Guowei Ma!
> 
> Best regards,
> JING ZHANG
> 
> Zakelly Lan  于2021年7月7日周三 上午10:30写道:
> 
>> Congratulations, Guowei!
>> 
>> Best,
>> Zakelly
>> 
>> On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
>> 
>>> Congrats! NB.
>>> 
>>> Best,
>>> tison.
>>> 
>>> 
>>> Jark Wu  于2021年7月7日周三 上午10:20写道:
>>> 
 Congratulations Guowei!
 
 Best,
 Jark
 
 On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:
 
> Congratulations, Guowei~ !
> 
> Best,
> Jin
> 
> Xintong Song  于2021年7月7日周三 上午9:37写道:
> 
>> Congratulations, Guowei~!
>> 
>> Thank you~
>> 
>> Xintong Song
>> 
>> 
>> 
>> On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
 wrote:
>> 
>>> Congratulations Guowei!
>>> 
>>> --
>>> Best Regards,
>>> 
>>> Qingsheng Ren
>>> Email: renqs...@gmail.com
>>> 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
 Congratulations! Guowei Ma
 
 Best,
 Leonard
 
> ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> 
> Hi all!
> 
> I'm very happy to announce that Guowei Ma has joined the
>> Flink
 PMC!
> 
> Congratulations and welcome Guowei!
> 
> Best,
> Kurt
 
>>> 
>> 
> 
 
>>> 
>> 
> 



Re: I want to contribute to Apache Flink

2021-07-06 Thread Zhilong Hong
Hi, Pang!

Thank you for your enthusiasm for contribution. You don't need any
permission to contribute codes to Apache Flink. Feel free to find the
issues that you are interested in JIRA (
https://issues.apache.org/jira/projects/FLINK/issues). The issues with the
label "starter" is a good choice to start with. You can comment with your
idea, and request committers to assign the ticket to you.

Best,
Zhilong

On Wed, Jul 7, 2021 at 11:56 AM pang pan  wrote:

> Hi Guys,
>
> I want to contribute to Apache Flink.
> Would you please give me the permission as a contributor?
> My JIRA ID is pangpan.
>


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Zhilong Hong
Congratulations, Guowei!

Best,
Zhilong

On Tue, Jul 6, 2021 at 10:01 PM Kurt Young  wrote:

> Hi all!
>
> I'm very happy to announce that Guowei Ma has joined the Flink PMC!
>
> Congratulations and welcome Guowei!
>
> Best,
> Kurt
>


Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yang Wang
Congratulations Guowei!

Best,
Yang

Yun Tang  于2021年7月7日周三 上午11:18写道:

> Congratulations, Guowei!
>
> Best
> Yun Tang
> 
> From: Jary Zhen 
> Sent: Wednesday, July 7, 2021 10:48
> To: dev 
> Cc: JING ZHANG 
> Subject: Re: Re: [ANNOUNCE] New PMC member: Guowei Ma
>
> Congratulations Guowei!
>
>
> Best,
> Jary
>
> Yun Gao  于2021年7月7日周三 上午10:38写道:
>
> > Congratulations Guowei!
> >
> >
> > Best,
> > Yun
> >
> >
> > --
> > Sender:JING ZHANG
> > Date:2021/07/07 10:33:51
> > Recipient:dev
> > Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma
> >
> > Congratulations,  Guowei Ma!
> >
> > Best regards,
> > JING ZHANG
> >
> > Zakelly Lan  于2021年7月7日周三 上午10:30写道:
> >
> > > Congratulations, Guowei!
> > >
> > > Best,
> > > Zakelly
> > >
> > > On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
> > >
> > > > Congrats! NB.
> > > >
> > > > Best,
> > > > tison.
> > > >
> > > >
> > > > Jark Wu  于2021年7月7日周三 上午10:20写道:
> > > >
> > > > > Congratulations Guowei!
> > > > >
> > > > > Best,
> > > > > Jark
> > > > >
> > > > > On Wed, 7 Jul 2021 at 09:54, XING JIN 
> > wrote:
> > > > >
> > > > > > Congratulations, Guowei~ !
> > > > > >
> > > > > > Best,
> > > > > > Jin
> > > > > >
> > > > > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > > > > >
> > > > > > > Congratulations, Guowei~!
> > > > > > >
> > > > > > > Thank you~
> > > > > > >
> > > > > > > Xintong Song
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren <
> renqs...@gmail.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > Congratulations Guowei!
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best Regards,
> > > > > > > >
> > > > > > > > Qingsheng Ren
> > > > > > > > Email: renqs...@gmail.com
> > > > > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > > > > Congratulations! Guowei Ma
> > > > > > > > >
> > > > > > > > > Best,
> > > > > > > > > Leonard
> > > > > > > > >
> > > > > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young 
> > дµÀ£º
> > > > > > > > > >
> > > > > > > > > > Hi all!
> > > > > > > > > >
> > > > > > > > > > I'm very happy to announce that Guowei Ma has joined the
> > > Flink
> > > > > PMC!
> > > > > > > > > >
> > > > > > > > > > Congratulations and welcome Guowei!
> > > > > > > > > >
> > > > > > > > > > Best,
> > > > > > > > > > Kurt
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
>


I want to contribute to Apache Flink

2021-07-06 Thread pang pan
Hi Guys,

I want to contribute to Apache Flink.
Would you please give me the permission as a contributor?
My JIRA ID is pangpan.


Re: [VOTE] Release 1.13.2, release candidate #1

2021-07-06 Thread JING ZHANG
Thanks Xintong for bringing the alarm, +1 on Xintong's proposal to hold the
vote until deciding what to do with FLINK-23233.

BTW, I made a typo in the previous voting. I mean +1 (non-binding) instead
of +1 (binding). I'm very sorry for the confusion.

+1 (non-binding).

1. Reviewed website pull request
2. Built from source code flink-1.13.2-src.tgz

 succeeded
3. Started a local Flink cluster, ran the WordCount example, WebUI looks
good,  no suspicious output/log
4. Started cluster and run some e2e sql queries using SQL Client, query
result is expected.
5. Repeat Step 3 and 4 with flink-1.13.2-bin-scala_2.11.tgz


Best regards,
JING ZHANG

Xintong Song  于2021年7月7日周三 上午11:09写道:

> Hi everyone,
>
> We find a bug that may cause data loss in a rare condition, which IMHO is a
> release blocker. Please see FLINK-23233 [1] for details.
>
> Given that this bug is not newly introduced but already exists in 1.13.0 &
> 1.13.1 releases, I would not replace my +1 with a -1 immediately. Instead,
> I would like to ask the release manager for holding this vote until
> deciding what to do with FLINK-23233.
>
> Thank you~
>
> Xintong Song
>
>
> [1] https://issues.apache.org/jira/browse/FLINK-23233
>
> On Wed, Jul 7, 2021 at 12:09 AM JING ZHANG  wrote:
>
> > +1 (binding)
> >
> > 1. Reviewed website pull request
> > 2. Built from source code flink-1.13.2-src.tgz
> > <
> >
> https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc1/flink-1.13.2-src.tgz
> > >
> > succeeded
> > 3. Started a local Flink cluster, ran the WordCount example, WebUI looks
> > good,  no suspicious output/log
> > 4. Started cluster and run some e2e sql queries using SQL Client, query
> > result is expected.
> > 5. Repeat Step 3 and 4 with flink-1.13.2-bin-scala_2.11.tgz
> > <
> >
> https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc1/flink-1.13.2-bin-scala_2.11.tgz
> > >
> >
> > Best regards,
> > JING ZHANG
> >
> >
> > Zakelly Lan  于2021年7月5日周一 下午6:06写道:
> >
> > > +1 (non-binding)
> > >
> > > - built from sources
> > > - run streaming job of wordcount
> > > - web-ui looks good
> > > - checkpoint and restore looks good
> > >
> > > Best,
> > > Zakelly
> > >
> > > On Mon, Jul 5, 2021 at 2:40 PM Jingsong Li 
> > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > - Verified checksums and signatures
> > > > - Built from sources
> > > > - run table example jobs
> > > > - web-ui looks good
> > > > - sql-client looks good
> > > >
> > > > I think we should update the unresolved JIRAs in [1] to 1.13.3.
> > > >
> > > > And we should check resolved JIRAs in [2], commits of some are not in
> > the
> > > > 1.13.2. We should exclude them. For example FLINK-23196 FLINK-23166
> > > >
> > > > [1]
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.13.2%20AND%20status%20not%20in%20(Closed%2C%20Resolved)%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC
> > > > [2]
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350218==12315522
> > > >
> > > > Best,
> > > > Jingsong
> > > >
> > > > On Mon, Jul 5, 2021 at 2:27 PM Xingbo Huang 
> > wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > - Verified checksums and signatures
> > > > > - Built from sources
> > > > > - Verified Python wheel package contents
> > > > > - Pip install Python wheel package in Mac
> > > > > - Run Python UDF job in Python shell
> > > > >
> > > > > Best,
> > > > > Xingbo
> > > > >
> > > > > Yangze Guo  于2021年7月5日周一 上午11:17写道:
> > > > >
> > > > > > +1 (non-binding)
> > > > > >
> > > > > > - built from sources
> > > > > > - run example jobs with standalone and yarn.
> > > > > > - check TaskManager's rest API from the JM master and its
> standby,
> > > > > > everything looks good
> > > > > >
> > > > > > Best,
> > > > > > Yangze Guo
> > > > > >
> > > > > > On Mon, Jul 5, 2021 at 10:10 AM Xintong Song <
> > tonysong...@gmail.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > +1 (binding)
> > > > > > >
> > > > > > > - verified checksums & signatures
> > > > > > > - built from sources
> > > > > > > - run example jobs with standalone and native k8s (with custom
> > > image)
> > > > > > > deployments
> > > > > > >   * job execution looks fine
> > > > > > >   * nothing unexpected found in logs and web ui
> > > > > > >
> > > > > > > Thank you~
> > > > > > >
> > > > > > > Xintong Song
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Sun, Jul 4, 2021 at 12:36 PM JING ZHANG <
> beyond1...@gmail.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > Hi yun,
> > > > > > > > Website pull request lists[6] and JIRA release notes[1] both
> > > > contain
> > > > > > > > unfinished JIRA (such as FLINK-22955).
> > > > > > > > Is it expected?
> > > > > > > >
> > > > > > > > Best regards,
> > > > > > > 

[jira] [Created] (FLINK-23289) BinarySection should null check in contusctor method

2021-07-06 Thread Terry Wang (Jira)
Terry Wang created FLINK-23289:
--

 Summary: BinarySection should null check in contusctor method
 Key: FLINK-23289
 URL: https://issues.apache.org/jira/browse/FLINK-23289
 Project: Flink
  Issue Type: Improvement
Reporter: Terry Wang



{code:java}
Caused by: java.lang.NullPointerException
    at 
org.apache.flink.table.data.binary.BinarySegmentUtils.inFirstSegment(BinarySegmentUtils.java:411)
    at 
org.apache.flink.table.data.binary.BinarySegmentUtils.copyToBytes(BinarySegmentUtils.java:132)
    at 
org.apache.flink.table.data.binary.BinarySegmentUtils.copyToBytes(BinarySegmentUtils.java:118)
    at 
org.apache.flink.table.data.binary.BinaryStringData.copy(BinaryStringData.java:360)
    at 
org.apache.flink.table.runtime.typeutils.StringDataSerializer.copy(StringDataSerializer.java:59)
    at 
org.apache.flink.table.runtime.typeutils.StringDataSerializer.copy(StringDataSerializer.java:37)
    at 
org.apache.flink.table.runtime.typeutils.ArrayDataSerializer.copyGenericArray(ArrayDataSerializer.java:128)
    at 
org.apache.flink.table.runtime.typeutils.ArrayDataSerializer.copy(ArrayDataSerializer.java:86)
    at 
org.apache.flink.table.runtime.typeutils.ArrayDataSerializer.copy(ArrayDataSerializer.java:47)
    at 
org.apache.flink.table.runtime.typeutils.RowDataSerializer.copyRowData(RowDataSerializer.java:170)
    at 
org.apache.flink.table.runtime.typeutils.RowDataSerializer.copy(RowDataSerializer.java:131)
    at 
org.apache.flink.table.runtime.typeutils.RowDataSerializer.copy(RowDataSerializer.java:48)
    at 
org.apache.flink.table.runtime.operators.join.lookup.AsyncLookupJoinWithCalcRunner$CalcCollectionCollector.collect(AsyncLookupJoinWithCalcRunner.java:152)
    at 
org.apache.flink.table.runtime.operators.join.lookup.AsyncLookupJoinWithCalcRunner$CalcCollectionCollector.collect(AsyncLookupJoinWithCalcRunner.java:142)
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [VOTE] Release 1.12.5, release candidate #1

2021-07-06 Thread Yang Wang
+1 (non-binding)

- verified checksums & signatures
- start a session cluster and verify HA data cleanup once job reached to
globally terminal state, FLINK-20695
- start a local standalone cluster, check the webUI good and JM/TM
without suspicious logs


Best,
Yang

Leonard Xu  于2021年7月7日周三 上午10:52写道:

> +1 (non-binding)
>
> - verified signatures and hashsums
> - built from source code with scala 2.11 succeeded
> - checked all denpendency artifacts are 1.12.5
> - started a cluster, ran a wordcount job, the result is expected
> - started SQL Client, ran a simple query, the result is expected
> - reviewed the web PR, left one minor name comment
>
> Best,
> Leonard
>
> > 在 2021年7月6日,10:02,Xintong Song  写道:
> >
> > +1 (binding)
> >
> > - verified checksums & signatures
> > - built from sources
> > - run example jobs with standalone and native k8s deployments
> >
> > Thank you~
> >
> > Xintong Song
> >
> >
> >
> > On Mon, Jul 5, 2021 at 11:18 AM Jingsong Li 
> wrote:
> >
> >> Hi everyone,
> >>
> >> Please review and vote on the release candidate #1 for the version
> 1.12.5,
> >> as follows:
> >> [ ] +1, Approve the release
> >> [ ] -1, Do not approve the release (please provide specific comments)
> >>
> >> The complete staging area is available for your review, which includes:
> >> * JIRA release notes [1],
> >> * the official Apache source release and binary convenience releases to
> be
> >> deployed to dist.apache.org [2], which are signed with the key with
> >> fingerprint FBB83C0A4FFB9CA8 [3],
> >> * all artifacts to be deployed to the Maven Central Repository [4],
> >> * source code tag "release-1.12.5-rc1" [5],
> >> * website pull request listing the new release and adding announcement
> blog
> >> post [6].
> >>
> >> The vote will be open for at least 72 hours. It is adopted by majority
> >> approval, with at least 3 PMC affirmative votes.
> >>
> >> Best,
> >> Jingsong Lee
> >>
> >> [1]
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12350166
> >> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.12.5-rc1/
> >> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
> >> [4]
> https://repository.apache.org/content/repositories/orgapacheflink-1430
> >> [5] https://github.com/apache/flink/releases/tag/release-1.12.5-rc1
> >> [6] https://github.com/apache/flink-web/pull/455
> >>
>
>


Re: Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Yun Tang
Congratulations, Yang!

Best
Yun Tang

From: Yu Li 
Sent: Wednesday, July 7, 2021 11:18
To: dev 
Subject: Re: Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

Congrats and welcome, Yang!

Best Regards,
Yu


On Wed, 7 Jul 2021 at 10:57, Yuan Mei  wrote:

> Congratulations, Yang!
>
> Best
> Yuan
>
> On Wed, Jul 7, 2021 at 10:47 AM Jary Zhen  wrote:
>
> > Congratulations, Yang Wang.
> >
> > Best
> > Jary
> >
> > Yun Gao  于2021年7月7日周三 上午10:38写道:
> >
> > > Congratulations Yang!
> > >
> > > Best,
> > > Yun
> > >
> > >
> > > --
> > > Sender:Jark Wu
> > > Date:2021/07/07 10:20:27
> > > Recipient:dev
> > > Cc:Yang Wang; 
> > > Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang
> > >
> > > Congratulations Yang Wang!
> > >
> > > Best,
> > > Jark
> > >
> > > On Wed, 7 Jul 2021 at 10:09, Xintong Song 
> wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> > Flink
> > > > committer.
> > > >
> > > > Yang has been a very active contributor for more than two years,
> mainly
> > > > focusing on Flink's deployment components. He's a main contributor
> and
> > > > maintainer of Flink's native Kubernetes deployment and native
> > Kubernetes
> > > > HA. He's also very active on the mailing lists, participating in
> > > > discussions and helping with user questions.
> > > >
> > > > Please join me in congratulating Yang Wang for becoming a Flink
> > > committer!
> > > >
> > > > Thank you~
> > > >
> > > > Xintong Song
> > > >
> > >
> > >
> >
>


Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yun Tang
Congratulations, Guowei!

Best
Yun Tang

From: Jary Zhen 
Sent: Wednesday, July 7, 2021 10:48
To: dev 
Cc: JING ZHANG 
Subject: Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

Congratulations Guowei!


Best,
Jary

Yun Gao  于2021年7月7日周三 上午10:38写道:

> Congratulations Guowei!
>
>
> Best,
> Yun
>
>
> --
> Sender:JING ZHANG
> Date:2021/07/07 10:33:51
> Recipient:dev
> Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma
>
> Congratulations,  Guowei Ma!
>
> Best regards,
> JING ZHANG
>
> Zakelly Lan  于2021年7月7日周三 上午10:30写道:
>
> > Congratulations, Guowei!
> >
> > Best,
> > Zakelly
> >
> > On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
> >
> > > Congrats! NB.
> > >
> > > Best,
> > > tison.
> > >
> > >
> > > Jark Wu  于2021年7月7日周三 上午10:20写道:
> > >
> > > > Congratulations Guowei!
> > > >
> > > > Best,
> > > > Jark
> > > >
> > > > On Wed, 7 Jul 2021 at 09:54, XING JIN 
> wrote:
> > > >
> > > > > Congratulations, Guowei~ !
> > > > >
> > > > > Best,
> > > > > Jin
> > > > >
> > > > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > > > >
> > > > > > Congratulations, Guowei~!
> > > > > >
> > > > > > Thank you~
> > > > > >
> > > > > > Xintong Song
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren  >
> > > > wrote:
> > > > > >
> > > > > > > Congratulations Guowei!
> > > > > > >
> > > > > > > --
> > > > > > > Best Regards,
> > > > > > >
> > > > > > > Qingsheng Ren
> > > > > > > Email: renqs...@gmail.com
> > > > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > > > Congratulations! Guowei Ma
> > > > > > > >
> > > > > > > > Best,
> > > > > > > > Leonard
> > > > > > > >
> > > > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young 
> дµÀ£º
> > > > > > > > >
> > > > > > > > > Hi all!
> > > > > > > > >
> > > > > > > > > I'm very happy to announce that Guowei Ma has joined the
> > Flink
> > > > PMC!
> > > > > > > > >
> > > > > > > > > Congratulations and welcome Guowei!
> > > > > > > > >
> > > > > > > > > Best,
> > > > > > > > > Kurt
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>


Re: Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Yu Li
Congrats and welcome, Yang!

Best Regards,
Yu


On Wed, 7 Jul 2021 at 10:57, Yuan Mei  wrote:

> Congratulations, Yang!
>
> Best
> Yuan
>
> On Wed, Jul 7, 2021 at 10:47 AM Jary Zhen  wrote:
>
> > Congratulations, Yang Wang.
> >
> > Best
> > Jary
> >
> > Yun Gao  于2021年7月7日周三 上午10:38写道:
> >
> > > Congratulations Yang!
> > >
> > > Best,
> > > Yun
> > >
> > >
> > > --
> > > Sender:Jark Wu
> > > Date:2021/07/07 10:20:27
> > > Recipient:dev
> > > Cc:Yang Wang; 
> > > Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang
> > >
> > > Congratulations Yang Wang!
> > >
> > > Best,
> > > Jark
> > >
> > > On Wed, 7 Jul 2021 at 10:09, Xintong Song 
> wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> > Flink
> > > > committer.
> > > >
> > > > Yang has been a very active contributor for more than two years,
> mainly
> > > > focusing on Flink's deployment components. He's a main contributor
> and
> > > > maintainer of Flink's native Kubernetes deployment and native
> > Kubernetes
> > > > HA. He's also very active on the mailing lists, participating in
> > > > discussions and helping with user questions.
> > > >
> > > > Please join me in congratulating Yang Wang for becoming a Flink
> > > committer!
> > > >
> > > > Thank you~
> > > >
> > > > Xintong Song
> > > >
> > >
> > >
> >
>


Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yu Li
Congrats and welcome, Guowei!

Best Regards,
Yu


On Wed, 7 Jul 2021 at 10:56, Yuan Mei  wrote:

> Congratulations Guowei!
>
> Best,
> Yuan
>
> On Wed, Jul 7, 2021 at 10:49 AM Jary Zhen  wrote:
>
> > Congratulations Guowei!
> >
> >
> > Best,
> > Jary
> >
> > Yun Gao  于2021年7月7日周三 上午10:38写道:
> >
> > > Congratulations Guowei!
> > >
> > >
> > > Best,
> > > Yun
> > >
> > >
> > > --
> > > Sender:JING ZHANG
> > > Date:2021/07/07 10:33:51
> > > Recipient:dev
> > > Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma
> > >
> > > Congratulations,  Guowei Ma!
> > >
> > > Best regards,
> > > JING ZHANG
> > >
> > > Zakelly Lan  于2021年7月7日周三 上午10:30写道:
> > >
> > > > Congratulations, Guowei!
> > > >
> > > > Best,
> > > > Zakelly
> > > >
> > > > On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
> > > >
> > > > > Congrats! NB.
> > > > >
> > > > > Best,
> > > > > tison.
> > > > >
> > > > >
> > > > > Jark Wu  于2021年7月7日周三 上午10:20写道:
> > > > >
> > > > > > Congratulations Guowei!
> > > > > >
> > > > > > Best,
> > > > > > Jark
> > > > > >
> > > > > > On Wed, 7 Jul 2021 at 09:54, XING JIN 
> > > wrote:
> > > > > >
> > > > > > > Congratulations, Guowei~ !
> > > > > > >
> > > > > > > Best,
> > > > > > > Jin
> > > > > > >
> > > > > > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > > > > > >
> > > > > > > > Congratulations, Guowei~!
> > > > > > > >
> > > > > > > > Thank you~
> > > > > > > >
> > > > > > > > Xintong Song
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren <
> > renqs...@gmail.com
> > > >
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > Congratulations Guowei!
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Best Regards,
> > > > > > > > >
> > > > > > > > > Qingsheng Ren
> > > > > > > > > Email: renqs...@gmail.com
> > > > > > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > > > > > Congratulations! Guowei Ma
> > > > > > > > > >
> > > > > > > > > > Best,
> > > > > > > > > > Leonard
> > > > > > > > > >
> > > > > > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young 
> > > дµÀ£º
> > > > > > > > > > >
> > > > > > > > > > > Hi all!
> > > > > > > > > > >
> > > > > > > > > > > I'm very happy to announce that Guowei Ma has joined
> the
> > > > Flink
> > > > > > PMC!
> > > > > > > > > > >
> > > > > > > > > > > Congratulations and welcome Guowei!
> > > > > > > > > > >
> > > > > > > > > > > Best,
> > > > > > > > > > > Kurt
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> >
>


Re: [VOTE] Release 1.13.2, release candidate #1

2021-07-06 Thread Xintong Song
Hi everyone,

We find a bug that may cause data loss in a rare condition, which IMHO is a
release blocker. Please see FLINK-23233 [1] for details.

Given that this bug is not newly introduced but already exists in 1.13.0 &
1.13.1 releases, I would not replace my +1 with a -1 immediately. Instead,
I would like to ask the release manager for holding this vote until
deciding what to do with FLINK-23233.

Thank you~

Xintong Song


[1] https://issues.apache.org/jira/browse/FLINK-23233

On Wed, Jul 7, 2021 at 12:09 AM JING ZHANG  wrote:

> +1 (binding)
>
> 1. Reviewed website pull request
> 2. Built from source code flink-1.13.2-src.tgz
> <
> https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc1/flink-1.13.2-src.tgz
> >
> succeeded
> 3. Started a local Flink cluster, ran the WordCount example, WebUI looks
> good,  no suspicious output/log
> 4. Started cluster and run some e2e sql queries using SQL Client, query
> result is expected.
> 5. Repeat Step 3 and 4 with flink-1.13.2-bin-scala_2.11.tgz
> <
> https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc1/flink-1.13.2-bin-scala_2.11.tgz
> >
>
> Best regards,
> JING ZHANG
>
>
> Zakelly Lan  于2021年7月5日周一 下午6:06写道:
>
> > +1 (non-binding)
> >
> > - built from sources
> > - run streaming job of wordcount
> > - web-ui looks good
> > - checkpoint and restore looks good
> >
> > Best,
> > Zakelly
> >
> > On Mon, Jul 5, 2021 at 2:40 PM Jingsong Li 
> wrote:
> >
> > > +1 (non-binding)
> > >
> > > - Verified checksums and signatures
> > > - Built from sources
> > > - run table example jobs
> > > - web-ui looks good
> > > - sql-client looks good
> > >
> > > I think we should update the unresolved JIRAs in [1] to 1.13.3.
> > >
> > > And we should check resolved JIRAs in [2], commits of some are not in
> the
> > > 1.13.2. We should exclude them. For example FLINK-23196 FLINK-23166
> > >
> > > [1]
> > >
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.13.2%20AND%20status%20not%20in%20(Closed%2C%20Resolved)%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC
> > > [2]
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350218==12315522
> > >
> > > Best,
> > > Jingsong
> > >
> > > On Mon, Jul 5, 2021 at 2:27 PM Xingbo Huang 
> wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > - Verified checksums and signatures
> > > > - Built from sources
> > > > - Verified Python wheel package contents
> > > > - Pip install Python wheel package in Mac
> > > > - Run Python UDF job in Python shell
> > > >
> > > > Best,
> > > > Xingbo
> > > >
> > > > Yangze Guo  于2021年7月5日周一 上午11:17写道:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > - built from sources
> > > > > - run example jobs with standalone and yarn.
> > > > > - check TaskManager's rest API from the JM master and its standby,
> > > > > everything looks good
> > > > >
> > > > > Best,
> > > > > Yangze Guo
> > > > >
> > > > > On Mon, Jul 5, 2021 at 10:10 AM Xintong Song <
> tonysong...@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > > +1 (binding)
> > > > > >
> > > > > > - verified checksums & signatures
> > > > > > - built from sources
> > > > > > - run example jobs with standalone and native k8s (with custom
> > image)
> > > > > > deployments
> > > > > >   * job execution looks fine
> > > > > >   * nothing unexpected found in logs and web ui
> > > > > >
> > > > > > Thank you~
> > > > > >
> > > > > > Xintong Song
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Sun, Jul 4, 2021 at 12:36 PM JING ZHANG  >
> > > > wrote:
> > > > > >
> > > > > > > Hi yun,
> > > > > > > Website pull request lists[6] and JIRA release notes[1] both
> > > contain
> > > > > > > unfinished JIRA (such as FLINK-22955).
> > > > > > > Is it expected?
> > > > > > >
> > > > > > > Best regards,
> > > > > > > JING ZHANG
> > > > > > >
> > > > > > > Dawid Wysakowicz  于2021年7月2日周五
> 下午9:05写道:
> > > > > > >
> > > > > > > > +1 (binding)
> > > > > > > >
> > > > > > > >- verified signatures and checksums
> > > > > > > >- reviewed the announcement PR
> > > > > > > >- built from sources and run an example, quickly checked
> Web
> > > UI
> > > > > > > >- checked diff of pom.xml and NOTICE files from 1.13.1,
> > > > > > > >- commons-io updated,
> > > > > > > >   - bundled guava:failureaccess addded in
> > > > > flink-sql-connector-kinesis
> > > > > > > >   which is properly reflected in the NOTICE file
> > > > > > > >
> > > > > > > > Best,
> > > > > > > > Dawid
> > > > > > > > On 01/07/2021 12:57, Yun Tang wrote:
> > > > > > > >
> > > > > > > > Hi everyone,
> > > > > > > > Please review and vote on the release candidate #1 for the
> > > version
> > > > > > > 1.13.2, as follows:
> > > > > > > > [ ] +1, Approve the release
> > > > > > > > [ ] -1, Do not approve the release (please provide specific
> > > > comments)
> > > > > > > >
> > > > > > > >
> > > > > > > > The complete staging area is available for your review, which
> > > > > includes:
> > 

[jira] [Created] (FLINK-23288) Inserting (1.378593404E9) (0.6047707965147558) to a double type, it will generate CodeGenException

2021-07-06 Thread xiaojin.wy (Jira)
xiaojin.wy created FLINK-23288:
--

 Summary: Inserting (1.378593404E9) (0.6047707965147558) to a 
double type, it will generate CodeGenException
 Key: FLINK-23288
 URL: https://issues.apache.org/jira/browse/FLINK-23288
 Project: Flink
  Issue Type: Improvement
  Components: Table SQL / Runtime
Affects Versions: 1.14.0
Reporter: xiaojin.wy


CREATE TABLE database5_t0(
`c0` DOUBLE , `c1` INTEGER , `c2` STRING
) WITH (
 'connector' = 'filesystem',
'path' = 'hdfs:///tmp/database5_t0.csv',   
 'format' = 'csv'
)
INSERT OVERWRITE database5_t0(c0, c1, c2) VALUES(1.378593404E9, 1336919677, 
'1969-12-31 20:29:41'), (0.6047707965147558, 1336919677, '1970-01-06 03:36:50')

*After excuting that, will generate this errors, but mysql,pg,sqlite won`t have 
the error:*

org.apache.flink.table.planner.codegen.CodeGenException: Incompatible types of 
expression and result type. 
Expression[GeneratedExpression(((org.apache.flink.table.data.DecimalData) 
decimal$3),false,,DECIMAL(17, 16) NOT NULL,Some(0.6047707965147558))] type is 
[DECIMAL(17, 16) NOT NULL], result type is [DOUBLE NOT NULL]

at 
org.apache.flink.table.planner.codegen.ExprCodeGenerator$$anonfun$generateResultExpression$1.apply(ExprCodeGenerator.scala:312)
at 
org.apache.flink.table.planner.codegen.ExprCodeGenerator$$anonfun$generateResultExpression$1.apply(ExprCodeGenerator.scala:300)
at 
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at 
org.apache.flink.table.planner.codegen.ExprCodeGenerator.generateResultExpression(ExprCodeGenerator.scala:300)
at 
org.apache.flink.table.planner.codegen.ExprCodeGenerator.generateResultExpression(ExprCodeGenerator.scala:256)
at 
org.apache.flink.table.planner.codegen.ValuesCodeGenerator$$anonfun$1.apply(ValuesCodeGenerator.scala:44)
at 
org.apache.flink.table.planner.codegen.ValuesCodeGenerator$$anonfun$1.apply(ValuesCodeGenerator.scala:43)
at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at 
org.apache.flink.table.planner.codegen.ValuesCodeGenerator$.generatorInputFormat(ValuesCodeGenerator.scala:43)
at 
org.apache.flink.table.planner.codegen.ValuesCodeGenerator.generatorInputFormat(ValuesCodeGenerator.scala)
at 
org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecValues.translateToPlanInternal(CommonExecValues.java:50)
at 
org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:171)
at 
org.apache.flink.table.planner.plan.nodes.exec.ExecEdge.translateToPlan(ExecEdge.java:247)
at 
org.apache.flink.table.planner.plan.nodes.exec.batch.BatchExecSink.translateToPlanInternal(BatchExecSink.java:58)
at 
org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:171)
at 
org.apache.flink.table.planner.delegation.BatchPlanner$$anonfun$translateToPlan$1.apply(BatchPlanner.scala:81)
at 
org.apache.flink.table.planner.delegation.BatchPlanner$$anonfun$translateToPlan$1.apply(BatchPlanner.scala:80)
at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at 
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at 
org.apache.flink.table.planner.delegation.BatchPlanner.translateToPlan(BatchPlanner.scala:80)
at 
org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:174)
at 
org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1658)
at 
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:747)
at 

[jira] [Created] (FLINK-23287) Create user document for Window Join in SQL

2021-07-06 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-23287:
--

 Summary: Create user document for Window Join in SQL
 Key: FLINK-23287
 URL: https://issues.apache.org/jira/browse/FLINK-23287
 Project: Flink
  Issue Type: Sub-task
  Components: Documentation
Reporter: JING ZHANG


Create user document for Window Join in SQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23286) Create user document for Window Join in SQL

2021-07-06 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-23286:
--

 Summary: Create user document for Window Join in SQL
 Key: FLINK-23286
 URL: https://issues.apache.org/jira/browse/FLINK-23286
 Project: Flink
  Issue Type: Improvement
  Components: Documentation
Reporter: JING ZHANG


Create user document for Window Join in SQL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Yuan Mei
Congratulations, Yang!

Best
Yuan

On Wed, Jul 7, 2021 at 10:47 AM Jary Zhen  wrote:

> Congratulations, Yang Wang.
>
> Best
> Jary
>
> Yun Gao  于2021年7月7日周三 上午10:38写道:
>
> > Congratulations Yang!
> >
> > Best,
> > Yun
> >
> >
> > --
> > Sender:Jark Wu
> > Date:2021/07/07 10:20:27
> > Recipient:dev
> > Cc:Yang Wang; 
> > Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang
> >
> > Congratulations Yang Wang!
> >
> > Best,
> > Jark
> >
> > On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:
> >
> > > Hi everyone,
> > >
> > > On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> Flink
> > > committer.
> > >
> > > Yang has been a very active contributor for more than two years, mainly
> > > focusing on Flink's deployment components. He's a main contributor and
> > > maintainer of Flink's native Kubernetes deployment and native
> Kubernetes
> > > HA. He's also very active on the mailing lists, participating in
> > > discussions and helping with user questions.
> > >
> > > Please join me in congratulating Yang Wang for becoming a Flink
> > committer!
> > >
> > > Thank you~
> > >
> > > Xintong Song
> > >
> >
> >
>


Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yuan Mei
Congratulations Guowei!

Best,
Yuan

On Wed, Jul 7, 2021 at 10:49 AM Jary Zhen  wrote:

> Congratulations Guowei!
>
>
> Best,
> Jary
>
> Yun Gao  于2021年7月7日周三 上午10:38写道:
>
> > Congratulations Guowei!
> >
> >
> > Best,
> > Yun
> >
> >
> > --
> > Sender:JING ZHANG
> > Date:2021/07/07 10:33:51
> > Recipient:dev
> > Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma
> >
> > Congratulations,  Guowei Ma!
> >
> > Best regards,
> > JING ZHANG
> >
> > Zakelly Lan  于2021年7月7日周三 上午10:30写道:
> >
> > > Congratulations, Guowei!
> > >
> > > Best,
> > > Zakelly
> > >
> > > On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
> > >
> > > > Congrats! NB.
> > > >
> > > > Best,
> > > > tison.
> > > >
> > > >
> > > > Jark Wu  于2021年7月7日周三 上午10:20写道:
> > > >
> > > > > Congratulations Guowei!
> > > > >
> > > > > Best,
> > > > > Jark
> > > > >
> > > > > On Wed, 7 Jul 2021 at 09:54, XING JIN 
> > wrote:
> > > > >
> > > > > > Congratulations, Guowei~ !
> > > > > >
> > > > > > Best,
> > > > > > Jin
> > > > > >
> > > > > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > > > > >
> > > > > > > Congratulations, Guowei~!
> > > > > > >
> > > > > > > Thank you~
> > > > > > >
> > > > > > > Xintong Song
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren <
> renqs...@gmail.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > > Congratulations Guowei!
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best Regards,
> > > > > > > >
> > > > > > > > Qingsheng Ren
> > > > > > > > Email: renqs...@gmail.com
> > > > > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > > > > Congratulations! Guowei Ma
> > > > > > > > >
> > > > > > > > > Best,
> > > > > > > > > Leonard
> > > > > > > > >
> > > > > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young 
> > дµÀ£º
> > > > > > > > > >
> > > > > > > > > > Hi all!
> > > > > > > > > >
> > > > > > > > > > I'm very happy to announce that Guowei Ma has joined the
> > > Flink
> > > > > PMC!
> > > > > > > > > >
> > > > > > > > > > Congratulations and welcome Guowei!
> > > > > > > > > >
> > > > > > > > > > Best,
> > > > > > > > > > Kurt
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
>


Re: [VOTE] Release 1.12.5, release candidate #1

2021-07-06 Thread Leonard Xu
+1 (non-binding)

- verified signatures and hashsums
- built from source code with scala 2.11 succeeded
- checked all denpendency artifacts are 1.12.5
- started a cluster, ran a wordcount job, the result is expected
- started SQL Client, ran a simple query, the result is expected
- reviewed the web PR, left one minor name comment

Best,
Leonard

> 在 2021年7月6日,10:02,Xintong Song  写道:
> 
> +1 (binding)
> 
> - verified checksums & signatures
> - built from sources
> - run example jobs with standalone and native k8s deployments
> 
> Thank you~
> 
> Xintong Song
> 
> 
> 
> On Mon, Jul 5, 2021 at 11:18 AM Jingsong Li  wrote:
> 
>> Hi everyone,
>> 
>> Please review and vote on the release candidate #1 for the version 1.12.5,
>> as follows:
>> [ ] +1, Approve the release
>> [ ] -1, Do not approve the release (please provide specific comments)
>> 
>> The complete staging area is available for your review, which includes:
>> * JIRA release notes [1],
>> * the official Apache source release and binary convenience releases to be
>> deployed to dist.apache.org [2], which are signed with the key with
>> fingerprint FBB83C0A4FFB9CA8 [3],
>> * all artifacts to be deployed to the Maven Central Repository [4],
>> * source code tag "release-1.12.5-rc1" [5],
>> * website pull request listing the new release and adding announcement blog
>> post [6].
>> 
>> The vote will be open for at least 72 hours. It is adopted by majority
>> approval, with at least 3 PMC affirmative votes.
>> 
>> Best,
>> Jingsong Lee
>> 
>> [1]
>> 
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12350166
>> [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.12.5-rc1/
>> [3] https://dist.apache.org/repos/dist/release/flink/KEYS
>> [4] https://repository.apache.org/content/repositories/orgapacheflink-1430
>> [5] https://github.com/apache/flink/releases/tag/release-1.12.5-rc1
>> [6] https://github.com/apache/flink-web/pull/455
>> 



Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Jary Zhen
Congratulations Guowei!


Best,
Jary

Yun Gao  于2021年7月7日周三 上午10:38写道:

> Congratulations Guowei!
>
>
> Best,
> Yun
>
>
> --
> Sender:JING ZHANG
> Date:2021/07/07 10:33:51
> Recipient:dev
> Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma
>
> Congratulations,  Guowei Ma!
>
> Best regards,
> JING ZHANG
>
> Zakelly Lan  于2021年7月7日周三 上午10:30写道:
>
> > Congratulations, Guowei!
> >
> > Best,
> > Zakelly
> >
> > On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
> >
> > > Congrats! NB.
> > >
> > > Best,
> > > tison.
> > >
> > >
> > > Jark Wu  于2021年7月7日周三 上午10:20写道:
> > >
> > > > Congratulations Guowei!
> > > >
> > > > Best,
> > > > Jark
> > > >
> > > > On Wed, 7 Jul 2021 at 09:54, XING JIN 
> wrote:
> > > >
> > > > > Congratulations, Guowei~ !
> > > > >
> > > > > Best,
> > > > > Jin
> > > > >
> > > > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > > > >
> > > > > > Congratulations, Guowei~!
> > > > > >
> > > > > > Thank you~
> > > > > >
> > > > > > Xintong Song
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren  >
> > > > wrote:
> > > > > >
> > > > > > > Congratulations Guowei!
> > > > > > >
> > > > > > > --
> > > > > > > Best Regards,
> > > > > > >
> > > > > > > Qingsheng Ren
> > > > > > > Email: renqs...@gmail.com
> > > > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > > > Congratulations! Guowei Ma
> > > > > > > >
> > > > > > > > Best,
> > > > > > > > Leonard
> > > > > > > >
> > > > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young 
> дµÀ£º
> > > > > > > > >
> > > > > > > > > Hi all!
> > > > > > > > >
> > > > > > > > > I'm very happy to announce that Guowei Ma has joined the
> > Flink
> > > > PMC!
> > > > > > > > >
> > > > > > > > > Congratulations and welcome Guowei!
> > > > > > > > >
> > > > > > > > > Best,
> > > > > > > > > Kurt
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>


Re: Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Jary Zhen
Congratulations, Yang Wang.

Best
Jary

Yun Gao  于2021年7月7日周三 上午10:38写道:

> Congratulations Yang!
>
> Best,
> Yun
>
>
> --
> Sender:Jark Wu
> Date:2021/07/07 10:20:27
> Recipient:dev
> Cc:Yang Wang; 
> Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang
>
> Congratulations Yang Wang!
>
> Best,
> Jark
>
> On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:
>
> > Hi everyone,
> >
> > On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
> > committer.
> >
> > Yang has been a very active contributor for more than two years, mainly
> > focusing on Flink's deployment components. He's a main contributor and
> > maintainer of Flink's native Kubernetes deployment and native Kubernetes
> > HA. He's also very active on the mailing lists, participating in
> > discussions and helping with user questions.
> >
> > Please join me in congratulating Yang Wang for becoming a Flink
> committer!
> >
> > Thank you~
> >
> > Xintong Song
> >
>
>


Re: Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Yun Gao
Congratulations Yang!

Best,
Yun


--
Sender:Jark Wu
Date:2021/07/07 10:20:27
Recipient:dev
Cc:Yang Wang; 
Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

Congratulations Yang Wang!

Best,
Jark

On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:

> Hi everyone,
>
> On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
> committer.
>
> Yang has been a very active contributor for more than two years, mainly
> focusing on Flink's deployment components. He's a main contributor and
> maintainer of Flink's native Kubernetes deployment and native Kubernetes
> HA. He's also very active on the mailing lists, participating in
> discussions and helping with user questions.
>
> Please join me in congratulating Yang Wang for becoming a Flink committer!
>
> Thank you~
>
> Xintong Song
>



Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yun Gao
Congratulations Guowei!


Best,
Yun


--
Sender:JING ZHANG
Date:2021/07/07 10:33:51
Recipient:dev
Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma

Congratulations,  Guowei Ma!

Best regards,
JING ZHANG

Zakelly Lan  于2021年7月7日周三 上午10:30写道:

> Congratulations, Guowei!
>
> Best,
> Zakelly
>
> On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
>
> > Congrats! NB.
> >
> > Best,
> > tison.
> >
> >
> > Jark Wu  于2021年7月7日周三 上午10:20写道:
> >
> > > Congratulations Guowei!
> > >
> > > Best,
> > > Jark
> > >
> > > On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:
> > >
> > > > Congratulations, Guowei~ !
> > > >
> > > > Best,
> > > > Jin
> > > >
> > > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > > >
> > > > > Congratulations, Guowei~!
> > > > >
> > > > > Thank you~
> > > > >
> > > > > Xintong Song
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
> > > wrote:
> > > > >
> > > > > > Congratulations Guowei!
> > > > > >
> > > > > > --
> > > > > > Best Regards,
> > > > > >
> > > > > > Qingsheng Ren
> > > > > > Email: renqs...@gmail.com
> > > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > > Congratulations! Guowei Ma
> > > > > > >
> > > > > > > Best,
> > > > > > > Leonard
> > > > > > >
> > > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > > > > > >
> > > > > > > > Hi all!
> > > > > > > >
> > > > > > > > I'm very happy to announce that Guowei Ma has joined the
> Flink
> > > PMC!
> > > > > > > >
> > > > > > > > Congratulations and welcome Guowei!
> > > > > > > >
> > > > > > > > Best,
> > > > > > > > Kurt
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>



Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread JING ZHANG
Congratulations,  Guowei Ma!

Best regards,
JING ZHANG

Zakelly Lan  于2021年7月7日周三 上午10:30写道:

> Congratulations, Guowei!
>
> Best,
> Zakelly
>
> On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
>
> > Congrats! NB.
> >
> > Best,
> > tison.
> >
> >
> > Jark Wu  于2021年7月7日周三 上午10:20写道:
> >
> > > Congratulations Guowei!
> > >
> > > Best,
> > > Jark
> > >
> > > On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:
> > >
> > > > Congratulations, Guowei~ !
> > > >
> > > > Best,
> > > > Jin
> > > >
> > > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > > >
> > > > > Congratulations, Guowei~!
> > > > >
> > > > > Thank you~
> > > > >
> > > > > Xintong Song
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
> > > wrote:
> > > > >
> > > > > > Congratulations Guowei!
> > > > > >
> > > > > > --
> > > > > > Best Regards,
> > > > > >
> > > > > > Qingsheng Ren
> > > > > > Email: renqs...@gmail.com
> > > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > > Congratulations! Guowei Ma
> > > > > > >
> > > > > > > Best,
> > > > > > > Leonard
> > > > > > >
> > > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > > > > > >
> > > > > > > > Hi all!
> > > > > > > >
> > > > > > > > I'm very happy to announce that Guowei Ma has joined the
> Flink
> > > PMC!
> > > > > > > >
> > > > > > > > Congratulations and welcome Guowei!
> > > > > > > >
> > > > > > > > Best,
> > > > > > > > Kurt
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread JING ZHANG
Congratulations!  Yang Wang!

Best regards,
JING ZHANG

Zakelly Lan  于2021年7月7日周三 上午10:31写道:

> Congrats & well deserved, Yang Wang!
>
> Best,
> Zakelly
>
> On Wed, Jul 7, 2021 at 10:30 AM 刘建刚  wrote:
>
> > Congratulations, Yang Wang.
> >
> > Best
> > Jiangang Liu
> >
> > Leonard Xu  于2021年7月7日周三 上午10:27写道:
> >
> > > Congratulations!  Yang Wang
> > >
> > >
> > > Best,
> > > Leonard
> > > > 在 2021年7月7日,10:23,tison  写道:
> > > >
> > > > Congratulations and well deserved!
> > > >
> > > > It is my pressure to work with you excellent developer.
> > > >
> > > > Best,
> > > > tison.
> > > >
> > > >
> > > > Jark Wu  于2021年7月7日周三 上午10:21写道:
> > > >
> > > >> Congratulations Yang Wang!
> > > >>
> > > >> Best,
> > > >> Jark
> > > >>
> > > >> On Wed, 7 Jul 2021 at 10:09, Xintong Song 
> > > wrote:
> > > >>
> > > >>> Hi everyone,
> > > >>>
> > > >>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> > > Flink
> > > >>> committer.
> > > >>>
> > > >>> Yang has been a very active contributor for more than two years,
> > mainly
> > > >>> focusing on Flink's deployment components. He's a main contributor
> > and
> > > >>> maintainer of Flink's native Kubernetes deployment and native
> > > Kubernetes
> > > >>> HA. He's also very active on the mailing lists, participating in
> > > >>> discussions and helping with user questions.
> > > >>>
> > > >>> Please join me in congratulating Yang Wang for becoming a Flink
> > > >> committer!
> > > >>>
> > > >>> Thank you~
> > > >>>
> > > >>> Xintong Song
> > > >>>
> > > >>
> > >
> > >
> >
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Zakelly Lan
Congrats & well deserved, Yang Wang!

Best,
Zakelly

On Wed, Jul 7, 2021 at 10:30 AM 刘建刚  wrote:

> Congratulations, Yang Wang.
>
> Best
> Jiangang Liu
>
> Leonard Xu  于2021年7月7日周三 上午10:27写道:
>
> > Congratulations!  Yang Wang
> >
> >
> > Best,
> > Leonard
> > > 在 2021年7月7日,10:23,tison  写道:
> > >
> > > Congratulations and well deserved!
> > >
> > > It is my pressure to work with you excellent developer.
> > >
> > > Best,
> > > tison.
> > >
> > >
> > > Jark Wu  于2021年7月7日周三 上午10:21写道:
> > >
> > >> Congratulations Yang Wang!
> > >>
> > >> Best,
> > >> Jark
> > >>
> > >> On Wed, 7 Jul 2021 at 10:09, Xintong Song 
> > wrote:
> > >>
> > >>> Hi everyone,
> > >>>
> > >>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> > Flink
> > >>> committer.
> > >>>
> > >>> Yang has been a very active contributor for more than two years,
> mainly
> > >>> focusing on Flink's deployment components. He's a main contributor
> and
> > >>> maintainer of Flink's native Kubernetes deployment and native
> > Kubernetes
> > >>> HA. He's also very active on the mailing lists, participating in
> > >>> discussions and helping with user questions.
> > >>>
> > >>> Please join me in congratulating Yang Wang for becoming a Flink
> > >> committer!
> > >>>
> > >>> Thank you~
> > >>>
> > >>> Xintong Song
> > >>>
> > >>
> >
> >
>


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Zakelly Lan
Congratulations, Guowei!

Best,
Zakelly

On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:

> Congrats! NB.
>
> Best,
> tison.
>
>
> Jark Wu  于2021年7月7日周三 上午10:20写道:
>
> > Congratulations Guowei!
> >
> > Best,
> > Jark
> >
> > On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:
> >
> > > Congratulations, Guowei~ !
> > >
> > > Best,
> > > Jin
> > >
> > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > >
> > > > Congratulations, Guowei~!
> > > >
> > > > Thank you~
> > > >
> > > > Xintong Song
> > > >
> > > >
> > > >
> > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
> > wrote:
> > > >
> > > > > Congratulations Guowei!
> > > > >
> > > > > --
> > > > > Best Regards,
> > > > >
> > > > > Qingsheng Ren
> > > > > Email: renqs...@gmail.com
> > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > Congratulations! Guowei Ma
> > > > > >
> > > > > > Best,
> > > > > > Leonard
> > > > > >
> > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > > > > >
> > > > > > > Hi all!
> > > > > > >
> > > > > > > I'm very happy to announce that Guowei Ma has joined the Flink
> > PMC!
> > > > > > >
> > > > > > > Congratulations and welcome Guowei!
> > > > > > >
> > > > > > > Best,
> > > > > > > Kurt
> > > > > >
> > > > >
> > > >
> > >
> >
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread 刘建刚
Congratulations, Yang Wang.

Best
Jiangang Liu

Leonard Xu  于2021年7月7日周三 上午10:27写道:

> Congratulations!  Yang Wang
>
>
> Best,
> Leonard
> > 在 2021年7月7日,10:23,tison  写道:
> >
> > Congratulations and well deserved!
> >
> > It is my pressure to work with you excellent developer.
> >
> > Best,
> > tison.
> >
> >
> > Jark Wu  于2021年7月7日周三 上午10:21写道:
> >
> >> Congratulations Yang Wang!
> >>
> >> Best,
> >> Jark
> >>
> >> On Wed, 7 Jul 2021 at 10:09, Xintong Song 
> wrote:
> >>
> >>> Hi everyone,
> >>>
> >>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new
> Flink
> >>> committer.
> >>>
> >>> Yang has been a very active contributor for more than two years, mainly
> >>> focusing on Flink's deployment components. He's a main contributor and
> >>> maintainer of Flink's native Kubernetes deployment and native
> Kubernetes
> >>> HA. He's also very active on the mailing lists, participating in
> >>> discussions and helping with user questions.
> >>>
> >>> Please join me in congratulating Yang Wang for becoming a Flink
> >> committer!
> >>>
> >>> Thank you~
> >>>
> >>> Xintong Song
> >>>
> >>
>
>


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread 刘建刚
Congratulations,Guowei Ma.

Best
Jiangang Liu

tison  于2021年7月7日周三 上午10:24写道:

> Congrats! NB.
>
> Best,
> tison.
>
>
> Jark Wu  于2021年7月7日周三 上午10:20写道:
>
> > Congratulations Guowei!
> >
> > Best,
> > Jark
> >
> > On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:
> >
> > > Congratulations, Guowei~ !
> > >
> > > Best,
> > > Jin
> > >
> > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > >
> > > > Congratulations, Guowei~!
> > > >
> > > > Thank you~
> > > >
> > > > Xintong Song
> > > >
> > > >
> > > >
> > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
> > wrote:
> > > >
> > > > > Congratulations Guowei!
> > > > >
> > > > > --
> > > > > Best Regards,
> > > > >
> > > > > Qingsheng Ren
> > > > > Email: renqs...@gmail.com
> > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > Congratulations! Guowei Ma
> > > > > >
> > > > > > Best,
> > > > > > Leonard
> > > > > >
> > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > > > > >
> > > > > > > Hi all!
> > > > > > >
> > > > > > > I'm very happy to announce that Guowei Ma has joined the Flink
> > PMC!
> > > > > > >
> > > > > > > Congratulations and welcome Guowei!
> > > > > > >
> > > > > > > Best,
> > > > > > > Kurt
> > > > > >
> > > > >
> > > >
> > >
> >
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Yangze Guo
Congrats, Yang Wang!

Best,
Yangze Guo

On Wed, Jul 7, 2021 at 10:27 AM Leonard Xu  wrote:
>
> Congratulations!  Yang Wang
>
>
> Best,
> Leonard
> > 在 2021年7月7日,10:23,tison  写道:
> >
> > Congratulations and well deserved!
> >
> > It is my pressure to work with you excellent developer.
> >
> > Best,
> > tison.
> >
> >
> > Jark Wu  于2021年7月7日周三 上午10:21写道:
> >
> >> Congratulations Yang Wang!
> >>
> >> Best,
> >> Jark
> >>
> >> On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:
> >>
> >>> Hi everyone,
> >>>
> >>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
> >>> committer.
> >>>
> >>> Yang has been a very active contributor for more than two years, mainly
> >>> focusing on Flink's deployment components. He's a main contributor and
> >>> maintainer of Flink's native Kubernetes deployment and native Kubernetes
> >>> HA. He's also very active on the mailing lists, participating in
> >>> discussions and helping with user questions.
> >>>
> >>> Please join me in congratulating Yang Wang for becoming a Flink
> >> committer!
> >>>
> >>> Thank you~
> >>>
> >>> Xintong Song
> >>>
> >>
>


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yangze Guo
Congrats, Guowei!

Best,
Yangze Guo

On Wed, Jul 7, 2021 at 10:24 AM tison  wrote:
>
> Congrats! NB.
>
> Best,
> tison.
>
>
> Jark Wu  于2021年7月7日周三 上午10:20写道:
>
> > Congratulations Guowei!
> >
> > Best,
> > Jark
> >
> > On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:
> >
> > > Congratulations, Guowei~ !
> > >
> > > Best,
> > > Jin
> > >
> > > Xintong Song  于2021年7月7日周三 上午9:37写道:
> > >
> > > > Congratulations, Guowei~!
> > > >
> > > > Thank you~
> > > >
> > > > Xintong Song
> > > >
> > > >
> > > >
> > > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
> > wrote:
> > > >
> > > > > Congratulations Guowei!
> > > > >
> > > > > --
> > > > > Best Regards,
> > > > >
> > > > > Qingsheng Ren
> > > > > Email: renqs...@gmail.com
> > > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > > Congratulations! Guowei Ma
> > > > > >
> > > > > > Best,
> > > > > > Leonard
> > > > > >
> > > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > > > > >
> > > > > > > Hi all!
> > > > > > >
> > > > > > > I'm very happy to announce that Guowei Ma has joined the Flink
> > PMC!
> > > > > > >
> > > > > > > Congratulations and welcome Guowei!
> > > > > > >
> > > > > > > Best,
> > > > > > > Kurt
> > > > > >
> > > > >
> > > >
> > >
> >


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Leonard Xu
Congratulations!  Yang Wang


Best,
Leonard
> 在 2021年7月7日,10:23,tison  写道:
> 
> Congratulations and well deserved!
> 
> It is my pressure to work with you excellent developer.
> 
> Best,
> tison.
> 
> 
> Jark Wu  于2021年7月7日周三 上午10:21写道:
> 
>> Congratulations Yang Wang!
>> 
>> Best,
>> Jark
>> 
>> On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:
>> 
>>> Hi everyone,
>>> 
>>> On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
>>> committer.
>>> 
>>> Yang has been a very active contributor for more than two years, mainly
>>> focusing on Flink's deployment components. He's a main contributor and
>>> maintainer of Flink's native Kubernetes deployment and native Kubernetes
>>> HA. He's also very active on the mailing lists, participating in
>>> discussions and helping with user questions.
>>> 
>>> Please join me in congratulating Yang Wang for becoming a Flink
>> committer!
>>> 
>>> Thank you~
>>> 
>>> Xintong Song
>>> 
>> 



Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread tison
Congrats! NB.

Best,
tison.


Jark Wu  于2021年7月7日周三 上午10:20写道:

> Congratulations Guowei!
>
> Best,
> Jark
>
> On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:
>
> > Congratulations, Guowei~ !
> >
> > Best,
> > Jin
> >
> > Xintong Song  于2021年7月7日周三 上午9:37写道:
> >
> > > Congratulations, Guowei~!
> > >
> > > Thank you~
> > >
> > > Xintong Song
> > >
> > >
> > >
> > > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren 
> wrote:
> > >
> > > > Congratulations Guowei!
> > > >
> > > > --
> > > > Best Regards,
> > > >
> > > > Qingsheng Ren
> > > > Email: renqs...@gmail.com
> > > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > > Congratulations! Guowei Ma
> > > > >
> > > > > Best,
> > > > > Leonard
> > > > >
> > > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > > > >
> > > > > > Hi all!
> > > > > >
> > > > > > I'm very happy to announce that Guowei Ma has joined the Flink
> PMC!
> > > > > >
> > > > > > Congratulations and welcome Guowei!
> > > > > >
> > > > > > Best,
> > > > > > Kurt
> > > > >
> > > >
> > >
> >
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread tison
Congratulations and well deserved!

It is my pressure to work with you excellent developer.

Best,
tison.


Jark Wu  于2021年7月7日周三 上午10:21写道:

> Congratulations Yang Wang!
>
> Best,
> Jark
>
> On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:
>
> > Hi everyone,
> >
> > On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
> > committer.
> >
> > Yang has been a very active contributor for more than two years, mainly
> > focusing on Flink's deployment components. He's a main contributor and
> > maintainer of Flink's native Kubernetes deployment and native Kubernetes
> > HA. He's also very active on the mailing lists, participating in
> > discussions and helping with user questions.
> >
> > Please join me in congratulating Yang Wang for becoming a Flink
> committer!
> >
> > Thank you~
> >
> > Xintong Song
> >
>


Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Jark Wu
Congratulations Yang Wang!

Best,
Jark

On Wed, 7 Jul 2021 at 10:09, Xintong Song  wrote:

> Hi everyone,
>
> On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
> committer.
>
> Yang has been a very active contributor for more than two years, mainly
> focusing on Flink's deployment components. He's a main contributor and
> maintainer of Flink's native Kubernetes deployment and native Kubernetes
> HA. He's also very active on the mailing lists, participating in
> discussions and helping with user questions.
>
> Please join me in congratulating Yang Wang for becoming a Flink committer!
>
> Thank you~
>
> Xintong Song
>


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Jark Wu
Congratulations Guowei!

Best,
Jark

On Wed, 7 Jul 2021 at 09:54, XING JIN  wrote:

> Congratulations, Guowei~ !
>
> Best,
> Jin
>
> Xintong Song  于2021年7月7日周三 上午9:37写道:
>
> > Congratulations, Guowei~!
> >
> > Thank you~
> >
> > Xintong Song
> >
> >
> >
> > On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren  wrote:
> >
> > > Congratulations Guowei!
> > >
> > > --
> > > Best Regards,
> > >
> > > Qingsheng Ren
> > > Email: renqs...@gmail.com
> > > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > > Congratulations! Guowei Ma
> > > >
> > > > Best,
> > > > Leonard
> > > >
> > > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > > >
> > > > > Hi all!
> > > > >
> > > > > I'm very happy to announce that Guowei Ma has joined the Flink PMC!
> > > > >
> > > > > Congratulations and welcome Guowei!
> > > > >
> > > > > Best,
> > > > > Kurt
> > > >
> > >
> >
>


Re: [ANNOUNCE] The term "blink" has been removed from the code base

2021-07-06 Thread Jark Wu
Thanks Timo for the great work!

It's a milestone that we finally finished the blink merge work!

Cheers,
Jark

On Wed, 7 Jul 2021 at 09:42, Leonard Xu  wrote:

> Thanks Timo for the great work.
>
> Developers and user can finally care about only one planner after Flink
> 1.14 released.
>
> Cheers,
> Leonard
>
>
> > 在 2021年7月6日,23:51,Timo Walther  写道:
> >
> > Hi everyone,
> >
> > as discussed previously [1] and tracked in FLINK-14437, we executed the
> last step of FLIP-32 and removed all occurences of the term "blink" in the
> code base.
> >
> > This includes renaming the following Maven modules:
> >
> > flink-table-planner-blink -> flink-table-planner
> > flink-table-runtime-blink -> flink-table-runtime
> > flink-table-uber-blink-> flink-table-uber
> >
> > This will cause a couple of merge conflicts. Be careful when merging PRs
> that change the mentioned modules to not break the master.
> >
> > In order to reduce user confusion, we should not use "Blink
> engine/planner" in docs/presentations/talks and refer to it as "Flink SQL",
> "Flink Table API", or "Flink SQL planner".
> >
> > Sorry, for any inconvinience that this refactoring might have caused.
> >
> > Regards,
> > Timo
> >
> > [1]
> https://lists.apache.org/thread.html/r0851e101e37fbab273775b6a252172c7a9f7c7927107c160de779831%40%3Cdev.flink.apache.org%3E
>
>


[ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Xintong Song
Hi everyone,

On behalf of the PMC, I'm very happy to announce Yang Wang as a new Flink
committer.

Yang has been a very active contributor for more than two years, mainly
focusing on Flink's deployment components. He's a main contributor and
maintainer of Flink's native Kubernetes deployment and native Kubernetes
HA. He's also very active on the mailing lists, participating in
discussions and helping with user questions.

Please join me in congratulating Yang Wang for becoming a Flink committer!

Thank you~

Xintong Song


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread XING JIN
Congratulations, Guowei~ !

Best,
Jin

Xintong Song  于2021年7月7日周三 上午9:37写道:

> Congratulations, Guowei~!
>
> Thank you~
>
> Xintong Song
>
>
>
> On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren  wrote:
>
> > Congratulations Guowei!
> >
> > --
> > Best Regards,
> >
> > Qingsheng Ren
> > Email: renqs...@gmail.com
> > 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > > Congratulations! Guowei Ma
> > >
> > > Best,
> > > Leonard
> > >
> > > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > > >
> > > > Hi all!
> > > >
> > > > I'm very happy to announce that Guowei Ma has joined the Flink PMC!
> > > >
> > > > Congratulations and welcome Guowei!
> > > >
> > > > Best,
> > > > Kurt
> > >
> >
>


Re: [ANNOUNCE] The term "blink" has been removed from the code base

2021-07-06 Thread Leonard Xu
Thanks Timo for the great work.

Developers and user can finally care about only one planner after Flink 1.14 
released.

Cheers,
Leonard


> 在 2021年7月6日,23:51,Timo Walther  写道:
> 
> Hi everyone,
> 
> as discussed previously [1] and tracked in FLINK-14437, we executed the last 
> step of FLIP-32 and removed all occurences of the term "blink" in the code 
> base.
> 
> This includes renaming the following Maven modules:
> 
> flink-table-planner-blink -> flink-table-planner
> flink-table-runtime-blink -> flink-table-runtime
> flink-table-uber-blink-> flink-table-uber
> 
> This will cause a couple of merge conflicts. Be careful when merging PRs that 
> change the mentioned modules to not break the master.
> 
> In order to reduce user confusion, we should not use "Blink engine/planner" 
> in docs/presentations/talks and refer to it as "Flink SQL", "Flink Table 
> API", or "Flink SQL planner".
> 
> Sorry, for any inconvinience that this refactoring might have caused.
> 
> Regards,
> Timo
> 
> [1] 
> https://lists.apache.org/thread.html/r0851e101e37fbab273775b6a252172c7a9f7c7927107c160de779831%40%3Cdev.flink.apache.org%3E



Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Xintong Song
Congratulations, Guowei~!

Thank you~

Xintong Song



On Wed, Jul 7, 2021 at 9:31 AM Qingsheng Ren  wrote:

> Congratulations Guowei!
>
> --
> Best Regards,
>
> Qingsheng Ren
> Email: renqs...@gmail.com
> 2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> > Congratulations! Guowei Ma
> >
> > Best,
> > Leonard
> >
> > > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> > >
> > > Hi all!
> > >
> > > I'm very happy to announce that Guowei Ma has joined the Flink PMC!
> > >
> > > Congratulations and welcome Guowei!
> > >
> > > Best,
> > > Kurt
> >
>


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Qingsheng Ren
Congratulations Guowei!

--
Best Regards,

Qingsheng Ren
Email: renqs...@gmail.com
2021年7月7日 +0800 09:30 Leonard Xu ,写道:
> Congratulations! Guowei Ma
>
> Best,
> Leonard
>
> > ÔÚ 2021Äê7ÔÂ6ÈÕ£¬21:56£¬Kurt Young  дµÀ£º
> >
> > Hi all!
> >
> > I'm very happy to announce that Guowei Ma has joined the Flink PMC!
> >
> > Congratulations and welcome Guowei!
> >
> > Best,
> > Kurt
>


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Leonard Xu
Congratulations!  Guowei Ma

Best,
Leonard

> 在 2021年7月6日,21:56,Kurt Young  写道:
> 
> Hi all!
> 
> I'm very happy to announce that Guowei Ma has joined the Flink PMC!
> 
> Congratulations and welcome Guowei!
> 
> Best,
> Kurt



[jira] [Created] (FLINK-23285) The link on page docs/dev/datastream/event-time/generating_atermarks/ is failed and 404 is returned

2021-07-06 Thread wuguihu (Jira)
wuguihu created FLINK-23285:
---

 Summary: The link on page 
docs/dev/datastream/event-time/generating_atermarks/ is failed and 404 is 
returned
 Key: FLINK-23285
 URL: https://issues.apache.org/jira/browse/FLINK-23285
 Project: Flink
  Issue Type: Bug
  Components: Documentation
Reporter: wuguihu


The page url 
:[https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/datastream/event-time/generating_watermarks/#watermark-strategies-and-the-kafka-connector]

 

1. When i click the link [Apache 
Kafka]([https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/datastream/event-time/generating_watermarks/connectors/kafka.html]),
 404 is returned.The correct jump address is 
[https://ci.apache.org/projects/flink/flink-docs-master/docs/connectors/datastream/kafka/]

2. When i click the link [ascending timestamps watermark 
generator]([https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/datastream/event-time/generating_watermarks/event_timestamp_extractors.html#assigners-with-ascending-timestamps]),
 404 is returned.The correct jump address is 
[https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/datastream/event-time/built_in/#monotonously-increasing-timestamps].

3. The link shown below returns 404.
{code:java}
//
//1. line414 
[Apache Kafka](connectors/kafka.html)
//2. line427
[ascending timestamps watermark
generator](event_timestamp_extractors.html#assigners-with-ascending-timestamps)

{code}
4.  The correct link address is shown below.
{code:java}
//1.
[Apache Kafka]({{< ref "docs/connectors/datastream/kafka" >}}) 

//2. 
[ascending timestamps watermark
generator]({{< ref 
"docs/dev/datastream/event-time/built_in">}}#monotonously-increasing-timestamps)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Jiayi Liao
Congratulations!

Best,
Jiayi Liao


On Tue, Jul 6, 2021 at 10:01 PM Kurt Young  wrote:

> Hi all!
>
> I'm very happy to announce that Guowei Ma has joined the Flink PMC!
>
> Congratulations and welcome Guowei!
>
> Best,
> Kurt
>


Re: [VOTE] Release 1.13.2, release candidate #1

2021-07-06 Thread JING ZHANG
+1 (binding)

1. Reviewed website pull request
2. Built from source code flink-1.13.2-src.tgz

succeeded
3. Started a local Flink cluster, ran the WordCount example, WebUI looks
good,  no suspicious output/log
4. Started cluster and run some e2e sql queries using SQL Client, query
result is expected.
5. Repeat Step 3 and 4 with flink-1.13.2-bin-scala_2.11.tgz


Best regards,
JING ZHANG


Zakelly Lan  于2021年7月5日周一 下午6:06写道:

> +1 (non-binding)
>
> - built from sources
> - run streaming job of wordcount
> - web-ui looks good
> - checkpoint and restore looks good
>
> Best,
> Zakelly
>
> On Mon, Jul 5, 2021 at 2:40 PM Jingsong Li  wrote:
>
> > +1 (non-binding)
> >
> > - Verified checksums and signatures
> > - Built from sources
> > - run table example jobs
> > - web-ui looks good
> > - sql-client looks good
> >
> > I think we should update the unresolved JIRAs in [1] to 1.13.3.
> >
> > And we should check resolved JIRAs in [2], commits of some are not in the
> > 1.13.2. We should exclude them. For example FLINK-23196 FLINK-23166
> >
> > [1]
> >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.13.2%20AND%20status%20not%20in%20(Closed%2C%20Resolved)%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC
> > [2]
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350218==12315522
> >
> > Best,
> > Jingsong
> >
> > On Mon, Jul 5, 2021 at 2:27 PM Xingbo Huang  wrote:
> >
> > > +1 (non-binding)
> > >
> > > - Verified checksums and signatures
> > > - Built from sources
> > > - Verified Python wheel package contents
> > > - Pip install Python wheel package in Mac
> > > - Run Python UDF job in Python shell
> > >
> > > Best,
> > > Xingbo
> > >
> > > Yangze Guo  于2021年7月5日周一 上午11:17写道:
> > >
> > > > +1 (non-binding)
> > > >
> > > > - built from sources
> > > > - run example jobs with standalone and yarn.
> > > > - check TaskManager's rest API from the JM master and its standby,
> > > > everything looks good
> > > >
> > > > Best,
> > > > Yangze Guo
> > > >
> > > > On Mon, Jul 5, 2021 at 10:10 AM Xintong Song 
> > > > wrote:
> > > > >
> > > > > +1 (binding)
> > > > >
> > > > > - verified checksums & signatures
> > > > > - built from sources
> > > > > - run example jobs with standalone and native k8s (with custom
> image)
> > > > > deployments
> > > > >   * job execution looks fine
> > > > >   * nothing unexpected found in logs and web ui
> > > > >
> > > > > Thank you~
> > > > >
> > > > > Xintong Song
> > > > >
> > > > >
> > > > >
> > > > > On Sun, Jul 4, 2021 at 12:36 PM JING ZHANG 
> > > wrote:
> > > > >
> > > > > > Hi yun,
> > > > > > Website pull request lists[6] and JIRA release notes[1] both
> > contain
> > > > > > unfinished JIRA (such as FLINK-22955).
> > > > > > Is it expected?
> > > > > >
> > > > > > Best regards,
> > > > > > JING ZHANG
> > > > > >
> > > > > > Dawid Wysakowicz  于2021年7月2日周五 下午9:05写道:
> > > > > >
> > > > > > > +1 (binding)
> > > > > > >
> > > > > > >- verified signatures and checksums
> > > > > > >- reviewed the announcement PR
> > > > > > >- built from sources and run an example, quickly checked Web
> > UI
> > > > > > >- checked diff of pom.xml and NOTICE files from 1.13.1,
> > > > > > >- commons-io updated,
> > > > > > >   - bundled guava:failureaccess addded in
> > > > flink-sql-connector-kinesis
> > > > > > >   which is properly reflected in the NOTICE file
> > > > > > >
> > > > > > > Best,
> > > > > > > Dawid
> > > > > > > On 01/07/2021 12:57, Yun Tang wrote:
> > > > > > >
> > > > > > > Hi everyone,
> > > > > > > Please review and vote on the release candidate #1 for the
> > version
> > > > > > 1.13.2, as follows:
> > > > > > > [ ] +1, Approve the release
> > > > > > > [ ] -1, Do not approve the release (please provide specific
> > > comments)
> > > > > > >
> > > > > > >
> > > > > > > The complete staging area is available for your review, which
> > > > includes:
> > > > > > > * JIRA release notes [1],
> > > > > > > * the official Apache source release and binary convenience
> > > releases
> > > > to
> > > > > > be deployed to dist.apache.org [2], which are signed with the
> key
> > > with
> > > > > > fingerprint 78A306590F1081CC6794DC7F62DAD618E07CF996 [3],
> > > > > > > * all artifacts to be deployed to the Maven Central Repository
> > [4],
> > > > > > > * source code tag "release-1.13.2-rc1" [5],
> > > > > > > * website pull request listing the new release and adding
> > > > announcement
> > > > > > blog post [6].
> > > > > > >
> > > > > > > The vote will be open for at least 72 hours. It is adopted by
> > > > majority
> > > > > > approval, with at least 3 PMC affirmative votes.
> > > > > > >
> > > > > > > Best,
> > > > > > > Yun Tang
> > > > > > >
> > > > > > > [1]
> > > > > >
> > > >
> > >
> >
> 

[ANNOUNCE] The term "blink" has been removed from the code base

2021-07-06 Thread Timo Walther

Hi everyone,

as discussed previously [1] and tracked in FLINK-14437, we executed the 
last step of FLIP-32 and removed all occurences of the term "blink" in 
the code base.


This includes renaming the following Maven modules:

flink-table-planner-blink -> flink-table-planner
flink-table-runtime-blink -> flink-table-runtime
flink-table-uber-blink-> flink-table-uber

This will cause a couple of merge conflicts. Be careful when merging PRs 
that change the mentioned modules to not break the master.


In order to reduce user confusion, we should not use "Blink 
engine/planner" in docs/presentations/talks and refer to it as "Flink 
SQL", "Flink Table API", or "Flink SQL planner".


Sorry, for any inconvinience that this refactoring might have caused.

Regards,
Timo

[1] 
https://lists.apache.org/thread.html/r0851e101e37fbab273775b6a252172c7a9f7c7927107c160de779831%40%3Cdev.flink.apache.org%3E


Re: [VOTE] FLIP-181: Custom netty HTTP request inbound/outbound handlers

2021-07-06 Thread Gabor Somogyi
+1 (non-binding)
The @Experimental annotation is really missing, Marton could you add it
please?


On Tue, Jul 6, 2021 at 5:04 PM Austin Cawley-Edwards <
austin.caw...@gmail.com> wrote:

> Hi Márton,
>
> The FLIP looks generally good to me, though could we add the
> `@Experimental` annotation to the proposed interfaces so it is in sync with
> what was agreed in the discussion thread?
>
> Thanks,
> Austin
>
> On Tue, Jul 6, 2021 at 9:40 AM Gyula Fóra  wrote:
>
> > +1 from my side
> >
> > This is a good addition that will open many possibilities in the future
> and
> > solve some immediate issues with the current Kerberos integration.
> >
> > Gyula
> >
> > On Tue, Jul 6, 2021 at 2:50 PM Márton Balassi 
> > wrote:
> >
> > > Hi everyone, I would like to start a vote on FLIP-181 [1] which was
> > > discussed in this thread [2]. The vote will be open for at least 72
> hours
> > > until July 9th unless there is an objection or not enough votes.
> > >
> > > [1] https://cwiki.apache.org/confluence/x/CAUBCw
> > > [2]
> > >
> > >
> >
> https://lists.apache.org/thread.html/r53b6b8931b6248a849855dad27b1a431e55cdd48ca055910e8f015a8%40%3Cdev.flink.apache.org%3E
> > >
> >
>


Re: [VOTE] FLIP-181: Custom netty HTTP request inbound/outbound handlers

2021-07-06 Thread Austin Cawley-Edwards
Hi Márton,

The FLIP looks generally good to me, though could we add the
`@Experimental` annotation to the proposed interfaces so it is in sync with
what was agreed in the discussion thread?

Thanks,
Austin

On Tue, Jul 6, 2021 at 9:40 AM Gyula Fóra  wrote:

> +1 from my side
>
> This is a good addition that will open many possibilities in the future and
> solve some immediate issues with the current Kerberos integration.
>
> Gyula
>
> On Tue, Jul 6, 2021 at 2:50 PM Márton Balassi 
> wrote:
>
> > Hi everyone, I would like to start a vote on FLIP-181 [1] which was
> > discussed in this thread [2]. The vote will be open for at least 72 hours
> > until July 9th unless there is an objection or not enough votes.
> >
> > [1] https://cwiki.apache.org/confluence/x/CAUBCw
> > [2]
> >
> >
> https://lists.apache.org/thread.html/r53b6b8931b6248a849855dad27b1a431e55cdd48ca055910e8f015a8%40%3Cdev.flink.apache.org%3E
> >
>


[jira] [Created] (FLINK-23284) All records are processed in the close stage in ContinuousFileReaderOperatorBenchmark

2021-07-06 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-23284:


 Summary: All records are processed in the close stage in 
ContinuousFileReaderOperatorBenchmark
 Key: FLINK-23284
 URL: https://issues.apache.org/jira/browse/FLINK-23284
 Project: Flink
  Issue Type: Bug
  Components: Benchmarks
Reporter: Dawid Wysakowicz
Assignee: Dawid Wysakowicz


The {{TARGET_COUNT_REACHED_LATCH}} is not correctly reset after the warmup 
iterations and thus subsequent runs process all records in the {{CLOSE}} stage 
of the {{ContinuousFileReaderOperator}} testing something different than 
anticipated.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23283) GroupWindowITCase.testWindowAggregateOnUpsertSource fails on azure

2021-07-06 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-23283:
-

 Summary: GroupWindowITCase.testWindowAggregateOnUpsertSource fails 
on azure
 Key: FLINK-23283
 URL: https://issues.apache.org/jira/browse/FLINK-23283
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Reporter: Roman Khachatryan
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19978=logs=e25d5e7e-2a9c-5589-4940-0b638d75a414=a6e0f756-5bb9-5ea8-a468-5f60db442a29=7086

{code}
2021-07-06T10:13:10.6091443Z Jul 06 10:13:10 [ERROR] Tests run: 48, Failures: 
1, Errors: 0, Skipped: 0, Time elapsed: 14.945 s <<< FAILURE! - in 
org.apache.flink.table.planner.runtime.stream.sql.GroupWindowITCase
2021-07-06T10:13:10.6093667Z Jul 06 10:13:10 [ERROR] 
testWindowAggregateOnUpsertSource[StateBackend=HEAP, UseTimestampLtz = 
false](org.apache.flin*k.table.planner.runtime.stream.sql.GroupWindowITCase)  
Time elapsed: 0.329 s  <<< FAILURE!
2021-07-06T10:13:10.6096965Z Jul 06 10:13:10 java.lang.AssertionError: 
expected: but 
was:
2021-07-06T10:13:10.6098985Z Jul 06 10:13:10at 
org.junit.Assert.fail(Assert.java:89)
2021-07-06T10:13:10.6099695Z Jul 06 10:13:10at 
org.junit.Assert.failNotEquals(Assert.java:835)
2021-07-06T10:13:10.6100489Z Jul 06 10:13:10at 
org.junit.Assert.assertEquals(Assert.java:120)
2021-07-06T10:13:10.6101292Z Jul 06 10:13:10at 
org.junit.Assert.assertEquals(Assert.java:146)
2021-07-06T10:13:10.6102395Z Jul 06 10:13:10at 
org.apache.flink.table.planner.runtime.stream.sql.GroupWindowITCase.testWindowAggregateOnUpsert*Source(GroupWindowITCase.scala:421)
{code}

Fails locally 3 times out of 1000



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23282) Compile error in `Streaming Java` module: MailboxProcessor.java:[217,13]

2021-07-06 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-23282:
--

 Summary: Compile error in `Streaming Java` module: 
MailboxProcessor.java:[217,13]
 Key: FLINK-23282
 URL: https://issues.apache.org/jira/browse/FLINK-23282
 Project: Flink
  Issue Type: Bug
Reporter: JING ZHANG


Compile error in master branch caused by class MailboxProcessor.java[217,13],

the detailed information is as following:
{code:java}
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 03:47 min
[INFO] Finished at: 2021-07-06T22:21:27+08:00
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) 
on project flink-streaming-java_2.11: Compilation failure
[ERROR] 
/Users/zhangjing/IdeaProjects/flink/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/MailboxProcessor.java:[217,13]
 找不到符号
[ERROR] 符号: 方法 ensureControlFlowSignalCheck()
[ERROR] 位置: 类 org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor
[ERROR]
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn  -rf :flink-streaming-java_2.11
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Kurt Young
Hi all!

I'm very happy to announce that Guowei Ma has joined the Flink PMC!

Congratulations and welcome Guowei!

Best,
Kurt


Re: [VOTE] FLIP-181: Custom netty HTTP request inbound/outbound handlers

2021-07-06 Thread Gyula Fóra
+1 from my side

This is a good addition that will open many possibilities in the future and
solve some immediate issues with the current Kerberos integration.

Gyula

On Tue, Jul 6, 2021 at 2:50 PM Márton Balassi 
wrote:

> Hi everyone, I would like to start a vote on FLIP-181 [1] which was
> discussed in this thread [2]. The vote will be open for at least 72 hours
> until July 9th unless there is an objection or not enough votes.
>
> [1] https://cwiki.apache.org/confluence/x/CAUBCw
> [2]
>
> https://lists.apache.org/thread.html/r53b6b8931b6248a849855dad27b1a431e55cdd48ca055910e8f015a8%40%3Cdev.flink.apache.org%3E
>


Re: [DISCUSS] Incrementally deprecating the DataSet API

2021-07-06 Thread Etienne Chauchot

Hi all,

Any comments ?

cheers,

Etienne

On 25/06/2021 15:09, Etienne Chauchot wrote:

Hi everyone,

@Timo, my comments are inline for steps 2, 4 and 5, please tell me 
what you think.


Best

Etienne


On 23/06/2021 15:27, Chesnay Schepler wrote:
If we want to publicize this plan more shouldn't we have a rough 
timeline for when 2.0 is on the table?


On 6/23/2021 2:44 PM, Stephan Ewen wrote:

Thanks for writing this up, this also reflects my understanding.

I think a blog post would be nice, ideally with an explicit call for
feedback so we learn about user concerns.
A blog post has a lot more reach than an ML thread.

Best,
Stephan


On Wed, Jun 23, 2021 at 12:23 PM Timo Walther  
wrote:



Hi everyone,

I'm sending this email to make sure everyone is on the same page about
slowly deprecating the DataSet API.

There have been a few thoughts mentioned in presentations, offline
discussions, and JIRA issues. However, I have observed that there are
still some concerns or different opinions on what steps are 
necessary to

implement this change.

Let me summarize some of the steps and assumpations and let's have a
discussion about it:

Step 1: Introduce a batch mode for Table API (FLIP-32)
[DONE in 1.9]

Step 2: Introduce a batch mode for DataStream API (FLIP-134)
[DONE in 1.12]



I've been using DataSet API and I tested migrating to DataStream + 
batch mode.


I opened this (1) ticket regarding the support of aggregations in 
batch mode for DataStream API. It seems that join operation (at least) 
does not work in batch mode even though I managed to implement a join 
using low level KeyedCoProcessFunction (thanks Seth, for the pointer !).


=> Should it be considered a blocker ? Is there a plan to solve it 
before the actual drop of DataSet API ? Maybe in step 6 ?


[1] https://issues.apache.org/jira/browse/FLINK-22587




Step 3: Soft deprecate DataSet API (FLIP-131)
[DONE in 1.12]

We updated the documentation recently to make this deprecation even 
more

visible. There is a dedicated `(Legacy)` label right next to the menu
item now.

We won't deprecate concrete classes of the API with a @Deprecated
annotation to avoid extensive warnings in logs until then.

Step 4: Drop the legacy SQL connectors and formats (FLINK-14437)
[DONE in 1.14]

We dropped code for ORC, Parque, and HBase formats that were only used
by DataSet API users. The removed classes had no documentation and 
were

not annotated with one of our API stability annotations.

The old functionality should be available through the new sources and
sinks for Table API and DataStream API. If not, we should bring them
into a shape that they can be a full replacement.

DataSet users are encouraged to either upgrade the API or use Flink
1.13. Users can either just stay at Flink 1.13 or copy only the 
format's
code to a newer Flink version. We aim to keep the core interfaces 
(i.e.

InputFormat and OutputFormat) stable until the next major version.

We will maintain/allow important contributions to dropped 
connectors in
1.13. So 1.13 could be considered as kind of a DataSet API LTS 
release.



I added several bug fixes and enhancements (avro support, automatic 
schema etc...) to parquet DataSet connector. After discussing with 
Jingsong and Arvid, we agreed to merge them to 1.13 in accordance to 
the fact that 1.13 is a LTS release receiving maintenance changes as 
you mentioned here.


=> Is it needed to port these Avro enhancements to new DataStream 
connectors (add a new equivalent of ParquetColumnarRowInputFormat but 
for Avro) ? IMHO opinion it is an important feature that the users 
will need. So, if I understand the plan correctly, we have until the 
release of 2.0 to implement it, right ?


=> Also there are parquet bugs still open on deprecated parquet 
connector: https://issues.apache.org/jira/browse/FLINK-21520, 
https://issues.apache.org/jira/browse/FLINK-21468, I think that the 
same applies, we should fix them on 1.13 right ?




Step 5: Drop the legacy SQL planner (FLINK-14437)
[DONE in 1.14]

This included dropping support of DataSet API with SQL.



That is a major point ! I've been doing TPCDS benchmarks with Flink 
lately by coding query3 with a DataSet pipeline, a DataStream pipeline 
and a SQL pipeline. What I can tell is that when I migrated from the 
legacy SQL planer to blink SQL planner, I got 2 major improvements:


1. around 25% gain in run times on 1TB input dataset (even if memory 
conf was slightly different between runs of the 2 planners)


2. global order support: with legacy planer based on DataSet, only 
local partition ordering was supported. As a consequence, a SQL query 
with an ORDER BY clause actually produced wrong results. With blink 
planner based on DataStream, global order is supported and now the 
query results are correct !


=> congrats to everyone involved in these big SQL improvements !



Step 6: Connect both Table and DataStream API in batch mode 
(FLINK-20897)

[PLANNED in 1.14]

Step 7: Reach 

[VOTE] FLIP-181: Custom netty HTTP request inbound/outbound handlers

2021-07-06 Thread Márton Balassi
Hi everyone, I would like to start a vote on FLIP-181 [1] which was
discussed in this thread [2]. The vote will be open for at least 72 hours
until July 9th unless there is an objection or not enough votes.

[1] https://cwiki.apache.org/confluence/x/CAUBCw
[2]
https://lists.apache.org/thread.html/r53b6b8931b6248a849855dad27b1a431e55cdd48ca055910e8f015a8%40%3Cdev.flink.apache.org%3E


Re: Job Recovery Time on TM Lost

2021-07-06 Thread Gen Luo
Yes, I have noticed the PR and commented there with some consideration
about the new option. We can discuss further there.

On Tue, Jul 6, 2021 at 6:04 PM Till Rohrmann  wrote:

> This is actually a very good point Gen. There might not be a lot to gain
> for us by implementing a fancy algorithm for figuring out whether a TM is
> dead or not based on failed heartbeat RPCs from the JM if the TM <> TM
> communication does not tolerate failures and directly fails the affected
> tasks. This assumes that the JM and TM run in the same environment.
>
> One simple approach could be to make the number of failed heartbeat RPCs
> until a target is marked as unreachable configurable because what
> represents a good enough criterion in one user's environment might produce
> too many false-positives in somebody else's environment. Or even simpler,
> one could say that one can disable reacting to a failed heartbeat RPC as it
> is currently the case.
>
> We currently have a discussion about this on this PR [1]. Maybe you wanna
> join the discussion there and share your insights.
>
> [1] https://github.com/apache/flink/pull/16357
>
> Cheers,
> Till
>
> On Tue, Jul 6, 2021 at 4:37 AM Gen Luo  wrote:
>
>> I know that there are retry strategies for akka rpc frameworks. I was
>> just considering that, since the environment is shared by JM and TMs, and
>> the connections among TMs (using netty) are flaky in unstable environments,
>> which will also cause the job failure, is it necessary to build a
>> strongly guaranteed connection between JM and TMs, or it could be as flaky
>> as the connections among TMs?
>>
>> As far as I know, connections among TMs will just fail on their first
>> connection loss, so behaving like this in JM just means "as flaky as
>> connections among TMs". In a stable environment it's good enough, but in an
>> unstable environment, it indeed increases the instability. IMO, though a
>> single connection loss is not reliable, a double check should be good
>> enough. But since I'm not experienced with an unstable environment, I can't
>> tell whether that's also enough for it.
>>
>> On Mon, Jul 5, 2021 at 5:59 PM Till Rohrmann 
>> wrote:
>>
>>> I think for RPC communication there are retry strategies used by the
>>> underlying Akka ActorSystem. So a RpcEndpoint can reconnect to a remote
>>> ActorSystem and resume communication. Moreover, there are also
>>> reconciliation protocols in place which reconcile the states between the
>>> components because of potentially lost RPC messages. So the main question
>>> would be whether a single connection loss is good enough for triggering the
>>> timeout or whether we want a more elaborate mechanism to reason about the
>>> availability of the remote system (e.g. a couple of lost heartbeat
>>> messages).
>>>
>>> Cheers,
>>> Till
>>>
>>> On Mon, Jul 5, 2021 at 10:00 AM Gen Luo  wrote:
>>>
 As far as I know, a TM will report connection failure once its
 connected TM is lost. I suppose JM can believe the report and fail the
 tasks in the lost TM if it also encounters a connection failure.

 Of course, it won't work if the lost TM is standalone. But I suppose we
 can use the same strategy as the connected scenario. That is, consider it
 possibly lost on the first connection loss, and fail it if double check
 also fails. The major difference is the senders of the probes are the same
 one rather than two different roles, so the results may tend to be the 
 same.

 On the other hand, the fact also means that the jobs can be fragile in
 an unstable environment, no matter whether the failover is triggered by TM
 or JM. So maybe it's not that worthy to introduce extra configurations for
 fault tolerance of heartbeat, unless we also introduce some retry
 strategies for netty connections.


 On Fri, Jul 2, 2021 at 9:34 PM Till Rohrmann 
 wrote:

> Could you share the full logs with us for the second experiment, Lu? I
> cannot tell from the top of my head why it should take 30s unless you have
> configured a restart delay of 30s.
>
> Let's discuss FLINK-23216 on the JIRA ticket, Gen.
>
> I've now implemented FLINK-23209 [1] but it somehow has the problem
> that in a flakey environment you might not want to mark a TaskExecutor 
> dead
> on the first connection loss. Maybe this is something we need to make
> configurable (e.g. introducing a threshold which admittedly is similar to
> the heartbeat timeout) so that the user can configure it for her
> environment. On the upside, if you mark the TaskExecutor dead on the first
> connection loss (assuming you have a stable network environment), then it
> can now detect lost TaskExecutors as fast as the heartbeat interval.
>
> [1] https://issues.apache.org/jira/browse/FLINK-23209
>
> Cheers,
> Till
>
> On Fri, Jul 2, 2021 at 9:33 AM Gen Luo  wrote:
>
>> Thanks for 

[jira] [Created] (FLINK-23281) StateFun - Simplify Getting Stared Experience with HTTP Ingresses and Egresses

2021-07-06 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-23281:


 Summary: StateFun - Simplify Getting Stared Experience with HTTP 
Ingresses and Egresses
 Key: FLINK-23281
 URL: https://issues.apache.org/jira/browse/FLINK-23281
 Project: Flink
  Issue Type: New Feature
  Components: Stateful Functions
Reporter: Stephan Ewen


To make it easier to get started with StateFun, we want to reduce the 
dependencies on other systems and tools that are currently required to get your 
first program running.
_(For reference, you currently need a docker-compose setup with at least Flink, 
Kafka, ZooKeeper, and then you need to interact with it using Kafka command 
line tools (or other clients) to publish messages to the ingress topic.)_

This issue aims to add simple pre-packaged HTTP ingresses/egresses that can be 
used for examples and exploration, and can be used with standard tools (like 
\{{curl}}). That reduces the barrier to exploration.
_(Citing @ssc here: you have roughlyone lunchbreak of time to get a developer 
excited. Many devs just play around for about 45 minutes, and when they don't 
see some preliminary success with simple examples, they drop the exploration.)_

An example interaction could be:
{code}
> curl -X POST -i http://:/in/example/greeter/Igal
HTTP/2 200
request-id: 8acb377c-fc5e-4bdb-b2cc-eddb5992b7b5

> curl -X GET 
> http://:/out/8acb377c-fc5e-4bdb-b2cc-eddb5992b7b5
Hello for the 1337th time...
{code}

*Note:* The HTTP Ingress/Egress here are different from the HTTP state access 
from FLINK-23261.
State requests against the state access API (FLINK-23261) only interacts with 
state entries and never invoke functions. In contrast, messages against the 
here-proposed Ingress/Egress send messages to functions like any other ingress.

This is the umbrella issue. Dedicated tasks for ingress/egress and request 
correlation are in the subtasks.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23280) Python ExplainDetails does not have JSON_EXECUTION_PLAN option

2021-07-06 Thread Mans Singh (Jira)
Mans Singh created FLINK-23280:
--

 Summary: Python ExplainDetails does not have JSON_EXECUTION_PLAN 
option
 Key: FLINK-23280
 URL: https://issues.apache.org/jira/browse/FLINK-23280
 Project: Flink
  Issue Type: Bug
  Components: API / Python, Table SQL / API
Affects Versions: 1.13.0
Reporter: Mans Singh
 Fix For: 1.14.0


Add missing JSON_EXECUTION_PLAN option to python ExplainDetails class 
(https://github.com/apache/flink/blob/master/flink-python/pyflink/table/explain_detail.py)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [DISCUSS] Releasing Flink 1.11.4

2021-07-06 Thread Chesnay Schepler
Since 1.11.4 is about releasing the commits we already have merged 
between 1.11.3 and 1.13.0, I would suggest to not add additional fixes.


On 06/07/2021 12:47, Matthias Pohl wrote:

Hi Godfrey,
Thanks for volunteering to be the release manager for 1.11.4. FLINK-21445
[1] has a backport PR for 1.11.4 [2] prepared. I wouldn't label it as a
blocker but it would be nice to have it included in 1.11.4 considering that
it's quite unlikely to have another 1.11.5 release. Right now, AzureCI is
running as a final step. I'm CC'ing Chesnay because he would be in charge
of merging the PR.

Matthias

[1] https://issues.apache.org/jira/browse/FLINK-21445
[2] https://github.com/apache/flink/pull/16387

On Wed, Jun 30, 2021 at 2:15 PM godfrey he  wrote:


Hi devs,

As discussed in [1], I would like to start a discussion for releasing Flink
1.11.4.

I would like to volunteer as the release manger for 1.11.4, and will start
the release process on the next Wednesday (July 7th).

There are 75 issues that have been closed or resolved [2],
and no blocker issues left [3] so far.

If any issues need to be marked as blocker for 1.11.4, please let me know
in this thread!

Best,
Godfrey


[1]

https://lists.apache.org/thread.html/r40a541027c6a04519f37c61f2a6f3dabdb821b3760cda9cc6ebe6ce9%40%3Cdev.flink.apache.org%3E
[2]

https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.11.4%20AND%20status%20in%20(Closed%2C%20Resolved)
[3]

https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.11.4%20AND%20status%20not%20in%20(Closed%2C%20Resolved)%20ORDER%20BY%20priority%20DESC





Re: [DISCUSS] Releasing Flink 1.11.4

2021-07-06 Thread Matthias Pohl
Hi Godfrey,
Thanks for volunteering to be the release manager for 1.11.4. FLINK-21445
[1] has a backport PR for 1.11.4 [2] prepared. I wouldn't label it as a
blocker but it would be nice to have it included in 1.11.4 considering that
it's quite unlikely to have another 1.11.5 release. Right now, AzureCI is
running as a final step. I'm CC'ing Chesnay because he would be in charge
of merging the PR.

Matthias

[1] https://issues.apache.org/jira/browse/FLINK-21445
[2] https://github.com/apache/flink/pull/16387

On Wed, Jun 30, 2021 at 2:15 PM godfrey he  wrote:

> Hi devs,
>
> As discussed in [1], I would like to start a discussion for releasing Flink
> 1.11.4.
>
> I would like to volunteer as the release manger for 1.11.4, and will start
> the release process on the next Wednesday (July 7th).
>
> There are 75 issues that have been closed or resolved [2],
> and no blocker issues left [3] so far.
>
> If any issues need to be marked as blocker for 1.11.4, please let me know
> in this thread!
>
> Best,
> Godfrey
>
>
> [1]
>
> https://lists.apache.org/thread.html/r40a541027c6a04519f37c61f2a6f3dabdb821b3760cda9cc6ebe6ce9%40%3Cdev.flink.apache.org%3E
> [2]
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.11.4%20AND%20status%20in%20(Closed%2C%20Resolved)
> [3]
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.11.4%20AND%20status%20not%20in%20(Closed%2C%20Resolved)%20ORDER%20BY%20priority%20DESC
>


Re: Job Recovery Time on TM Lost

2021-07-06 Thread Till Rohrmann
This is actually a very good point Gen. There might not be a lot to gain
for us by implementing a fancy algorithm for figuring out whether a TM is
dead or not based on failed heartbeat RPCs from the JM if the TM <> TM
communication does not tolerate failures and directly fails the affected
tasks. This assumes that the JM and TM run in the same environment.

One simple approach could be to make the number of failed heartbeat RPCs
until a target is marked as unreachable configurable because what
represents a good enough criterion in one user's environment might produce
too many false-positives in somebody else's environment. Or even simpler,
one could say that one can disable reacting to a failed heartbeat RPC as it
is currently the case.

We currently have a discussion about this on this PR [1]. Maybe you wanna
join the discussion there and share your insights.

[1] https://github.com/apache/flink/pull/16357

Cheers,
Till

On Tue, Jul 6, 2021 at 4:37 AM Gen Luo  wrote:

> I know that there are retry strategies for akka rpc frameworks. I was just
> considering that, since the environment is shared by JM and TMs, and the
> connections among TMs (using netty) are flaky in unstable environments,
> which will also cause the job failure, is it necessary to build a
> strongly guaranteed connection between JM and TMs, or it could be as flaky
> as the connections among TMs?
>
> As far as I know, connections among TMs will just fail on their first
> connection loss, so behaving like this in JM just means "as flaky as
> connections among TMs". In a stable environment it's good enough, but in an
> unstable environment, it indeed increases the instability. IMO, though a
> single connection loss is not reliable, a double check should be good
> enough. But since I'm not experienced with an unstable environment, I can't
> tell whether that's also enough for it.
>
> On Mon, Jul 5, 2021 at 5:59 PM Till Rohrmann  wrote:
>
>> I think for RPC communication there are retry strategies used by the
>> underlying Akka ActorSystem. So a RpcEndpoint can reconnect to a remote
>> ActorSystem and resume communication. Moreover, there are also
>> reconciliation protocols in place which reconcile the states between the
>> components because of potentially lost RPC messages. So the main question
>> would be whether a single connection loss is good enough for triggering the
>> timeout or whether we want a more elaborate mechanism to reason about the
>> availability of the remote system (e.g. a couple of lost heartbeat
>> messages).
>>
>> Cheers,
>> Till
>>
>> On Mon, Jul 5, 2021 at 10:00 AM Gen Luo  wrote:
>>
>>> As far as I know, a TM will report connection failure once its connected
>>> TM is lost. I suppose JM can believe the report and fail the tasks in the
>>> lost TM if it also encounters a connection failure.
>>>
>>> Of course, it won't work if the lost TM is standalone. But I suppose we
>>> can use the same strategy as the connected scenario. That is, consider it
>>> possibly lost on the first connection loss, and fail it if double check
>>> also fails. The major difference is the senders of the probes are the same
>>> one rather than two different roles, so the results may tend to be the same.
>>>
>>> On the other hand, the fact also means that the jobs can be fragile in
>>> an unstable environment, no matter whether the failover is triggered by TM
>>> or JM. So maybe it's not that worthy to introduce extra configurations for
>>> fault tolerance of heartbeat, unless we also introduce some retry
>>> strategies for netty connections.
>>>
>>>
>>> On Fri, Jul 2, 2021 at 9:34 PM Till Rohrmann 
>>> wrote:
>>>
 Could you share the full logs with us for the second experiment, Lu? I
 cannot tell from the top of my head why it should take 30s unless you have
 configured a restart delay of 30s.

 Let's discuss FLINK-23216 on the JIRA ticket, Gen.

 I've now implemented FLINK-23209 [1] but it somehow has the problem
 that in a flakey environment you might not want to mark a TaskExecutor dead
 on the first connection loss. Maybe this is something we need to make
 configurable (e.g. introducing a threshold which admittedly is similar to
 the heartbeat timeout) so that the user can configure it for her
 environment. On the upside, if you mark the TaskExecutor dead on the first
 connection loss (assuming you have a stable network environment), then it
 can now detect lost TaskExecutors as fast as the heartbeat interval.

 [1] https://issues.apache.org/jira/browse/FLINK-23209

 Cheers,
 Till

 On Fri, Jul 2, 2021 at 9:33 AM Gen Luo  wrote:

> Thanks for sharing, Till and Yang.
>
> @Lu
> Sorry but I don't know how to explain the new test with the log. Let's
> wait for others' reply.
>
> @Till
> It would be nice if JIRAs could be fixed. Thanks again for proposing
> them.
>
> In addition, I was tracking an issue that RM 

[jira] [Created] (FLINK-23279) Enable changelog backend in tests

2021-07-06 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-23279:
-

 Summary: Enable changelog backend in tests
 Key: FLINK-23279
 URL: https://issues.apache.org/jira/browse/FLINK-23279
 Project: Flink
  Issue Type: Sub-task
  Components: Runtime / State Backends
Reporter: Roman Khachatryan
 Fix For: 1.14.0


FLINK-21448 adds the capability (test randomization), but it can't be turned on 
as there are some test failures: FLINK-23276, FLINK-23277, FLINK-23278 (should 
be enabled after those bugs fixed).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23278) Changelog backend creates "raw materialized" savepoint but expects it's "normal" snapshot on recovery

2021-07-06 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-23278:
-

 Summary: Changelog backend creates "raw materialized" savepoint 
but expects it's "normal" snapshot on recovery
 Key: FLINK-23278
 URL: https://issues.apache.org/jira/browse/FLINK-23278
 Project: Flink
  Issue Type: Bug
  Components: Runtime / State Backends
Affects Versions: 1.14.0
Reporter: Roman Khachatryan
Assignee: Roman Khachatryan
 Fix For: 1.14.0


Savepoint consist of "raw" keyed handles from the underlying backend:
{code}
public SavepointResources savepoint() throws Exception {
return keyedStateBackend.savepoint();
}
{code}

On recovery, ChangelogStateBackendHandles are expected.

This fails e.g. SavepointWriterITCase if enabled.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23277) Changelog backend doesn't apply TTL after recovery

2021-07-06 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-23277:
-

 Summary: Changelog backend doesn't apply TTL after recovery
 Key: FLINK-23277
 URL: https://issues.apache.org/jira/browse/FLINK-23277
 Project: Flink
  Issue Type: Bug
  Components: Runtime / State Backends
Reporter: Roman Khachatryan
Assignee: Roman Khachatryan
 Fix For: 1.14.0


Upon recovery, changelog backend requests states to apply changes.
TTL config is not available at this moment, so states are created regardless of 
TTL config.
One solution is to serialize TTL config along with metadata (in changelog).

Note: values are already serialized as TTL values and serializers as TTL 
seralizers

{code}
Caused by: java.lang.ClassCastException: 
org.apache.flink.runtime.state.ttl.TtlValue cannot be cast to 
org.apache.flink.table.data.RowData
   at 
org.apache.flink.table.runtime.operators.aggregate.GroupAggFunction.processElement(GroupAggFunction.java:129)
   at 
org.apache.flink.table.runtime.operators.aggregate.GroupAggFunction.processElement(GroupAggFunction.java:43)
   at 
org.apache.flink.streaming.api.operators.KeyedProcessOperator.processElement(KeyedProcessOperator.java:83)
   at 
org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:228)
   at 
org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134)
   at 
org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105)
   at 
org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:66)
   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:428)
   at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:204)
   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:691)
   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:646)
   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:657)
   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:630)
   at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
   at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
   at java.lang.Thread.run(Thread.java:748)
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23276) Changelog backend not always updates delegating functions

2021-07-06 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-23276:
-

 Summary: Changelog backend not always updates delegating functions
 Key: FLINK-23276
 URL: https://issues.apache.org/jira/browse/FLINK-23276
 Project: Flink
  Issue Type: Bug
  Components: Runtime / State Backends
Affects Versions: 1.14.0
Reporter: Roman Khachatryan
Assignee: Roman Khachatryan
 Fix For: 1.14.0


(currently disabled in tests, so doesn't affect build stability)

E.g. org.apache.flink.table.planner.runtime.stream.table.GroupWindowITCase

 

{code}
 2021-07-03T20:30:28.0384912Z Jul 03 20:30:28 Caused by: 
java.lang.NullPointerException
*2021-07-03T20:30:28.0385566Z Jul 03 20:30:28at 
org.apache.flink.util.Preconditions.checkNotNull(Preconditions.java:59)
*2021-07-03T20:30:28.0386330Z Jul 03 20:30:28at 
org.apache.flink.state.changelog.restore.FunctionDelegationHelper$DelegatingReduceFunction.redu*ce(FunctionDelegationHelper.java:138)
*2021-07-03T20:30:28.0387147Z Jul 03 20:30:28at 
org.apache.flink.contrib.streaming.state.RocksDBReducingState.add(RocksDBReducingState.java:95)
*2021-07-03T20:30:28.0387892Z Jul 03 20:30:28at 
org.apache.flink.state.changelog.ChangelogReducingState.add(ChangelogReducingState.java:82)
*2021-07-03T20:30:28.0388677Z Jul 03 20:30:28at 
org.apache.flink.table.runtime.operators.window.triggers.ElementTriggers$CountElement.onElement*(ElementTriggers.java:124)
*2021-07-03T20:30:28.0389503Z Jul 03 20:30:28at 
org.apache.flink.table.runtime.operators.window.WindowOperator$TriggerContext.onElement(WindowO*perator.java:572)
*2021-07-03T20:30:28.0390296Z Jul 03 20:30:28at 
org.apache.flink.table.runtime.operators.window.WindowOperator.processElement(WindowOperator.ja*va:379)
*2021-07-03T20:30:28.0391107Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(*OneInputStreamTask.java:228)
*2021-07-03T20:30:28.0391936Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStr*eamTaskNetworkInput.java:134)
*2021-07-03T20:30:28.0392776Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTas*kNetworkInput.java:105)
*2021-07-03T20:30:28.0393929Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProces*sor.java:66)
*2021-07-03T20:30:28.0394611Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:428)
*2021-07-03T20:30:28.0395288Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcess*or.java:204)
*2021-07-03T20:30:28.0395966Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:691)
*2021-07-03T20:30:28.0396892Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:646)
*2021-07-03T20:30:28.0397601Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:657)
*2021-07-03T20:30:28.0398398Z Jul 03 20:30:28at 
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:630)
*2021-07-03T20:30:28.0399051Z Jul 03 20:30:28at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
*2021-07-03T20:30:28.0399669Z Jul 03 20:30:28at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
 2021-07-03T20:30:28.0400238Z Jul 03 20:30:28at 
java.lang.Thread.run(Thread.java:748)

{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23275) Support to release cluster partitions stored externally

2021-07-06 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-23275:
---

 Summary: Support to release cluster partitions stored externally
 Key: FLINK-23275
 URL: https://issues.apache.org/jira/browse/FLINK-23275
 Project: Flink
  Issue Type: Sub-task
  Components: Runtime / Coordination, Runtime / Network
Reporter: Yingjie Cao
 Fix For: 1.14.0


Currently, if the cluster partition is stored externally, it can not be 
released by the partition tracker, one of reason is that the ShuffleMaster is 
not a cluster level service, after FLINK-23214,we can release the cluster 
partition by ShuffleMaster.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23274) Implement SPNEGO authentication handler

2021-07-06 Thread Jira
Márton Balassi created FLINK-23274:
--

 Summary: Implement SPNEGO authentication handler
 Key: FLINK-23274
 URL: https://issues.apache.org/jira/browse/FLINK-23274
 Project: Flink
  Issue Type: Sub-task
Reporter: Márton Balassi
Assignee: Gabor Somogyi






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23273) Implement basic authentication handler

2021-07-06 Thread Jira
Márton Balassi created FLINK-23273:
--

 Summary: Implement basic authentication handler
 Key: FLINK-23273
 URL: https://issues.apache.org/jira/browse/FLINK-23273
 Project: Flink
  Issue Type: Sub-task
Reporter: Márton Balassi
Assignee: Gabor Somogyi






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23272) FLIP-181: Custom netty HTTP request inbound/outbound handlers

2021-07-06 Thread Jira
Márton Balassi created FLINK-23272:
--

 Summary: FLIP-181: Custom netty HTTP request inbound/outbound 
handlers
 Key: FLINK-23272
 URL: https://issues.apache.org/jira/browse/FLINK-23272
 Project: Flink
  Issue Type: Improvement
  Components: Runtime / Web Frontend
Affects Versions: 1.13.0
Reporter: Márton Balassi
Assignee: Gabor Somogyi


FLIP: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=184616200



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [IGNORE] [RESULT] [VOTE] FLIP-150: Introduce Hybrid Source

2021-07-06 Thread Becket Qin
Hi Nicholas and Thomas,

Thanks for pushing this FLIP. The hybrid source is quite useful. It seems
that the FLIP wiki page did not cover all the new public interfaces we are
introducing. For example, the interface of the following classes are either
incomplete or not included in the wiki at the point.

HybridSourceSplit
HybridSourceEnumeratorState
SourceFactory
HybridSourceBuilder

As far as I understand these are public APIs that are visible to the users.
Not sure if they are all the public interfaces, though. Can you please
update the FLIP to make the public interface change clear and complete?

Thanks,

Jiangjie (Becket) Qin


On Tue, Jul 6, 2021 at 4:11 PM 蒋晓峰  wrote:

> Hello everyone,
>
>
>Sorry for the mistake to report the result of FLIP-150 voting for only
> 2 binding. Please ignore the vote result for FLIP-150. The vote of FLIP-150
> is still open, please continue to vote FLIP-150: Introduce Hybrid Source.
>
>
> Thanks,
> Nicholas Jiang


Re: [IGNORE] [RESULT] [VOTE] FLIP-150: Introduce Hybrid Source

2021-07-06 Thread 蒋晓峰
Hello everyone,


   Sorry for the mistake to report the result of FLIP-150 voting for only 2 
binding. Please ignore the vote result for FLIP-150. The vote of FLIP-150 is 
still open, please continue to vote FLIP-150: Introduce Hybrid Source. 


Thanks,
Nicholas Jiang

[jira] [Created] (FLINK-23271) RuntimeException: while resolving method 'booleanValue' in class class java.math.BigDecimal

2021-07-06 Thread xiaojin.wy (Jira)
xiaojin.wy created FLINK-23271:
--

 Summary: RuntimeException: while resolving method 'booleanValue' 
in class class java.math.BigDecimal
 Key: FLINK-23271
 URL: https://issues.apache.org/jira/browse/FLINK-23271
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.14.0
Reporter: xiaojin.wy


*--sql--*
CREATE TABLE database3_t0(
c0 DECIMAL , c1 SMALLINT
) WITH (
 'connector' = 'filesystem',
 'path' = 'hdfs:///tmp/database3_t0.csv',
 'format' = 'csv' 
);
INSERT OVERWRITE database8_t0(c0, c1) VALUES(2113554022, cast(-22975 as 
SMALLINT)), (1570419395, cast(-26858 as SMALLINT)), (-1569861129, cast(-20143 
as SMALLINT));
SELECT database8_t0.c0 AS ref0 FROM database8_t0 WHERE CAST 
(0.10915913549909961 AS BOOLEAN;

After excuting the sql, you will find the error:
java.lang.RuntimeException: while resolving method 'booleanValue' in class 
class java.math.BigDecimal

at org.apache.calcite.linq4j.tree.Expressions.call(Expressions.java:424)
at org.apache.calcite.linq4j.tree.Expressions.call(Expressions.java:435)
at 
org.apache.calcite.linq4j.tree.Expressions.unbox(Expressions.java:1453)
at 
org.apache.calcite.adapter.enumerable.EnumUtils.convert(EnumUtils.java:398)
at 
org.apache.calcite.adapter.enumerable.EnumUtils.convert(EnumUtils.java:326)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.translateCast(RexToLixTranslator.java:538)
at 
org.apache.calcite.adapter.enumerable.RexImpTable$CastImplementor.implementSafe(RexImpTable.java:2450)
at 
org.apache.calcite.adapter.enumerable.RexImpTable$AbstractRexCallImplementor.genValueStatement(RexImpTable.java:2894)
at 
org.apache.calcite.adapter.enumerable.RexImpTable$AbstractRexCallImplementor.implement(RexImpTable.java:2859)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.visitCall(RexToLixTranslator.java:1084)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.visitCall(RexToLixTranslator.java:90)
at org.apache.calcite.rex.RexCall.accept(RexCall.java:174)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.visitLocalRef(RexToLixTranslator.java:970)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.visitLocalRef(RexToLixTranslator.java:90)
at org.apache.calcite.rex.RexLocalRef.accept(RexLocalRef.java:75)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.translate(RexToLixTranslator.java:237)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.translate(RexToLixTranslator.java:231)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.translateList(RexToLixTranslator.java:818)
at 
org.apache.calcite.adapter.enumerable.RexToLixTranslator.translateProjects(RexToLixTranslator.java:198)
at 
org.apache.calcite.rex.RexExecutorImpl.compile(RexExecutorImpl.java:90)
at 
org.apache.calcite.rex.RexExecutorImpl.compile(RexExecutorImpl.java:66)
at 
org.apache.calcite.rex.RexExecutorImpl.reduce(RexExecutorImpl.java:128)
at 
org.apache.calcite.rex.RexSimplify.simplifyCast(RexSimplify.java:2101)
at org.apache.calcite.rex.RexSimplify.simplify(RexSimplify.java:326)
at 
org.apache.calcite.rex.RexSimplify.simplifyUnknownAs(RexSimplify.java:287)
at org.apache.calcite.rex.RexSimplify.simplify(RexSimplify.java:262)
at 
org.apache.flink.table.planner.plan.utils.FlinkRexUtil$.simplify(FlinkRexUtil.scala:224)
at 
org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule.simplify(SimplifyFilterConditionRule.scala:63)
at 
org.apache.flink.table.planner.plan.rules.logical.SimplifyFilterConditionRule.onMatch(SimplifyFilterConditionRule.scala:46)
at 
org.apache.calcite.plan.AbstractRelOptPlanner.fireRule(AbstractRelOptPlanner.java:333)
at org.apache.calcite.plan.hep.HepPlanner.applyRule(HepPlanner.java:542)
at 
org.apache.calcite.plan.hep.HepPlanner.applyRules(HepPlanner.java:407)
at 
org.apache.calcite.plan.hep.HepPlanner.executeInstruction(HepPlanner.java:243)
at 
org.apache.calcite.plan.hep.HepInstruction$RuleInstance.execute(HepInstruction.java:127)
at 
org.apache.calcite.plan.hep.HepPlanner.executeProgram(HepPlanner.java:202)
at 
org.apache.calcite.plan.hep.HepPlanner.findBestExp(HepPlanner.java:189)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkHepProgram.optimize(FlinkHepProgram.scala:69)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkHepRuleSetProgram.optimize(FlinkHepRuleSetProgram.scala:87)
at 
org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1$$anonfun$apply$1.apply(FlinkGroupProgram.scala:63)
at 

Re: [VOTE] FLIP-172: Support custom transactional.id prefix in FlinkKafkaProducer

2021-07-06 Thread Daniel Lorych
+1 (non-binding)

pon., 28 cze 2021, 20:19 użytkownik Arvid Heise  napisał:

> +1 (binding)
>
> On Mon, Jun 28, 2021 at 8:04 PM Piotr Nowojski 
> wrote:
>
> > +1 (binding)
> >
> > Piotrek
> >
> > pon., 28 cze 2021 o 16:01 Wenhao Ji  napisał(a):
> >
> > > Hi everyone,
> > >
> > > I would like to start a vote on FLIP-172 [1] which was discussed in
> > > this thread [2].
> > > The vote will be open for at least 72 hours until July 1 unless there
> > > is an objection or not enough votes.
> > >
> > > Thanks,
> > > Wenhao
> > >
> > > [1]
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-172%3A+Support+custom+transactional.id+prefix+in+FlinkKafkaProducer
> > > [2]
> > >
> >
> https://lists.apache.org/thread.html/r67610aa2d4dfdaf3b027b82edd1a3f46771f0d58902a4258d931e5a5%40%3Cdev.flink.apache.org%3E
> > >
> >
>


[jira] [Created] (FLINK-23270) The examples in the documentation are inappropriate

2021-07-06 Thread Fangliang Liu (Jira)
Fangliang Liu created FLINK-23270:
-

 Summary: The examples in the documentation are inappropriate
 Key: FLINK-23270
 URL: https://issues.apache.org/jira/browse/FLINK-23270
 Project: Flink
  Issue Type: Bug
  Components: Documentation
Reporter: Fangliang Liu


[https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/dev/table/sql/queries/joins/]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23269) json format decode number to vatchar error when define Decimal type in ddl

2021-07-06 Thread silence (Jira)
silence created FLINK-23269:
---

 Summary: json format decode number to vatchar error when define 
Decimal type in ddl
 Key: FLINK-23269
 URL: https://issues.apache.org/jira/browse/FLINK-23269
 Project: Flink
  Issue Type: Bug
  Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
Reporter: silence


when use json format and define decimal
json:
{"c1":50.0,"c2":50.0}
ddl:
create table(
c1 varchar,
c2 decimal
)with(
'format'='json'
)
output:
{"c1":"5E+1","c2":50.0}

And the following unit tests will produce the following results

{"double1":50.0,"double2":50.0,"double3":"50.0","float1":20.0,"float2":20.0,"float3":"20.0"}

java.lang.AssertionError: 
Expected :+I[50.0, 50.0, 50.0, 20.0, 20.0, 20.0]
Actual   :+I[5E+1, 50.0, 50.0, 2E+1, 20.0, 20.0]


{code:java}
@Test
public void testDeserialization() throws Exception {
double doubleValue = 50.0;
float floatValue = 20.0f;

ObjectMapper objectMapper = new ObjectMapper();
ObjectNode root = objectMapper.createObjectNode();
root.put("double1", doubleValue);
root.put("double2", doubleValue);
root.put("double3", String.valueOf(doubleValue));
root.put("float1", floatValue);
root.put("float2", floatValue);
root.put("float3", String.valueOf(floatValue));

byte[] serializedJson = objectMapper.writeValueAsBytes(root);
System.out.println(new String(serializedJson));
DataType dataType =
ROW(
FIELD("double1", STRING()),
FIELD("double2", DECIMAL(10,1)),
FIELD("double3", DOUBLE()),
FIELD("float1", STRING()),
FIELD("float2", DECIMAL(10,1)),
FIELD("float3", FLOAT()));

RowType rowType = (RowType) dataType.getLogicalType();
JsonRowDataDeserializationSchema deserializationSchema =
new JsonRowDataDeserializationSchema(
rowType,
InternalTypeInfo.of(rowType),
false,
false,
TimestampFormat.ISO_8601);

Row expected = new Row(6);
expected.setField(0, String.valueOf(doubleValue));
expected.setField(1, String.valueOf(doubleValue));
expected.setField(2, doubleValue);
expected.setField(3, String.valueOf(floatValue));
expected.setField(4, String.valueOf(floatValue));
expected.setField(5, floatValue);

RowData rowData = deserializationSchema.deserialize(serializedJson);
Row actual = convertToExternal(rowData, dataType);
assertEquals(expected, actual);
}
{code}

when define the DecimalType 
ObjectMapper will enable USE_BIG_DECIMAL_FOR_FLOATS
and jsonNode.asText() will call BigDecimal toString method

{code:java}
boolean hasDecimalType =
LogicalTypeChecks.hasNested(rowType, t -> t instanceof 
DecimalType);
if (hasDecimalType) {

objectMapper.enable(DeserializationFeature.USE_BIG_DECIMAL_FOR_FLOATS);
}
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)