Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-01-13 Thread Yun Gao
Hi all, I updated the FLIP[1] to reflect the major discussed points in the ML thread: 1) For the "new" root tasks finished before it received trigger message, previously we proposed to let JM re-compute and re-trigger the descendant tasks, but after the discussion we realized that it might

Re: Re: Idea import Flink source code

2021-01-13 Thread Matthias Pohl
Don't forget to use the reply-all button when replying to threads on the mailing lists. :-) Have you tried building the project via command line using `mvn -DskipTests -Dfast install` to pull all dependencies? And just to verify: you didn't change the code, did you? We're talking about the vanilla

Re: [DISCUSS] Releasing Apache Flink 1.10.3

2021-01-13 Thread Xingbo Huang
Thanks for starting this discussion, Matthias. +1 for releasing 1.10.3 as it contains a number of important fixes. Best, Xingbo Xintong Song 于2021年1月13日周三 下午3:46写道: > Thanks for bringing this up, Matthias. > > Per the "Update Policy for old releases" [1], normally we do not release > 1.10.x af

Re:Re: Re: Idea import Flink source code

2021-01-13 Thread penguin.
Hi, I click the reply button every time... Does this mean that only the replied person can see the email? If Maven fails to download plugins or dependencies, is mvn -clean install -DskipTests a must? I'll try first. penguin 在 2021-01-13 16:35:10,"Matthias Pohl" 写道: Don't for

Re: [DISCUSS] Support obtaining Hive delegation tokens when submitting application to Yarn

2021-01-13 Thread Till Rohrmann
Hi Jie Wang, thanks for starting this discussion. To me the SPI approach sounds better because it is not as brittle as using reflection. Concerning the configuration, we could think about introducing some Hive specific configuration options which allow us to specify these paths. How are other proj

Re: 7UUNA`SE$DZI74Y)S)T)GZB

2021-01-13 Thread Till Rohrmann
Hi Penguin, the attached screenshot is not displayed correctly. Maybe you can post the error to this thread. Cheers, Till On Wed, Jan 13, 2021 at 6:17 AM penguin. wrote: > Hello, > When importing the Flink source code into idea, the following error > occurred. > And several mirrors were config

Re: [DISCUSS] Releasing Apache Flink 1.10.3

2021-01-13 Thread Till Rohrmann
Thanks for starting this discussion Matthias. I agree with all of you that a final 1.10.3 release could be really helpful for our users. Given that CI passes, it shouldn't be too much overhead either. Cheers, Till On Wed, Jan 13, 2021 at 9:45 AM Xingbo Huang wrote: > Thanks for starting this di

Re: 7UUNA`SE$DZI74Y)S)T)GZB

2021-01-13 Thread Matthias Pohl
FYI: This was a duplicate post. The discussion continued in [1]. Matthias [1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Re-Idea-import-Flink-source-code-td40597.html On Wed, Jan 13, 2021 at 9:54 AM Till Rohrmann wrote: > Hi Penguin, > > the attached screenshot is not

Re: Re: Re: Idea import Flink source code

2021-01-13 Thread Matthias Pohl
The mvn command helps to identify whether your issue is related to Maven and/or missing dependencies or whether it's an Intellij problem. Usually, running `mvn clean install -DskipTests -Dfast` isn't required to import the Flink project into Intellij. Best, Matthias PS: reply adds only the immedi

[jira] [Created] (FLINK-20954) Optimize State with Cross Bundle State Cache In PyFlink

2021-01-13 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-20954: Summary: Optimize State with Cross Bundle State Cache In PyFlink Key: FLINK-20954 URL: https://issues.apache.org/jira/browse/FLINK-20954 Project: Flink Issue

[jira] [Created] (FLINK-20955) Refactor HBase Source in accordance with FLIP-27

2021-01-13 Thread Moritz Manner (Jira)
Moritz Manner created FLINK-20955: - Summary: Refactor HBase Source in accordance with FLIP-27 Key: FLINK-20955 URL: https://issues.apache.org/jira/browse/FLINK-20955 Project: Flink Issue Type

[jira] [Created] (FLINK-20956) SQLClientSchemaRegistryITCase.testWriting unstable

2021-01-13 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-20956: - Summary: SQLClientSchemaRegistryITCase.testWriting unstable Key: FLINK-20956 URL: https://issues.apache.org/jira/browse/FLINK-20956 Project: Flink Issue Ty

Re: [ANNOUNCE] Welcome Danny Cranmer as a new Apache Flink Committer

2021-01-13 Thread Cranmer, Danny
Thankyou everyone for the welcome! I look forward to working with more of you in the near future. Danny, On 13/01/2021, 07:38, "Yun Gao" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and kn

[jira] [Created] (FLINK-20957) StreamTaskTest.testProcessWithUnAvailableOutput unstable

2021-01-13 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-20957: - Summary: StreamTaskTest.testProcessWithUnAvailableOutput unstable Key: FLINK-20957 URL: https://issues.apache.org/jira/browse/FLINK-20957 Project: Flink Is

[jira] [Created] (FLINK-20958) Starting flink doc build script in preview mode occur version error

2021-01-13 Thread ZhaoLiming (Jira)
ZhaoLiming created FLINK-20958: -- Summary: Starting flink doc build script in preview mode occur version error Key: FLINK-20958 URL: https://issues.apache.org/jira/browse/FLINK-20958 Project: Flink

[jira] [Created] (FLINK-20959) How to close Apache Flink REST API

2021-01-13 Thread wuchangwen (Jira)
wuchangwen created FLINK-20959: -- Summary: How to close Apache Flink REST API Key: FLINK-20959 URL: https://issues.apache.org/jira/browse/FLINK-20959 Project: Flink Issue Type: Bug Comp

[jira] [Created] (FLINK-20960) Add warning in 1.12 release notes about potential corrupt data stream with unaligned checkpoint

2021-01-13 Thread Xintong Song (Jira)
Xintong Song created FLINK-20960: Summary: Add warning in 1.12 release notes about potential corrupt data stream with unaligned checkpoint Key: FLINK-20960 URL: https://issues.apache.org/jira/browse/FLINK-20960

Re: [DISCUSS] Backport broadcast operations in BATCH mode to Flink

2021-01-13 Thread Dawid Wysakowicz
Hi, Given that the BATCH execution mode was only released in 1.12 and a rather small impact of the suggested change I'd be ok with backporting it to 1.12.x. Best, Dawid On 07/01/2021 12:50, Kostas Kloudas wrote: > +1 on my side as it does not break anything and it can act as motivation > for so

[jira] [Created] (FLINK-20961) Flink throws NullPointerException for tables created from DataStream with no assigned timestamps and watermarks

2021-01-13 Thread Yuval Itzchakov (Jira)
Yuval Itzchakov created FLINK-20961: --- Summary: Flink throws NullPointerException for tables created from DataStream with no assigned timestamps and watermarks Key: FLINK-20961 URL: https://issues.apache.org/jira

InfluxDB Source Sink Connector

2021-01-13 Thread Leon Papke
Hi all, we want to contribute a connector for InfluxDB v2.0. In the following, we will briefly describe our planned architecture. We happily appreciate any comments on our plans. Background InfluxDB is a time-series database created by InfluxData. InfluxData offers an open source, enterprise, and c

Re: [ANNOUNCE] Welcome Danny Cranmer as a new Apache Flink Committer

2021-01-13 Thread Yu Li
Congrats and welcome, Danny! Best Regards, Yu On Wed, 13 Jan 2021 at 15:37, Yun Gao wrote: > Congratulations, Danny! > > Best, > Yun > > > -- > From:Xintong Song > Send Time:2021 Jan. 13 (Wed.) 15:29 > To:dev > Subject:Re: [ANN

Re: [DISCUSS] Releasing Apache Flink 1.10.3

2021-01-13 Thread Yu Li
+1 for having a bugfix release for the 1.10 branch to fix the security issue. Thanks for driving the discussion Matthias! Minor: CVE-2020-17519 is introduced by 1.11.0 [1] so we don't need to fix it in 1.10.3, but CVE-2020-17518 [2] is needed. Best Regards, Yu [1] https://s.apache.org/CVE-2020-

[jira] [Created] (FLINK-20962) Rewrite the example in 'flink-python/pyflink/shell.py'

2021-01-13 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-20962: - Summary: Rewrite the example in 'flink-python/pyflink/shell.py' Key: FLINK-20962 URL: https://issues.apache.org/jira/browse/FLINK-20962 Project: Flink Issue Type:

[jira] [Created] (FLINK-20963) Rewrite the example under 'flink-python/pyflink/table/examples'

2021-01-13 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-20963: - Summary: Rewrite the example under 'flink-python/pyflink/table/examples' Key: FLINK-20963 URL: https://issues.apache.org/jira/browse/FLINK-20963 Project: Flink Is

[jira] [Created] (FLINK-20964) Introduce PythonStreamGroupWindowAggregateOperator

2021-01-13 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-20964: Summary: Introduce PythonStreamGroupWindowAggregateOperator Key: FLINK-20964 URL: https://issues.apache.org/jira/browse/FLINK-20964 Project: Flink Issue Type

[DISCUSS] Planning Flink 1.13

2021-01-13 Thread Dawid Wysakowicz
Hi all, With the 1.12 being released some time ago already I thought it would be a good time to kickstart the 1.13 release cycle. What do you think about Guowei and me being the release managers for Flink 1.13? We are happy to volunteer for it. The second topic I wanted to raise was the rough tim

[DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-13 Thread Seth Wiesman
Hi All, I would like to start a discussion for FLIP-157: Migrating the Flink docs from Jekyll to Hugo. This will allow us: - Proper internationalization - Working Search - Sub-second build time ;) Please take a look and let me know what you think. Seth https://cwiki.apache.org/conflu

Re: [DISCUSS] Backport broadcast operations in BATCH mode to Flink

2021-01-13 Thread Seth Wiesman
+1 I would hope this helps attract more early adopters so if there are issues we can resolve them in time for 1.13. Seth On Wed, Jan 13, 2021 at 5:13 AM Dawid Wysakowicz wrote: > Hi, > > Given that the BATCH execution mode was only released in 1.12 and a > rather small impact of the suggested

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-13 Thread Ufuk Celebi
+1 to do this. I really like what you have build and the advantages to Jekyll seem overwhelming to me. Hugo is very flexible and I've seen a few other projects use it successfully for docs. On Wed, Jan 13, 2021, at 5:14 PM, Seth Wiesman wrote: > Hi All, > > I would like to start a discussion fo

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-13 Thread Chesnay Schepler
+1 - no dependencies have been changed requiring license updates - nothing seems to be missing from the maven repository - verified checksums/signatures On 1/10/2021 2:23 AM, Xintong Song wrote: Hi everyone, Please review and vote on the release candidate #2 for the version 1.12.1, as follows:

Re: [DISCUSS] Backport broadcast operations in BATCH mode to Flink

2021-01-13 Thread Kurt Young
+1 Best, Kurt On Thu, Jan 14, 2021 at 12:25 AM Seth Wiesman wrote: > +1 > > I would hope this helps attract more early adopters so if there are issues > we can resolve them in time for 1.13. > > Seth > > On Wed, Jan 13, 2021 at 5:13 AM Dawid Wysakowicz > wrote: > > > Hi, > > > > Given that th

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-13 Thread Xintong Song
+1 (non-binding) - verified checksums and signatures - no binaries found in source archive - build from source - played with a couple of example jobs - played with various deployment modes - webui and logs look good On Thu, Jan 14, 2021 at 1:02 AM Chesnay Schepler wrote: > +1 > > - no dependenc

Re: [DISCUSS] Planning Flink 1.13

2021-01-13 Thread Xintong Song
Thanks for kicking off the 1.13 release cycle and volunteering as the release managers. +1 for Dawid & Guowei as the 1.13 release managers. +1 for targeting feature freeze at the end of March Thank you~ Xintong Song On Wed, Jan 13, 2021 at 10:48 PM Dawid Wysakowicz wrote: > Hi all, > With t

Re: [DISCUSS] Releasing Apache Flink 1.10.3

2021-01-13 Thread Xintong Song
Maybe I can help drive this release, if there's no one else volunteering. I've been managing the 1.11.3 and 1.12.1 releases. The bugfix release process is still warm in my mind. :) Thank you~ Xintong Song On Wed, Jan 13, 2021 at 8:09 PM Yu Li wrote: > +1 for having a bugfix release for the 1

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-13 Thread Jark Wu
The build time sounds impressive. Could you explain more what strong internationalization features it provides? Best, Jark On Thu, 14 Jan 2021 at 01:01, Ufuk Celebi wrote: > +1 to do this. I really like what you have build and the advantages to > Jekyll seem overwhelming to me. Hugo is very f

[jira] [Created] (FLINK-20965) BigDecimalTypeInfo can not be converted.

2021-01-13 Thread Wong Mulan (Jira)
Wong Mulan created FLINK-20965: -- Summary: BigDecimalTypeInfo can not be converted. Key: FLINK-20965 URL: https://issues.apache.org/jira/browse/FLINK-20965 Project: Flink Issue Type: Bug

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-13 Thread Yang Wang
+1 (non-binding) * Check the checksum and signatures * Build from source successfully * Deploy Flink on K8s natively with HA mode and check the related fixes * FLINK-20650, flink binary could work with the updated docker-entrypoint.sh in flink-docker * FLINK-20664, support service account for

[jira] [Created] (FLINK-20966) Rename StreamExecIntermediateTableScan to StreamPhysicalIntermediateTableScan

2021-01-13 Thread godfrey he (Jira)
godfrey he created FLINK-20966: -- Summary: Rename StreamExecIntermediateTableScan to StreamPhysicalIntermediateTableScan Key: FLINK-20966 URL: https://issues.apache.org/jira/browse/FLINK-20966 Project: Fl