Re: [VOTE] FLIP-111: Docker image unification

2020-04-09 Thread Yangze Guo
+1 (non-binding) Thanks for driving this, Andrey. Best, Yangze Guo On Thu, Apr 9, 2020 at 11:33 PM Ismaël Mejía wrote: > > +1 (non-binding) > Great work Andrey, pretty excited about this happening! > > > On Wed, Apr 8, 2020 at 4:20 AM Canbin Zheng wrote: > > > > Thanks for the FLIP Andrey. > >

Re: [DISCUSS] Releasing Flink 1.9.3

2020-04-09 Thread Dian Fu
Hi Jincheng, Thanks a lot for offering help. It would be very helpful. Thanks again! Regards, Dian > 在 2020年4月10日,下午12:46,jincheng sun 写道: > > Hi Dian, > > Thanks for bring up the discussion. I would like to give you a hand at the > last stage when the RC is finished. :) > > Best, >

Re: [DISCUSS] FLIP-118: Improve Flink’s ID system

2020-04-09 Thread Yangze Guo
Hi there, Sorry for the belated reply. I just make a preliminary investigation of the infect of refactoring IntermediateResultPartitionID. The key change is making it being composed of IntermediateDataSetID and a partitionNum. public class IntermediateResultPartitionID { private final

Re: [DISCUSS] Releasing Flink 1.9.3

2020-04-09 Thread jincheng sun
Hi Dian, Thanks for bring up the discussion. I would like to give you a hand at the last stage when the RC is finished. :) Best, Jincheng Dian Fu 于2020年4月10日周五 上午11:08写道: > Hi all, > > It has been more than two months since we released Flink 1.9.2. There are > already 36

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Dian Fu
+1 for this proposal. > 在 2020年4月10日,上午10:58,Zhijiang 写道: > > +1 for the proposal. > > Best, > Zhijiang > > > -- > From:Robert Metzger > Send Time:2020 Apr. 10 (Fri.) 02:15 > To:dev > Subject:Re: [DISCUSS] Creating a new

[DISCUSS] Releasing Flink 1.9.3

2020-04-09 Thread Dian Fu
Hi all, It has been more than two months since we released Flink 1.9.2. There are already 36 improvements/bugfixes in the release-1.9 branch. Therefore, I propose to create the next bugfix release 1.9.3 for Flink 1.9. Most notable fixes are: - [FLINK-15085] HistoryServer dashboard config json

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Zhijiang
+1 for the proposal. Best, Zhijiang -- From:Robert Metzger Send Time:2020 Apr. 10 (Fri.) 02:15 To:dev Subject:Re: [DISCUSS] Creating a new repo to host Flink benchmarks +1 on creating the repo. On Thu, Apr 9, 2020 at 5:54 PM

[jira] [Created] (FLINK-17078) Logging output is misleading when executing bin/flink -e kubernetes-session without specifying cluster-id

2020-04-09 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-17078: Summary: Logging output is misleading when executing bin/flink -e kubernetes-session without specifying cluster-id Key: FLINK-17078 URL:

[VOTE] FLIP-113: Supports Dynamic Table Options for Flink SQL

2020-04-09 Thread Danny Chan
Hi all, I would like to start the vote for FLIP-113 [1], which is discussed and reached a consensus in the discussion thread [2]. The vote will be open until April 13nd (72h), unless there is an objection or not enough votes. Best, Danny Chan [1]

Re: [VOTE] FLIP-71: E2E View support in Flink SQL

2020-04-09 Thread Danny Chan
+1 from my side. Best, Danny Chan 在 2020年4月9日 +0800 PM9:23,Timo Walther ,写道: > +1 (binding) > > Thanks for your efforts. > > Regards, > Timo > > > On 09.04.20 14:46, Zhenghua Gao wrote: > > Hi all, > > > > I'd like to start the vote for FLIP-71[1] which adds E2E view support in > > Flink SQL. > >

Re: [DISCUSS] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-09 Thread SHI Xiaogang
Hi, I don't think the proposal is a good solution to the problems. I am in favour of using a ProcessFunction chained to the source/sink function to serialize/deserialize the records, instead of embedding (de)serialization schema in source/sink function. Message packing is heavily used in our

[jira] [Created] (FLINK-17077) FLINK_CONF_DIR environment variable to locate flink-conf.yaml in Docker container

2020-04-09 Thread Eui Heo (Jira)
Eui Heo created FLINK-17077: --- Summary: FLINK_CONF_DIR environment variable to locate flink-conf.yaml in Docker container Key: FLINK-17077 URL: https://issues.apache.org/jira/browse/FLINK-17077 Project:

[jira] [Created] (FLINK-17076) Revamp Kafka Connector Documentation

2020-04-09 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-17076: Summary: Revamp Kafka Connector Documentation Key: FLINK-17076 URL: https://issues.apache.org/jira/browse/FLINK-17076 Project: Flink Issue Type: Improvement

Re: [PROPOSAL] Contribute training materials to Apache Flink

2020-04-09 Thread Seth Wiesman
Hi David, +1 to add to the project. I agree that flink.apache.org and flink playgrounds respectively are the best places to host this content. On Thu, Apr 9, 2020 at 2:56 PM Niels Basjes wrote: > Hi, > > Sounds like a very nice thing to have as part of the project ecosystem. > > Niels > > On

Re: [PROPOSAL] Contribute training materials to Apache Flink

2020-04-09 Thread Niels Basjes
Hi, Sounds like a very nice thing to have as part of the project ecosystem. Niels On Thu, Apr 9, 2020 at 8:10 PM David Anderson wrote: > Dear Flink Community! > > For some time now Ververica has been hosting some freely available Apache > Flink training materials at

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Robert Metzger
+1 on creating the repo. On Thu, Apr 9, 2020 at 5:54 PM Till Rohrmann wrote: > I think it is a good idea to make the benchmarks available to the community > via a repo under the Apache project and to make updating it part of the > release process. Hence +1 for the proposal. > > Cheers, > Till

[PROPOSAL] Contribute training materials to Apache Flink

2020-04-09 Thread David Anderson
Dear Flink Community! For some time now Ververica has been hosting some freely available Apache Flink training materials at https://training.ververica.com. This includes tutorial content covering the core concepts of the DataStream API, and hands-on exercises that accompany those explanations.

[jira] [Created] (FLINK-17075) Add task status reconciliation between TM and JM

2020-04-09 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-17075: - Summary: Add task status reconciliation between TM and JM Key: FLINK-17075 URL: https://issues.apache.org/jira/browse/FLINK-17075 Project: Flink Issue

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Till Rohrmann
I think it is a good idea to make the benchmarks available to the community via a repo under the Apache project and to make updating it part of the release process. Hence +1 for the proposal. Cheers, Till On Thu, Apr 9, 2020 at 4:01 PM Piotr Nowojski wrote: > Hi Yun Tang, > > Thanks for

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Till Rohrmann
Thanks Yun. This is very helpful :-) Cheers, Till On Thu, Apr 9, 2020 at 3:16 PM Zhijiang wrote: > Very nice work! Thanks Yun finding this feature and making it happen! > > Best, > Zhijiang > > > -- > From:Xingbo Huang > Send

Re: [DISCUSS] FLIP-111: Docker image unification

2020-04-09 Thread Ismaël Mejía
I am coming extremely late to this discussion since the vote already started but it is great we are finally getting into unification Enthusiast +1. Kudos to Andrey and the rest of the community for bringing all the useful and different perspectives. I just want to bring information on two tickets

Re: [VOTE] FLIP-111: Docker image unification

2020-04-09 Thread Ismaël Mejía
+1 (non-binding) Great work Andrey, pretty excited about this happening! On Wed, Apr 8, 2020 at 4:20 AM Canbin Zheng wrote: > > Thanks for the FLIP Andrey. > > +1 (non-binding) from my side. > > Regards, > Canbin Zheng > > Yang Wang 于2020年4月8日周三 上午9:57写道: > > > Thanks Andrey for the efforts of

[jira] [Created] (FLINK-17074) Deprecate DataStream.keyBy() that use tuple/expression keys

2020-04-09 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-17074: Summary: Deprecate DataStream.keyBy() that use tuple/expression keys Key: FLINK-17074 URL: https://issues.apache.org/jira/browse/FLINK-17074 Project: Flink

Re: [VOTE] FLIP-71: E2E View support in Flink SQL

2020-04-09 Thread Jingsong Li
+1 Hope we can finish it in 1.11, we have been looking forward to it for a long time. Best, Jingsong Lee On Thu, Apr 9, 2020 at 9:23 PM Timo Walther wrote: > +1 (binding) > > Thanks for your efforts. > > Regards, > Timo > > > On 09.04.20 14:46, Zhenghua Gao wrote: > > Hi all, > > > > I'd like

Re: [DISCUSS] FLIP-123: DDL and DML compatibility for Hive connector

2020-04-09 Thread Jingsong Li
Thanks Rui for diving. +1 for this proposal. There are still lots of people who love Hive SQL. And I have seen some people support HQL on presto. Presto, as a famous computing engine, also supports ANSI SQL as we do. This is quite different from HQL. Do you think we must need import

[jira] [Created] (FLINK-17073) Slow checkpoint cleanup causing OOMs

2020-04-09 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-17073: - Summary: Slow checkpoint cleanup causing OOMs Key: FLINK-17073 URL: https://issues.apache.org/jira/browse/FLINK-17073 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17072) Let Dispatcher and ResourceManager pick random endpoint id

2020-04-09 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-17072: - Summary: Let Dispatcher and ResourceManager pick random endpoint id Key: FLINK-17072 URL: https://issues.apache.org/jira/browse/FLINK-17072 Project: Flink

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Piotr Nowojski
Hi Yun Tang, Thanks for proposing the idea. Since we can not include benchmarks in the Flink repository what you are proposing is the second best option. +1 from my side for the proposal. I think benchmarks have proven their value to justify this. Piotrek > On 9 Apr 2020, at 08:56, Yun Tang

Re: contributor apply

2020-04-09 Thread Timo Walther
Hi, welcome to our community! You don't need to be a contributor in JIRA to contribute to Apache Flink. Just ping a committer if your want to work on some JIRA ticket and someone will assign the ticket to you. Regards, Timo On 09.04.20 11:03, zhangzhanhua wrote: Hi Guys, I want to

Re: [VOTE] FLIP-71: E2E View support in Flink SQL

2020-04-09 Thread Timo Walther
+1 (binding) Thanks for your efforts. Regards, Timo On 09.04.20 14:46, Zhenghua Gao wrote: Hi all, I'd like to start the vote for FLIP-71[1] which adds E2E view support in Flink SQL. This FLIP is discussed in the thread[2]. The vote will be open for at least 72 hours. Unless there is an

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Zhijiang
Very nice work! Thanks Yun finding this feature and making it happen! Best, Zhijiang -- From:Xingbo Huang Send Time:2020 Apr. 9 (Thu.) 20:23 To:dev Subject:Re: Configuring autolinks to Flink JIRA ticket in github repos Thanks

Re: [ANNOUNCE] Apache Flink Stateful Functions 2.0.0 released

2020-04-09 Thread Zhijiang
Great work! Thanks Gordon for the continuous efforts for enhancing stateful functions and the efficient release! Wish stateful functions becoming more and more popular in users. Best, Zhijiang -- From:Yun Tang Send Time:2020 Apr.

[VOTE] FLIP-71: E2E View support in Flink SQL

2020-04-09 Thread Zhenghua Gao
Hi all, I'd like to start the vote for FLIP-71[1] which adds E2E view support in Flink SQL. This FLIP is discussed in the thread[2]. The vote will be open for at least 72 hours. Unless there is an objection. I will try to close it by April 13, 2020 09:00 UTC if we have received sufficient votes.

[jira] [Created] (FLINK-17071) Kubernetes session CLI logging output is either misleading or concerning

2020-04-09 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17071: Summary: Kubernetes session CLI logging output is either misleading or concerning Key: FLINK-17071 URL: https://issues.apache.org/jira/browse/FLINK-17071

[jira] [Created] (FLINK-17070) Kubernetes session CLI ignores stop/help command in detached mode

2020-04-09 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17070: Summary: Kubernetes session CLI ignores stop/help command in detached mode Key: FLINK-17070 URL: https://issues.apache.org/jira/browse/FLINK-17070 Project:

Re: [VOTE] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

2020-04-09 Thread Xingbo Huang
Hi Dian, +1 (non-binding) Thanks a lot for driving this. Best, Xingbo Dian Fu 于2020年4月8日周三 上午10:03写道: > Hi all, > > I'd like to start the vote for FLIP-120[1] which is discussed and reached > consensus in the discussion thread[2]. > > The vote will be open for at least 72 hours unless there

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Xingbo Huang
Thanks Yun, Good Work. It is very convenient to link to JIRA from corresponding PR currently. Best, Xingbo Hequn Cheng 于2020年4月9日周四 下午8:16写道: > It’s much more convenient now. Thanks you! > > > On Apr 9, 2020, at 8:01 PM, Aljoscha Krettek > wrote: > > > > That is very nice! Thanks for taking

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Hequn Cheng
It’s much more convenient now. Thanks you! > On Apr 9, 2020, at 8:01 PM, Aljoscha Krettek wrote: > > That is very nice! Thanks for taking care of this ~3q > > On 09.04.20 11:08, Dian Fu wrote: >> Cool! Thanks Yun for this effort. Very useful feature. >> Regards, >> Dian >>> 在

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Aljoscha Krettek
That is very nice! Thanks for taking care of this ~3q On 09.04.20 11:08, Dian Fu wrote: Cool! Thanks Yun for this effort. Very useful feature. Regards, Dian 在 2020年4月9日,下午4:32,Yu Li 写道: Great! Thanks for the efforts Yun. Best Regards, Yu On Thu, 9 Apr 2020 at 16:15, Jark Wu wrote:

[jira] [Created] (FLINK-17069) DefaultClusterClientServiceLoader should provide more information in case of missing dependencies

2020-04-09 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17069: Summary: DefaultClusterClientServiceLoader should provide more information in case of missing dependencies Key: FLINK-17069 URL:

[jira] [Created] (FLINK-17068) ERROR at teardown of TableConfigTests.test_get_set_decimal_context

2020-04-09 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17068: -- Summary: ERROR at teardown of TableConfigTests.test_get_set_decimal_context Key: FLINK-17068 URL: https://issues.apache.org/jira/browse/FLINK-17068 Project:

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Dian Fu
Cool! Thanks Yun for this effort. Very useful feature. Regards, Dian > 在 2020年4月9日,下午4:32,Yu Li 写道: > > Great! Thanks for the efforts Yun. > > Best Regards, > Yu > > > On Thu, 9 Apr 2020 at 16:15, Jark Wu wrote: > >> Thanks Yun, >> >> This's a great feature! I was surprised by the

[jira] [Created] (FLINK-17067) CatalogManager#createTable and createTemporaryTable should provide consistent semantics

2020-04-09 Thread Zhenghua Gao (Jira)
Zhenghua Gao created FLINK-17067: Summary: CatalogManager#createTable and createTemporaryTable should provide consistent semantics Key: FLINK-17067 URL: https://issues.apache.org/jira/browse/FLINK-17067

contributor apply

2020-04-09 Thread zhangzhanhua
Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is zhangzhanhua.

[DISCUSS] Generating java code?

2020-04-09 Thread Niels Basjes
Hi, I'm working on https://issues.apache.org/jira/browse/FLINK-16871 to make more build time variables (like the scala version) into the code available at runtime. During the review process there was discussion around a basic question: *Is generating java code during the build ok?* See -

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Yu Li
Great! Thanks for the efforts Yun. Best Regards, Yu On Thu, 9 Apr 2020 at 16:15, Jark Wu wrote: > Thanks Yun, > > This's a great feature! I was surprised by the autolink feature yesterday > (didn't know your work at that time). > > Best, > Jark > > On Thu, 9 Apr 2020 at 16:12, Yun Tang

[jira] [Created] (FLINK-17066) Limits the PyArrow version to 0.13

2020-04-09 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-17066: Summary: Limits the PyArrow version to 0.13 Key: FLINK-17066 URL: https://issues.apache.org/jira/browse/FLINK-17066 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17065) Adds notes of Python versions supported by PyFlink in doc

2020-04-09 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-17065: Summary: Adds notes of Python versions supported by PyFlink in doc Key: FLINK-17065 URL: https://issues.apache.org/jira/browse/FLINK-17065 Project: Flink

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Jark Wu
Thanks Yun, This's a great feature! I was surprised by the autolink feature yesterday (didn't know your work at that time). Best, Jark On Thu, 9 Apr 2020 at 16:12, Yun Tang wrote: > Hi community > > The autolink to Flink JIRA ticket has taken effect. You could refer to the > commit details

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-09 Thread Yun Tang
Hi community The autolink to Flink JIRA ticket has taken effect. You could refer to the commit details page[1] to see all Flink JIRA titles within commits has the hyper link underline. Moreover, you don't need to use markdown language to create hyper link to Flink JIRA ticket when discussing

Re: [DISCUSS] FLIP-123: DDL and DML compatibility for Hive connector

2020-04-09 Thread Rui Li
Hi Kurt, Thanks for the feedback and that's a good idea. I have updated the FLIP and added tables in the "Limited Scope" section to list the supported and unsupported features. Please have a look and let me know if that makes sense. Thanks. On Wed, Apr 8, 2020 at 2:19 PM Kurt Young wrote: > Hi

[jira] [Created] (FLINK-17064) Improve ExpressionConverter

2020-04-09 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17064: Summary: Improve ExpressionConverter Key: FLINK-17064 URL: https://issues.apache.org/jira/browse/FLINK-17064 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17063) Make null typ be a possible result of a type inference

2020-04-09 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17063: Summary: Make null typ be a possible result of a type inference Key: FLINK-17063 URL: https://issues.apache.org/jira/browse/FLINK-17063 Project: Flink

[jira] [Created] (FLINK-17062) Fix the conversion from Java row type to Python row type

2020-04-09 Thread Dian Fu (Jira)
Dian Fu created FLINK-17062: --- Summary: Fix the conversion from Java row type to Python row type Key: FLINK-17062 URL: https://issues.apache.org/jira/browse/FLINK-17062 Project: Flink Issue Type:

[DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Yun Tang
Hi Flink devs, As Flink develops rapidly with more and more features added, how to ensure no performance regression existed has become more and more important. And we would like to create a new repo under apache project to host previous flink-benchmarks [1] repo, which is inspired when we

Re: [VOTE] FLIP-108: Add GPU support in Flink

2020-04-09 Thread Becket Qin
+1 Thanks for driving this effort, Ynagze. The latest FLIP wiki looks good to me. Cheers, Jiangjie (Becket) Qin On Wed, Apr 8, 2020 at 4:10 PM Yangze Guo wrote: > Edit: RuntimeContext interface > From: Map> > getExternalResourceInfo(ResourceSpec resourceSpec); > To: Map>