Re: Cwiki edit access

2020-02-13 Thread jincheng sun
Hi lining, Sounds good! I have assigned write edit permission to `jinglining` account. Please log in again and verify whether it works. Have a nice day at work! Best, Jincheng lining jing 于2020年2月14日周五 上午11:49写道: > As I am currently drafting FLIP-98 ~ 104 with Yadong, so i need to edit it. >

[jira] [Created] (FLINK-16053) Remove redundant metrics in PyFlink

2020-02-13 Thread Dian Fu (Jira)
Dian Fu created FLINK-16053: --- Summary: Remove redundant metrics in PyFlink Key: FLINK-16053 URL: https://issues.apache.org/jira/browse/FLINK-16053 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16052) Homebrew test failed with 1.10.0 dist package

2020-02-13 Thread Yu Li (Jira)
Yu Li created FLINK-16052: - Summary: Homebrew test failed with 1.10.0 dist package Key: FLINK-16052 URL: https://issues.apache.org/jira/browse/FLINK-16052 Project: Flink Issue Type: Bug

Re: [VOTE] Support Python ML Pipeline API

2020-02-13 Thread Dian Fu
+1 (binding) Regards, Dian > 在 2020年2月14日,下午2:49,Yuan Mei 写道: > > +1 vote > > This is one of the most important things for Flink ML framework to be > widely adopted since most data scientists use python. > > Best > > Yuan > > On Fri, Feb 14, 2020 at 9:45 AM Hequn Cheng wrote: > >> Hi

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Dian Fu
+1 (non-binding) - Verified the signature and checksum - Checked the release note that all the tickets included in this release are there - Checked the website PR and it LGTM - Checked the notice file of the newly added module flink-shade-zookeeper-3 and it LGTM Regards, Dian > 在

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Hequn Cheng
Thank you Chesnay for the release! +1 (non-binding) - The problem that exists in RC1 has been resolved. - Release notes looks good. - Built from source archive successfully. - Check commit history manually. Nothing looks weird. - Signatures and hash are correct. - All artifacts have been

Re: [VOTE] Support Python ML Pipeline API

2020-02-13 Thread Yuan Mei
+1 vote This is one of the most important things for Flink ML framework to be widely adopted since most data scientists use python. Best Yuan On Fri, Feb 14, 2020 at 9:45 AM Hequn Cheng wrote: > Hi everyone, > > I'd like to start the vote of FLIP-96[1] which is discussed and reached >

Re: [DISCUSS] Support Python ML Pipeline API

2020-02-13 Thread Hequn Cheng
Hi Becket, Thanks a lot for your advice. Definitely agree with you that we should follow the FLIP process. Will pay more attention to this next time. Best, Hequn On Fri, Feb 14, 2020 at 2:19 PM Becket Qin wrote: > I just had an offline chat with Hequn and realized that FLIP-96 has already >

Re: [DISCUSS] Support Python ML Pipeline API

2020-02-13 Thread Becket Qin
I just had an offline chat with Hequn and realized that FLIP-96 has already been opened for this discussion. I missed that because the FLIP was not mentioned in the thread. I am fine with proceeding to a vote. Thanks, Jiangjie (Becket) Qin On Fri, Feb 14, 2020 at 12:52 PM Becket Qin wrote: >

Re: [VOTE] Support Python ML Pipeline API

2020-02-13 Thread jincheng sun
+1(binding) Best, Jincheng Hequn Cheng 于2020年2月14日周五 上午9:45写道: > Hi everyone, > > I'd like to start the vote of FLIP-96[1] which is discussed and reached > consensus in the discussion thread[2]. > The vote will be open for at least 72 hours. Unless there is an objection, > I will try to close

Re: [DISCUSS] Support Python ML Pipeline API

2020-02-13 Thread Becket Qin
Hi Hequn, Given this is an addition to the public API, we probably should follow the FLIP process. It would be a quick one though, I think. Thanks, Jiangjie (Becket) Qin On Fri, Feb 14, 2020 at 10:03 AM Hequn Cheng wrote: > Hi all, > > Thanks a lot for your valuable feedback! > As it seems

[jira] [Created] (FLINK-16051) subtask id in Checkpoint UI not consistent with TaskUI

2020-02-13 Thread Jiayi Liao (Jira)
Jiayi Liao created FLINK-16051: -- Summary: subtask id in Checkpoint UI not consistent with TaskUI Key: FLINK-16051 URL: https://issues.apache.org/jira/browse/FLINK-16051 Project: Flink Issue

Re: Cwiki edit access

2020-02-13 Thread lining jing
As I am currently drafting FLIP-98 ~ 104 with Yadong, so i need to edit it. jincheng sun 于2020年2月14日周五 上午11:43写道: > Hi Lining, > > Could you please add more information about why you need page access > authority, and which page you want to edit? > > Best, > Jincheng > > > lining jing

Re: Cwiki edit access

2020-02-13 Thread jincheng sun
Hi Lining, Could you please add more information about why you need page access authority, and which page you want to edit? Best, Jincheng lining jing 于2020年2月14日周五 上午11:09写道: > Hi, I would like to be able to edit pages in the Confluence Flink space. > Can > someone give me access, please? >

Re: Cwiki edit access

2020-02-13 Thread jincheng sun
Hi Lining, Could you please information about why you need page access authority, and which page you want edit? Best, Jincheng lining jing 于2020年2月14日周五 上午11:09写道: > Hi, I would like to be able to edit pages in the Confluence Flink space. > Can > someone give me access, please? > > Thanks >

Cwiki edit access

2020-02-13 Thread lining jing
Hi, I would like to be able to edit pages in the Confluence Flink space. Can someone give me access, please? Thanks

[jira] [Created] (FLINK-16050) Add Attempt Information

2020-02-13 Thread lining (Jira)
lining created FLINK-16050: -- Summary: Add Attempt Information Key: FLINK-16050 URL: https://issues.apache.org/jira/browse/FLINK-16050 Project: Flink Issue Type: Improvement Components:

[VOTE] FLIP-75: Flink Web UI Improvement Proposal

2020-02-13 Thread Yadong Xie
Hi all, I would like to start the vote for FLIP-75 which proposes to provide a better experience for Flink users in web UI. In order to make the vote easier, the FLIP-75 was split into several top-level sub FLIPs: - FLIP-98: Better Back Pressure Detection

Re: [DISCUSS] Support Python ML Pipeline API

2020-02-13 Thread Hequn Cheng
Hi all, Thanks a lot for your valuable feedback! As it seems we have reached a consensus on the discussion now. I have started a VOTE thread[1]. Looking forward to your vote. Best, Hequn [1]

[VOTE] Support Python ML Pipeline API

2020-02-13 Thread Hequn Cheng
Hi everyone, I'd like to start the vote of FLIP-96[1] which is discussed and reached consensus in the discussion thread[2]. The vote will be open for at least 72 hours. Unless there is an objection, I will try to close it by Feb 19, 2020 02:00 UTC if we have received sufficient votes. Thanks,

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Zhu Zhu
+1 (non-binding) - checked release notes, JIRA tickets and commit history - verified the signature and checksum - checked the maven central artifacts * examined the zookeeper shaded jars (both 3.4.10 and 3.5.6), curator and zookeeper classes are there and shaded - built from the source archive

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Ufuk Celebi
PS: Also verified the NOTICE changes since the last RC. On Thu, Feb 13, 2020 at 5:25 PM Ufuk Celebi wrote: > Hey Chensay, > > +1 (binding). > > - Verified checksum ✅ > - Verified signature ✅ > - Jira changelog looks good to me ✅ > - Website PR looks good to me ✅ > - Verified no unshaded

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Ufuk Celebi
Hey Chensay, +1 (binding). - Verified checksum ✅ - Verified signature ✅ - Jira changelog looks good to me ✅ - Website PR looks good to me ✅ - Verified no unshaded dependencies (except the Hadoop modules which I think is expected) ✅ - Verified dependency management fix FLINK-15540

Re: [DISCUSS][TABLE] Issue with package structure in the Table API

2020-02-13 Thread Timo Walther
Hi everyone, thanks for bringing our offline discussion to the mailing list, Dawid. This is a very bad mistake that has been made in the past. In general, we should discourage putting the terms "java" and "scala" in package names as this has side effects on Scala imports. I really don't

Re: [Discussion] Job generation / submission hooks & Atlas integration

2020-02-13 Thread Gyula Fóra
Thanks for the feedback Aljoscha! I have a POC ready with the Flink changes + the Atlas hook implementation. I will try to push this to a public repo tomorrow and we can discuss further based on that! Gyula On Thu, Feb 13, 2020, 15:26 Aljoscha Krettek wrote: > I think exposing the Pipeline

[jira] [Created] (FLINK-16049) Remove outdated "Best Pracatices" section from Application Development Section

2020-02-13 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-16049: Summary: Remove outdated "Best Pracatices" section from Application Development Section Key: FLINK-16049 URL: https://issues.apache.org/jira/browse/FLINK-16049

Re: [DISCUSS] Improve history server with log support

2020-02-13 Thread Aljoscha Krettek
Hi, what's the difference in approach to the mentioned related Jira Issue ([1])? I commented there because I'm skeptical about adding Hadoop-specific code to the generic cluster components. Best, Aljoscha [1] https://issues.apache.org/jira/browse/FLINK-14317 On 13.02.20 03:47, SHI Xiaogang

[jira] [Created] (FLINK-16048) Support read avro data that serialized by KafkaAvroSerializer from Kafka in Table

2020-02-13 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-16048: -- Summary: Support read avro data that serialized by KafkaAvroSerializer from Kafka in Table Key: FLINK-16048 URL: https://issues.apache.org/jira/browse/FLINK-16048

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-13 Thread Dawid Wysakowicz
Sorry for late reply, @all I think there is a general consensus that we want to drop ES 2.x support. I created https://issues.apache.org/jira/browse/FLINK-16046 to track it. @Stephan @Chesnay @Itamar In our connectors we use Java High Level Rest Client. ES promises to maintain compatibility of

Re: [Discussion] Job generation / submission hooks & Atlas integration

2020-02-13 Thread Aljoscha Krettek
I think exposing the Pipeline should be ok. Using the internal StreamGraph might be problematic because this might change/break but that's a problem of the external code. Aljoscha On 11.02.20 16:26, Gyula Fóra wrote: Hi All! I have made a prototype that simply adds a getPipeline() method to

[jira] [Created] (FLINK-16047) Blink planner produces wrong aggregate results with state clean up

2020-02-13 Thread Timo Walther (Jira)
Timo Walther created FLINK-16047: Summary: Blink planner produces wrong aggregate results with state clean up Key: FLINK-16047 URL: https://issues.apache.org/jira/browse/FLINK-16047 Project: Flink

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Yu Li
+1 (non-binding) Checked issues listed in release notes: ok Checked sums and signatures: ok Checked the maven central artifices: ok Built from source: ok (8u101, 11.0.4) Built from source (with -Dshade-sources): ok (8u101, 11.0.4) Checked contents of zookeeper shaded jars: ok - no unshaded

[jira] [Created] (FLINK-16046) Drop Elasticsearch 2.x connector

2020-02-13 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-16046: Summary: Drop Elasticsearch 2.x connector Key: FLINK-16046 URL: https://issues.apache.org/jira/browse/FLINK-16046 Project: Flink Issue Type:

[DISCUSS][TABLE] Issue with package structure in the Table API

2020-02-13 Thread Dawid Wysakowicz
Hi devs, I wanted to bring up a problem that we have in our package structure. As a result of https://issues.apache.org/jira/browse/FLINK-13045 we started advertising importing two packages in the scala API: import org.apache.flink.table.api._ import org.apache.flink.table.api.scala._ The

[jira] [Created] (FLINK-16045) Extract connectors documentation to a top-level section

2020-02-13 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-16045: Summary: Extract connectors documentation to a top-level section Key: FLINK-16045 URL: https://issues.apache.org/jira/browse/FLINK-16045 Project: Flink

[jira] [Created] (FLINK-16044) Extract libraries documentation to a top-level section

2020-02-13 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-16044: Summary: Extract libraries documentation to a top-level section Key: FLINK-16044 URL: https://issues.apache.org/jira/browse/FLINK-16044 Project: Flink

[jira] [Created] (FLINK-16043) Support non-BMP Unicode for JsonRowSerializationSchema

2020-02-13 Thread Benchao Li (Jira)
Benchao Li created FLINK-16043: -- Summary: Support non-BMP Unicode for JsonRowSerializationSchema Key: FLINK-16043 URL: https://issues.apache.org/jira/browse/FLINK-16043 Project: Flink Issue

Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-13 Thread godfrey he
hi kurt,jark,jingsong Regarding to "fromQuery", I agree with kurt. In addition, I think `Table from(String tableName)` should be renamed to `Table fromCatalog(String tableName)`. Regarding to the "DmlBatch", DML contains "INSERT", "UPDATE", "DELETE", and they can be executed in a same batch in

[jira] [Created] (FLINK-16042) Add state benchmark for append operation in AppendingState

2020-02-13 Thread Jiayi Liao (Jira)
Jiayi Liao created FLINK-16042: -- Summary: Add state benchmark for append operation in AppendingState Key: FLINK-16042 URL: https://issues.apache.org/jira/browse/FLINK-16042 Project: Flink Issue

[jira] [Created] (FLINK-16041) Expand "popular" documentation sections by default

2020-02-13 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-16041: Summary: Expand "popular" documentation sections by default Key: FLINK-16041 URL: https://issues.apache.org/jira/browse/FLINK-16041 Project: Flink

[jira] [Created] (FLINK-16040) Change local import to global import

2020-02-13 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-16040: Summary: Change local import to global import Key: FLINK-16040 URL: https://issues.apache.org/jira/browse/FLINK-16040 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16039) Add API method to get last element in session window

2020-02-13 Thread Manas Kale (Jira)
Manas Kale created FLINK-16039: -- Summary: Add API method to get last element in session window Key: FLINK-16039 URL: https://issues.apache.org/jira/browse/FLINK-16039 Project: Flink Issue Type:

Re: [ANNOUNCE] Apache Flink Python API(PyFlink) 1.9.2 released

2020-02-13 Thread Hequn Cheng
Thanks a lot for the release, Jincheng! Also thanks to everyone that make this release possible! Best, Hequn On Thu, Feb 13, 2020 at 2:18 PM Dian Fu wrote: > Thanks for the great work, Jincheng. > > Regards, > Dian > > 在 2020年2月13日,下午1:32,jincheng sun 写道: > > Hi everyone, > > The Apache Flink

[jira] [Created] (FLINK-16038) Expose hitRate metric for JDBCLookupFunction

2020-02-13 Thread Benchao Li (Jira)
Benchao Li created FLINK-16038: -- Summary: Expose hitRate metric for JDBCLookupFunction Key: FLINK-16038 URL: https://issues.apache.org/jira/browse/FLINK-16038 Project: Flink Issue Type:

[jira] [Created] (FLINK-16037) maven-dependency-plugin not fully compatible with Java 11

2020-02-13 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16037: Summary: maven-dependency-plugin not fully compatible with Java 11 Key: FLINK-16037 URL: https://issues.apache.org/jira/browse/FLINK-16037 Project: Flink

[jira] [Created] (FLINK-16036) Deprecate String based Expression DSL

2020-02-13 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-16036: Summary: Deprecate String based Expression DSL Key: FLINK-16036 URL: https://issues.apache.org/jira/browse/FLINK-16036 Project: Flink Issue Type:

Re: [VOTE] Support scalar vectorized Python UDF in PyFlink

2020-02-13 Thread Hequn Cheng
+1 (binding) Best, Hequn On Thu, Feb 13, 2020 at 11:48 AM Jingsong Li wrote: > +1 (non-binding) > Thanks Dian for driving. > > Best, > Jingsong Lee > > On Thu, Feb 13, 2020 at 11:45 AM jincheng sun > wrote: > > > +1 (binding) > > > > Best, > > Jincheng > > > > > > Dian Fu 于2020年2月12日周三

Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-13 Thread Kurt Young
Regarding to "fromQuery" is confusing users with "Table from(String tableName)", I have a just opposite opinion. I think this "fromXXX" pattern can make users quite clear when they want to get a Table from TableEnvironment. Similar interfaces will also include like "fromElements". Regarding to

[jira] [Created] (FLINK-16035) Update Java's TableEnvironment/Table to accept Java Expression DSL

2020-02-13 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-16035: Summary: Update Java's TableEnvironment/Table to accept Java Expression DSL Key: FLINK-16035 URL: https://issues.apache.org/jira/browse/FLINK-16035 Project:

[jira] [Created] (FLINK-16034) Update string based expressions to java dsl in documentation

2020-02-13 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-16034: Summary: Update string based expressions to java dsl in documentation Key: FLINK-16034 URL: https://issues.apache.org/jira/browse/FLINK-16034 Project: Flink

[jira] [Created] (FLINK-16033) Introduce Java Expression DSL

2020-02-13 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-16033: Summary: Introduce Java Expression DSL Key: FLINK-16033 URL: https://issues.apache.org/jira/browse/FLINK-16033 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16032) Depends on core classifier hive-exec in hive connector

2020-02-13 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16032: Summary: Depends on core classifier hive-exec in hive connector Key: FLINK-16032 URL: https://issues.apache.org/jira/browse/FLINK-16032 Project: Flink Issue

[VOTE][RESULT] FLIP-55: Introduction of a Table API Java Expression DSL

2020-02-13 Thread Dawid Wysakowicz
Thanks all for the votes. So far, we have - 3 binding +1 votes (Timo, Jark, Aljoscha) - 2 non-binding +1 votes (Jingsong, Dian) - No -1 votes The voting time has past and there is enough +1 votes to consider the FLIP-55 approved. Thank you all. Best, Dawid On 12/02/2020 06:21, Dian Fu

Re: [DISCUSS] FLIP-84: Improve & Refactor execute/sqlQuery/sqlUpdate APIS of TableEnvironment

2020-02-13 Thread Jark Wu
I agree with Jingsong. +1 to keep `sqlQuery`, it's clear from the method name and return type that it accepts a SELECT query and returns a logic representation `Table`. The `fromQuery` is a little confused users with the `Table from(String tableName)` method. Regarding to the `DmlBatch`, I agree