Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

2019-06-19 Thread Hequn Cheng
Hi, Thanks a lot for your great discussion and great to see that some agreement has been reached on the "local aggregate engine"! ===> Considering the abstract engine, I'm thinking is it valuable for us to extend the current window to meet both demands raised by Kurt and Vino? There are some bene

[jira] [Created] (FLINK-12896) Missing some information in History Server

2019-06-19 Thread xymaqingxiang (JIRA)
xymaqingxiang created FLINK-12896: - Summary: Missing some information in History Server Key: FLINK-12896 URL: https://issues.apache.org/jira/browse/FLINK-12896 Project: Flink Issue Type: Bug

Re: Something wrong with travis?

2019-06-19 Thread Chesnay Schepler
The compile stage was always passing. The timeout makes no difference, it only affects how long we wait for the download to complete. We already had significantly more data in the cache a while ago (like twice as much), so I skeptical that the amount of cached data is the problem. On 18/06/2

Re: Apply for contributor permission

2019-06-19 Thread Chesnay Schepler
You now have contributor permissions. On 19/06/2019 01:38, Jasper Yue wrote: Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is yuetongshu Regards, Jasper Yue

[jira] [Created] (FLINK-12897) Improve the Python Table API docs by adding more examples

2019-06-19 Thread Dian Fu (JIRA)
Dian Fu created FLINK-12897: --- Summary: Improve the Python Table API docs by adding more examples Key: FLINK-12897 URL: https://issues.apache.org/jira/browse/FLINK-12897 Project: Flink Issue Type: S

Re: Apply for contributor permission

2019-06-19 Thread Chesnay Schepler
You now have contributor permissions. On 18/06/2019 12:20, 何建宁 wrote: Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is hejianning,

[jira] [Created] (FLINK-12898) FlinkSQL job fails when rowTime field encounters dirty data

2019-06-19 Thread Mai (JIRA)
Mai created FLINK-12898: --- Summary: FlinkSQL job fails when rowTime field encounters dirty data Key: FLINK-12898 URL: https://issues.apache.org/jira/browse/FLINK-12898 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12899) Introduce a resolved expression with data type

2019-06-19 Thread Timo Walther (JIRA)
Timo Walther created FLINK-12899: Summary: Introduce a resolved expression with data type Key: FLINK-12899 URL: https://issues.apache.org/jira/browse/FLINK-12899 Project: Flink Issue Type: Su

Re: Something wrong with travis?

2019-06-19 Thread Chesnay Schepler
Recent builds are passing again. On 18/06/2019 08:34, Kurt Young wrote: Hi dev, I noticed that all the travis tests triggered by pull request are failed with the same error: "Cached flink dir /home/travis/flink_cache/x/flink does not exist. Exiting build." Anyone have a clue on what happe

Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

2019-06-19 Thread vino yang
Hi Hequn, Thanks for your comments! I agree that allowing local aggregation reusing window API and refining window operator to make it match both requirements (come from our and Kurt) is a good decision! Concerning your questions: 1. The result of input.localKeyBy(0).sum(1).keyBy(0).sum(1) may

[jira] [Created] (FLINK-12900) Refactor the class hierarchy for BinaryFormat

2019-06-19 Thread Liya Fan (JIRA)
Liya Fan created FLINK-12900: Summary: Refactor the class hierarchy for BinaryFormat Key: FLINK-12900 URL: https://issues.apache.org/jira/browse/FLINK-12900 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-12901) Update build instructions for building Flink with a custom hadoop version

2019-06-19 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12901: Summary: Update build instructions for building Flink with a custom hadoop version Key: FLINK-12901 URL: https://issues.apache.org/jira/browse/FLINK-12901 Pro

[jira] [Created] (FLINK-12902) flink-shaded-yarn-tests relies on flink-shaded-hadoop relocation pattern

2019-06-19 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12902: Summary: flink-shaded-yarn-tests relies on flink-shaded-hadoop relocation pattern Key: FLINK-12902 URL: https://issues.apache.org/jira/browse/FLINK-12902 Proj

[jira] [Created] (FLINK-12903) Remove legacy flink-python APIs

2019-06-19 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12903: Summary: Remove legacy flink-python APIs Key: FLINK-12903 URL: https://issues.apache.org/jira/browse/FLINK-12903 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-12904) Remove TableSource#getTableStats() interface

2019-06-19 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12904: --- Summary: Remove TableSource#getTableStats() interface Key: FLINK-12904 URL: https://issues.apache.org/jira/browse/FLINK-12904 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-12905) Convert CatalogView to org.apache.calcite.schema.Table so that planner can use unified catalog APIs

2019-06-19 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-12905: Summary: Convert CatalogView to org.apache.calcite.schema.Table so that planner can use unified catalog APIs Key: FLINK-12905 URL: https://issues.apache.org/jira/browse/FL

[jira] [Created] (FLINK-12906) Port OperationTreeBuilder to Java

2019-06-19 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-12906: --- Summary: Port OperationTreeBuilder to Java Key: FLINK-12906 URL: https://issues.apache.org/jira/browse/FLINK-12906 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-12907) flink-table-planner-blink fails to compile with scala 2.12

2019-06-19 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-12907: Summary: flink-table-planner-blink fails to compile with scala 2.12 Key: FLINK-12907 URL: https://issues.apache.org/jira/browse/FLINK-12907 Project: Flink

apply for contributor permission

2019-06-19 Thread maidangdang
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is dangdang

Re: apply for contributor permission

2019-06-19 Thread Chesnay Schepler
You now have contributor permissions. On 19/06/2019 16:49, maidangdang wrote: Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is dangdang

Re: [DISCUSS] Flink client api enhancement for downstream project

2019-06-19 Thread Zili Chen
Hi Jeff, Thanks for raising this thread and the design document! As @Thomas Weise mentioned above, extending config to flink requires far more effort than it should be. Another example is we achieve detach mode by introduce another execution environment which also hijack #execute method. I agree

Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

2019-06-19 Thread Kurt Young
Hi all, As vino said in previous emails, I think we should first discuss and decide what kind of use cases this FLIP want to resolve, and what the API should look like. From my side, I think this is probably the root cause of current divergence. My understand is (from the FLIP title and motivatio

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-06-19 Thread Tzu-Li (Gordon) Tai
Hi all, Just a few observations from the MODERATE emails I receive as a moderator of the user-zh@ mailing list: - About at least once every day, there would be someone trying to incorrectly subscribe to user-zh@ via the user-zh@ address, and not user-zh-subscribe@. Maybe there is something better

Re: [VOTE] FLIP-41: Unified binary format for keyed state

2019-06-19 Thread Tzu-Li (Gordon) Tai
Thanks for the votes! We have 2 +1's from Congxian and Aljoscha. Since there are no disapproving votes and the voting time has passed, I will see this FLIP as approved to be adopted into Apache Flink. @Aljoscha Krettek Yes, some interface naming in the doc should also be correspondingly updated.

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-06-19 Thread Hequn Cheng
Hi Gordon, Thanks a lot for providing the valuable information! As I carry out the survey about the mailing list, a lot of people told me that they just can't subscribe to the mailing list normally. I think your information gives a good answer! - User subscribes `user-zh@ address` instead of `use

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-06-19 Thread Jark Wu
> Furthermore, could we also add some meaningful reply to the users if they send email to `user-zh@` without subscribing `user-zh-subscribe@`? Hi @Gordon, Can we customize the reply to Chinese? Is that possible? I think one reason is many Chinese people don't understand the meaning of the reply. O

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-06-19 Thread Kurt Young
Is there any chance that we can contact Apache infra team to find out why apache mails are blocked by qq.com? QQ mails are very popular in Chinese. Best, Kurt On Thu, Jun 20, 2019 at 12:01 PM Hequn Cheng wrote: > Hi Gordon, > > Thanks a lot for providing the valuable information! > As I carry

Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

2019-06-19 Thread vino yang
Hi Kurt, Thanks for your comments. It seems we come to a consensus that we should alleviate the performance degraded by data skew with local aggregation. In this FLIP, our key solution is to introduce local keyed partition to achieve this goal. I also agree that we can benefit a lot from the usa