Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

I want to first clarify that I think Flink China operation team has done a PHENOMENAL job to grow user base in China! This discussion is not about discrediting anyone. The problem occurs as more of a high growth pain IMHO. >> We did guide users to use mailing list to ask questions, but people

[jira] [Created] (FLINK-12855) Stagger panes on partitions to distribute workload.

Teng Hu created FLINK-12855: --- Summary: Stagger panes on partitions to distribute workload. Key: FLINK-12855 URL: https://issues.apache.org/jira/browse/FLINK-12855 Project: Flink Issue Type: New

[jira] [Created] (FLINK-12854) evaluate and support for primitive array in Hive functions

Bowen Li created FLINK-12854: Summary: evaluate and support for primitive array in Hive functions Key: FLINK-12854 URL: https://issues.apache.org/jira/browse/FLINK-12854 Project: Flink Issue

Re: Unit tests consuming a lot of disk

Resolved the issue. I was running a very old version of macos, after upgrading to Mojave the issue disappeared. Disk usage stopped spiking and I stopped running out of disk space. I'm guessing there was a bug with how macos used to handle swap space or memory mapped files that was later fixed.

Re: Unit tests consuming a lot of disk

Hi Ken, I don't believe so, my main disk should be used to store /tmp. Timothys-MacBook-Pro:~ tfarkas$ diskutil list /dev/disk0 (internal): #: TYPE NAMESIZE IDENTIFIER 0: GUID_partition_scheme 251.0 GB disk0 1:

Re: Unit tests consuming a lot of disk

Hi Tim, I wouldn’t expect these tests to consume 30GB of space. Any chance your temp dir is using a mount point with much less free space? — Ken > On Jun 14, 2019, at 12:28 PM, Timothy Farkas > wrote: > > Hi All, > > I get *Caused by: java.io.IOException: No space left on device* errors

Unit tests consuming a lot of disk

Hi All, I get *Caused by: java.io.IOException: No space left on device* errors from some tests when running the flink unit tests on my mac. I have 30 GB free space on my machine and I am building the latest code from the master branch. The following tests in flink-runtime are failing with this

Re: [Contributors List] [JIRA] - Request to be added

Thank you Chesnay! On Fri, Jun 14, 2019 at 5:12 AM Chesnay Schepler wrote: > I've given you contributor permissions. > > On 13/06/2019 22:56, Hugo Da Cruz Louro wrote: > > Hi, > > > > I would like to ask to please be added to the Apache Flink contributors > > list and to obtain permission to

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Please also see my comment on https://issues.apache.org/jira/browse/FLINK-12619?focusedCommentId=16864098=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16864098

Sort streams in windows

Hi folks I want to sort stream based on event time field derived from events. To do this I can use one of the existing windows like TimeWindow to collect events in a window of a particular size, or SlidingWindow to run sort logic more often (and sort within slide). Ideally, I want to sort events

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Hi Aljoscha and all, My 2 cents here: 1. Conceptually it worth a second thought about introducing an optimized snapshot format for now (i.e. use checkpoint format in savepoint), just like it's not recommended to use snapshot for backup in database (although practically it could be implemented).

Re: [DISCUSS] Deprecate previous Python APIs

+1 for removing and we can try our best to enrich the new Python API. Cheers, Jincheng Yu Li 于2019年6月14日周五 下午6:42写道： > +1 on removing plus an explicit NOTE thread, to prevent any neglection due > to the current title (deprecation). > > Best Regards, > Yu > > > On Fri, 14 Jun 2019 at 18:09,

Re: [Contributors List] [JIRA] - Request to be added

I've given you contributor permissions. On 13/06/2019 22:56, Hugo Da Cruz Louro wrote: Hi, I would like to ask to please be added to the Apache Flink contributors list and to obtain permission to assign JIRA's to myself. GitHub: hmcl Apache JIRA Id: hmclouro Thank you Hugo PS. I have

[jira] [Created] (FLINK-12853) Port TableSourceUtils#validateTableSource to api module

Dawid Wysakowicz created FLINK-12853: Summary: Port TableSourceUtils#validateTableSource to api module Key: FLINK-12853 URL: https://issues.apache.org/jira/browse/FLINK-12853 Project: Flink

Re: [DISCUSS] Deprecate previous Python APIs

+1 on removing plus an explicit NOTE thread, to prevent any neglection due to the current title (deprecation). Best Regards, Yu On Fri, 14 Jun 2019 at 18:09, Stephan Ewen wrote: > Okay, so we seem to have consensus for at least deprecating them, with a > suggestion to even directly remove

[jira] [Created] (FLINK-12852) Deadlock occurs when requiring exclusive buffer for RemoteInputChannel

Yun Gao created FLINK-12852: --- Summary: Deadlock occurs when requiring exclusive buffer for RemoteInputChannel Key: FLINK-12852 URL: https://issues.apache.org/jira/browse/FLINK-12852 Project: Flink

Re: [DISCUSS] Deprecate previous Python APIs

Okay, so we seem to have consensus for at least deprecating them, with a suggestion to even directly remove them. A previous survey also brought no users of that python API to light [1] I am inclined to go with removing. Typically, deprecation is the way to go, but we could make an exception and

[jira] [Created] (FLINK-12851) Add travis profile for gelly/kafka

Chesnay Schepler created FLINK-12851: Summary: Add travis profile for gelly/kafka Key: FLINK-12851 URL: https://issues.apache.org/jira/browse/FLINK-12851 Project: Flink Issue Type:

Re: Updating Kinesis Connector to latest Apache licensed libs

+1 Nice! Less special-case handling is always good. > On 14. Jun 2019, at 10:30, Thomas Weise wrote: > > Dyana, thanks for taking this up! > > The flink-connector-kinesis module is already part of the CI pipeline, it > is just excluded when creating the release. So what needs to be done is to

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

Bowen, I agree with your observations regarding a chat group with 10k members! I'm not very familiar with how the tech scene in the Chinese-speaking world works. Ideally, we find a way to help the community grow AND follow good apache practices. If most other projects and communities are doing

[jira] [Created] (FLINK-12850) Introduce LocalDate/LocalTime/LocalDateTime TypeInfo

Jingsong Lee created FLINK-12850: Summary: Introduce LocalDate/LocalTime/LocalDateTime TypeInfo Key: FLINK-12850 URL: https://issues.apache.org/jira/browse/FLINK-12850 Project: Flink Issue

Re: Updating Kinesis Connector to latest Apache licensed libs

Dyana, thanks for taking this up! The flink-connector-kinesis module is already part of the CI pipeline, it is just excluded when creating the release. So what needs to be done is to remove the -Pinclude-kinesis cruft and make it part of the default modules instead. Thomas On Fri, Jun 14, 2019

[jira] [Created] (FLINK-12849) Add support for build Python Docs in Buildbot

sunjincheng created FLINK-12849: --- Summary: Add support for build Python Docs in Buildbot Key: FLINK-12849 URL: https://issues.apache.org/jira/browse/FLINK-12849 Project: Flink Issue Type:

Re: [DISCUSS] Putting Table API jars in /lib by default

Thanks, then let's revisit this in a bit when the Blink/Flink runners have been separated in their package structure. On Wed, Jun 12, 2019 at 2:04 PM Aljoscha Krettek wrote: > +1 I agree that Table API should be in lib because it will become a > first-class-citizen. > > Currently, both the

[jira] [Created] (FLINK-12848) Method equals() in RowTypeInfo should consider fieldsNames

aloyszhang created FLINK-12848: -- Summary: Method equals() in RowTypeInfo should consider fieldsNames Key: FLINK-12848 URL: https://issues.apache.org/jira/browse/FLINK-12848 Project: Flink Issue

Re: Updating Kinesis Connector to latest Apache licensed libs

Brilliant. That Issue is in now under: https://issues.apache.org/jira/browse/FLINK-12847 Thanks, Dyana On Fri, 14 Jun 2019 at 03:07, Tzu-Li (Gordon) Tai wrote: > Hi, > > Thanks Dyana for bringing this up and Bowen for helping to move this > forward. Very happy to hear about this! > > Please

[jira] [Created] (FLINK-12847) Update Kinesis Connectors to latest Apache licensed libraries

Dyana Rose created FLINK-12847: -- Summary: Update Kinesis Connectors to latest Apache licensed libraries Key: FLINK-12847 URL: https://issues.apache.org/jira/browse/FLINK-12847 Project: Flink

[jira] [Created] (FLINK-12846) Carry primary key and unique key information in TableSchema

Jark Wu created FLINK-12846: --- Summary: Carry primary key and unique key information in TableSchema Key: FLINK-12846 URL: https://issues.apache.org/jira/browse/FLINK-12846 Project: Flink Issue

Re: [DISCUSS] Adopting a Code Style and Quality Guide

Thanks for providing this useful guide for benefiting both contributors and committers in consistency. I just reviewed and learned the whole doc which covers a lot of information. Wish it further categoried and put onto somewhere for easily traced future. Best, Zhijiang

Re: Apply for a conributor permission

I've given you contributor permissions. Please make sure to read thecontribution guide . On 14/06/2019 05:24, ? ? wrote: Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is BeauHe,

Re: apply for contributor permission

I've given you contributor permissions. Please make sure to read the contribution guide . On 12/06/2019 11:28, kevin sun wrote: Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is

Re: About Contributor Permission

I've given you contributor permissions. Please make sure to read the contribution guide . On 13/06/2019 17:21, Kevin Liu wrote: Hi, I've been using Apache Flink for a year and I find it quite interesting. Now I really want to make

Re: Support for controlling slot assignment based on CPU requirements

Hi Ken, You are right. Slot-sharing can only be configured for DataStream applications. The DataSet API does not support this. I think right now, there is no good solution for this problem. There are several ongoing efforts to improve Flink's batch capabilities, incl. better scheduling, failure

[jira] [Created] (FLINK-12845) Execute multiple statements in command line or sql script file

Zhenghua Gao created FLINK-12845: Summary: Execute multiple statements in command line or sql script file Key: FLINK-12845 URL: https://issues.apache.org/jira/browse/FLINK-12845 Project: Flink

Re: [DISCUSS] FLIP-33: Standardize connector metrics

> we will need to revisit the convention list and adjust them accordingly when > FLIP-27 is ready Yes, this sounds good :) Piotrek > On 13 Jun 2019, at 13:35, Becket Qin wrote: > > Hi Piotr, > > That's great to know. Chances are that we will need to revisit the > convention list and adjust

Re: [DISCUSS] Adopting a Code Style and Quality Guide

Thanks a lot for putting this together! I'm in the process of reworking the "How to contribute" pages [1] and I'm happy to add the guide to the Flink website, once the discussion here is over. [1] https://github.com/apache/flink-web/pull/217 On Fri, Jun 14, 2019 at 3:21 AM Kurt Young wrote: >

[jira] [Created] (FLINK-12844) Use default conversion class LocalDate/LocalTime/LocalDateTime for DateType/TimeType/TimestampType in blink

Jingsong Lee created FLINK-12844: Summary: Use default conversion class LocalDate/LocalTime/LocalDateTime for DateType/TimeType/TimestampType in blink Key: FLINK-12844 URL: