Support for daylight saving timezone changes in Flink

2017-02-13 Thread Swapnil Chougule
I want to know the behavior of flink streaming systems during daylight saving changes in multiple timezones. As streaming systems may in such timezones. Is there any built-in support is needed ? Can anybody answer ? Thanks in advance --Swapnil

[DISCUSS] Support Incremental Checkpointing in Flink

2017-02-13 Thread SHI Xiaogang
Hi all, Incremental checkpointing can help a lot in improving the efficiency of fault tolerance and recovery in Flink. I wrote an initial design of incremental checkpointing in Flink, and am looking forwards for your comments.

[jira] [Created] (FLINK-5791) Resource should be strictly matched when allocating for yarn

2017-02-13 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5791: --- Summary: Resource should be strictly matched when allocating for yarn Key: FLINK-5791 URL: https://issues.apache.org/jira/browse/FLINK-5791 Project: Flink Issue

[jira] [Created] (FLINK-5790) Use list types when ListStateDescriptor extends StateDescriptor

2017-02-13 Thread Xiaogang Shi (JIRA)
Xiaogang Shi created FLINK-5790: --- Summary: Use list types when ListStateDescriptor extends StateDescriptor Key: FLINK-5790 URL: https://issues.apache.org/jira/browse/FLINK-5790 Project: Flink

RE: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-13 Thread Radu Tudoran
Hi Fabian, Thanks for starting the discussion. Before I give my thoughts on this can you please give some examples of how would you see option of using "system attributes"? Do you use this when you register the stream as a table, do you use if when you call an SQL query, do you use it when you

[DISCUSS] Table API / SQL indicators for event and processing time

2017-02-13 Thread Fabian Hueske
Hi, I'd like to start an discussion about how Table API / SQL queries indicate whether an operation is done in event or processing time. 1) Why do we need to indicate the time mode? We need to distinguish event time and processing time mode for operations in queries in order to have the

[jira] [Created] (FLINK-5789) Make Bucketing Sink independent of Hadoop's FileSysten

2017-02-13 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5789: --- Summary: Make Bucketing Sink independent of Hadoop's FileSysten Key: FLINK-5789 URL: https://issues.apache.org/jira/browse/FLINK-5789 Project: Flink Issue

[jira] [Created] (FLINK-5788) Document assumptions about File Systems and persistence

2017-02-13 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5788: --- Summary: Document assumptions about File Systems and persistence Key: FLINK-5788 URL: https://issues.apache.org/jira/browse/FLINK-5788 Project: Flink Issue

Re: [DISCUSS] Planning Release 1.3

2017-02-13 Thread Aljoscha Krettek
+1, we can do it this time! :-) On Mon, 6 Feb 2017 at 20:19 Robert Metzger wrote: > Hi, > according to our recent time-based releases discussion, I came up with the > following deadlines for the upcoming 1.3 release: > > *Feature freeze (branch forking)*: 1 May 2017 >

[jira] [Created] (FLINK-5787) Unable to run jobs uploaded from IE

2017-02-13 Thread Andrey (JIRA)
Andrey created FLINK-5787: - Summary: Unable to run jobs uploaded from IE Key: FLINK-5787 URL: https://issues.apache.org/jira/browse/FLINK-5787 Project: Flink Issue Type: Bug Affects Versions:

[jira] [Created] (FLINK-5786) Add support GetClusterStatus message for standalong flink cluster

2017-02-13 Thread Dmitrii Kniazev (JIRA)
Dmitrii Kniazev created FLINK-5786: -- Summary: Add support GetClusterStatus message for standalong flink cluster Key: FLINK-5786 URL: https://issues.apache.org/jira/browse/FLINK-5786 Project: Flink

Re: New Flink team member - Kate Eri.

2017-02-13 Thread Felix Neutatz
Hi Kate, that's great news. This would help to boost ML on Flink a lot :) Best regards, Felix 2017-02-13 14:09 GMT+01:00 Katherin Eri : > Hello guys, > > > > It seems that issue FLINK-1730 > significantly impacts >

Re: New Flink team member - Kate Eri.

2017-02-13 Thread Katherin Eri
Hello guys, It seems that issue FLINK-1730 significantly impacts integration of Flink with SystemML. They have checked several integrations, and Flinkā€™s integration is slowest

[jira] [Created] (FLINK-5785) Add an Imputer for preparing data

2017-02-13 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created FLINK-5785: -- Summary: Add an Imputer for preparing data Key: FLINK-5785 URL: https://issues.apache.org/jira/browse/FLINK-5785 Project: Flink Issue Type: New

[jira] [Created] (FLINK-5784) TaskExecutor may register JobManagerLeaderListener in LeaderRetrievalService multiple times

2017-02-13 Thread Biao Liu (JIRA)
Biao Liu created FLINK-5784: --- Summary: TaskExecutor may register JobManagerLeaderListener in LeaderRetrievalService multiple times Key: FLINK-5784 URL: https://issues.apache.org/jira/browse/FLINK-5784

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-13 Thread Kostas Kloudas
Thanks a lot guys! Looking forward to working closer with all of you to keep Flink as the most advanced open-source stream processor! Kostas > On Feb 10, 2017, at 5:07 PM, Henry Saputra wrote: > > Awesome! Congrats and Welcome, Jark and Kostas K. > > - Henry > >

Re: [ANNOUNCE] Welcome Stefan Richter as a new committer

2017-02-13 Thread Stefan Richter
Thanks a lot! I feel very happy and will try help the Flink community as good as I can :-) Best, Stefan > Am 10.02.2017 um 11:00 schrieb Ufuk Celebi : > > Hey everyone, > > I'm very happy to announce that the Flink PMC has accepted Stefan > Richter to become a committer of