Re: expose side output stream

Stephan Humm... I see. Back off one step, how do Flink deal with corrupted input data right now, like a dead letter queue? Thanks, Chen On Thu, Aug 11, 2016 at 5:40 AM, Stephan Ewen wrote: > Hi! > > This is a very big change, both on the semantics, the runtime classes. >

[jira] [Created] (FLINK-4386) Add as way to assert that code runs in the RpcEndpoint's Main Thread

Stephan Ewen created FLINK-4386: --- Summary: Add as way to assert that code runs in the RpcEndpoint's Main Thread Key: FLINK-4386 URL: https://issues.apache.org/jira/browse/FLINK-4386 Project: Flink

[jira] [Created] (FLINK-4385) Union on Timestamp fields does not work

Timo Walther created FLINK-4385: --- Summary: Union on Timestamp fields does not work Key: FLINK-4385 URL: https://issues.apache.org/jira/browse/FLINK-4385 Project: Flink Issue Type: Bug

[DISCUSS] FLIP-8: Rescalable Non-Partitioned State

Hey all! I've created a short FLIP for rescalable non-partitioned state: https://cwiki.apache.org/confluence/display/FLINK/FLIP-8%3A+Rescalable+Non-Partitioned+State This is related to an effort led by Till, Aljoscha, Stephan, and Stefan to allow rescaling of Flink jobs (see FLINK-3755,

[jira] [Created] (FLINK-4384) Add a "scheduleRunAsync()" feature to the RpcEndpoint

Stephan Ewen created FLINK-4384: --- Summary: Add a "scheduleRunAsync()" feature to the RpcEndpoint Key: FLINK-4384 URL: https://issues.apache.org/jira/browse/FLINK-4384 Project: Flink Issue

Re: [DISCUSS] Breaking Savepoint Compatibility from 1.1 to 1.2

Hi, I think this is a very important change for the the future of the system that provides a much cleaner internal representation of the states. You are right that this can in theory break programs written in 1.1 when upgraded to 1.2 but I wonder if this will be actually a practical problem in

[jira] [Created] (FLINK-4383) Check parameters for serializability before sending a remote RpcInvocation message

Till Rohrmann created FLINK-4383: Summary: Check parameters for serializability before sending a remote RpcInvocation message Key: FLINK-4383 URL: https://issues.apache.org/jira/browse/FLINK-4383

[jira] [Created] (FLINK-4382) Buffer rpc calls until RpcEndpoint is properly started

Till Rohrmann created FLINK-4382: Summary: Buffer rpc calls until RpcEndpoint is properly started Key: FLINK-4382 URL: https://issues.apache.org/jira/browse/FLINK-4382 Project: Flink Issue

[DISCUSS] Breaking Savepoint Compatibility from 1.1 to 1.2

Hi, Stefan and I are currently working on preparing our state infrastructure for the introduction of key-grouped state. This is the parent issue for key-grouped state https://issues.apache.org/jira/browse/FLINK-3755 while this is the specific issue that we are currently working on

[jira] [Created] (FLINK-4381) Refactor State to Prepare For Key-Group State Backends

Aljoscha Krettek created FLINK-4381: --- Summary: Refactor State to Prepare For Key-Group State Backends Key: FLINK-4381 URL: https://issues.apache.org/jira/browse/FLINK-4381 Project: Flink

[jira] [Created] (FLINK-4380) Introduce KeyGroupAssigner and Max-Parallelism Parameter

Aljoscha Krettek created FLINK-4380: --- Summary: Introduce KeyGroupAssigner and Max-Parallelism Parameter Key: FLINK-4380 URL: https://issues.apache.org/jira/browse/FLINK-4380 Project: Flink

[jira] [Created] (FLINK-4379) Add Rescalable Non-Partitioned State

Ufuk Celebi created FLINK-4379: -- Summary: Add Rescalable Non-Partitioned State Key: FLINK-4379 URL: https://issues.apache.org/jira/browse/FLINK-4379 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-4378) Enable RollingSink to custom HDFS client configuration

Wenlong Lyu created FLINK-4378: -- Summary: Enable RollingSink to custom HDFS client configuration Key: FLINK-4378 URL: https://issues.apache.org/jira/browse/FLINK-4378 Project: Flink Issue Type:

[jira] [Created] (FLINK-4377) akka.remote.OversizedPayloadException: Discarding oversized payload

Sajeev Ramakrishnan created FLINK-4377: -- Summary: akka.remote.OversizedPayloadException: Discarding oversized payload Key: FLINK-4377 URL: https://issues.apache.org/jira/browse/FLINK-4377

Re: expose side output stream

Hi! This is a very big change, both on the semantics, the runtime classes. These changes are tricky to get in, and usually work best if you document the changes and all implications well. Something like a deep design doc, or a FLIP would be great for this.

[jira] [Created] (FLINK-4376) implement job manager init procedure

Wenlong Lyu created FLINK-4376: -- Summary: implement job manager init procedure Key: FLINK-4376 URL: https://issues.apache.org/jira/browse/FLINK-4376 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4375) defined rpc protocols provided by job manager

Wenlong Lyu created FLINK-4375: -- Summary: defined rpc protocols provided by job manager Key: FLINK-4375 URL: https://issues.apache.org/jira/browse/FLINK-4375 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4374) GroupReduce Broken for null Date

Stefan Richter created FLINK-4374: - Summary: GroupReduce Broken for null Date Key: FLINK-4374 URL: https://issues.apache.org/jira/browse/FLINK-4374 Project: Flink Issue Type: Bug

Re: N-ary stream operators - status

Hi Theo, I think currently, there is nobody actively working on side inputs. Thus, it might be possible that they don't make it in the 1.2 release. Cheers, Till On Wed, Aug 10, 2016 at 10:41 PM, Theodore Vasiloudis < theodoros.vasilou...@gmail.com> wrote: > Hello Aljoscha, > > Do you think the

Re: [DISCUSS] Streaming connector contributions

Thank you for your responses. I will get in touch with the Bahir community to see what they are thinking about this. Once we know a bit more about the details of such a collaboration, we can make a final decision here. On Tue, Aug 9, 2016 at 3:47 PM, Till Rohrmann wrote: >

[ANNOUNCE] Flink 1.1.1 Released

The Flink PMC is pleased to announce the availability of Flink 1.1.1. The Maven artifacts published on Maven central for the previous 1.1.0 version had a Hadoop dependency issue. No Hadoop 1 specific version (with version 1.1.0-hadoop1) was deployed and the 1.1.0 artifacts have a dependency on