withPartitioner() vs calling partitionCustom() beforehand

2018-12-02 Thread Giannis Evagorou
Hi all, I have a question regarding partitioning. Does calling the withPartitioner() method on a coGroup operation has the same effect as performing partitionCustom on both datasets beforehand? i.e. Is 1. a.coGroup(b).where(…).equalTo(…).withPartitioner(…).with(…) equivalent to: 1. Da

[jira] [Created] (FLINK-11047) CoGroupGroupSortTranslationTest does not compile with scala 2.12

2018-12-02 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-11047: Summary: CoGroupGroupSortTranslationTest does not compile with scala 2.12 Key: FLINK-11047 URL: https://issues.apache.org/jira/browse/FLINK-11047 Project: Fli

[jira] [Created] (FLINK-11048) Ability to programmatically execute streaming pipeline with savepoint restore

2018-12-02 Thread Thomas Weise (JIRA)
Thomas Weise created FLINK-11048: Summary: Ability to programmatically execute streaming pipeline with savepoint restore Key: FLINK-11048 URL: https://issues.apache.org/jira/browse/FLINK-11048 Proje

[DISCUSS] Unified Core API for Streaming and Batch

2018-12-02 Thread 孙海波
Hi all, This post proposes unified core API for Streaming and Batch. Currently DataStream and DataSet adopt separated compilation processes, execution tasks and basic programming models in the runtime layer, which complicates the system implementation. We think that batch jobs can be processed

[jira] [Created] (FLINK-11049) Unable to execute partial DAG

2018-12-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-11049: -- Summary: Unable to execute partial DAG Key: FLINK-11049 URL: https://issues.apache.org/jira/browse/FLINK-11049 Project: Flink Issue Type: Bug Component

[jira] [Created] (FLINK-11050) When IntervalJoin, get left or right buffer's entries more quickly by assigning lowerBound

2018-12-02 Thread Liu (JIRA)
Liu created FLINK-11050: --- Summary: When IntervalJoin, get left or right buffer's entries more quickly by assigning lowerBound Key: FLINK-11050 URL: https://issues.apache.org/jira/browse/FLINK-11050 Project: Fli