[jira] [Created] (FLINK-9902) Improve and refactor window checkpointing IT cases

2018-07-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9902: - Summary: Improve and refactor window checkpointing IT cases Key: FLINK-9902 URL: https://issues.apache.org/jira/browse/FLINK-9902 Project: Flink Issue Type

[jira] [Created] (FLINK-9903) Add support for bulk writers.

2018-07-20 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-9903: - Summary: Add support for bulk writers. Key: FLINK-9903 URL: https://issues.apache.org/jira/browse/FLINK-9903 Project: Flink Issue Type: Sub-task

Idea for preventing OOM in continuous queries of Flink SQL by implementing a "spillable" StateTable

2018-07-20 Thread kyled...@connect.hku.hk
Hi everyone, I am currently dealing with an OOM issue caused by continuous queries in Flink SQL (for example, a GROUP BY clause without a window). After looking into Flink's Runtime & Core module, I found that as time goes by, StateTables in the HeapKeyedStateBackend grows larger and larger, b

Re: Idea for preventing OOM in continuous queries of Flink SQL by implementing a "spillable" StateTable

2018-07-20 Thread Stefan Richter
Hi, > > I am currently dealing with an OOM issue caused by continuous queries in > Flink SQL (for example, a GROUP BY clause without a window). After looking > into Flink's Runtime & Core module, I found that as time goes by, StateTables > in the HeapKeyedStateBackend grows larger and larger,

[jira] [Created] (FLINK-9904) Allow users to control MaxDirectMemorySize

2018-07-20 Thread Himanshu Roongta (JIRA)
Himanshu Roongta created FLINK-9904: --- Summary: Allow users to control MaxDirectMemorySize Key: FLINK-9904 URL: https://issues.apache.org/jira/browse/FLINK-9904 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-9905) ClassCastException: org.apache.flink.streaming.runtime.streamrecord.LatencyMarker

2018-07-20 Thread Gregory Fee (JIRA)
Gregory Fee created FLINK-9905: -- Summary: ClassCastException: org.apache.flink.streaming.runtime.streamrecord.LatencyMarker Key: FLINK-9905 URL: https://issues.apache.org/jira/browse/FLINK-9905 Project:

Cherry picking FLINK-9753 and FLINK-9753 on release-1.6

2018-07-20 Thread Kostas Kloudas
Hi all, We just merged on the master [FLINK-9753] (commit 66b1f854a0250bdd048808d40f93aa2990476841) and [FLINK-9903] (commit b56c75ca375049b1d2c80d2d0945ae1ae04eb39e). These two commits introduce: 1) a big refactoring to the new StreamingFileSink which allows it to support bulk formats in gene