Re: [DISCUSS] Flink security improvements

Thanks a lot, Till and Eron, for the updates. I'll try to pin this thread after 1.5 release. Also let me know how I can help more with Flink 1.5. I am currently working on adding e2e test for kerberos and cassandra. On Wed, Mar 21, 2018 at 8:16 AM, Eron Wright wrote: > Please accept my apologie

Re: Flip 6 mesos support

Hi, Till: Has anybody succeeded to deploy flip 6 mode on mesos? I'm testing flip 6 using the master branch and I just can't run jobs. The following are my configurations: *jobmanager.rpc.address: qt9ss.prod.mediav.com * *jobmanager.rpc.port: 6123* *jobmanager.heap.mb

[jira] [Created] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

Jamie Grier created FLINK-9061: -- Summary: S3 checkpoint data not partitioned well -- causes errors and poor performance Key: FLINK-9061 URL: https://issues.apache.org/jira/browse/FLINK-9061 Project: Flin

Errors checkpointing to S3 for high-scale jobs

I think we need to modify the way we write checkpoints to S3 for high-scale jobs (those with many total tasks). The issue is that we are writing all the checkpoint data under a common key prefix. This is the worst case scenario for S3 performance since the key is used as a partition key. In the

[jira] [Created] (FLINK-9060) Deleting state using KeyedStateBackend.getKeys() throws Exception

Aljoscha Krettek created FLINK-9060: --- Summary: Deleting state using KeyedStateBackend.getKeys() throws Exception Key: FLINK-9060 URL: https://issues.apache.org/jira/browse/FLINK-9060 Project: Flink

[jira] [Created] (FLINK-9059) Add support for unified table source and sink declaration in environment file

Shuyi Chen created FLINK-9059: - Summary: Add support for unified table source and sink declaration in environment file Key: FLINK-9059 URL: https://issues.apache.org/jira/browse/FLINK-9059 Project: Flink

[jira] [Created] (FLINK-9058) Relax ListState.addAll() and ListState.update() to take Iterable

Aljoscha Krettek created FLINK-9058: --- Summary: Relax ListState.addAll() and ListState.update() to take Iterable Key: FLINK-9058 URL: https://issues.apache.org/jira/browse/FLINK-9058 Project: Flink

[jira] [Created] (FLINK-9057) NPE in CreditBasedSequenceNumberingViewReader when cancelling before initilization was complete

Nico Kruber created FLINK-9057: -- Summary: NPE in CreditBasedSequenceNumberingViewReader when cancelling before initilization was complete Key: FLINK-9057 URL: https://issues.apache.org/jira/browse/FLINK-9057

[jira] [Created] (FLINK-9056) Job submission fails with AskTimeoutException if not enough slots are available

Fabian Hueske created FLINK-9056: Summary: Job submission fails with AskTimeoutException if not enough slots are available Key: FLINK-9056 URL: https://issues.apache.org/jira/browse/FLINK-9056 Project

Re: [ANNOUNCE] Weekly community update #12

Eron pointed out to me that the Flink improvement proposal 6 (short Flip-6) deserves some more comments since not everyone will be aware of what it actually means. I totally agree and will try to give a bit more context for everyone interested. Flip-6 is intended to solve some of the Flink's short

[jira] [Created] (FLINK-9055) WebUI shows job as Running although not enough resources are available

Fabian Hueske created FLINK-9055: Summary: WebUI shows job as Running although not enough resources are available Key: FLINK-9055 URL: https://issues.apache.org/jira/browse/FLINK-9055 Project: Flink

Re: [Proposal] CEP library changes - review request

To trigger the computations for each batch, I'll have to use the processing time timer in the abstract keyed cep operator, right? The reason why I'm avoiding the watermarks is that it is not possible to generate watermarks per key. Thanks for the 'within' remark. A couple of questions: 1. Given

Re: [Proposal] CEP library changes - review request

If you do the buffering you can emit watermark for each such batch (equal to highest timestamp in such batch). This way you won’t need to sort. CEP library will do it for you. The within clause will work in EventTime then. One more remark also the within clause always work for whole pattern not

[jira] [Created] (FLINK-9054) IllegalStateException: Buffer pool is destroyed

dhiraj prajapati created FLINK-9054: --- Summary: IllegalStateException: Buffer pool is destroyed Key: FLINK-9054 URL: https://issues.apache.org/jira/browse/FLINK-9054 Project: Flink Issue Typ

[jira] [Created] (FLINK-9053) RescalingITCase failed on travis

Chesnay Schepler created FLINK-9053: --- Summary: RescalingITCase failed on travis Key: FLINK-9053 URL: https://issues.apache.org/jira/browse/FLINK-9053 Project: Flink Issue Type: Bug