Re: Streaming Iterations, no headOperator ?

Hi, the iteration operators (head and tail) don't have a StreamOperator, they are pure tasks. On Sat, Jan 2, 2016, 21:08 Matthias J. Sax wrote: > Hi, > > I am working on FLINK-1870 and my changes break some unit tests. The > problem is in streaming.api.IterateTest. > > I tracked the problem down

Streaming Iterations, no headOperator ?

Hi, I am working on FLINK-1870 and my changes break some unit tests. The problem is in streaming.api.IterateTest. I tracked the problem down to StreamTask.registerInputOutput(). It calls headOperator.setup(...). My changes depend on this call, however, there is no head operator (ie, ==null), and

Re: Checkpointing to S3

Ok, I could figure out the problem, it was my fault :). The issue was that I was running a short testing job and the sources finished before triggering the checkpoint. So the folder was created for the job in S3 but since we didn't write anything to it is shown as a file in S3. Maybe it would be g

Checkpointing to S3

Hey, I am trying to checkpoint my streaming job to S3 but it seems that the checkpoints never complete but also I don't get any error in the logs. The state backend connects properly to S3 apparently as it creates the following file in the given S3 directory : 95560b1acf5307bc3096020071c83230_$f

[jira] [Created] (FLINK-3198) Rename Grouping.getDataSet() method and add JavaDocs

Fabian Hueske created FLINK-3198: Summary: Rename Grouping.getDataSet() method and add JavaDocs Key: FLINK-3198 URL: https://issues.apache.org/jira/browse/FLINK-3198 Project: Flink Issue Type