Hi Mailing List, I want to write and read intermediates to/from disk. The following foo- codesnippet may illustrate my intention:
public void mapPartition(Iterable<T> tuples, Collector<T> out) { for (T tuple : tuples) { if (Condition) out.collect(tuple); else writeTupleToDisk } While ('TupleOnDisk') out.collect('ReadNextTupleFromDisk'); } I'am wondering if flink provides an integrated class for this purpose. I also have to precise identify the files with the intermediates due parallelism of mapPartition. Thank you in advance! Robert