Re: Question on Task Chaining

2015-11-07 Thread Isha Arkatkar
Thanks Stephan! That helps :) Regards, Isha On Sat, Nov 7, 2015 at 7:08 AM, Stephan Ewen wrote: > Hi! > > Chained tasks run in the same thread, and there is no serialization > involved. The FilterFunction is directly called on the result of the > MapFunction. > > Records between non-chained tas

Re: Question on Task Chaining

2015-11-07 Thread Stephan Ewen
Hi! Chained tasks run in the same thread, and there is no serialization involved. The FilterFunction is directly called on the result of the MapFunction. Records between non-chained tasks always go through the serialization stack. Even in the case of non-chained tasks, the different operators sh

Question on Task Chaining

2015-11-06 Thread Isha Arkatkar
Hi all, I am new to flink and wanted to understand effects of setting task chaining and resource group allocation. I tried following configurations, with task slots set to 2: 1. map(..).disableChaining.filter(..) In this case, I can see 2 vertices for this application, both on the same no