Hello,

I want to implement a DAGScheduler that ensures that all (or some) map
vertices of a given dag are not scheduled immediately, but say after a
configurable amount of time, T.

I can think to do this in 3 following ways:

1. I would buffer all the "scheduleTask" events and then raise
"TaskAttemptEventSchedule" after time, T. For this, I would need a clock
with in DAGScheduler. I can also subscribe to an event raised periodically.
Is there such an eventGenerator in Tez ?

2. Using delayed events. Is there support to raised delayed events ?

3. Modify the priority levels in "DAGSchedulerNaturalOrderControlled" based
on T, to delay the start of vertices ?


Which of the three is easiest to implement and possibly have limited
side-effects ? Any help/pointers is appreciated.

Thanks
Raajay

Reply via email to