Hi, I am working on spark 1.4 . I am running a spark job on a yarn cluster .When number of other jobs are less then my spark job completes very smoothly and when more number of small job run on the cluster my spark job starts showing schedular delay at the end on each stage.
PS:I am running my spark job in high priority queue. PLEASE SUGGEST SOME SOLUTION Thanks & Regards, Renu Yadav