Hi Users, When action(I am using count and write) gets executed in my spark job , it launches many more application instances(around 25 more apps).
In my spark code , I am running the transformations through Dataframes then converting dataframe to rdd then applying zipwithindex , then converting it back to dataframe and then applying 2 actions(Count & Write). Please note : This was working fine till the previous week, it has started giving this issue since yesterday. Could you please tell what can be the reason for this behavior? Kind Regards, Sachit Murarka
