Hi, I have 20 node clusters. I run multiple batch jobs. in spark submit file ,driver memory=2g and executor memory=4g and I have 8 GB worker. I have below questions
1. Is there any way I know in each batch job which worker is the driver node? 2. Will the driver node be part of one of the executors or it is independent ? Thanks Amit