I'm interested to see if anyone knows of a way to have custom job/stage name for Spark Application.
I believe I can use *sparkContext.setCallSite(String)* to update job/stage names but it does not let me update each stage name, setting this value will set same text for all job and stage names for that application. Anyone has done something like this before or have thoughts about have custom stage names? On a side note, what is the benefit of having a friendly name for RDD ( RDD.name() ) Thanks, Nithin