Hi, All When I run spark applications, I see from the web-ui that some stage description are like "apply at Option.scala:120". Why spark splits a stage on a line that is not in my spark program but a Scala library?
Thanks Jensen
Hi, All When I run spark applications, I see from the web-ui that some stage description are like "apply at Option.scala:120". Why spark splits a stage on a line that is not in my spark program but a Scala library?
Thanks Jensen