Hi All, I have spark deployed to an EC2 cluster and were able to run jobs successfully when drive is reside within the cluster. However, job was killed when I tried to submit it from local. My guess is spark cluster can’t open connection back to the driver since it is on my machine.
I’m wondering if spark actually support submitting jobs from local? If so, would you please advise? Many thanks in advance! YK --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
