Hi all, I have a process where local mode takes only 40 seconds. While the same on stand-alone mode, being the same node used for local mode the only available node, is taking up for ever. rdd actions hang up.
I could only "sort this out" by turning speculation on, so the same task hanging is retried and then it works. Sadly, this does not help on huge tasks. How could I diagnose this fruther? Thanks, Saif