Hi, All Before sc.runJob invokes dagScheduler.runJob, the func performed on the rdd is "cleaned" by ClosureCleaner.clearn. Why spark has to do this? What's the purpose?
- The function of ClosureCleaner.clean Wang, Jensen
- Re: The function of ClosureCleaner.clean Mayur Rustagi
- RE: The function of ClosureCleaner.clean Wang, Jensen