Hi,
is there a way to use custom python module that is available to all executors 
under PYTHONPATH (without a need to upload it using sc.addPyFile()) - bit weird 
that this module is on all nodes yet the spark tasks can't use it (references 
to its objects are serialized and sent to all executors but since the module 
doesn't get imported the calls fail).
thanks,Antony.

Reply via email to