Re: PySpark 1.6.1: 'builtin_function_or_method' object has no attribute '__code__' in Pickles

Hi Glad that your problem is resolved. spark-submit is the recommended way of submitting application (Pyspark internally does spark-submit) Yes, the process remains same single node vs multiple node. However, I would suggest to use any of the cluster mode instead of the local mode. In single

RE: PySpark 1.6.1: 'builtin_function_or_method' object has no attribute '__code__' in Pickles

pache.org> Subject: Re: PySpark 1.6.1: 'builtin_function_or_method' object has no attribute '__code__' in Pickles I'm very new to Spark. Im running it on a single CentOS7 box. How would I add a test.py to spark submit? Point to any resources would be great. Thanks for your help. On Sat, Jul 30,

Re: PySpark 1.6.1: 'builtin_function_or_method' object has no attribute '__code__' in Pickles

I'm very new to Spark. Im running it on a single CentOS7 box. How would I add a test.py to spark submit? Point to any resources would be great. Thanks for your help. On Sat, Jul 30, 2016 at 1:28 AM, ayan guha wrote: > I think you need to add test.py in spark submit so that

Re: PySpark 1.6.1: 'builtin_function_or_method' object has no attribute '__code__' in Pickles

I think you need to add test.py in spark submit so that it gets shipped to all executors On Sat, Jul 30, 2016 at 3:24 PM, Bhaarat Sharma wrote: > I am using PySpark 1.6.1. In my python program I'm using ctypes and trying > to load the liblept library via the

PySpark 1.6.1: 'builtin_function_or_method' object has no attribute '__code__' in Pickles

I am using PySpark 1.6.1. In my python program I'm using ctypes and trying to load the liblept library via the liblept.so.4.0.2 file on my system. While trying to load the library via cdll.LoadLibrary("liblept.so.4.0.2") I get an error : 'builtin_function_or_method' object has no attribute