Re: Distributing Python code packaged as tar balls

Thank you for the reply. I am using zip files for now. Documentation for 1.5.2 mentions use of zip files or eggs, maybe a 'note' that tar's are not supported might be helpful to some. https://spark.apache.org/docs/latest/submitting-applications.html Best Regards, Praveen On 14.11.2015 00:40,

Re: Distributing Python code packaged as tar balls

Python does not support library as tar balls, so PySpark may also not support that. On Wed, Nov 4, 2015 at 5:40 AM, Praveen Chundi wrote: > Hi, > > Pyspark/spark-submit offers a --py-files handle to distribute python code > for execution. Currently(version 1.5) only zip

Distributing Python code packaged as tar balls

Hi, Pyspark/spark-submit offers a --py-files handle to distribute python code for execution. Currently(version 1.5) only zip files seem to be supported, I have tried distributing tar balls unsuccessfully. Is it worth adding support for tar balls? Best regards, Praveen Chundi