Re: Adding h5 files in a zip to use with PySpark

Thanks! That worked! :) And to read the files, I used pyspark.SparkFiles module. On Thu, Jun 16, 2016 at 7:12 AM, Sun Rui wrote: > have you tried > --files ? > > On Jun 15, 2016, at 18:50, ar7 wrote: > > > > I am using PySpark 1.6.1 for my spark

Re: Adding h5 files in a zip to use with PySpark

have you tried --files ? > On Jun 15, 2016, at 18:50, ar7 wrote: > > I am using PySpark 1.6.1 for my spark application. I have additional modules > which I am loading using the argument --py-files. I also have a h5 file > which I need to access from one of the modules for

Adding h5 files in a zip to use with PySpark

I am using PySpark 1.6.1 for my spark application. I have additional modules which I am loading using the argument --py-files. I also have a h5 file which I need to access from one of the modules for initializing the ApolloNet. Is there any way I could access those files from the modules if I put