Hi, Looks like the ordering of your parameters to spark submit is different on Windows vs EMR. I assume the -h flag is for an arguments for your python script? In that case you'll need to put the arguments after the python script.
Daniel On 1 Dec 2016 6:24 a.m., "Patnaik, Vandana" <vandana.patn...@infogroup.com> wrote: > Hello All, > > I am new to spark and am wondering how to pass an optional argument to my > python program using SPARK-SUBMIT. > > This works fine on my local machine but not on AWS EMR: > > On Windows: > C:\Vandana\spark\examples>..\bin\spark-submit new_profile_csv1.py -h 0 > -t exam ple_float.txt On EMR: > spark-submit -h 0 How.py hdfs://10.1.X.XXX:8020/user/hadoop/hello.dat > > This does not work.. > > Thanks > > Vandana > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
