Re:Re: Re: spark uploading resource error

2016-05-10 Thread
2016 at 4:17 PM, 朱旻 <z...@126.com> wrote: it was a product sold by huawei . name is FusionInsight. it says spark was 1.3 with hadoop 2.7.1 where can i find the code or config file which define the files to be uploaded? At 2016-05-10 16:06:05, "Saisai Shao" <s

Re:Re: spark uploading resource error

2016-05-10 Thread
of Spark are you using? From my understanding, there's no code in yarn#client will upload "__hadoop_conf__" into distributed cache. On Tue, May 10, 2016 at 3:51 PM, 朱旻 <z...@126.com> wrote: hi all: I found a problem using spark . WHEN I use spark-submit to launch a tas

spark uploading resource error

2016-05-10 Thread
hi all: I found a problem using spark . WHEN I use spark-submit to launch a task. it works spark-submit --num-executors 8 --executor-memory 8G --class com.icbc.nss.spark.PfsjnlSplit --master yarn-cluster /home/nssbatch/nss_schedual/jar/SparkBigtableJoinSqlJava.jar