.setJars(List("C:\\Temp\\test.jar"));
val sc = new SparkContext(conf);
val textFile = sc.textFile("hdfs://10.20.17.70:9000/wc/indata/wht.txt");
textFile.flatMap(_.split(" ")).map((_,
1)).reduceByKey(_+_).collect().foreach(println);
}
}
--
View thi
Hokam Singh Chauhan";;
: 2015??12??24??(??) ????10:54
??????: "Akhil Das";
: "user"; "????";
: Re: Problem of submitting Spark task to cluster from eclipse IDE on
Windows
Hi,
Use spark://hostname:7077 as spark master if you are using I
ala
>> WordCount").setMaster("spark://10.20.17.70:7077
>> ").setJars(List("C:\\Temp\\test.jar"));
>> val sc = new SparkContext(conf);
>> val textFile = sc.textFile("hdfs://10.20.17.70:9000/wc/indata/wht.txt
>> ");
>> t
clipse-scala plugin.
> (2) run spark-submit on the SparkPi examle by specifying the --master
> param to "10.20.17.70:7077", and it successfully worked out the result. I
> was also able to see the application history on the Master's Web UI.
> (3) I turned off the
turned off the firewall on my Windows machine.
Unfortunately, the error message remains. Could anybody give me some
suggestions ? Thanks very much!
Yours Sincerely,
Yefeng
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Problem-of-submitting-Spark-task-to-
