Could any one please tell me why this takes forever to finish?

2017-04-28 Thread Yuan Fang
object SparkPi { private val logger = Logger(this.getClass) val sparkConf = new SparkConf() .setAppName("Spark Pi") .setMaster("spark://10.100.103.192:7077") lazy val sc = new SparkContext(sparkConf) sc.addJar("/Users/yfang/workspace/mcs/target/scala-2.11/root-assembly-0.1.0.jar")

Why "Initial job has not accepted any resources"?

2017-04-27 Thread Yuan Fang
Here is my code. It works on local. setMaster("local[*]"). But it does not work for my remote spark cluster. I checked all logs. I did not find any error. It shows the following warning. Could you please help? Thank you very very much! 14:45:47.956 [Timer-0] WARN org.apache.spark.scheduler.TaskSch