Hi,
I am trying to connect to a new cluster I just set up.
And I get...
[Timer-0:WARN] Logging$class: Initial job has not accepted any resources; check
your cluster UI to ensure that workers are registered and have sufficient
resources
I must have forgotten something really super obvious.
My connection code is:
SparkSession spark = SparkSession.builder()
.appName("JavaSparkPi")
.master("spark://10.0.100.81:7077")
.config("spark.executor.memory", "4g")
.config("spark.executor.cores", "2")
.getOrCreate();
My master is on 10.0.100.81, start with a simple start-master.sh. I have 2
nodes, which i run with ./sbin/start-slave.sh spark://un.oplo.io:7077
<spark://un.oplo.io:7077>.
I use Spark's own resource scheduler.
jg