I had to copy config file to all boxes on cluster at same location. can we
use hdfs instead?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/ignition-on-yarn-taking-up-all-memory-tp7161p7177.html
Sent from the Apache Ignite Users mailing list archive at Nabble.co
Nevermind, from https://github.com/apache/ignite/pull/740 , it looks like
parameters were taken off.
The following works:
val ic = new IgniteContext(sc, "config/default-config.xml")
Now, when I execute, the following line:
sharedRDD.filter(_._2 < 10).collect()
I get errors:
[Stage 0:>
Cool. That worked. Now the memory is around 5GB.
In spark-shell, when I give
val ic = new IgniteContext[Integer, Integer](sc,
"config/default-config.xml")
I get,
error: org.apache.ignite.spark.IgniteContext does not take type parameters
Which means, something is wrong right?
When I remove th
I started ignite on yarn and then tried to submit a sample spark job. The
ignition job took all available memory and so spark job was in "accepted"
state forever. Spark job never had enough resources to run.
So, I copied the following file to hdfs path /tmp/ignite and gave
IGNITE_XML_CONFIG=/tmp/
Yes, that worked. Thank you.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/yarn-deployment-tp6843p7142.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
I downloaded the binary from here https://ignite.apache.org/download.cgi
Do I have to copy the entire unzipped folder to HDFS and provide the root
folder location of that?
Thank you!
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/yarn-deployment-tp6843p6938.h
bump...
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/yarn-deployment-tp6843p6885.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
I am trying to follow instructions here
https://apacheignite.readme.io/docs/yarn-deployment for version 1.7.0
I get the following error when I try to run hadoop jar
ignite-yarn-.jar
Exception in thread "main" java.lang.RuntimeException: Got unexpected
response code. Response code: 403
at