Re: ignition on yarn taking up all memory

2016-08-19 Thread prasanth
I had to copy config file to all boxes on cluster at same location. can we use hdfs instead? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/ignition-on-yarn-taking-up-all-memory-tp7161p7177.html Sent from the Apache Ignite Users mailing list archive at Nabble.co

Re: ignition on yarn taking up all memory

2016-08-19 Thread prasanth
Nevermind, from https://github.com/apache/ignite/pull/740 , it looks like parameters were taken off. The following works: val ic = new IgniteContext(sc, "config/default-config.xml") Now, when I execute, the following line: sharedRDD.filter(_._2 < 10).collect() I get errors: [Stage 0:>

Re: ignition on yarn taking up all memory

2016-08-19 Thread prasanth
Cool. That worked. Now the memory is around 5GB. In spark-shell, when I give val ic = new IgniteContext[Integer, Integer](sc, "config/default-config.xml") I get, error: org.apache.ignite.spark.IgniteContext does not take type parameters Which means, something is wrong right? When I remove th

ignition on yarn taking up all memory

2016-08-18 Thread prasanth
I started ignite on yarn and then tried to submit a sample spark job. The ignition job took all available memory and so spark job was in "accepted" state forever. Spark job never had enough resources to run. So, I copied the following file to hdfs path /tmp/ignite and gave IGNITE_XML_CONFIG=/tmp/

Re: yarn deployment

2016-08-17 Thread prasanth
Yes, that worked. Thank you. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/yarn-deployment-tp6843p7142.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: yarn deployment

2016-08-10 Thread prasanth
I downloaded the binary from here https://ignite.apache.org/download.cgi Do I have to copy the entire unzipped folder to HDFS and provide the root folder location of that? Thank you! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/yarn-deployment-tp6843p6938.h

Re: yarn deployment

2016-08-09 Thread prasanth
bump... -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/yarn-deployment-tp6843p6885.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

yarn deployment

2016-08-07 Thread prasanth
I am trying to follow instructions here https://apacheignite.readme.io/docs/yarn-deployment for version 1.7.0 I get the following error when I try to run hadoop jar ignite-yarn-.jar Exception in thread "main" java.lang.RuntimeException: Got unexpected response code. Response code: 403 at