Re: ignite in yarn

Hello Ranjit! Just a few days ago there were discussions where we set up Ignite with YARN. Steps to run it (on AWS in that case) are described here: http://apache-ignite-users.70518.x6.nabble.com/Error-running-ignite-in-YARN-td18280.html#a18577 (Hopefully you won't need to apply patch

ignite in yarn

Hi , Can anyone share the experience of using ignite in yarn mode and the steps to set it up in CDH ? Thanks, Ranjit

Re: Error running ignite in YARN

Hello Juan! Thank you for the hints! With this, I was able to run Ignite on YARN with your configuration and my patch. The patch from IGNITE-7080 was already merged to master by N. Tikhonov, so it will be included in the next versions. Note that there are still usability issues. I would be glad

Re: Error running ignite in YARN

Hi Ilya, Thanks a lot for your help, I'll try and the test the patch. Regarding how I run this, I wait for the cluster to enter in WAITING state and then I ssh to the master node as described in https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-connect-master-node-ssh.html, and then I ju

Re: Error running ignite in YARN

Hello once more! I have prepared a patch. I think it won't be hard for you to try it out since you are accustomized to building Ignite. Please try it, tell if it solves the current issue. ignite-7080.patch I was tryi

Re: Error running ignite in YARN

Hello again! After a close examination I have discovered a problem between Ignite YARN and Hadoop code: Ignite YARN collects all existing environment variables to pass them to container, including variables with incorrect names, such as Bash functions, which have extra characters at the end, and

Re: Error running ignite in YARN

Hello Juan! We are looking into the Yarn portion of this case. Meanwhile, could you tell us what happens if tou fix launch_container.sh script? I believe it should be export BASH_FUNC_run_prestart="() { su -s /bin/bash $SVC_USER -c "cd $WORKING_DIR && $EXEC_PATH --config '$CONF_DIR' start $DA

Re: Error running ignite in YARN

Hi, Any thoughts on this? Do you need any further details about the setup? Thanks, Juan On Tue, Nov 21, 2017 at 8:59 AM, Juan Rodríguez Hortalá < juan.rodriguez.hort...@gmail.com> wrote: > Hi, > > Anyone might help a newbie ramping up with Ignite on YARN? > > Thanks, > > Juan > > > On Sun, Nov

Re: Error running ignite in YARN

Hi, Anyone might help a newbie ramping up with Ignite on YARN? Thanks, Juan On Sun, Nov 19, 2017 at 7:34 PM, Juan Rodríguez Hortalá < juan.rodriguez.hort...@gmail.com> wrote: > Hi, > > I'm trying to run ignite on AWS EMR as a YARN application, using zookeeper > for node discovery. I have comp

Error running ignite in YARN

Hi, I'm trying to run ignite on AWS EMR as a YARN application, using zookeeper for node discovery. I have compiled ignite with ``` mvn clean package -DskipTests -Dignite.edition=hadoop -Dhadoop.version=2.7.3 ``` I'm using ignite_yarn.properties ``` # The number of nodes in the cluster. IGNITE_N