Re: Ignite behaving strange with Spark SharedRDD in AWS EMR Yarn Client Mode

2017-08-08 Thread raksja
Thanks for your reply Val. We tried that, now it stopped spinning up several servers, all of those became clients now (I still dont know the difference). But still just for a single row rdd it takes several minutes to retrieve it. It still spins up 100s of executor even though i specify 1 execut

Ignite behaving strange with Spark SharedRDD in AWS EMR Yarn Client Mode

2017-08-04 Thread raksja
Hi, We are evaluating Ignite and our ultimate goal is to share an rdd between multiple spark jobs. So one job can cache its computation in ignite and other can use that for its computation. We setup ignite server in master node & 6 worker nodes of AWS EMR cluster and ran the spark-submit with Sca

Re: Amazon AMI not available in a specific region

2017-08-01 Thread raksja
Thanks for quick turn around that helped. Also do you know/any one how to install ignite in EMR worker nodes? Looks like there's no straight forward way. Any help or suggestions? On Tue, Aug 1, 2017, 5:33 AM Nikolai Tikhonov [via Apache Ignite Users] < ml+s70518n15854...@n6.nabble.com> wrote: >