Re: Yarn Ignite Container Automatically exit when other yarn application running

Hi, Did you use kerberos authentication for YARN? On Fri, Sep 2, 2016 at 3:46 AM, percent620 wrote: > but from yarn contains, i can't find any errors. > > > sometimes the yarn am ignite was shutdown down(and sometimes restart a new > AM, i don't know why)? > > > > -- > View

Re: why allocated containers much more than INGNITE_NODE_COUNT?

Val, Shirely Yes. our YARN integration does not support win environment. I've created ticket on it https://issues.apache.org/jira/browse/IGNITE-3850 On Wed, Sep 7, 2016 at 5:23 AM, vkulichenko wrote: > Nikolai, > > Is this a bug? Should we create a ticket? > >

Re: why allocated containers much more than INGNITE_NODE_COUNT?

Hi, Could you try to run examples over YARN (for example http://wiki.apache.org/hadoop/WordCount)? If it works could you share your ignite-yarn configuration file? On Tue, Aug 30, 2016 at 12:19 PM, shirely wrote: > hi, > Thanks for your advise. I found that launch

Re: Spring application context resource is not injected exception while starting ignite in jdbc driver mode

Andery, It's for guarantee consistency. We should update entries in store in one transaction how in Ignite. On Fri, Aug 26, 2016 at 2:01 PM, Andrey Gura wrote: > Val, > > Why we need store on client node in case of partitioned or replicated > cache? > > On Fri, Aug 26, 2016

Re: why allocated containers much more than INGNITE_NODE_COUNT?

Hi, It's looks like your containers failed and ignite yarn tries to start new containers. Could you share your configurations and logs from containers? On Tue, Aug 23, 2016 at 5:18 AM, shirely wrote: > well, I tried to integrate ignite with yarn and set IGNITE_NODE_COUNT

Re: Yarn Ignite Container Automatically exit when other yarn application running

Hi, Could you please show logs from container which was failed? On Fri, Aug 26, 2016 at 11:36 AM, percent620 wrote: > Hello, > > I faced important issues. I have deployed yarn ignite application > successfully. everything is okay. > > > But today, when others running spark

Re: Yarn deployment for memory capacity make a bigger than before: Urgent!!!

Hi, How I see from your logs, server node (which probably deployed by YARN) consumes 1Gb memory (per node). But client node consumes more memory how I see 4Gb. You can decrease memory consumption using -Xmx and -Xms jvm options for client nodes. On Wed, Aug 24, 2016 at 5:28 PM, percent620

Re: ignition on yarn taking up all memory

Hi, Ignite which running over YARN should occupies memory how set in IGNITE_MEMORY_PER_NODE property. Could you please share your config file? On Fri, Aug 19, 2016 at 9:24 AM, prasanth wrote: > I started ignite on yarn and then tried to submit a sample spark job. The >

Re: Re:Re: Ignite for Spark on YARN Deployment

Hi, Could you make sure that you have access from "driver" machine to machines on which running YARN? Could you ping them? On Fri, Aug 12, 2016 at 11:26 AM, percent620 wrote: > scala> [14:52:04] New version is available at ignite.apache.org: 1.7.0 > 16/08/12 14:52:46 ERROR

Re: Re:Re: Ignite for Spark on YARN Deployment

> > 3) I'm running spark-shell on driver machine NOT yarn cluster? > ignite-spark starts Ignite client node which should have direct access to YARN ignite cluster (have network access, open ports and etc).

Re: Re:Re: Ignite for Spark on YARN Deployment

Could you show logs from containers? spark-shell just hangs or print some logs? Also are you sure that you have direct access to machine on which running yarn cluster? On Thu, Aug 11, 2016 at 3:43 PM, percent620 wrote: > Hello, Nikolai, > 1、 > Just updated configuration

Re: Re:Re: Ignite for Spark on YARN Deployment

Hi, You can use hdfs path as hdfs://your_host:9000/ignite/release16/apache-ignite-fabric-1.6.0-bin/config/default-config.xml. Or you can just copy this config file on local disk. ;) You should use the same configuration, but it can be different files with the same content. On Thu, Aug 11, 2016

Re: Re:Re: Ignite for Spark on YARN Deployment

Great! Ignite YARN cluster successfully started, but ignite spark shell doesn't see server nodes. You need to configure IP finder, by default YARN cluster using VmIpFinder, but ignite-spark MulticastIpFinder. Could you change configuration for YARN cluster (IGNITE_XML_CONFIG=/ignite/

Re: Why there are no official 1.6.0 and 1.7.0 ignite docker images on Docker Hub?

Hi, I've updated apache ignite images on docker hub. Thank you for your attention. On Sun, Aug 7, 2016 at 12:18 AM, zshamrock wrote: > Why there is no official 1.6.0 and 1.7.0 ignite docker images on Docker Hub > https://hub.docker.com/r/apacheignite/ignite/tags/?

Re: Ignite for Spark on YARN Deployment

Hi, Could you please provide logs from containers? Also IGNITE_PATH property incorrect. The property should contains path to apache ignite zip archive. For example: /ignite/apache-ignite-fabric-1.7.0-bin.zip. Also IGNITE_USERS_LIBS not needed here. The property need to use when you want deploy to

Re: yarn deployment

Val, Yes, you are right. For example: /ignite/apache-ignite-fabric-1.7.0-bin.zip On Thu, Aug 11, 2016 at 2:16 AM, vkulichenko wrote: > To my knowledge you can upload the ZIP file and provide the path to it. No > need to unzip it manually. > > Nikolai, can you

Re: Client Reconnect Lifecycle with Continuous Queries

Hi, In your case, a client node will deploy CQ query on new nodes which will join to topology. Until you don't stop CQ (invoke close() method) or node (which started CQ) stays in topology you will getting events. On Thu, Aug 4, 2016 at 4:11 PM, barrettbnr wrote: > I'm

Re: yarn deployment

Hi, YARN could not download Ignite build. It's might be related with configuration your access to internet. You can configure IGNITE_PATH property. In this case ignite yarn will take a apache ignite build from hdfs [1]. [1] http://apacheignite.gridgain.org/v1.6/docs/yarn-deployment On Tue, Aug

Re: Ignite for Spark on YARN Deployment

>>> >>> >>> >>> >>> >>> >>> >>> >>> >>>

Re: Ignite for Spark on YARN Deployment

t; context > *[springUrl=file:/disk/12/hadoop/yarn/local/usercache/hongmei/appcache/application_1464374946035_27403/container_e24_1464374946035_27403_01_110493/./ignite-config.xml/, > err=Line 1 in XML document from URL > [file:/disk/12/hadoop/yarn/local/usercache/hongmei/appcache/applicatio

Re: Ignite for Spark on YARN Deployment

Hi Hongmei Zong! Client node which started from IgniteContext can't to find server nodes. By default ignite integration with YARN uses TcpDiscoveryVmIpFinder (if you don't use another ip finder in your configuration). In the case you should set the ip finder in IgniteContext. The following code

Re: Using Ignite within within networks without internet egress

Hi, Haithem Turki! If your yarn cluster running in network without internet, you can use IGNITE_PATH property. The property allows to use apache ignite build from hdfs. Also error message isn't clear, I've created ticket [1] for this issue. 1. https://issues.apache.org/jira/browse/IGNITE-3268

Re: IGFS YARN setup

Hi, Haithem Turki! * Seems like dynamic allocation isn't supported? Wanted to get a sense of >> whether this was in the roadmap >> > Could you please describe more about what you want from a dynamic allocation? > * Since YARN allocates containers at random it's pretty onerous to figure >> out

<    1   2   3