export ignite data

HI, we have export functionality which reads the ignite data (around 1L records) and add to file. i have implemented using jdbc driver to get the fetch size of 100. when i run parallel exports , client is getting restarted with following log 2017-05-15 22:36:50 342 ERROR TcpDiscoverySpi:495 -

Re: Ignite 2.0: CacheWriteSynchronizationMode = FULL_ASYNC when using cache.putAsync

Hi, The only difference between replicated and partitioned caches is that the former has a primary node (as any partitioned cache) for a key while all the other nodes are treated as backups. An affinity function knows that difference but use the same logic to map a key to a partition and the

Re: Kindly tell me where to find these jar files.

Hi Humphrey, thank you so much for your kind help. As I am a beginner, and using eclipse, till now, I have lots of errors in my project like `create class`. Could you kindly tell me the imports that I have to do, in these classes? Thank you. -- View this message in context:

RE: Ignite 2.0: CacheWriteSynchronizationMode = FULL_ASYNC when using cache.putAsync

Thanks Humphrey, yes I have read that. But it is still not clear to me how the primary node for a key is assigned in a REPLICTED cache, where we have no specific key affinity specified. From: Humphrey Lopez [mailto:hmmlo...@gmail.com] Sent: Tuesday, 16 May 2017 2:52 PM To:

Re: Ignite 2.0: CacheWriteSynchronizationMode = FULL_ASYNC when using cache.putAsync

https://apacheignite.readme.io/v2.0/docs/primary-and-backup-copies#synchronous-and-asynchronous-backups Humphrey > On 16 May 2017, at 03:14, Gordon Reid (Nine Mile) > wrote: > > Thanks Humphrey. And in the case of PRIMARY_SYNC, how is the primary node >

Re: HDP, Hive + Ignite

Hi Ivan, TEZ was on 6 data nodes. So you're right, I can't reliably estimate the performance of Ignite MR. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/HDP-Hive-Ignite-tp12195p12868.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite-Visor with Alert and Logs

Hello @Swetad90 Log command can not collect events when event storage is disabled. I create separated issue. You can track it by link https://issues.apache.org/jira/browse/IGNITE-5228 You can execute custom script on alert. See -s flag of alert command.

Re: using ignite web console

Hi Denis Thanks for information, ignite web agent default. properties details are documented in the link you shared Can you please give name of property files of back end /frontend which need to be changed as this is not documented anywhere. Thanks On Tue, May 16, 2017 at 5:31 AM, Denis Magda

RE: Ignite 2.0: CacheWriteSynchronizationMode = FULL_ASYNC when using cache.putAsync

Thanks Humphrey. And in the case of PRIMARY_SYNC, how is the primary node determined for the entity? Will it be the node where the entity was created? (we are in REPLICATED) Thanks,. -Original Message- From: Humphrey [mailto:hmmlo...@gmail.com] Sent: Monday, 15 May 2017 5:19 PM To:

Re: Ignite2.0 memory policy limit

Alex G., please look at this discussion. I don’t think that IAE is thrown as a result of insufficient RAM on the machine. Everything works perfectly fine on my Mac OS laptop even when a region with initial size > total RAM available is requested. Ajay, share a complete log file and

Re: using ignite web console

Yes, you need to give the machine where the console is to be deployed a unique IP address so that it’s accessible from remote machines. Also you might need to tweak some of web agent’s configuration parameters if the console should be linked with a remote Ignite cluster:

Re: How to deploy ignite service evenly across the cluster ?

Hey Alex. Thanks for the prompt response ! We actually do employ a node filter - lets say we have N nodes, we deploy our services to a group B, being roughly N/10 of size (20~ nodes). Our services are quite extensive, and so deploying them unevenly across B causes GCs, stalls and other

Re: How to deploy ignite service evenly across the cluster ?

Danny, in this case, it looks like you are right and the random don't provide even distribution. To avoid this you could devise a solution based on a node filter if affinity deployment doesn't do the trick for you

Ignite2.0 Data Strorage

Hi, I have two servers X and Y. I can store 100 entries in X. If i got 500 entries to put into cache the exceed data in X can i bypass into Y servers along with Y data. If possible please let me know how to achieve. Thanks -- View this message in context:

Re: How to deploy ignite service evenly across the cluster ?

Hey Alex, The services are deployed dynamically after all nodes are started. It could be the case that the random distribution isn't "random enough" - and most of the services are concentrated on specific nodes. Could we somehow control the way those services are deployed within their cluster

Re: Alerting and Eventing in Ignite

Hi Anyone yet have had such an use case for Ignite? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Alerting-and-Eventing-in-Ignite-tp12671p12857.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: what does CurrentCpuLoad in ClusterLocalNodeMetricsMXBeanImpl means?

Hi, Actualy, it returns OS process CPU load. On Fri, May 12, 2017 at 12:17 PM, bluehu wrote: > what does CurrentCpuLoad in ClusterLocalNodeMetricsMXBeanImpl means? > > "the TOTAL system cpuload" or "cpuload the node consume"? > > > > -- > View this message in context:

Re: Ignite2.0 memory policy limit

[20:45:42,727][ERROR][main][IgniteKernal] Exception during start processors, node will be stopped and close connections java.lang.IllegalArgumentException at sun.misc.Unsafe.allocateMemory(Native Method) at

Re: Cannot create cache in EVT_CLIENT_NODE_RECONNECTED event

Hi David, Seems, this predicate called from sensitive code and cache creation end up with deadlock. Try to move cache creation to separate thread. On Mon, May 15, 2017 at 11:44 AM, David Li wrote: > Hi guys, > > In the code snippet below, I am trying to re-create a cache

Re: Ignite2.0 memory policy limit

Hi Ajay, Would you please share a full stacktrace? On Mon, May 15, 2017 at 11:00 AM, Ajay wrote: > Hi, > > Is Ignite having any limit to create the memory region on single server > node. Because i created server node with following > > > >

Re: PutIfAbsent issues

Hi Rick, This should be impossible. Please, fill the ticket if you will have a success to reproduce it. On Thu, May 11, 2017 at 3:42 PM, rick_tem wrote: > Hi, > > I am using Ignite 2.0 and wondering if there are any known putIfAbsent(key, > value) issues where on

Re: HDP, Hive + Ignite

Alena, wrt 1.: saying 80 vs. 23 sec , do you compare Ignite MR on 1 node vs. Tez on *1* node also? On Mon, May 15, 2017 at 5:03 PM, Alena Melnikova wrote: > Ivan, > > 1. In my environment Ignite MR works correctly only on one node and it > works > slower than TEZ (80 sec vs 23

Re: HDP, Hive + Ignite

Ivan, 1. In my environment Ignite MR works correctly only on one node and it works slower than TEZ (80 sec vs 23 sec). I guess because of one ignite node. On multi node cluster result was incorrect. 2. "Do I correctly understand that Ignite MR was not used in that experiment?" Yes, it was

Re: Performance issue with Replicated Cache among 7 nodes

Hi Ramzinator, 1. There is no need to se number of backups when using replicated cache. All data nodes will have full cache data copy. 2. For FULL_SYNC mode, Ignite will send updates to all nodes and waits for they being finished. 3. Is it possible there is slow connection? How much time takes to

Performance issue with Replicated Cache among 7 nodes

Hi all, I have an ignite cluster of 7 nodes and a cache that is replicated among all of them configured as follows: When inserting the first object (of size ~15mb) into the cache, the insertion takes around *30 mins*. No exception are

using ignite web console

I am trying to install ignite web console in one of our servers (linux)as given in https://apacheignite-tools.readme.io/v1.9/docs/build-and-deploy We will be accessing the web console from different windows machine browser Do we need server ip address while building front end or back end as we

Re: HDP, Hive + Ignite

Ivan, what kind of tests did u run ? plz show SQL requests ? 1-node tests for distributed computing looks like wierd My observations (on very simplified 1-node environment) show that Ignite-MR ~10% faster than TEZ under equal >conditions. On Mon, May 15, 2017 at 1:52 PM, Ivan V.

Re: How to deploy ignite service evenly across the cluster ?

Hi Danny. At the moment, cluster singleton services are deployed on a random basis. How many Ignite nodes do you run? How did you deploy services: after all the nodes had been started or you have the services specified in configuration? Kind regards, Alex. On Sat, May 13, 2017 at 1:06 AM,

Re: HDP, Hive + Ignite

My observations (on very simplified 1-node environment) show that Ignite-MR ~10% faster than TEZ under equal conditions. On Mon, May 15, 2017 at 1:52 PM, Ivan V. wrote: > Hi, Alena, regarding "1) Ignite MR works slower than Hive on TEZ, but > faster than Hive on MR."

Re: HDP, Hive + Ignite

Hi, Alena, regarding "1) Ignite MR works slower than Hive on TEZ, but faster than Hive on MR." -- as far as I remember, you have observed incorrect results with Ignite MR, and we didn't find the reason, just abandoned that. Performance measurements don't have much sense until we have correct query

Cannot create cache in EVT_CLIENT_NODE_RECONNECTED event

Hi guys, In the code snippet below, I am trying to re-create a cache after the client node has disconnected and reconnected to the server node, somehow the line of creating the cache cannot be executed, the program just hangs there. public static class Predicate implements IgnitePredicate {

Ignite2.0 memory policy limit

Hi, Is Ignite having any limit to create the memory region on single server node. Because i created server node with following

Re: Ignite 2.0: CacheWriteSynchronizationMode = FULL_ASYNC when using cache.putAsync

Hi Gordon, FULL_ASYNC: Do not wait for any server node to acknowledge So it will fire and forget, and will not wait for all nodes in cluster to be updated. That will happen in the background. Humphrey -- View this message in context:

Re: HDP, Hive + Ignite

Hi Ivan, You're right. In kernel log there is message: "Out of memory: Kill process 19988 (java)" Let me sum up, please, correct me if I'm wrong. If we use Hive + Tez we don't need Hadoop Accelerator because: 1) Ignite MR works slower than Hive on TEZ, but faster than Hive on MR. 2) TEZ+HDFS and