Re: Failed to wait for initial partition map exchange

2017-05-16 Thread jaipal
Val, It doesn't look like a memory issue.We are using explicit locking (lock entry , do processing and then unlock).Under high load, When we bring down one of the Ignite Server nodes and then again add it back to the cluster,We are getting this issue.We observed the exceptions like Failed to wait

Re: Closures stuck in 2.0 when try to add an element into the queue.

2017-05-16 Thread afedotov
Hi. The question was answered on stackoverflow . Duplicating the answer below: It's not allowed to invoke ignite.queue and ignite.affinity methods in EventListener, because it may lead to

Re: Is it restricted by ignite to put elements into queue in closures

2017-05-16 Thread afedotov
Well, actually the question was answered on stackoverflow with the following: It's not allowed to invoke ignite.queue and ignite.affinity methods in EventListener, because it may lead to d

Is it restricted by ignite to put elements into queue in closures

2017-05-16 Thread fatality
Hi I have posted below question a while ago and still not received any response yet. Could you please tell me what can be accessed or can not be from closures that we send with remotelisteners. http://apache-ignite-users.70518.x6.nabble.com/Closures-stuck-in-2-0-when-try-to-add-an-element-into-t

Is there a way to allow nodes to join an already started task?

2017-05-16 Thread Ryan Ripken
In the GridGain days I was able to add nodes to an already started task. Is there a way to do that in Ignite? I occasionally have nodes disconnect or crash in a custom native library. I'd like to be able to restart those failed nodes or add additional nodes if the compute isn't progressing

Re: Ignite2.0 memory policy limit

2017-05-16 Thread Denis Magda
Ajay, I could successfully start a node using your configuration on my laptop. Could you check how many processes are running on your Linux machine and how much physical RAM is left for the Ignite process? You can share the output of “top” or similar tool. Btw, what’s the Linux distribution n

Igfs and MaprFs

2017-05-16 Thread Pranay Tonpay
Hi, On the ignite site, it does have links that talk about running igfs on top of Apache hadoop, hdp and cdh but there is no mention of MapR ... Is it due to the no namenode architecture of MapR that it is not supported? Pls advise

BinaryFieldIdentityResolver

2017-05-16 Thread thammoud
Hello, >From what I understand, Ignite uses the equals of the binary image of the key. we have a key that contains extra information that does not need to be considered in equals/hashCode. I tried writing custom code using BinaryFieldIdentityResolver bu it does not seem to work. Attached is the ex

Re: Sizing in Ignite

2017-05-16 Thread vkulichenko
What you quote is just an example emphasizing that Ignite and relational DB are completely different storages and that mapping memory estimates one by one are wrong. You should use the actual guide for calculations that doesn't mention any multipliers like this. -Val -- View this message in con

Re: Ignite 1.6.0 suspected memory leak from DynamicCacheDescriptor

2017-05-16 Thread vkulichenko
Hi, It looks like there is client node constantly joining and leaving topology. What is the reason for this? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-1-6-0-suspected-memory-leak-from-DynamicCacheDescriptor-tp9443p12894.html Sent from the Apac

Re: HDFS IGFS Integration

2017-05-16 Thread Pranay Tonpay
Thx Ivan, that helps On May 16, 2017 10:24 AM, "Ivan Veselovsky" wrote: Hi, Pranay, > Does it mean that Namenode can be avoided when IGFS get deployed on top of > HDFS ? No. IGFS itself does not have namenode, it is a distributed cache storing file blocks. But when deployed on top of HDFS, it f

how to save data to local node and share it with other nodes

2017-05-16 Thread Libo Yu
Hi all, I am trying to figure out how to do this with Ignite Cache: I have ignite cache installed on several application servers. Those application servers may need the same data from time to time. Here is my scenario: After server A gets some data, it saves the data to the cache which is local

Re: HDFS IGFS Integration

2017-05-16 Thread Ivan Veselovsky
Hi, Pranay, > Does it mean that Namenode can be avoided when IGFS get deployed on top of > HDFS ? No. IGFS itself does not have namenode, it is a distributed cache storing file blocks. But when deployed on top of HDFS, it fetches the underlying data using ordinary namenode mechanism. > Or is it

Re: Failed to wait for initial partition map exchange

2017-05-16 Thread vkulichenko
Jai, So what is the result of investigation? Does it look like memory issue or not? As I said earlier, the issue itself doesn't have generic solution, you need to find out the reason. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Failed-to-wait-for-initi

Re: 10X decrease in performance with Ignite 2.0.0

2017-05-16 Thread Chris Berry
Hi Yakov, I was able to try these suggestions yesterday. 2.0.0 is now only a 19% decrease in performance -- versus the original 1000+% This is it in more detail: I do not truly understand the ramifications of using the BinaryMar

Re: How to deploy ignite service evenly across the cluster ?

2017-05-16 Thread Alexander Fedotov
Danny, just one more question. Are all the services deployed as cluster singletons? Kind regards, Alex. On Tue, May 16, 2017 at 1:10 PM, afedotov wrote: > Hi Danny, > > Could you please share your node filter/cluster group pedicate? > > Kind regards, > Alex. > > On Mon, May 15, 2017 at 10:49 PM

Re: Pessimistic TXN did not release lock on a key, all subsequent txns failed

2017-05-16 Thread Andrey Gura
Hi, There was a problem with incorrect transaction timeout handling [1] that was fixed in Ignite 1.8. It is possible that it is your case. [1] https://issues.apache.org/jira/browse/IGNITE-2797 On Thu, May 11, 2017 at 1:51 AM, bintisepaha wrote: > Hey guys, we had a key lock issue again on 1.7.0

Re: OOM Issue with Eviction Event listener - Ignite 1.9.0

2017-05-16 Thread Andrey Gura
Hi, anyway such increasing of memory consumption is too suspicious for me. Could you please provide more information about your use case: cluster topology, Ignite and caches configuration? Siomple reproducer would be grade in order to analyse the problem. On Mon, May 1, 2017 at 11:05 PM, Pradeep

Re: Failed to wait for initial partition map exchange

2017-05-16 Thread jaipal
Hii val, I tried recommended settings and configurations. still I observe this issue and it can be reproduced easily. Is there any fix available to this issue. Regards Jai -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Failed-to-wait-for-initial-partition-map

Re: Kindly tell me where to find these jar files.

2017-05-16 Thread Humphrey
Seems like you need to start first with the basics. This is not the correct place to learn java. Google online and do more research. Here are some links explaining maven. https://youtu.be/JK9oZfScQgg https://youtu.be/uEYjXpMDJiU There are more out there. Play a little around with maven and java

Re: How to deploy ignite service evenly across the cluster ?

2017-05-16 Thread afedotov
Hi Danny, Could you please share your node filter/cluster group pedicate? Kind regards, Alex. On Mon, May 15, 2017 at 10:49 PM, dany74q [via Apache Ignite Users] < ml+s70518n12861...@n6.nabble.com> wrote: > Hey Alex. > Thanks for the prompt response ! > We actually do employ a node filter - let

Re: Ignite2.0 Data Strorage

2017-05-16 Thread Andrey Mashenkov
Hi Ajay, This is not supported. Ignite cache is divided into partitions and distribute partition among nodes. Partitions distribution depends on AffinityFunction [1] you configured. AffinityFunction available by default are designed to have distribution closer to equal. However you may try to imp

Re: Understanding the mechanics of peer class loading

2017-05-16 Thread Dmitry Pavlov
Hi Ilya, I supposed following: GridDeploymentClassLoader usage for loading message class on receiver side is mandatory condition for reproduction. But for now it is only hypothesis. In my test if all nodes have message payload class in its classpath there are no problems with messaging under high

Re: Performance issue with Replicated Cache among 7 nodes

2017-05-16 Thread Ramzinator
Hi Andrey, It turns out that we had increases our failureDetectionTimeout wayyy too much. After setting it to something more sensible, the issue stopped. Thanks for the info, Rami -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Performance-issue-with-Replicated

Re: Understanding the mechanics of peer class loading

2017-05-16 Thread Ilya
Hi Dmitry, Unfortunately, I've did not yet manage to reproduce this issue outside of our project. What do you mean by "GridDeploymentClassLoader is used for loading class on server"? How can server classloaders be configured? How does a remote node choose, in which classloader to deploy the recei

Re: 10X decrease in performance with Ignite 2.0.0

2017-05-16 Thread Yakov Zhdanov
Chris, any news? --Yakov 2017-05-13 1:05 GMT+03:00 Denis Magda : > Chris, > > These are some links for reference: > > 1. BinaryObject and BinaryObjectBuilder interfaces usage: > https://apacheignite.readme.io/docs/binary-marshaller# > section-binaryobject-cache-api > https://apac

Re: export ignite data

2017-05-16 Thread dkarachentsev
Hi, Probably the reason of client reconnection was a long GC pause on it. Try to use scan query [1], it's liter than SQL, and check that you have enough of heap. [1] https://apacheignite.readme.io/v1.8/docs/cache-queries#scan-queries Thanks! -Dmitry -- View this message in context: http://ap