Re: Configuration Recommendations after ESX maintenance failure

2017-02-24 Thread styriver
Hi I want to make sure I am using correct vm ware terminology. They used vMotion and when this happend one of the ignite servers "moved" to another VMware host. Our network personnel tell me it should look like it is back "online" almost instantaneously. I thought we could solve this by increasing

Re: Node fauliure

2017-02-24 Thread Anil
Thank you Andrey.

Re: Missing records Ignite cache size grows

2017-02-24 Thread diopek
Yes, we checked uniqueness of key several times. Below is representative snippet of our code, how we generate cache key inside inputIterator method. @Override protected Iterator>> *inputIterator*(Object... args) throws CacheLoaderException {

Re: Missing records Ignite cache size grows

2017-02-24 Thread vkulichenko
Are you sure keys are unique for all the parsed rows? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Missing-records-Ignite-cache-size-grows-tp10809p10888.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: How to configure MongoDB Client? I'm getting NotSerializableException

2017-02-24 Thread vkulichenko
Mauricio, You still use singleton factory for the cache store: -Val -- View this message in context:

Re: [RESOLVED] Cache Entries get lost after multiple nodes started ?

2017-02-24 Thread vkulichenko
Neeraj, Rebalancing is not happening in this scenario. Any node stop/failure will cause data loss if there are no backups. Note that if you have a persistence store with read-through, you may live without backups, as any lost entry will be reloaded from the store when needed. -Val -- View

Re: Understanding Swap Space feature-- how it works?

2017-02-24 Thread vkulichenko
Hi, Yes, swap space is transparent. Only keep in mind that whenever you read an entry from swap, it has to be unswapped first. So it's useful for the data that is rarely used, but still can't be accessed sometimes. If all you data is active, you will end up with a lot of swaps/unswaps which will

Re: Missing records Ignite cache size grows

2017-02-24 Thread diopek
Hi Andrew, Problem is, we have 24 GB RAM, 8 CPU Windows server where we couldn't replicate the issue. Issue happens when we move it to Linux box with 64 CPU and set the memory 64 GB RAM (or higher) to process much larger volumes data, again we observed that Java collection gets populated correctly

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

2017-02-24 Thread vkulichenko
kadsank wrote > Thanks, But can you suggest the name of missing libraries. I assume you need ignite-flink module with all its dependencies. -Val -- View this message in context:

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

2017-02-24 Thread vkulichenko
-- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/java-lang-NoClassDefFoundError-Could-not-initialize-class-org-apache-ignite-sink-flink-IgniteSink-Sir-tp10703p10881.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Cache Entries get lost after multiple nodes started ?

2017-02-24 Thread vkulichenko
Neeraj, The latter most likely means that this node was running in server mode. You should start it as client: https://apacheignite.readme.io/docs/clients-vs-servers -Val -- View this message in context:

Re: Missing records Ignite cache size grows

2017-02-24 Thread Andrey Mashenkov
Hi, I can't reproduce the issue. Would you please make a simple test that will reproduce it? On Fri, Feb 24, 2017 at 11:42 PM, diopek wrote: > CacheConfiguration> cacheCfg = new > CacheConfiguration<>(cacheName); >

Configuration Recommendations after ESX maintenance failure

2017-02-24 Thread styriver
Hello I am looking for some general recommendation concerning configuration in a VM environment. We ran into an issue where our network people were doing some ESX maintenance and they confirmed that one of our hosts "moved" at the time we detected a segmentation failure. I am including our

Re: Missing records Ignite cache size grows

2017-02-24 Thread diopek
CacheConfiguration> cacheCfg = new CacheConfiguration<>(cacheName); cacheCfg.setStartSize(startSize); cacheCfg.setCacheMode(CacheMode.LOCAL); cacheCfg.setIndexedTypes(Long.class,ArrayList.class);

Re: Missing records Ignite cache size grows

2017-02-24 Thread Andrey Mashenkov
Hi, I've asked for closure that passed to CacheStore.loadCache(closure, ..) method. On Fri, Feb 24, 2017 at 9:31 PM, diopek wrote: > package myignite.loading.test.cache.store; > > import static myignite.loading.test.common.CommonUtils.CONFIG_DIR; > import static

Re: How to configure MongoDB Client? I'm getting NotSerializableException

2017-02-24 Thread Mauricio Arroqui
Thanks AG. I did what you suggest and now my code runs okey, but when I start a second node on the same machine the first started node throws java.io.NotSerializableException: org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter$ThreadLocalSession My new xml

Re: Failure to start a bigger ignite cluster.

2017-02-24 Thread Andrey Mashenkov
Hi, Would you please attach full logs and grid configuration? On Fri, Feb 24, 2017 at 10:54 AM, atricuix wrote: > upon enabling debug logs - observing the below on the node which fails to > start after the initial set of 6-7 nodes. > >

Re: Node fauliure

2017-02-24 Thread Andrey Mashenkov
Hi Anil, I've created a Jira ticket [1] for SIGSEGV JVM crash. So, you can track it. [1] https://issues.apache.org/jira/browse/IGNITE-4751 On Fri, Feb 24, 2017 at 4:41 PM, Andrey Mashenkov < andrey.mashen...@gmail.com> wrote: > Hi Anil, > > Partition processing time can be high due to

Re: unicode character with apache ignite with multiple nodes

2017-02-24 Thread Andrey Mashenkov
Hi, I can't reproduce you issue aganst Ignite 1.7, 1.8 and master branches. On Fri, Feb 24, 2017 at 3:31 PM, babak wrote: > I don't have unit test but I share simple code that has this problem. > > In this code ,

Re: Missing records Ignite cache size grows

2017-02-24 Thread diopek
package myignite.loading.test.cache.store; import static myignite.loading.test.common.CommonUtils.CONFIG_DIR; import static myignite.loading.test.common.CommonUtils.DATA_SRC_PWD; import static myignite.loading.test.common.CommonUtils.DATA_SRC_URL; import static

Re: Missing records Ignite cache size grows

2017-02-24 Thread Andrey Mashenkov
Hi, Would you please provide a clusure code that passed to loadCache method. On Fri, Feb 24, 2017 at 11:05 AM, diopek wrote: > Val, > For debugging missing records issue > We confirmed that inside CacheLoadOnlyStoreAdapter.inputIterator method, > just before returning

Re: Node fauliure

2017-02-24 Thread Andrey Mashenkov
Hi Anil, Partition processing time can be high due to non-uniform data distribution when data collocation or bad affinity function used. It is ok for collocate data, and it is shouldn't be an issue if partition size variation is low enough and you iterate over partitions in parallel manner.

Re: Node fauliure

2017-02-24 Thread Anil
Hi Andrey, if you notice in the log, time taken to process the partition is high ( > 15 sec). Not sure what is causing that high query time. In my case, both caches are collocated, and eqId column is indexed and setLocal is true for the query. I wonder if my approach is correct. please correct

Re: Node fauliure

2017-02-24 Thread Anil
Hi Andrey, I have attached the log. thanks. Thanks. On 24 February 2017 at 18:16, Andrey Mashenkov wrote: > Hi Anil, > > Would you please provide ignite logs as well? > > > On Fri, Feb 24, 2017 at 3:33 PM, Andrey Gura wrote: > >> Hi, Anil >>

Re: getOrCreateCache hang

2017-02-24 Thread Matt Warner
Hi Nikolai. I discovered the reason the two applications weren't seeing each other was resolved by adding an explicit port number (Arrays.asList("127.0.0.1:47500")). However, the two still deadlock when running concurrently. The latest test shows one application blocked in getOrCreateCache, the

Re: Node fauliure

2017-02-24 Thread Andrey Mashenkov
Hi Anil, Would you please provide ignite logs as well? On Fri, Feb 24, 2017 at 3:33 PM, Andrey Gura wrote: > Hi, Anil > > Could you please provide crash dump? In your case it is > /opt/ignite-manager/api/hs_err_pid18543.log file. > > On Fri, Feb 24, 2017 at 9:05 AM, Anil

Re: Node fauliure

2017-02-24 Thread Andrey Gura
Hi, Anil Could you please provide crash dump? In your case it is /opt/ignite-manager/api/hs_err_pid18543.log file. On Fri, Feb 24, 2017 at 9:05 AM, Anil wrote: > Hi , > > I see the node is down with following error while running compute task > > > # A fatal error has been

Re: unicode character with apache ignite with multiple nodes

2017-02-24 Thread babak
I don't have unit test but I share simple code that has this problem. In this code , I have three classes: Main class, Person class and PersonManager. I run the project three times and each time, I add 100 persons to the person cache and

Re: [RESOLVED] Cache Entries get lost after multiple nodes started ?

2017-02-24 Thread Andrey Mashenkov
Hi Neeraj, Check if you custom key AffinityUuid implements hashCode() and equals() methods properly. I would recomment to use Ignite atomic data structures [1] to generate unique values. Ignite rebalance data automatically when a node enter\leave topology and you can see corresponding messaged

[RESOLVED] Cache Entries get lost after multiple nodes started ?

2017-02-24 Thread Neeraj Vaidya
I was able to resolve this. I set the backup copies of each cache to 1 in the XML file. Now, I can see all data present even if one goes down. But shouldn't data be automatically pushed/rebalanced to other nodes at the time of shutting down a node ? i.e. by the ignite-core capturing that event

Understanding Swap Space feature-- how it works?

2017-02-24 Thread edwardk
Hi, I am trying to understand the support in Ignite for spilling over to disk when memory limits are reached. I see there is a feature of swap space as in the link below, https://apacheignite.readme.io/docs/off-heap-memory#swap-space But, I am not clear on how it works. When we configure

Re: Missing records Ignite cache size grows

2017-02-24 Thread diopek
Val, For debugging missing records issue We confirmed that inside CacheLoadOnlyStoreAdapter.inputIterator method, just before returning collection.iterator from this method, number of records count (522636) for that collection has correct record count. And parse method which is also very straight