Re: Exception - Method rawReader can be called only once

2019-10-10 Thread javastuff....@gmail.com
The interface does not have 2 sets of methods, so second method with "raw" reader is extra code with special programmatic changes in extending class to call "raw" method from superclass. This is how I am using it for now, however it needs extra code and special handling in extended class which seem

Re: Exception - Method rawReader can be called only once

2019-10-04 Thread javastuff....@gmail.com
Hi Ilya, Each object is also eligible for separate caching so if class level chaining is not working/allowed then its too much unnecessary code needs to be written and maintained throughout the class chains. Or separate value objects need to be created only for caching with Ignite. In my experien

Re: Exception - Method rawReader can be called only once

2019-10-03 Thread javastuff....@gmail.com
Hi Ilya, Thanks for your reply. I tried to program it around and I do not see exception anymore, but still need to verify object is built correctly or not. For complex or deep class hierarchy this seems a bit of hassle and not maintainable. Could you please throw some light on why this limitati

Re: Exception - Method rawReader can be called only once

2019-10-03 Thread javastuff....@gmail.com
Hi Ilya, Thanks for your reply. I tried to program it around and I do not see exception anymore, but still need to verify object is built correctly or not. For complex or deep class hierarchy this seems a bit of hassle and not maintainable. Could you please throw some light on why this limitatio

Re: isolated cluster configuration

2019-03-13 Thread javastuff....@gmail.com
Thank you for the response Ilya. Using 2 different DB schema is a way out here, but I was trying to see if there is any other way to achieve this. Maybe property or configuration resulting in different table names for the isolated cluster or table details having cluster details to isolate from eac

Re: isolated cluster configuration

2019-03-12 Thread javastuff....@gmail.com
Any pointers for this? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Re: TPS does not increase even though new server nodes added

2019-03-08 Thread javastuff....@gmail.com
Checkout below - java.lang.Thread.State: BLOCKED (on object monitor) at java.io.PrintStream.println(PrintStream.java:805) - waiting to lock <0x85d6d798> (a java.io.PrintStream) at com.example.ignite.service.IgniteCacheImpl.doInTransaction(IgniteCacheImpl.java:57)

isolated cluster configuration

2019-03-08 Thread javastuff....@gmail.com
Hi, We have a requirement for 2 separate cache cluster isolated from each other. We have 2 separate configuration file and java program to initialize. We achieved it by using non-intersecting IP and Port for different cluster while using TCP discovery. However, we need to achieve the same using

Re: Upgrading from 1.9 .... need help

2018-11-15 Thread javastuff....@gmail.com
Hello Ilya, Can you please elaborate on "You would need to use some other means to limit sizes of your caches"? Are there any guidelines or best practices for defining data region? Thanks, -Sam -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Upgrading from 1.9 .... need help

2018-11-14 Thread javastuff....@gmail.com
Hi, We are using Ignite 1.9 OffHeapCache with swap space disabled, we have about 80 different caches, all are defined programmatically. Some have the expiry, some have eviction policy. We are trying to upgrade to 2.6 and need help - 1. Many API from 1.9 is no longer supported or deprecated in 2

Cache metrics

2018-04-25 Thread javastuff....@gmail.com
Can we reset cache metrics, without destroying or restarting a cache? Thanks, -Sam -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Slow invoke call

2018-04-23 Thread javastuff....@gmail.com
Sorry, I do not have trace for scan query. We moved away from the earlier implementation, as of now it is not showing big latencies like earlier. Thank you for help. Thanks, -Sam -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Slow invoke call

2018-04-17 Thread javastuff....@gmail.com
Thanks Val. I understand Array copy is heavy operation and probably lots of memory allocations too, however, my profiler showing complete logic of copy and append taking 50% of the total time taken by Invoke call. that's why the question, does invoke should take this much time or its the concurren

Re: Slow invoke call

2018-04-05 Thread javastuff....@gmail.com
Thanks Pavel for reply. /"When you store entries into the off-heap, any update operation requires copying value from the off-heap to the heap." / I am updating using remote entry processor, does that also need to copy value to calling heap? If yes then no benefit using entry processor here, I can

Slow invoke call

2018-04-04 Thread javastuff....@gmail.com
Hi, I have a usecase where we are storing byte array into one of the OFFHEAP ATOMIC cache. Multiple threads keep on appending bytes to it using remote operation (Entry processor / invoke call). Below is the logic for remote operation. if (mutableEntry.exists()) { MyObject m = (MyObject)

Re: Event Listeners

2017-07-07 Thread javastuff....@gmail.com
No. Near cache is one of the usecase, because of serializing/deserialize can not use Ignite Near cache, it's a big overhead and negating benefits of near cache altogether. In other usecases we need to notify all changes to cached data. In a specific scenario, we have to remove all entries and sam

Re: Event Listeners

2017-07-06 Thread javastuff....@gmail.com
Cached data change notifications are used in multiple use-cases. Here is one - We have OFFHEAP distributed Ignite cache fronted by JVM level local copy. It is similar to what Near cache would work. However, Ignite Near cache (JVM level local copy) also get serialized/de-serialized. which results i

Re: Event Listeners

2017-07-05 Thread javastuff....@gmail.com
In general what event to look for cache.clear()? I tried remoteListener for EVT_CACHE_OBJECT_PUT/READ/REMOVED and unable to capture clear() activity. To use remove() instead of clear() as a workaround, need to do a scan query and then remove/removeAll. Sounds expensive. I am looking at PARTITIONED

Re: Event Listeners

2017-07-05 Thread javastuff....@gmail.com
onRemoved listener is not called when cache.clear() is used. Can you please let me know what event I need to listen for clear()? Thanks, -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Event-Listeners-tp8306p14361.html Sent from the Apache Ignite Users mail

Re: Out-Of-Memory

2017-06-19 Thread javastuff....@gmail.com
Sorry my bad. Example also talking in terms of number of entries. Thanks for help. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Out-Of-Memory-tp13829p13969.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Out-Of-Memory

2017-06-19 Thread javastuff....@gmail.com
I found Performance tune tip with example of startSize [1] . Example specifying startSize in MB. Can you also comment on what would be startSize incase offHeapMaxMemory set to 0 (unlimited)? Based on your previous comme

Re: Out-Of-Memory

2017-06-16 Thread javastuff....@gmail.com
I will try it out. One question - Default 1_500_000 means number of entries in map or bytes or KB or MB? Document does not clarifies this either. Thanks, -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Out-Of-Memory-tp13829p13878.html Sent from the Apache

Out-Of-Memory

2017-06-15 Thread javastuff....@gmail.com
Hi, We are using Ignite 1.9, OFFHEAP with SWAP disabled. We are creating caches programmatic and want to use SQL. At one instance creating 350 empty cache ran into out-of-memory. We are already setting low queue size for delete history (IGNITE_ATOMIC_CACHE_DELETE_HISTORY_SIZE=100) Log metrics s

novalue (NULL) vs default zero for writeInt/readInt

2017-06-01 Thread javastuff....@gmail.com
Hi, We have a usecase where we receive data in a map with all field values in String format. However actual datatype is different for various fields. While pushing into cache using writeBinary we convert string to int/long/double. If String is NULL, we skip writeInt/writeLong. These fields are SQ

Re: Grid is in invalid state to perform this operation

2017-05-03 Thread javastuff....@gmail.com
Want to go to the cluster case as you suggested. As of now I am running only single node. After awake application (JBOSS) revive, but cache grid seems to be stopped. Thanks, -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Grid-is-in-invalid-state-to-perform

Grid is in invalid state to perform this operation

2017-05-02 Thread javastuff....@gmail.com
Hi, My application was working and later laptop went into sleep/standBy mode. After awake got below exception. Looks like grid is stopped. Is there a way to handle this? /java.lang.IllegalStateException: Grid is in invalid state to perform this operation. It either not started yet or has already

Serializer

2017-05-02 Thread javastuff....@gmail.com
Hi We have multiple off-heap caches defined. We have implemented Binarylizable for each cache object. So far so good. We have a requirement we have to store List or Map of Binarylizable objects in a cache. How do I attempt to write serializer for List and Map? These List and Map are extended o

Re: Offheap and max memory

2017-04-26 Thread javastuff....@gmail.com
It looks like documentation is misleading. Tried test program - - without setting offHeapMaxMemory, getOffHeapMaxMemory returns 0. - Setting offHeapMaxMemory=-1, getOffHeapMaxMemory returns 0. Thanks, -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Off

Offheap and max memory

2017-04-26 Thread javastuff....@gmail.com
Hi I am using Partitioned, Atomic, OffHeap cache, creating cache pragmatically. Recently noticed offHeapMaxMemory is not set because of glitch in my configuration and program. Based on java doc default offHeapMaxMemory value is -1, specified by DFLT_OFFHEAP_MEMORY constant which means that off-

Re: SQLQuery and Datatypes

2017-04-24 Thread javastuff....@gmail.com
It would be helpful to understand how the date and timestamp are stored with writeDate and writeTimestamp specifically for the format perspective. So that I can create queries on the same line if I choose not to use setArgs. Thanks, -Sam -- View this message in context: http://apache-ignite

Re: stdout - Message queue limit is set to 0, potential OOMEs

2017-04-24 Thread javastuff....@gmail.com
In that case I will change my configuration to have and change it if needed. Out-of-box unlimited seems too aggressive with potential OOME risk. Thanks, -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/stdout-Message-queue-limit-is-set-to-0-potential-OOME

SQLQuery and Datatypes

2017-04-21 Thread javastuff....@gmail.com
Hi My cached object is Binarylizable. I am using SQLQuery and SQLFieldQuery. In some cases I need to query on a hardcoded/fixed filter e.g. Name = 'xyz'. Same usecase for Long, Date, TimeStamp datatype as well. Basically not using setArgs(). I see it works fine for String, Int, Long. - Can

Re: stdout - Message queue limit is set to 0, potential OOMEs

2017-04-21 Thread javastuff....@gmail.com
Added below to TcpCommunicationSpi and message went away, able to see the new value on JMX as well. // However, how do I know what is the good or suitable value one need to set? I have more than 50 different PARTITIONED OFF-HEAP caches defined, most likely to have 2 to 4 nodes with 20GB each or mo

Re: Index

2017-04-21 Thread javastuff....@gmail.com
Resolved it! I used default constructor for QueryIndex and missed setting IndexType. This resulted into missing index. Added /"idx.setIndexType(QueryIndexType.SORTED)"/, able to see index on H2 debug console. What is the default IndexType? Is it expected to not throw error when IndexType is not s

Re: Index

2017-04-19 Thread javastuff....@gmail.com
I tried REST API and H2 debug console. Do not see index, not sure what is wrong. I am creating cache pragmatically and can not use annotations. Below is the sample based on CacheQueryExample.java. Removed annotations from Person.java to create Person2.java /CacheConfiguration personC

Re: stdout - Message queue limit is set to 0, potential OOMEs

2017-04-19 Thread javastuff....@gmail.com
Thank you. Last question - Why it showing up with 1.9 and not earlier? Thanks, -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/stdout-Message-queue-limit-is-set-to-0-potential-OOMEs-tp12048p12091.html Sent from the Apache Ignite Users mailing list archive

Re: stdout - Message queue limit is set to 0, potential OOMEs

2017-04-19 Thread javastuff....@gmail.com
What do you mean by messages? I am not using Ignite messaging. Are these messages of rebalancing during topology change? How do I configure it to avoid potential OOME? Thanks, -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/stdout-Message-queue-limit-is-s

stdout - Message queue limit is set to 0, potential OOMEs

2017-04-18 Thread javastuff....@gmail.com
Recently moved to Ignite 1.9 and noticed below line on stdout - /Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides./ Not sure if this existed in older versio

Re: ScanQuery log all entries

2017-04-18 Thread javastuff....@gmail.com
Thanks. One question though - Below loop will automatically go over all pages or just one page with 1024 entries? for (Cache.Entry, Person> entry : cursor) System.out.println("Key: " + entry.getKey() + ", Value: " + entry.getValue()); If it is just one page t

Re: Index

2017-04-17 Thread javastuff....@gmail.com
Webconsole is the only way? Visor or JMX or logs or sample JAVA API. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Index-tp11969p12004.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: ScanQuery log all entries

2017-04-17 Thread javastuff....@gmail.com
Thanks Dmitry. So it means if I use QueryCursor, it will not bring all entries in heap but only 1024 or page size setting. Is there any example for QueryCursor? Can anybody share a sample code snippet for QueryCursor usage? Thanks, -Sam -- View this message in context: http://apache-ignite-u

ScanQuery log all entries

2017-04-13 Thread javastuff....@gmail.com
Hi, I have a usecase where I have to log cached entries. I am doing below - /ScanQuery scan = new ScanQuery<>(); cache.query(scan).getAll();/ Question - 1. With OFF_HEAP cache it is suppose to be huge number of entries in cache. Does getAll() will try to bring all into heap and potential ou-of-m

Index

2017-04-13 Thread javastuff....@gmail.com
Hi, How to check index is created? How many indexes are present? What is the definition of index? Thanks, --Sambhav -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Index-tp11969.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Logging ignite-log4j.jar

2017-03-24 Thread javastuff....@gmail.com
Thanks Andrey. Looked at code and seems like check for log configuration is made, /if(!isConfigured()) { this.impl.setLevel(Level.OFF); }/ but not completely correct. Below is the method from Log4JLogger /public static boolean

Logging ignite-log4j.jar

2017-03-23 Thread javastuff....@gmail.com
Hi My application already uses Log4j for logging, simply adding ignite-log4j.jar enables Ignite logging. I also added a new logger configuration for package "org.apche.ignite" in my application logging configuration, so that Ignite can log into a separate rolling file. Ignite logging working fin

Re: REST service command LOG

2017-03-20 Thread javastuff....@gmail.com
Created minor ticket IGNITE-4845 -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/REST-service-command-LOG-tp10148p11325.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: REST service command LOG

2017-03-13 Thread javastuff....@gmail.com
Hi Val, Apologies for coming back to this thread late. I agree for security reasons it should internally figure out which log file to read. However it does not work, here is the scenario - Ignite-log4j module is enabled simply including this jar file, now it uses my application log4j configurati

Re: Fetch by contains on a field as Array or List

2017-01-31 Thread javastuff....@gmail.com
I guess TextQuery can be a option provided Collection field is converted to String field. I will try out a sample. Any comments or cons for this approach? -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Fetch-by-contains-on-a-field-as-Array-or-List-tp102

Re: Fetch by contains on a field as Array or List

2017-01-30 Thread javastuff....@gmail.com
"Search will not be indexed" sounds costly, Is there any other way this can be done example - LIKE operator in SQL? Regarding custom function option - 1. Need to use "WHERE CONTAINS(ID_LIST) =12345" where CONTAINS is custom function. 2. From above example where clause ID_LIST will be available a

Re: eagerTtl

2017-01-27 Thread javastuff....@gmail.com
Thanks, Looks like false alarm. I see a single thread for ttl-cleanup-worker per node. -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/eagerTtl-tp10249p10292.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Fetch by contains on a field as Array or List

2017-01-26 Thread javastuff....@gmail.com
Hi, I have an object with one of the field as Array or List. Array/List field holds Long values. Size could be 10s or 100s or few 1000s, not expecting it to grow more than 5000. Object won't be updated frequently, mostly read only. Object implements Binarylizable. Requirement is to fetch all the

Re: eagerTtl

2017-01-26 Thread javastuff....@gmail.com
Hi Val, JavaDoc does not talk about threads per cache or node. To get more info on this property, came across below post, I see similar memory and thread pattern with my application but not yet investigated specifically for eagerTtl or its related threads. http://apache-ignite-users.70518.x6.nabb

eagerTtl

2017-01-25 Thread javastuff....@gmail.com
Hi I was going through JAVADoc and came across CacheConfiguration property eagerTtl. Came across one of the post which says eagerTtl=true spans a thread per cache. We are not using ExpiryPolicy on any of the caches, we have almost 100 different cache. To keep memory and thread footprint down, do

Re: Ignite REST with JBOSS

2017-01-20 Thread javastuff....@gmail.com
Created improvement ticket - IGNITE-4586 -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-REST-with-JBOSS-tp10108p10162.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: REST Service for CLEAR

2017-01-20 Thread javastuff....@gmail.com
Created improvement ticket - IGNITE-4585 -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/REST-Service-for-CLEAR-tp10150p10161.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: REST service command LOG

2017-01-20 Thread javastuff....@gmail.com
No, it does not work. It tries to look for file $IGNITE_HOME/work/log/ignite.log. Code seems to have "/work/log/ignite.log" as default log file. Since Ignite configuration does not have logging details, best bet I thought was specifying path. Thanks, -Sam -- View this message in context: h

REST Service for CLEAR

2017-01-19 Thread javastuff....@gmail.com
Any specific reason why CLEAR command is not supported with REST Service? but DESTROY is supported. -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/REST-Service-for-CLEAR-tp10150.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

REST servive command LOG

2017-01-19 Thread javastuff....@gmail.com
Hi, I find LOG command very useful. Periodic metrics and topology change information helps monitoring. However it does not work with my application, It fails with below message - "Request parameter 'path' must contain a path to valid log file." My application already using Log4j, so not using I

Re: Ignite REST with JBOSS

2017-01-19 Thread javastuff....@gmail.com
I had looked at this again, here is what I think - 1. No embedded JETTY server 2. Custom plug-able endpoint handler Plug-able GridRestProcessor will be overkill. However customizable HTTP_PROTO_CLS should be good enough to plug custom rest handler. In 1.7 I see it is hard coded to Jetty. private

Re: Data Rebalancing & Transactions

2017-01-19 Thread javastuff....@gmail.com
Hi Val, I agree ASYNC makes more sense, but need tuning and lighting fast network to complete GBs of data. If it is just about backups then using NONE re-balancing mode can help in certain usecases, by avoiding network transfers of GBs of data. Side cache - Persistent store is DB, Cache does not

Re: Data Rebalancing & Transactions

2017-01-18 Thread javastuff....@gmail.com
Hi Val, Asynchronous re-balancing seems better option because of no blocking. However I would like to understand more on NONE mode. What is the advantage over other mode and how is the impact on over all cluster for serving data in terms of GET/PUT latency? With NONE mode what will happen when a

Re: Ignite REST with JBOSS

2017-01-18 Thread javastuff....@gmail.com
Hi Val, Application is already running on top of JBOSS, so no need of another HTTP server. Without connector configuration GridRestProcessor will not initialize. So I had to initialize Grid*CommandHandlers separately after Ignition.start() final GridKernalContext ctx = ((IgniteKernal)ignite).

Ignite REST with JBOSS

2017-01-17 Thread javastuff....@gmail.com
Hi We are using Ignite in our application which runs on top of JBOSS. Application starts Ignite server pragmatically. Is there a way to use Ignite REST-HTTP module? -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-REST-with-JBOSS-tp10108.html Sent

ignite update notifier

2017-01-17 Thread javastuff....@gmail.com
Hi Is it possible to disable ignite-update-notifier-timer? -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/ignite-update-notifier-tp10106.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Performance with increase in node

2017-01-05 Thread javastuff....@gmail.com
Thank you Denis for your reply. Application in client mode can be easy thing to change, however there will be multiple Ignite nodes to serve bigger size of cache. So going back to my initial question of degradation with increase in number of Ignite nodes - 1. Can some one try my test program in or

Re: Performance of multiple ignite JVMs within single node

2017-01-05 Thread javastuff....@gmail.com
I have observed significant degradation for get and put with increase in number of Ignite JVM. I am still searching to tune this. More details can be found at - http://apache-ignite-users.70518.x6.nabble.com/Performance-with-increase-in-node-td9378.html

Re: Cluster hung after a node killed

2017-01-04 Thread javastuff....@gmail.com
Thanks Val. Ticket has been fixed for 1.9, Any idea when 1.9 will be available? -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cluster-hung-after-a-node-killed-tp8965p9880.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Performance with increase in node

2016-12-12 Thread javastuff....@gmail.com
Thanks Denis. Are you saying application in client mode is recommended architecture in terms of performance? I had looked at GridGain bench-marking results, but it does not provide comparative results to understand impact of adding/removing cache node. In my simple test, application running as

Re: Cluster hung after a node killed

2016-12-09 Thread javastuff....@gmail.com
Hi Val, Did you had chance to look at attached sample program? Did it help figuring out what is going on? -Sam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cluster-hung-after-a-node-killed-tp8965p9465.html Sent from the Apache Ignite Users mailing list archi

Re: Performance with increase in node

2016-12-09 Thread javastuff....@gmail.com
Thank you Denis. Are you saying test application should not act as server node for Ignite and it should be client node? it does not matter. Regarding Yardstick, I had difficulty setting up no credential user to launch remote commands, so not able to make it fully functional. On other side results

Re: Performance with increase in node

2016-12-05 Thread javastuff....@gmail.com
Actual application is multiple machines and various threads doing get and put. As a simple test which can provide average get and put time, I tried attached test program. Tried same program on multiple physical machines (each with 48 CPU, 40GB Ram) and see similar behavior. To rule out network l

Performance with increase in node

2016-12-02 Thread javastuff....@gmail.com
Hi, We are observing really good performance with single node, however with multiple nodes in cluster ,performance is degrading or we can say application throughput is not scaling. I wrote a sample program to put 100K data into cache in a single thread using put() and later read all of them usi

Re: Cluster hung after a node killed

2016-12-02 Thread javastuff....@gmail.com
Attaching 4 classes - Node1.java - create empty cache node. Node2.java - seed cache with 100K dat. Node3.java - take explicit lock on a key and wait for 15 seconds to unlock. Node4.java - fetch cached data. Steps - 1. Run Node1, wait for empty node to boot up. 2. Run Node2, wait for completion

Re: Cluster hung after a node killed

2016-12-01 Thread javastuff....@gmail.com
Val, I have reproduced this with simple program - 1. Node 1 - run example ExampleNodeStartup 2. Node 2 - Run a program which create a transaction cache and add 100K simple entries. cfg.setCacheMode(CacheMode.PARTITIONED); cfg.setAtomicityMode(CacheAtomicityMode.TRANSACTIONAL);

Re: Cluster hung after a node killed

2016-11-30 Thread javastuff....@gmail.com
Hi Val, Killing the node that acquired the lock did not release it automatically and leads whole cluster in hung state, any operation on any cache (not related to lock) are in wait state. Cluster is not able to recover seamlessly. Looks like a bug to me. I understand lock timeout can be error-pr

Re: Cluster hung after a node killed

2016-11-28 Thread javastuff....@gmail.com
Ideally cluster should recover seamlessly. Is there any locktimeout which I can configure? or any other configuration which will make sure locks taken by crashing node gets released and cluster still serves all requests? Is this a bug? -Sam -- View this message in context: http://apache-igni

Re: Cluster hung after a node killed

2016-11-21 Thread javastuff....@gmail.com
Issue resolved for me. There was a typo which caused one of the lock to stay. Corrected typo which allows unlocking. However in real production node can crash before releasing lock, hence there must be something for locks to timeout or locks need to auto unlock when responsible node fails. I have

Re: Cluster hung after a node killed

2016-11-16 Thread javastuff....@gmail.com
Could you please elaborate your suspicion? addRoleDelegationToCache and addDocument calls were made after killing node3, these calls trying to push data into cache and we are not using any transaction API to start or commit transaction on cache explicitly while pushing data to cache. And these ca

Re: Cluster hung after a node killed

2016-11-15 Thread javastuff....@gmail.com
logs.zip Attaching threaddump and log from 2 nodes. Lost logs from node 3 which was killed using "kill-9 " Let me know if you need more logs. In my understanding, after killing node 3 topology version update screwed-up and N

Re: Cluster hung after a node killed

2016-11-14 Thread javastuff....@gmail.com
Do you want Ignite to be running in DEBUG? or System.out should be enough from all 3 nodes? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cluster-hung-after-a-node-killed-tp8965p8978.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Cluster hung after a node killed

2016-11-14 Thread javastuff....@gmail.com
Hi, I have configured cache as off-heap partitioned cache. Running 3 nodes on separate machine. Loaded some data into cache using my application's normal operations. Used "/kill -9 /" to kill node 3. Node 2 shows below Warning on console after every 10 seconds - /11:03:03,320 WARNING [org.apac

Re: Event Listeners

2016-10-17 Thread javastuff....@gmail.com
I will try out continuous query. In mean time I tried other approach, each node in cluster registers cache entry listener - IgniteCache cache = ignite.getOrCreateCache(CACHE_NAME); cache.registerCacheEntryListener(..); With this, listeners are being called on each registered node and I am abl

Event Listeners

2016-10-14 Thread javastuff....@gmail.com
Hi, 1. Is there a way to create cache event listener only for a particular cache, so that other cache don't generate events and its overhead? Currently, able to work with listener handler filtering based on CacheName, however events are generated for all cache. public boolean apply(CacheEvent evt

Re: Near cache

2016-10-11 Thread javastuff....@gmail.com
Thank you for your reply. Would like to add more details to 3rd point as you have not clearly understood it. Lets assume there are 4 nodes running, node A brings data to distributed cache, as concept of Near Cahce I will push data to distributed cache as well as Node A will have it on heap in Map

Near cache

2016-10-10 Thread javastuff....@gmail.com
Hi, Because Ignite always serialize data, we are not able to take advantage of Near cache where cached object are heavy interms of serialization/de-serilalization and no requirement of query or eviction. We are taking about 5 min vs 2 hours difference, if we do not cache meta information of frequ

Re: Out of memory

2016-09-30 Thread javastuff....@gmail.com
Good to know about future change. I will try your suggestion regarding system property. I do not think I will have scenario where insertion and deletion of same key happens at the same time. BTW all of my cache are marked TRANSACTIONAL, just for the sack of having capability of explicit distribut

Re: Out of memory

2016-09-29 Thread javastuff....@gmail.com
Thank you for your reply Den. Many LOCAL cache are less than 10MB, would that also need overhead of 20-30MB? When System is ideal, slowly consuming memory, so is there any metrics/statistics/JMX being captured regularly which need to be turned off? I turned off task and cache events, still same

Out of memory

2016-09-28 Thread javastuff....@gmail.com
In my application I have 100s of different caches defined. Some are LOCAL, NEAR and OFFHEAP, in total all are 10GB and LOCAL are about 1GB. Running application with 4GB heap, machine have 48 CPU and 40GB RAM. I am starting ignite from java code. Under bigger load getting OOM. Attaching screenshot

Local cache

2016-09-09 Thread javastuff....@gmail.com
Hello, It appears that entry is being serialized, eventhough cache is defined as LOCAL. Below is the configuration I used - 1. It will be performance overhead, when object is not shared and kept locally only. 2. It is losing state

Re: understanding Locks usage

2016-09-07 Thread javastuff....@gmail.com
With Key Vs Entry lock, I am talking about lock granularity. Key lock is kind of synchronous block or method which have processing logic unrelated to the key or cached data being processed but a different shared resource. Kind of distributed mutex. but note that it does not need all other feature

Re: understanding Locks usage

2016-09-07 Thread javastuff....@gmail.com
Thanks. Let me put it other way, Is there any other way to take a distributed lock which can be unlocked by owner thread, but does not need same LOCK instance? I mean unlock api finds and gets the lock instance automatically to unlock. I am not sure if IgniteLock can do that, not yet tried. Coupl

Re: understanding Locks usage

2016-09-03 Thread javastuff....@gmail.com
There are multiple common usecases I am looking at with distributed lock, few are below - 1. In a distributed application where application is running on more than 1 server node, want to synchronize some task for serial execution whenever there is common entity involved. 2. In concurrent environmen

Re: GET with LIKE operator for keys

2016-09-03 Thread javastuff....@gmail.com
I tried other ways to query, however I did not able to get it working. With my requirement I want to reuse code for multiple caches in the system, so I do not know stored object type. Based on documentation and examples I have seen so far, I think query feature is not suiting for my usecase witho

Re: GET with LIKE operator for keys

2016-09-02 Thread javastuff....@gmail.com
I want to use same method for multiple caches, so object stored is unknown. Key type is known and it is String. Following is the way I was able to make it working with regular expression as matchCriteria (.*January.*), Can you please let me know how to use '_key = %January%' way? and which way wo

understanding Locks usage

2016-09-02 Thread javastuff....@gmail.com
I am exploring Locks and need some help understanding it. 1. To take a distributed lock on a key, does key need to exists in cache? 2. Once distributed lock is taken on existing cache key, does any operation on that cache key entry restricted from other thread? other thread is not explicitly taki

LOCAL cache and EntryProcessor

2016-08-30 Thread javastuff....@gmail.com
1. We have a separate logic for local cache for a specific scenario, How to find cache mode for a given cache name? Does below code correct or there is alternate way - private boolean isLocalCache(String pObjectType) { CacheConfiguration[] cfg = ignite.configuration().getCacheConfigu

Re: GET with LIKE operator for keys

2016-08-30 Thread javastuff....@gmail.com
Thank you again. My bad I missed 'Predefined Fields' note from documentation. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/GET-with-LIKE-operator-for-keys-tp7381p7415.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

GET with LIKE operator for keys

2016-08-29 Thread javastuff....@gmail.com
Is there a way to query matching keys with wild card characters? Here is the usecase - We have few cache defined as local and few off-heap distributed. Some business logic need to capture all cache entries whose keys having text "January". (key='%January%') cache.getLike('%January%') --Sam

Re: Near Cache

2016-08-29 Thread javastuff....@gmail.com
Thanks. This should help analyzing OOM with incorrect sizing configuration. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Near-Cache-tp7033p7380.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Near Cache

2016-08-24 Thread javastuff....@gmail.com
Thanks. I know it won't be a good way to approach it, Is there any class instance I can search for in heapdump to count number of entries or heap space used by near cache? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Near-Cache-tp7033p7287.html Sent from the

  1   2   >