Re: Automatic Persistence - POJOs and XMLs for couchbase

2016-09-02 Thread Alexey Kuznetsov
Hi, Abhishek Jain. Actually schema utility loads jdbc driver jar via class loader. And in this case I think license file is not loaded. I will take a look (on Monday) at couchbase if it has trial version. Meanwhile could you try to put license file inside jdbc driver jar (it is a zip archive actu

Re: Reassign partitions

2016-09-02 Thread vkulichenko
Local store writes on both primary and backups. So you should be able to recover the data even if the topology was changing. Can you clarify what the issue is? How partition assignment will help you? Basically, you can implement AffinityFunction interface and implement your own assignment logic th

Re: Spark stage was hang via ignite

2016-09-02 Thread vkulichenko
Can you attach full logs from all Ignite nodes? Please don't copy-paste them in the message, use attach function or upload somewhere. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Spark-stage-was-hang-via-ignite-tp7485p7507.html Sent from the Apache Ignit

Re: understanding Locks usage

2016-09-02 Thread vkulichenko
Hi, What is your exact use case? Would transactions [1] fit it? In most cases this is a better and easier way to manipulate the data in a concurrent and distributed fashion. In my experience, explicit locks are needed for only specific use cases. Answering you questions: 1. No, it doesn't. 2. Thi

Re: Automatic Persistence - POJOs and XMLs for couchbase

2016-09-02 Thread Abhishek Jain
Thanks Val for replying soon. I will check with couchbase. As per their documentation, the license file should be in the same folder where the driver jar file is saved and I did so but of no help. Regards Abhishek On Fri, Sep 2, 2016 at 6:53 PM, vkulichenko wrote: > Hi, > > It looks like the

Re: Can anyone give me a full demo for embedded ignite for spark?

2016-09-02 Thread vkulichenko
Hi, I don't think someone has a full demo (and it's actually not very clear what is meant by that). If you already have some results, but something is not working, feel free to share you project so that anyone can easily run it and take a look. In this case I'm sure you will get help. -Val --

Re: Ignite odbc driver

2016-09-02 Thread vkulichenko
The page [1] lists features that are supported and that are not supported. DSN, to my knowledge, is not supported in 1.7, but looks like it is ready and merged to master [2]. [1] https://apacheignite.readme.io/docs/conformance [2] https://issues.apache.org/jira/browse/IGNITE-3390 -Val -- View

Ignite odbc driver

2016-09-02 Thread Murthy Kakarlamudi
Hi all, We are trying to access ignite cache from any sql client, Razorsql in particular. Our understanding is that any odbc compliant tool should be able to connect and issue sql queries against the cache. Is that a correct assumption? We have gone through the odbc section in Ignite docs and

Re: Ignite Cache Update(k,v)

2016-09-02 Thread vkulichenko
You can use the test [1] as a reference. [1] https://github.com/apache/ignite/blob/2cfe0cb5a0d84caede8b528b0a515ab4ba92bbc6/modules/ssh/src/test/java/org/apache/ignite/internal/IgniteProjectionStartStopRestartSelfTest.java -Val -- View this message in context: http://apache-ignite-users.70518

Re: Couchbase as persistent store

2016-09-02 Thread vkulichenko
Method signatures in your implementations are incorrect. Please pay attention to generics. The write method, for example, should look like this: @Override public void write(Cache.Entry entry) throws CacheWriterException -Val -- View this message in context: http://apache-ignite-users.70518.x6

Re: Cache Problems

2016-09-02 Thread vkulichenko
Hi Zhou, 1. Off-heap memory is managed manually by Ignite and it's released whenever it's not needed anymore (e.g., you remove entry from cache). System.gc() has access only to heap memory. 2. I'm not sure I understand this question. Can you clarify? 3. I'm not aware of such bugs. Are you experi

Re: CacheJdbcPojoStoreExampleFactory for Maria DB

2016-09-02 Thread vkulichenko
Hi, So what did you try? Basically, you should just provide the correct DataSource that will point to your database. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/CacheJdbcPojoStoreExampleFactory-for-Maria-DB-tp7479p7498.html Sent from the Apache Ignite

Re: Fail to compile apache-ignite-1.7.0

2016-09-02 Thread vkulichenko
Sometimes it's a good idea to clean local Maven repo. This can magically solve a lot of issues :) -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Fail-to-compile-apache-ignite-1-7-0-tp7458p7497.html Sent from the Apache Ignite Users mailing list archive at

Re: how to automatically exit JVM when the node stops?

2016-09-02 Thread vkulichenko
Hi Nicolae, You should listen for EVT_NODE_SEGMENTED through IgniteEvents API, like with any other events. There is no such configuration on the discovery SPI. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/how-to-automatically-exit-JVM-when-the-node-stop

Re: Overall desgn question

2016-09-02 Thread vkulichenko
Cache per document doesn't make much sense. I was talking about cache per data type. Ideally, you should split Document and Page objects (instead of creating a nested map within the document), store each page as a separate document and use collocation [1] to make sure that all pages are stored nex

Re: Automatic Persistence - POJOs and XMLs for couchbase

2016-09-02 Thread vkulichenko
Hi, It looks like the misuse of Couchbase - the driver can't connect to the server due to a licensing issue. You should refer to Couchbase docs and figure out where the license file should be located. I'm unfortunately not an expert, so can't help more. -Val -- View this message in context: h

Re: GET with LIKE operator for keys

2016-09-02 Thread vkulichenko
Hi, I don't see any reason why '_key = %January%' would not work. Did you try this? But actually, as I mentioned before, such query can't use any indexes and the cache will scanned, so SQL doesn't help much. If SCAN query solution works for you, the I think you're good here. -Val -- View this

Automatic Persistence - POJOs and XMLs for couchbase

2016-09-02 Thread Abhishek Jain
Hi, If somebody worked with Automatic Persistence for POJOs and XMLs creation for couchbase, please let me know the procedure for the same. (Although I have been successfully able to create the POJOs and XMLs for H2 database as mentioned in the Automatic Persistence section) I am getting the foll

Re: GET with LIKE operator for keys

2016-09-02 Thread javastuff....@gmail.com
I want to use same method for multiple caches, so object stored is unknown. Key type is known and it is String. Following is the way I was able to make it working with regular expression as matchCriteria (.*January.*), Can you please let me know how to use '_key = %January%' way? and which way wo

Re: Overall desgn question

2016-09-02 Thread styriver
One performance question we had would be serialization. If we do a cache per document strategy we were thinking the serialization cost would be less rather than having to go thru serialization of the entire nested HashMap. Again we are going to use Off Heap in replicated mode. -- View this mess

understanding Locks usage

2016-09-02 Thread javastuff....@gmail.com
I am exploring Locks and need some help understanding it. 1. To take a distributed lock on a key, does key need to exists in cache? 2. Once distributed lock is taken on existing cache key, does any operation on that cache key entry restricted from other thread? other thread is not explicitly taki

Re: Overall desgn question

2016-09-02 Thread styriver
Thanks for the response. At our peak we could have around 1000 documents cached. We can go with a cache per document design or a design with one named cache and add the document to the cache along with a nested hash map representing the pages. IgniteCache> Are there any performance considerations

Re: javax.cache.CacheException: Failed to find mapping description

2016-09-02 Thread Alexey Kuznetsov
Hi, vikram. I will send you a full project that works for me on Monday (05/09/2016). On Thu, Sep 1, 2016 at 2:10 PM, vikramT wrote: > hi Alexey, > > Thanks for logging the issue. > > But still I am facing the same issue: > > public class CacheConfig { > /** > * Create JDBC type for inv

Can anyone give me a full demo for embedded ignite for spark?

2016-09-02 Thread percent620
-- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Can-anyone-give-me-a-full-demo-for-embedded-ignite-for-spark-tp7486.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Spark stage was hang via ignite

2016-09-02 Thread percent620
/u01/spark-1.6.0-hive/bin/spark-submit --driver-memory 4G --class com.ETLTransform --master yarn --executor-cores 4 --executor-memory 1000m --num-executors 20 --conf spark.rdd.compress=false --conf spark.shuffle.compress=false --conf spark.broadcast.compress=false /u01/spark_engine863.jar -quesize

Re: how to automatically exit JVM when the node stops?

2016-09-02 Thread Marasoiu Nicolae
?Hi, So I think we found it: 1. For EVT_NODE_SEGMENTED, I think it is a "discovery event" and we register a listener on the tcp discovery component of the ignite configuration. 2. For other events, Ignite offer possibility to listen to local or remote events, at Ignite (global) level or at c

Re: Fail to compile apache-ignite-1.7.0

2016-09-02 Thread ewg
The problem was magically solved after removing "ignite-apache-license-gen" artifact from my local .m2 repo. I guess the problem was created when I run mave package without unit tests skip flag as the very first thing. I can see scope hack "hack to have ignite-apache-license-gen at first place at m

Re: how to automatically exit JVM when the node stops?

2016-09-02 Thread Marasoiu Nicolae
Hi Kamal, It seems that the only events available on the lifecycle (the classes you mentioned e.g. LifecycleBean and LifecycleEventType) are those of "node started" and "node stopped". There must other classes of events and event handlers for the case of segmentation and other events. Ignite

cluster hangs after node is stopped

2016-09-02 Thread Marasoiu Nicolae
Hi, We have a cluster with 5 server nodes. We run Ignite nodes dockerized. We do "docker stop" on one node to trigger a fail-over. At all this time we send operations to the cluster during a stress test. As soon as we stop one of the 5 nodes, all the other nodes stop processing requests done w

Re: javax.cache.CacheException: Failed to find mapping description

2016-09-02 Thread vikramT
Hello, Any workaround for this -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/javax-cache-CacheException-Failed-to-find-mapping-description-tp7350p7480.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

CacheJdbcPojoStoreExampleFactory for Maria DB

2016-09-02 Thread seyeony
Hi, I'm learning now apache ignite. During test I met the following isssues. In the CacheAutoStoreExample, I'd like to modify to load form not H2 but Maria-DB. /** * Example store factory. */ private static final class CacheJdbcPojoStoreExampleFactory extends CacheJdbcPojoStoreFa

Re: Access cache entries in C++ via JNI call

2016-09-02 Thread Caio Nishibe
Hi Igor, my cluster has 34 server nodes and 1 client node. Biometric data (fingerprint templates) is spread across a distributed cache (about 50 million fingerprint templates). The client node creates an identification task, which has to compare an input fingerprint against all stored templates. T

Cache Problems

2016-09-02 Thread Level D
Hi all, I have several questions about ignite 1.6.0's cache. 1. When does ignite free the non-heap memory? I found a system.gc in source code, is it? 2. How can I check the data in non-heap memory with just ignite itself? 3. Are there any bugs about ignite cannot release non-heap memory cor

Couchbase as persistent store

2016-09-02 Thread kvipin
Hi folks, I want to integrated couchbase as persistent store with apache-ignite as per instructions given in http://apacheignite.gridgain.org/v1.6/docs/persistent-store. But I'm getting error while compiling my TestTableStore.java which extends CacheStoreAdapter. *Following is the output from com