Re: cache update from .NET client to Java cluster

2017-03-16 Thread Pavel Tupitsyn
> new entry get created in the map Updating an entry in Ignite cache is not just updating some map; it is a distributed operation that may update multiple memory/disk locations on multiple machines, depending on cache mode, number of backups, swap storage, etc. Anyway, these are implementation de

Re: Lock and Transaction

2017-03-16 Thread Anil
Hi Nikolai, Thanks for response. in my usecase, i need to control incoming messages so that no two messages of personId process in parallel. i believe this can achieved with both explicit locks and entry processor. Can entryprocessor support cross cache atomicity ? Thanks On 17 March 2017 at 01

Re: cache update from .NET client to Java cluster

2017-03-16 Thread kfeerick
/When you update the entry and call cache.Put, it gets serialized and then sent to the server node./ Thanks Pavel, Perhaps I'm missing something here but I would expect the existing entry to get updated do to key equivalence rather than a new entry get created in the map? -- View this message

Re: create table via JDBC

2017-03-16 Thread Denis Magda
> I will dig into the example directory to see if I can find example > where a cache is created and then fields are added dynamically. It will be feasible to add new QueryEntity fields and indexes in a month or so once this ticket is completed: https://issues.apache.org/jira/browse/IGNITE-4565 <

Re: create table via JDBC

2017-03-16 Thread Ivan Zeng
Thanks Denis. I see that the example you gave use existing classes. These classes will need to be defined ahead of time. I will dig into the example directory to see if I can find example where a cache is created and then fields are added dynamically. If you know of any of this example, please

Re: create table via JDBC

2017-03-16 Thread Denis Magda
Ivan, You can refer to this example: https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ignite/examples/datagrid/CacheQueryExample.java Al

Re: create table via JDBC

2017-03-16 Thread Ivan Zeng
Hi Denis, Thanks for the response. Is there any sample code on how to use the IgniteCache to create caches with different fields and load data into the cache? Thanks so much. Ivan On Thu, Mar 16, 2017 at 3:52 PM, Denis Magda wrote: > Hi Ivan, > > Yes, caches can be created dynamically: > https

Re: create table via JDBC

2017-03-16 Thread Denis Magda
Hi Ivan, Yes, caches can be created dynamically: https://apacheignite.readme.io/docs/jcache#section-dynamic-cache — Denis > On Mar 16, 2017, at 3:28 PM, Ivan Zeng wrote: > > Hi Dmitriy, > > Thanks for your reply. I was able

Re: Pessimistic TXN did not release lock on a key, all subsequent txns failed

2017-03-16 Thread bintisepaha
Evans, we don't have a grid hanging issue. Also we do have server nodes leaving the cluster. the toplogy changes are for clients. I am attaching some errors we saw when a key got locked. Could someone please look at it and help us to find out why a client topology change is causing key locks? Err

Re: create table via JDBC

2017-03-16 Thread Ivan Zeng
Hi Dmitriy, Thanks for your reply. I was able to load data into cache after adding the QueryEntity in configuration. And I actually needed to restart the server database to pick up the new configuration. Is there a way that I can create new cache without restarting the server? Thank so much Iva

Re: Understanding Cache Key, Indexes, Partition and Affinity

2017-03-16 Thread anoorag.saxena
Thank you for the quick turnaround, Andrew! I have some follow-up questions: 1.) //AffinityKey should be a part of entry key and if AffinityKey mapping is configured then AffinityKey will be used instead of entry key for entry->partition mapping // What is meant by Entry Key in this context? 3

destroy and offheap memory

2017-03-16 Thread lawrencefinn
i have a setup where sometimes i will create caches from scratch and destroy old ones. when i call destroy on the cache, i don't think the process memory goes down by the total memory used by that offheap cache. how does destroy trigger a cleanup in offheap memory? is there a better way to do th

Re: create table via JDBC

2017-03-16 Thread Dmitriy Setrakyan
DDL commands are not supported in Ignite yet. However, in Ignite the table will be created automatically if you define a class with @SqlQueryField annotations or define a QueryEntity in configuration, as described here: https://apacheignite.readme.io/docs/indexes Starting with Ignite 2.0, planned

Re: Lock and Transaction

2017-03-16 Thread Nikolai Tikhonov
Anil, Yes, you're right that atomic cache doesn't support explicit locks. >I am not sure how entryprocessor invoke behaves in my case. if it is single cache update, that is straight forward. and not sure about transaction for 2-3 operations for 2 caches. EntryProcessor modifies (update/remove/cre

create table via JDBC

2017-03-16 Thread Ivan Zeng
Hi, I am new to Ignite. Could you tell me the right way to create a cache, load data into cache, and then query the cache via JDBC? I wrote the following code to create a table via JDBC. Class.forName("org.apache.ignite.IgniteJdbcDriver"); con = DriverManager.getConnection (connectionU

Re: Lock and Transaction

2017-03-16 Thread Anil
Hi Nikolai, Thanks for response. Distributed locks wont work for atomic caches. correct ? if i remember it correclty, i see an exception sometime back and then i used transcational. I do 2 to 3 updates/puts between two caches like updating parent person info to child person and creating empty de

Re: New Blogs: What's new in Ignite.NET 1.9 and Ignite Kubernetes deployment on Azure

2017-03-16 Thread Denis Magda
A couple of more blogs got published. * Continous queries in Ignite C++ by Igor - https://isapego.github.io/Continuous-Queries-in-Apache-Ignite-CPP-1-9/#disqus_thread * Modern Application Design With In-Memor

Re: hasOffHeapPointer

2017-03-16 Thread Peter Schmitt
Hi Andrey, thank you for your answer! I've observed it the past few days and it happens quite randomly. I can't really interpret the answer, because I haven't configured a AccessedEvictionPolicy. Do you mean that the stored entry has the same hash-code and therefore it doesn't get replaced? Kind

Re: Lock and Transaction

2017-03-16 Thread Nikolai Tikhonov
If your update logic does not contains heavy operations (locks, cache puts and etc) and how I see from your comment above this is true you can use IgniteCache#invoke [1]. The method provides needed you garanty. Also you can change cache mode to ATOMIC for better perfomance. 1. https://apacheignite

Re: Lock and Transaction

2017-03-16 Thread Anil
Hi Nikolai, No. person message and detail message can be executed by different nodes and both messages executes different logics. *Person message* - will update/create person entry into person cache and check the if any detail entry is available or not in detail cache. if exists, updates person i

Re: Lock and Transaction

2017-03-16 Thread Nikolai Tikhonov
Hi Anil! If I understood correctly (you need to perform operations on two caches have exclusive lock on personId) then in your case the better way is using Ignite pessimistic transaction: personCache = ignite.cache("PERSON_CACHE"); detailCache = ignite.cache("DETAIL_CACHE"); try (Transaction tx

Lock and Transaction

2017-03-16 Thread Anil
Hi, I need to make sure that entries are added correctly in two caches. I have two caches Person and Detail. personId is the key for Person cache and detailedId is the key for Detail cache. Each Detail cache entry would have some information of Person cache entry based on personId. and i am add

Re: Getting h2 jdbc url from cpp api

2017-03-16 Thread Sergi Vladykin
Hi, What are you trying to achieve? This URL is not a public API or something you can use in your app. Sergi 2017-03-16 17:13 GMT+03:00 mhergul : > Hi, > I'm using Apache Ignite 1.9 C++ api. I want to get h2 jdbc url (like: > jdbc:h2:mem:b552f121-9fc6-47f0-9a12-eba7693ed180 ) from C++ API. How

Re: Error: Failed to locate: "CL.exe"

2017-03-16 Thread kavitha
Thanks for your information. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-Failed-to-locate-CL-exe-tp11222p11240.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Getting h2 jdbc url from cpp api

2017-03-16 Thread mhergul
Hi, I'm using Apache Ignite 1.9 C++ api. I want to get h2 jdbc url (like: jdbc:h2:mem:b552f121-9fc6-47f0-9a12-eba7693ed180 ) from C++ API. How can I do that? I'm trying to get catalog name (e.g. "b552f121-9fc6-47f0-9a12-eba7693ed180" ) with following SQL query: ignite::cache::query::SqlFieldsQuery

Re: Apache NiFi PutIgnite Cache Error: Failed to send job request

2017-03-16 Thread austin solomon
The Cache is getting created however their is no data in it. +===+ | Name(@) |Mode | Nodes | Entries (Heap / Off-heap) | Hits | Misses | Reads | Writes | +

Apache NiFi PutIgnite Cache Error: Failed to send job request

2017-03-16 Thread austin solomon
Hi I am trying to get the streaming data from one Kafka topic and put it into Ignite's cache using Apache Nifi. The flow is like this GetKafka --> PutIgniteCache (I have a doubt what is the value for *Ignite Cache Entry Identifier*) My Ignite version is 2.0.0-SNAPSHOT and in NiFi also I have giv

Re: ODBC driver installation error

2017-03-16 Thread kavitha
Hi, Thanks for your reply. I have successfully installed ODBC driver. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/ODBC-driver-installation-error-tp11232p11236.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Error: Failed to locate: "CL.exe"

2017-03-16 Thread Igor Sapego
Well, cl.exe is part of MSVC. If your visual studio can't find it then there is something wrong with your VS. Try finding answer in the Internet, for example try looking here [1] [1] - https://social.msdn.microsoft.com/Forums/vstudio/en-US/b60f4b90-8eb5-49fb-83c9-7259a3fae66e/need-help-with-trk00

Re: ODBC driver installation error

2017-03-16 Thread Saifullah Zahid
Try by opening command prompt in administrative mode On Thu, Mar 16, 2017 at 5:18 PM, kavitha wrote: > Hi, > > I tired to following command in command prompt. But I get Access is denied > error message. > (Before executing command, successfully build all projects in ignite.sln) > > F:\Ignite\apa

Re: Ignite.NET very slow Cache Loading

2017-03-16 Thread Saifullah Zahid
Hi Pavel, Thanks for your reply. There are about 40 fileds TransactionsDetail and size is about 400 bytes. In Taskbar I can see the process is taking about 23GB I used 20GB heap-size. Also I have noticed that c: drive have only 3GB empty space. Thanks, Saif On Thu, Mar 16, 2017 at 11:16 AM, Pa

ODBC driver installation error

2017-03-16 Thread kavitha
Hi, I tired to following command in command prompt. But I get Access is denied error message. (Before executing command, successfully build all projects in ignite.sln) F:\Ignite\apache-ignite-1.9.0-src\modules\platforms\cpp\odbc\install>install_amd64 F:\Ignite\apache-ignite-1.9.0-src\modules\plat

Re: Ignite Spring-bean problem

2017-03-16 Thread kmandalas
My bad, I had Ignite 1.8.0 as Maven dependency at m Spring web app. Please ignore and/or let me know if I should delete this Post. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Spring-bean-problem-tp11229p11231.html Sent from the Apache Ignite Users mai

Re: Loading a native library on a grid node

2017-03-16 Thread jpmoore40
After a bit more investigation it appears this can be solved by setting peerClassLoadingEnabled=false. Probably not a huge problem but we currently have a grid set up with peerClassLoadingEnabled=true which has a couple of different separate uses, so we would either need to change our deployment pr

Ignite Spring-bean problem

2017-03-16 Thread kmandalas
Hello, I am starting an Ignite instance when deploying a Spring application and I use the IgniteSpringBean in my configuration XML. This node is the "master" is the one which triggers distributed closures to rest cluster members. However, when I try to start another "slave" node by command line,

Re: Understanding Cache Key, Indexes, Partition and Affinity

2017-03-16 Thread Andrey Mashenkov
Hi, 1. Ignite uses AffinityFunction [1] for data distribution. AF implements two mappings: key->partition and partition->node. Key->Partition mapping is definitely map entry to partition. It doesn't bother of backups, but data collocation\distribution over partitions. Usually, entry key (actually

Loading a native library on a grid node

2017-03-16 Thread jpmoore40
Hi, I'm trying to submit a task to the compute grid that makes a call to a native library. The first time the call is run on a node works fine - the dll is loaded and the call succeeds. However on subsequent attempts an exception is thrown as our code makes a second call to System.loadLibrary() wh

Re: Error: Failed to locate: "CL.exe"

2017-03-16 Thread kavitha
Yes I installed. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-Failed-to-locate-CL-exe-tp11222p11226.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Error: Failed to locate: "CL.exe"

2017-03-16 Thread Igor Sapego
Have you installed C++ toolchain with your VS? Best Regards, Igor On Thu, Mar 16, 2017 at 10:30 AM, kavitha wrote: > Hi, > > I tried to build the Ignite.sln to generate ignite.odbc.dll. But I got > following error message. > > Failed to locate:"CL.exe". The system cannot find the file specified

Distributed callables: passing data and getting back results

2017-03-16 Thread kmandalas
Dear Igniters, I have the following question related to Compute Grid and having large number of callables to be executed in the cluster for fast computation and results retrieval: - If I want to pass data to callables, for example Lists of objects, let's say Collections from 2000 to 6000 objects

Cache Queues and Load Balancing

2017-03-16 Thread kmandalas
Hello fellow igniters, At https://apacheignite.readme.io/docs/queue-and-set, section: "Cache Queues and Load Balancing" is mentioned that: "we can have threads on remote nodes call IgniteQueue.take()". Could you please elaborate on that? Is there somewhere an example? Thank you. -- View this m

Error: Failed to locate: "CL.exe"

2017-03-16 Thread kavitha
Hi, I tried to build the Ignite.sln to generate ignite.odbc.dll. But I got following error message. Failed to locate:"CL.exe". The system cannot find the file specified. Where I can download CL.exe? -- View this message in context: http://apache-ignite-users.70518