RE: Cache updates to nodes in client mode

2018-08-03 Thread Gordon Reid (Nine Mile)
Thanks Denis. Yes, I know about this setting. Actually, the problem really is that when a client is trying to 1. Reconnect after a problem 2. Or even just connect for the first time on start up Then the updates to other nodes will pause while this new client is joining the cluster. Is ther

Re: ALTER TABLE ... NOLOGGING

2018-08-03 Thread dkarachentsev
Hi, It might be an issue with deactivation. Try update to 2.6 or wait 2.7. Right now just skip cluster deactivation. Once you formed a baseline topology and finished loading data, just enable WAL log for all caches. When log enabled successfully, you can safely stop nodes. On next time when all b

Re: Additional field problems occurred in ignite2.6

2018-08-03 Thread dkarachentsev
Hi, Rules of field naming defined in BinaryIdMapper interface. By default used BinaryBasicIdMapper implementation that is by default converts all field names to lower case. So Ignite doesn't support the same field names in different cases as it will treat them as same field. But you can configure

Re: SYSTEM_WORKER_TERMINATION (Item Not found)

2018-08-03 Thread dkarachentsev
Hi, TTL fixes are not included in 2.6 as it was an emergency release. You'll need to wait for 2.7. https://issues.apache.org/jira/browse/IGNITE-5874 https://issues.apache.org/jira/browse/IGNITE-8503 https://issues.apache.org/jira/browse/IGNITE-8681 https://issues.apache.org/jira/browse/IGNITE-865

Re: Need help for setting offheap memory

2018-08-03 Thread Alex Plehanov
"Non-heap memory ..." metrics in visor have nothing to do with offheap memory allocated for data regions. "Non-heap memory" returned by visor it's JVM managed memory regions other then heap used for internal JVM purposes (JIT compiler, etc., see [1]). Memory allocated in offheap by Ignite for dat

Re: Cache updates to nodes in client mode

2018-08-03 Thread Denis Mekhanikov
Gordon, Client nodes are not developed to be used on user side of the application. Thin client should be used instead: https://apacheignite-net.readme.io/docs/thin-client Also ODBC client may be an option here: https://apacheignite-sql.readme.io/docs/odbc-driver Denis пт, 3 авг. 2018 г. в 10:13,

Contribution on Ignite

2018-08-03 Thread F.D.
Hi Igniters, I want to thank you because, my distrubuted closures are working perfectly! Now I'd like to do a step further. What I really need are the API for Service in C++. I already know that are missing, and maybe C++ is not your first thought. So, I'd like to try to contribute to the project t

Re: Contribution on Ignite

2018-08-03 Thread Dmitriy Pavlov
Hi, you could write email to d...@ignite.apache.org and take a look to https://cwiki.apache.org/confluence/display/IGNITE/How+to+Contribute page. You could share your JIRA ID, so you would be assigned to contributor role and will be able to assign issue to yourself. Any changes you would like to

The Apache Ignite book - I have some confusion when reading?

2018-08-03 Thread monstereo
Especially chapter 4 Architecture deep dive Now: 1) primary node is the node where we do igniteCache.put(2)="any string". I mean node which we put data in to cache is primary node? 2) let's say we have primary node(includes some cache datas, cache name cache1), now we create another node, then we

RE: Service not found for a deployed service

2018-08-03 Thread Calvin KL Wong, CLSA
Actually, we deployed the service at 02:00, and didn’t use the service until 16:27 the next day. Then got the error. There were more than 12 hours in between. Does this still seem related to IGNITE-1478 ? If not, can you think of other possibl

Re: Service not found for a deployed service

2018-08-03 Thread Denis Mekhanikov
Calvin, Did Service#init() method throw any exceptions? If so, then you would see the same problem. Denis пт, 3 авг. 2018 г. в 14:13, Calvin KL Wong, CLSA : > Actually, we deployed the service at 02:00, and didn’t use the service > until 16:27 the next day. Then got the error. There were more

Re: Transaction return value problem

2018-08-03 Thread Denis Mekhanikov
Guys, I tried playing around with transaction propagation policies with Ignite, and found, that at least NEVER policy doesn't work properly and doesn't throw any exceptions, if there is a transaction running. Could you assist and check the rest of them? I don't have much experience in Spring Tran

Re: two data region with two nodes

2018-08-03 Thread Вячеслав Коптилин
Hello, > There are two apps(more apps with different roles) with different ignite configs, > first App :set default region with persistence *enable* > second app :set default region with persistence *disable * By the way, I don't think that it is a good idea to configure the same data re

Spark-Ignite integration: unable to find CONFIG

2018-08-03 Thread rsmanda
Hi, When I try to execute the sample given here "https://github.com/apache/ignite/blob/master/examples/src/main/spark/org/apache/ignite/examples/spark/JavaIgniteDataFrameWriteExample.java";, it throws an error "java.io.FileNotFoundException: File C:/Apache%20Ignite/example-ignite.xml does not exis

S3 discovery and bridge networks

2018-08-03 Thread Dave Harvey
I've been successfully running 2.5 on AWS ECS with host or AWSVPC networking for the Ignite containers. Is there any way around the fact that with bridge networking, the Ignite node registers it's unmapped address on S3? Disclaimer The information contained in this communication from the sender

SQL SELECT with AffinityKeyMapped - no results

2018-08-03 Thread Floris Van Nee
Hi all, I have defined two classes in Java - one for a key and one for a value. Suppose they look like this: public static class Key implements Serializable { public String a; @QuerySqlField @AffinityKeyMapped public String b; } public static class Val

Re: SQL SELECT with AffinityKeyMapped - no results

2018-08-03 Thread Denis Mekhanikov
Floris, Most probably, you hit a bug, that was introduced in Ignite 2.0: https://issues.apache.org/jira/browse/IGNITE-5795 Because of this bug @AffinityKeyMapped annotation is ignored in classes, that are used in query entity configuration. As far as I can see, this is exactly your case. It's go

RE: SQL SELECT with AffinityKeyMapped - no results

2018-08-03 Thread Floris Van Nee
Thank you for your quick reply. That does look a lot like what I’m experiencing. However, I did some testing but so far I did not get the workaround to work. I put the following in the XML config file: org.apach

Re: SQL SELECT with AffinityKeyMapped - no results

2018-08-03 Thread Denis Mekhanikov
Floris, Binary metadata may be saved in work/binary_meta directory. Try cleaning this directory and see if it helps. You will also need to restart the whole cluster. Note, that it may lead to impossibility to read persisted data, if you have any. Denis пт, 3 авг. 2018 г. в 18:15, Floris Van Nee

Re: SQL SELECT with AffinityKeyMapped - no results

2018-08-03 Thread Floris Van Nee
I tried your suggestion but unfortunately to no effect yet. I restarted the cluster every time I tried something new. It seems it is now the following that causes a problem: cfg.setKeyConfiguration(new CacheKeyConfiguration(TestKey.class.getName(), "b")); // using this line, i get the incorre

Re: Need help for setting offheap memory

2018-08-03 Thread Amol Zambare
Thanks Alex and Denis We have configured off heap memory to 100GB and we have 10 nodes ignite cluster. However when we are running spark job we see following error in the ignite logs. When we run the spark job heap utilization on most of the ignite nodes is increasing significantly though we are u

No response from ignite job tracker

2018-08-03 Thread engrdean
I am successfully running mapreduce jobs using Ignite but I haven't been able to use the Ignite job tracker. I'm running my job like this: $ /bin/hadoop --config ~/ignite/ignite_conf jar wc.jar WordCount /user/ignite/ /tmp/output 2018-08-03 15:09:32,751 WARN [main] mapreduce.JobResourceUploader

Re: The Apache Ignite Book

2018-08-03 Thread Dmitriy Setrakyan
Thanks, Shamim. I will give it a read. On Wed, Aug 1, 2018 at 12:26 AM, srecon wrote: > Dear, Users. > Yesterday the first portion of our new title The Apache Ignite Book had > been published and available at https://leanpub.com/ignitebook . The full > table of contents and the sample chapter

Re: Toad Connection to Ignite

2018-08-03 Thread Dmitriy Setrakyan
Is it not possible to use TOAD with standard Ignite JDBC driver? I am not sure if there should be any issues. On Thu, Aug 2, 2018 at 9:42 AM, ApacheUser wrote: > Thanks Alex, > > We have large pool of developers who uses TOAD, just thought of making TOAD > connect to Ignite to have similar exper

Re: Contribution on Ignite

2018-08-03 Thread Denis Magda
Sounds great. Look forward to seeing you among the contributors and committers ;) -- Denis On Fri, Aug 3, 2018 at 2:55 AM F.D. wrote: > Hi Igniters, > I want to thank you because, my distrubuted closures are working > perfectly! Now I'd like to do a step further. What I really need are the > AP

Re: Delete/remove cache does not free the memory in PCF server

2018-08-03 Thread Denis Magda
I don't see any issue here. The Ignite process shows max virtual memory size [1] allocated by your operating system (OS) for it during the peak usage. The data region just grew to that size, and once you remove all the data, it will be empty (just call cache.size() to confirm this). So, Ignite as

Optimum persistent SQL storage and querying strategy

2018-08-03 Thread joseheitor
Hi Ignite team, We need to store and query retail transaction data that is expected to grow to over 50 million records. Each basket-transaction is represented as a JSON object with somewhat varying schema, depending on the type of transaction. And each transaction will contain a varying amount of