IgniteMessaging, What am I doing wrong?

2018-07-26 Thread monstereo
I want to send message to client nodes from server nodes, and client nodes will take this message and print it. Here is the server nodes public static void main { Ignite server = //start ignite with default config path ClusterGroup clientNodes = server.cluster().forClients();

Re: Ignite Cluster with remote server + Cassandra Persistence

2018-07-26 Thread Вячеслав Коптилин
Hello, > Just wondering, can I know why we are creating a custom CassandraCacheStoreFactory? It seems that the problem is PojoField#accessor field which is declared as `transient` and so this field is not serialized/deserialized. Therefore, it can lead to NullPointerException. The `PojoField` clas

Delete/remove cache does not free the memory in PCF server

2018-07-26 Thread okiesong
Hi, this is basically the command that I am using to clear and destroy the cache from the server that is deployed on the PCF server. But memory does not free, even after I do this. private clearCacheByName(String item) { if (ignite.cacheNames().contains(item)) {

Re: INSERT query that UPDATES if record already found

2018-07-26 Thread vkulichenko
Sounds like you're looking for the MERGE command: https://apacheignite-sql.readme.io/docs/merge -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Help needed with BinaryObjectException

2018-07-26 Thread vkulichenko
Roger, When exactly do you get this exception and what are the steps to reproduce it? Do you change the set of values in the enum? Do you restart the cluster when doing this? Ideally, it would be great if you provide a reproducer that we can just run to recreate the problem. That would help to ge

Re: SQL to limit number of records per agId

2018-07-26 Thread vkulichenko
You can try using UNION for this: (select * from cache1 where agid = 100 limit 2) union (select * from cache1 where agid = 101 limit 2) https://gist.github.com/vkulichenko/8de603b28aa784ede84150614003e3a6 -Valid -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL to limit number of records per agId

2018-07-26 Thread Prem Prakash Sharma
Can you add a temporary rank column add rank for columns for every ageid starting from 1 till number of rows with that ageid then select where rank < configurable_num Regards, Prem On Thu, Jul 26, 2018, 11:05 PM Prasad Bhalerao wrote: > Hi Stephen > Thank you for the solution. > But it is limit

Re: Using SQL users to open jdbc connections

2018-07-26 Thread Prem Prakash Sharma
Thanks it worked, I missed the conversion to upper case without the quotes Regards, Prem On Thu, Jul 26, 2018, 10:52 PM aealexsandrov wrote: > Hi, > > Could you please show the command how you create new users? > > When you create the user in quotes ("test") using SQL as next: > > CREATE USER "

Re: SQL to limit number of records per agId

2018-07-26 Thread Prasad Bhalerao
Hi Stephen Thank you for the solution. But it is limiting the no. Of record per agid to 1. I want to select 2 to 3 ( or some configurable no. Of records) record per agid. Any idea how it can be done? On Thu, Jul 26, 2018, 9:52 PM Stephen Darlington < stephen.darling...@gridgain.com> wrote: > H

Re: Using SQL users to open jdbc connections

2018-07-26 Thread aealexsandrov
Hi, Could you please show the command how you create new users? When you create the user in quotes ("test") using SQL as next: CREATE USER "test" WITH PASSWORD 'test' It will be created as it was set (in this case it will be test) If you create the user without quotes (test) using SQL as n

Re: Help needed with BinaryObjectException

2018-07-26 Thread Dave Harvey
The cluster needs to agree on how to decode various versions of the BinaryObjectSchema. Changing the type of a field name or an enum's value are non-upwards compatible changes which Ignite cannot handle. There is the question of the lifetime of the version of a type, and while you may know that t

Re: "Unable to await partitions release latch within timeout: ServerLatch" exception causing cluster freeze

2018-07-26 Thread Pavel Kovalenko
Hello Ray, Without explicit errors in the log, it's not so easy to guess what was that. Because I don't see any errors, it should be a recoverable failure (even taking a long time). If you have such option, could you please enable DEBUG log level for org.apache.ignite.internal.util.nio.GridTcpNioC

Re: SQL to limit number of records per agId

2018-07-26 Thread Stephen Darlington
How about: 0: jdbc:ignite:thin://127.0.0.1/> select * from cache1; 'ID','AGID','VAL' '1','100','10-15' '2','100','17-20' '3','100','30-50' '4','101','10-15' '5','101','17-20' 5 rows selected (0.003 seconds) 0: jdbc:ignite:thin://127.0.0.1/> select * from cache1 where id in (select min(id) from ca

Re: Storing Time Series data efficiently on Ignite

2018-07-26 Thread bintisepaha
Welly, would you please mind sharing how did this work out for you? what was the time-series size and how was the performance? Thanks, Binti -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite Cluster with remote server + Cassandra Persistence

2018-07-26 Thread okiesong
Hi, first of all, thanks once again, I have tried your approach (after uploading new jar to lib folder as a new class was introduced), but I am getting a below error. FYI, "ignite-cass-delta" is the name of the default cache name I am using. Thanks again! [11:36:25] Topology snapshot [ver=9, serve

Re: service deploy cluster singleton lock application

2018-07-26 Thread Evgenii Zhuravlev
Looks like TaskLockWatcher is an inner class, isn't it? When you deploy service, an instance of it will be serialized and saved to cache. If this class in inner, most possible it serializes an outer class too. Try to create not nested Class for Service. 2018-07-26 18:14 GMT+03:00 sergey.dolinkov :

Re: "Unable to await partitions release latch within timeout: ServerLatch" exception causing cluster freeze

2018-07-26 Thread Ray
Hello Pavel, Thanks for the explanation, it's been great help. Can you take a guess why PME has performed a long time due to communication issues between server nodes? >From the logs, the "no route to host" exception happened because server can't connect to client's ports. But I didn't see any l

SQL to limit number of records per agId

2018-07-26 Thread Prasad Bhalerao
Hi, I have cache CAHE_1 and it has entries as follows. ID is the cache key and agID and Val are part the values. Now I want to query this cache to get the output as shown below(Sample output). In short I want to limit the number of rows per agId. I just want to fetch 1 to 3 rows per agId. Filter

Re: service deploy cluster singleton lock application

2018-07-26 Thread sergey.dolinkov
upload as files locked-node-treaddump.txt worked-node-threaddump.txt -- Sent from: http://apache-ignite-users.70518.

Re: If the authenticationEnabled is true Ignite web control conneced failed

2018-07-26 Thread Alexey Kuznetsov
Actually, IGNITE-8428 already in master and will be released together with Ignite-2.7. As for https://console.gridgain.com it may be updated in the beginning of August. On Thu, Jul 26, 2018 at 6:17 AM Denis Magda wrote: > Alexey K., > > Please shed some light on when the secured cluster support

Re: Ignite Cluster with remote server + Cassandra Persistence

2018-07-26 Thread okiesong
Ok, thanks again. I will try it today and let you know the result. Just wondering, can I know why we are creating a custom CassandraCacheStoreFactory? Thanks in advance. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

INSERT query that UPDATES if record already found

2018-07-26 Thread olg.k...@gmail.com
Hi There, I'm using Ignite 2.4 with JDBC mainly as an in mem Cache and looking for a way to write the fastest query to insert new record but if a record with the same key already exists I would like it to be updated. DDL looks like this: CREATE TABLE PERSON ( Id VARCHAR, name VARCHAR, PRIMAR

Re: How do I rename multiple clusters

2018-07-26 Thread Alexey Kuznetsov
Hi, As a workaround you may set IGNITE_CLUSTER_NAME env variable for all nodes in cluster. On Thu, Jul 26, 2018 at 6:09 PM Evgenii Zhuravlev wrote: > Hi, > > There is no such thing like "cluster name" in Ignite right now. However, > I've found a ticket in Jira for adding it: > https://issues.a

Re: Ignite Cluster with remote server + Cassandra Persistence

2018-07-26 Thread Вячеслав Коптилин
Hello, It seems I found the root cause of the issue. Could you please try the following workaround? 1. create your own CacheStoreFactory public class CustomCassandraCacheStoreFactory extends CassandraCacheStoreFactory { private final String persistenceSettingsXml; public CustomCassandra

Re: "Unable to await partitions release latch within timeout: ServerLatch" exception causing cluster freeze

2018-07-26 Thread Pavel Kovalenko
Hello Ray, It's hard to say that the issue you mentioned is the cause of your problem. To determine it, it will be very good if you get thread dumps on next such network glitch both from server and client nodes (using jstack e.g.). I'm not aware of Ignite Spark DataFrames implementation features,

Re: Constant affinity key for some set of caches

2018-07-26 Thread Ilya Kasnacheev
Hello! You can extend RendezvousAffinityFunction overriding partition(Object) method, pass an instance of such affinity function in those caches' configurations. Regards, -- Ilya Kasnacheev 2018-07-26 16:01 GMT+03:00 Maxim Malygin : > Hi, > > I'd like to keep some set of caches together. In o

Constant affinity key for some set of caches

2018-07-26 Thread Maxim Malygin
Hi, I'd like to keep some set of caches together. In other words, I need that all elements of, for example, cache1 and cache2 were collocated to one node. I can do it by adding some additional field to their keys and initialize it with the same constant value for all caches. But I don't want keep

Re: CacheMetrics does not show the correct results

2018-07-26 Thread Evgenii Zhuravlev
Ignite updates metrics once in 2 seconds by default, it can be changed by using https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/configuration/IgniteConfiguration.html#setMetricsUpdateFrequency-long- Evgenii 2018-07-26 14:11 GMT+03:00 monstereo : > when i added > > TimeUnit.SE

Re: CacheMetrics does not show the correct results

2018-07-26 Thread monstereo
when i added TimeUnit.SECONDS.sleep(5); this line, it solved. But if we had more datas, maybe sleep time would be larger -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How do I rename multiple clusters

2018-07-26 Thread Evgenii Zhuravlev
Hi, There is no such thing like "cluster name" in Ignite right now. However, I've found a ticket in Jira for adding it: https://issues.apache.org/jira/browse/IGNITE-6597 Also, here is the thread on dev list regarding this feature: http://apache-ignite-developers.2346864.n4.nabble.com/Cluster-name

Re: Errors with TCPCommunicationSpi when using zookeeper discovery

2018-07-26 Thread Ilya Kasnacheev
Hello! As far as my understanding goes, ZookeeperClusterNode is not a Zookeeper daemon but a cluster node (i.e. Apache Ignite) which is managed by Zookeeper discovery. So it's natural that a connection will be initiated to such node. Modern TCP firewalls usually null route connection attempts to

Re: service deploy cluster singleton lock application

2018-07-26 Thread sergey.dolinkov
After a little analysis of the source code, I found out that when I called the method deployClusterSingleton I get GridServiceDeploymentCompoundFuture and it is never complite. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: service deploy cluster singleton lock application

2018-07-26 Thread Evgenii Zhuravlev
Well, then, do you have a mall reproducer for your issue? Or at least thread dumps, that I've mentioned in my previous message? Evgenii 2018-07-26 13:19 GMT+03:00 sergey.dolinkov : > This is an example. > The original code is more complicated. > For configuration, we convert megabytes to bytes.

Re: service deploy cluster singleton lock application

2018-07-26 Thread sergey.dolinkov
This is an example. The original code is more complicated. For configuration, we convert megabytes to bytes. In this example, there are no errors in the logs. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Using SQL users to open jdbc connections

2018-07-26 Thread prem
Hi, Is there any way we can use the user created via ignite sql to open jdbc connections. i have an authorization enabled cluster and can use the ignite superuser to open new jdbc connections with IgniteJdbcThinDriver but any users i create with create user sql command doesn't seem to work, the

Re: service deploy cluster singleton lock application

2018-07-26 Thread ezhuravlev
Hi, As per java doc of DataRegionConfiguration.setMaxSize - maxSize Maximum data region size in bytes. For sure, it won't work properly with such a small memory size(128 and 1024 bytes). Ignite even have validation for this parameter and it should be not less than 10mb at least. Have you checked

Re: peer class loading issue with client and server

2018-07-26 Thread debashissinha
Thanks a lot I agree with you and I am trying that only -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: peer class loading issue with client and server

2018-07-26 Thread Evgenii Zhuravlev
Hi, As per documentation: https://apacheignite.readme.io/docs/yarn-deployment#section-configuration, you can use IGNITE_XML_CONFIG property to use your xml config file. In this file you can configure peerClassLaodingEnabled property. Evgenii 2018-07-26 10:50 GMT+03:00 debashissinha : > Hi , > >

Re: Partitioned vs Replicated mode

2018-07-26 Thread Evgenii Zhuravlev
Hi, 1,2. You can use yardstick for benchmarking: https://apacheignite.readme.io/docs/perfomance-benchmarking. It contains a lot of already written benchmarks or you can write your own. 3. No, as for now, it's not possible to change backups count after the cache was created. Evgenii 2018-07-25 20

peer class loading issue with client and server

2018-07-26 Thread debashissinha
Hi , I am using ignite in client server mode . I am deploying ignite as an yarn application and in my client code I am doing tcp discovery to connect the server. In my client application i set in ignite configuration config.setcleintMode(true) and config.setPeerClassLaodingEnabled(true) However

Help needed with BinaryObjectException

2018-07-26 Thread Roger Janssen
Hi, Just some context first: We have a java application, and use spring function caching. In acceptance and prod, we have multiple instances and for that we use Ignite as a distributed in-memory cache. On test we run single instances, and we use Ignite just as a non-distributed in memory cache. We

Re: Composite Queries

2018-07-26 Thread Evgenii Zhuravlev
Of course, it's possible, but you I think you said that you want to build and store in Ignite already a composite object. Then if you want, you can write 4 cache stores for each table and select it with joins from client. 2018-07-25 16:55 GMT+03:00 musclesonvacation : > so your suggesting one cac

Re: What is the difference between TcpCommunicationSpi &TcpTcpDiscoverySpi ?

2018-07-26 Thread Evgenii Zhuravlev
Then I don't see how this can happen, two different processes can't bind to the same port. When you will have the reproducer, please share it with community. 2018-07-25 21:21 GMT+03:00 monstereo : > sorry, > there is no reproducure > > Stanislav Lukyanov wrote > > Please don’t send messages like