Re: Random2LruPageEvictionTracker causing hanging in our integration tests

2020-06-03 Thread scottmf
Thanks Ilya. I tried all your suggestions and they work as expected. I'll close the bug. WRT cache groups, what's the rule of thumb with using cache groups? I read https://apacheignite.readme.io/docs/cache-groups, but I'm not sure on the approach I should take. Should I simply stay away from

Re: Node is unable to join cluster because it has destroyed caches

2020-06-03 Thread xero
Hi, I tried your suggestion of using a NodeFilter but, is not solving this issue. Using a NodeFilter by consistent-id in order to create the cache in only one node is creating persistence information in every node: In the node for which the filter is true (directory size 75MB):

Re: embedded jetty & ignite

2020-06-03 Thread Clay Teahouse
Thank you, Denis. I'll research this topic further. Any recommendation for/against using jetty as an embedded servlet container, in this case, say, deployed as an ignite service? On Fri, May 29, 2020 at 11:22 PM Denis Magda wrote: > Clay, > > Just start your Jetty server and deploy as many

Re: Suggest a better way to access a particular K-V store

2020-06-03 Thread Ilya Kasnacheev
Hello! Please try doing cursor.close() before return; Regards, -- Ilya Kasnacheev ср, 3 июн. 2020 г. в 09:17, adipro : > Can someone please help regarding this issue? > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: How to get POJOs in Python?

2020-06-03 Thread Ilya Kasnacheev
Hello! Have you tried the following example: https://github.com/apache/ignite/blob/master/modules/platforms/python/examples/read_binary.py (yes, it mostly works with tables, but tables and POJOs are mapped in the same fashion). Regards, -- Ilya Kasnacheev ср, 3 июн. 2020 г. в 18:54, Andrew

How to get POJOs in Python?

2020-06-03 Thread Andrew Munn
I'm having the same issues as these guys: http://mail-archives.apache.org/mod_mbox/ignite-user/201901.mbox/%3csn6pr14mb2240feb74bc77de79b54ca67ca...@sn6pr14mb2240.namprd14.prod.outlook.com%3E I would like to put POJOs in a map and get them using pyignite. Python gives me ParseError('Binary

Re: ignite node heap size

2020-06-03 Thread Denis Magda
As Ilya suggested start with 2GB per server node. Then do the load testing of your cluster using basic operations you suppose to have in prod. The testing will show if you need to increase or decrease the heap size and to which degree. - Denis On Wed, Jun 3, 2020 at 3:50 AM Ilya Kasnacheev

Re: Configuring DR site for Ignite Application

2020-06-03 Thread Denis Magda
Hi Deepthi, If RP4VM is comparable to VMWare VMotion then the following page should be exactly what you are looking for: https://apacheignite.readme.io/docs/vmware-deployment#cluster-nodes-migration-with-vmotion - Denis On Wed, Jun 3, 2020 at 1:17 AM DEEPTHI KOLLIPARA wrote: > Hi Team, > > >

Re: Ignite 2.8.1: Spark 2.4.4. No class found error

2020-06-03 Thread Mahesh Renduchintala
this issue is solved. I was using 2.4.4 cluster and using 2.3 binaries

Re: How to define compound index with some field and _key

2020-06-03 Thread Ilya Kasnacheev
Hello! Yes, QueryEntity allows you to specify key fields / key field name. Then you can create index over these fields. Regards, -- Ilya Kasnacheev ср, 3 июн. 2020 г. в 18:08, dilaz03 : > Hi, Ilya. > > Thank you for reply. My table is defined by QueryEntity and doesn't have > any > explicit

RE: [CVE-2020-1963] Apache Ignite access to file system disclosure vulnerability

2020-06-03 Thread Nick Popov
Are you going to provide CVE-2020-1964 patches and patch instructions for previous Ignite versions? Regards, -Nick From: Sriveena Mattaparthi Sent: Wednesday, June 3, 2020 9:04 AM To: user@ignite.apache.org; dev ; annou...@apache.org; Apache Security Team Subject: COMMERCIAL:RE:

Re: How to define compound index with some field and _key

2020-06-03 Thread dilaz03
Hi, Ilya. Thank you for reply. My table is defined by QueryEntity and doesn't have any explicit primary keys. So alias '_key' points to cache key. I can define some field with value from cache key, but it's duplication. May be I don't know something about cache keys. Can I define cache key from

Re: Random2LruPageEvictionTracker causing hanging in our integration tests

2020-06-03 Thread Ilya Kasnacheev
Hello! This is expected :) I recommend decreasing the number of caches, grouping them into cacheGroup's so that they share metadata, or decreasing number of partitions in their affinity functions. Regards, -- Ilya Kasnacheev сб, 30 мая 2020 г. в 03:19, scottmf : > hi Ilya, I have reproduced

Re: connection refused

2020-06-03 Thread Ilya Kasnacheev
Hello! This is HTTP connection. Ignite does not use HTTP between servers and clients (thin and thick). The only relevant place where HTTP is used with Ignite is REST API. Can you show the method in the trace? at com.zetcode.restex.JerseyClient2.main (JerseyClient2.java:25) Regards, --

RE: [CVE-2020-1963] Apache Ignite access to file system disclosure vulnerability

2020-06-03 Thread Sriveena Mattaparthi
Thanks, Could you please confirm when the analysis will be updated here for the CVE logged. https://nvd.nist.gov/vuln/detail/CVE-2020-1963 Regards, Sriveena From: Юрий Sent: 03 June 2020 16:02 To: dev ; user@ignite.apache.org; annou...@apache.org; Apache Security Team ; Sriveena Mattaparthi

Re: How to define compound index with some field and _key

2020-06-03 Thread Ilya Kasnacheev
Hello! How is your table defined? _key is just an implicit alias for all of your primary key columns. So you should be listing those. Regards, -- Ilya Kasnacheev ср, 3 июн. 2020 г. в 13:14, Dmitry Lazurkin : > Hello, > > I try to define compound index with some field and _key: > create index

Re: Question regarding topology

2020-06-03 Thread adipro
Also, In SQL query, we are having a semaphore lock where all the threads stay there and only one thread can execute the code. It's because in the code, we have jdbc connection query. And it's not thread safe. Sometimes we even get thread hanging here if we keep increasing client worker threads.

Re: Question regarding topology

2020-06-03 Thread adipro
Thanks for reply. Our clients are connected in both ways one is JCache way and other is SQL way each for various caches. -> For get/put we use normal getAll() and normal putAll(). The thing is here all the threads will have their own data and the data is not shared. So no need to worry about

Question regarding topology

2020-06-03 Thread adipro
If I have a cache named "XYZ" with replication mode ON then what happens for the queries if the topology configuration is as below. 1) Two app servers (clients) which make total 100 connections (50 each) in parallel as it's multi-threaded application. Both are 64 core machines. 2) Two DB servers

Re: Message Queue Size

2020-06-03 Thread Ilya Kasnacheev
Hello! I think it involves the following tradeoff: If you limit it, operations will wait on communication once the limit is hit. If you don't limit it, you will see OOM (heap memory) eventually. This assumes that communication ever becomes a bottleneck, which will almost never happen. Since it

Re: ignite node heap size

2020-06-03 Thread Ilya Kasnacheev
Hello! I'm not completely sure, it surely depends on your use case (such as SQL, which will hold result sets on heap). 2G of heap is usually enough for a server node. Regards, -- Ilya Kasnacheev ср, 3 июн. 2020 г. в 04:44, kay : > Hello, I have 4 nodes for server node and I'd like to

[CVE-2020-1963] Apache Ignite access to file system disclosure vulnerability

2020-06-03 Thread Юрий
Hi All, Apache Ignite 2.8.1 has been released. The release contain fix of critical vulnerability CVE-2020-1963: Apache Ignite access to file system through predefined H2 SQL functions Severity: Critical Vendor: The Apache Software Foundation Versions Affected: All versions of Apache Ignite up

Re: Suggest a better way to access a particular K-V store

2020-06-03 Thread adipro
Can someone please help regarding this issue? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Two specific warnings everytime

2020-06-03 Thread adipro
Can someone please help regarding this issue? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Data Consistency Question

2020-06-03 Thread adipro
Can someone please help regarding this issue? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Semaphore Lock Not Acquired. Race issue?

2020-06-03 Thread adipro
When I removed the stopped Server node IP from Client IP list and server IP list and start both clients, it is working fine. Although I couldn't reproduce it again. If I found it again, I'll try taking dumps and reply it in this thread. Java version -> jdk 1.8.0_152 Ignite version -> 8.7.10

How to define compound index with some field and _key

2020-06-03 Thread Dmitry Lazurkin
Hello, I try to define compound index with some field and _key: create index idx_desc on mytable (somecolumn asc, _key desc); create index idx_asc on mytable (somecolumn asc, _key asc); Error: Column doesn't exist: _KEY (state=42000,code=3008) Is this bug? Because I see _key column in sqlline

Re: Message Queue Size

2020-06-03 Thread prudhvibiruda
Hi , We are using 2.8.0 version. And I still get this warning. Can you please explain the significance of this property and what is the advisable value to keep in production. I saw someone keep it to 1024. What is the significance and what happens after 1024. Thanks, Prudhvi -- Sent from:

Re: Ignite Spark - Error - Did you call Ignition.start(..)?

2020-06-03 Thread Mahesh Renduchintala
I am seeing this problem even on Ignite 2.8.1, spark 2.4.4 Does spark-worker and ignite be on the same server? val CONFIG = "resources/node-config-spark.xml" val TABLE_NAME = "table_access_master" //Creating Ignite-specific implementation of Spark session. val igniteSession =

Re: Question regarding topology

2020-06-03 Thread Stephen Darlington
How are your clients connected? Are they thick or thin clients? And what are the queries? Are they JCache (i.e., get/put) or SQL? > On 3 Jun 2020, at 08:54, adipro wrote: > > If I have a cache named "XYZ" with replication mode ON then what happens for > the queries if the topology

Configuring DR site for Ignite Application

2020-06-03 Thread DEEPTHI KOLLIPARA
Hi Team, We have implemented Apache Ignite 2.7 version with Ignite native persistence enabled in partition mode. We are planning to create a DR(Disaster Recovery) site for the production environment using RP4VM. RP4VM will technically keep the cloned VM at DR Site in sync with the

Re: Ignite memory memory-architecture with cache partitioned mode

2020-06-03 Thread kay
Thank you so much! It is very helpful!! :) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Ignite 2.8.1: Spark 2.4.4. No class found error

2020-06-03 Thread Mahesh Renduchintala
Hi, I am running a program that connects to a remote spark cluster. I get the following error. Any insight into the error? Spark 2.4.4 Scala 2.11.12 Ignite 2.8.1 Exception in thread "main" java.lang.NoSuchMethodError: