Ignite Node crashed in middle of checkpoint and data loss

2019-02-18 Thread garima.j
Hello, We have an ignite cluster of 3 nodes (16GB RAM, 50GB disk space each)and have given 10GB (off-heap) to data region and (Xms) 2GB and (Xmx) 3GB to the nodes. One node went down and while restarting the node, I get the exception that Ignite node crashed in the middle of checkpoint and JVM c

Re: Populating tables via IgniteDataStreamer

2019-02-18 Thread joseheitor
Hi Clay, With JDBC, I have used the following successfully: dbConnection = HikariCPDatasource.getConnection(); dbConnection.setSchema("public"); *dbConnection.createStatement().execute("ALTER TABLE tablename NOLOGGING");* *dbConnection.createStatement().execute("SET STREAMING ON");* f

Populating tables via IgniteDataStreamer

2019-02-18 Thread Clay Teahouse
Hello All, Can someone share an example of utilizing IgniteDataStreamer API to populate a table created via a DDL? thank you, Clay

Re: Authorization Plugin

2019-02-18 Thread Alexey Kuznetsov
Hi, Sergio! May be this article will be useful for you: http://smartkey.co.uk/development/securing-an-apache-ignite-cluster -- Alexey Kuznetsov

cache expiry issue

2019-02-18 Thread ignite_user2016
we use ignite with spring boot application and seeing issue in production where few cache entries are not being expired. our configuration is based on XML, sample configuration as follows - we apply this expiry

Segfault in GridCacheEvictionManager.touch()

2019-02-18 Thread breischl
I've been having problems recently with nodes crashing out of a running, 18-node cluster. I managed to catch the following error log out of one of them. Unfortunately I did not manage to grab the core dump before the AWS instance was destroyed. I'll try to grab one if I can. This application in ge

Re: Native memory tracking of an Ignite Java 1.8 Application

2019-02-18 Thread Павлухин Иван
Prasad, Thank you for sharing results! пн, 18 февр. 2019 г. в 20:06, Prasad Bhalerao : > > Hi, > > Thank you for the hint. I just wrote a small program to allocate 1 GB memory > and to free the same memory using UNSAFE api. I took the native memory > tracking report 3 times, before allocating 1

OutOfMemoryError in ClusterProcessor.updateNodeMetrics

2019-02-18 Thread Ruslan Kamashev
Hi, Could you tell me something about my problem? Before OOM error I was getting warning messages such as "Failed to unmarshal node metrics:". Caches: 1 cache - Persistence, FSYNC, PRIMARY_SYNC, 3 backups by Availability Zones (AZ) using ClusterNodeAttributeAffinityBackupFilter Topology: 12 no

Re: Native memory tracking of an Ignite Java 1.8 Application

2019-02-18 Thread Prasad Bhalerao
Hi, Thank you for the hint. I just wrote a small program to allocate 1 GB memory and to free the same memory using UNSAFE api. I took the native memory tracking report 3 times, before allocating 1 GB memory, after allocating 1 GB memory and after freeing 1 GB memory. Here is the snippet of report

Re: Native memory tracking of an Ignite Java 1.8 Application

2019-02-18 Thread Павлухин Иван
Prasad, Someone has already posted a snippet [1]. [1] https://gist.github.com/prasanthj/48e7063cac88eb396bc9961fb3149b58 пн, 18 февр. 2019 г. в 17:23, Павлухин Иван : > > Hi Prasad, > > As far as I remember offheap memory allocated with use of Unsafe is > not reflected in Native Memory Tracking

Re: Native memory tracking of an Ignite Java 1.8 Application

2019-02-18 Thread Павлухин Иван
Hi Prasad, As far as I remember offheap memory allocated with use of Unsafe is not reflected in Native Memory Tracking report. You are right that documentation is not verbose about reported categories [1]. It might be the case that memory allocated by ByteBuffer.allocateDirect falls into "internal

[Cache in Java] Missing AutomicConfiguration enum in lib

2019-02-18 Thread jameswsp
Hi Support, I am using cfg.setAtomicConfiguration() function, but I find there is no enum type for AtomicConfiguration. Only CacheAtomicityMode is available in Java doc. But it could not be used in cfg.setAtomicConfiguration() It is contradiction. Please advise what I am missing. Thank you. Ja

Re: Native memory tracking of an Ignite Java 1.8 Application

2019-02-18 Thread Dmitriy Pavlov
Hi. Please don't use posting to both dev/user lists simultaneously. If your question is not related to any contribution you are planning to do, then the user list is a better place to ask, because a possible answer may be interesting to all Ignite users. If you are going to fix any issue and wou

Native memory tracking of an Ignite Java 1.8 Application

2019-02-18 Thread Prasad Bhalerao
Hi, I have set the off heap size to 500 MB and max heap size to 512 MB. My process is taking around 1.7 GB on Windows 10 as per the task manager. So I decided to track the memory distribution using jcmd to find out if there are any memory leaks in non-heap space. After pushing the data to cache

Re: Authorization Plugin

2019-02-18 Thread Ilya Kasnacheev
Hello! Please note that SecurityContextHolder is thread-local. You might need to have a fixed instance of SecurityContext in your processor as opposed to getting it from holder when you don't need thread locality. -- Ilya Kasnacheev пн, 18 февр. 2019 г. в 14:22, Sergio Hernández Martínez < ser

RE: Authorization Plugin

2019-02-18 Thread Sergio Hernández Martínez
Hello! I'm already putting in authenticate method the security context in SecurityContextHolder: SecurityPluginSecuritySubject securityPluginSecuritySubject = new SecurityPluginSecuritySubject( authenticationContext.subjectId(), authenticationContext.subjectType(),

Re: Authorization Plugin

2019-02-18 Thread Ilya Kasnacheev
Hello! I guess you will have to fill this context yourself for calls which supply null as context. Then maybe put it in holder. Regards, -- Ilya Kasnacheev сб, 16 февр. 2019 г. в 16:28, Sergio Hernández Martínez < serher...@hotmail.com>: > Hi Ilya, > > Thank you for you tip, but push(), pop()

Re: pre-load data (Apache ignite native persistence store or Cassandra) into two partitioned cache tables

2019-02-18 Thread Ilya Kasnacheev
Hello! 1) The best way of preloading data is to add CacheLoader (or CacheStore) to cache configuration and call loadCache(). 2) Data will be collocated as long as both caches use same affinity field (via annotation, AffinityKey or configuration). Then if you join tables by that field Ignite will

Re: Apache Ignite starts fast and then become really slow with out of memory

2019-02-18 Thread Ilya Kasnacheev
Hello! I recommend starting from simplest configuration to more complex one. Remove onheap cache, see if problem goes away. Regards, -- Ilya Kasnacheev вс, 17 февр. 2019 г. в 12:09, : > Hey Ilya, > > > > Yes you are right, the LinkedHashMaps entries are the dominate part. > > I was concentrat

Re: Implementing custom plugin

2019-02-18 Thread Ilya Kasnacheev
Hello! Please see for example https://github.com/apache/ignite/blob/ignite-2.5/modules/compatibility/src/test/java/org/apache/ignite/compatibility/testframework/plugins/TestCompatibilityPluginProvider.java Regards, -- Ilya Kasnacheev вс, 17 февр. 2019 г. в 22:58, vitalys : > Is it on GitHub,