Re: Issue in starting IgniteSinkConnector with Distributed Worker mode

Hi, I'm not quite familiar with Kafka connector, but I'm going to figure it out and come back to help you. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p10664.html Se

Re: Node hangs while accessing cache from Compute Task

Hi, This is a correct behavior. It's not allowed to use cache API in CacheEntryProcessor, query listeners, interceptors and so forth, because it leads to deadlocks. In your example it looks like (threads T1, T2): T1 put entry -> T1 lock entry -> T1 call listener -> T1 execute job -> T1 wait for re

Re: Node hangs while accessing cache from Compute Task

I haven't found such documentation, so opened a ticket to improve it [1]. [1] https://issues.apache.org/jira/browse/IGNITE-4718 Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Node-hangs-while-accessing-cache-from-Compute-Task-tp10637p10700.htm

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

Hi, Check that file in path igniteCfgFile that you pass to IgniteSink constructor is available. If class initialization failed NoClassDefFoundError will be thrown. Also verify if IgniteSink$SinkContext$Holder.class is present in ignite-flink-2.0.jar. -Dmitry. -- View this message in context:

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

Is it possible to provide reproducible example? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/java-lang-NoClassDefFoundError-Could-not-initialize-class-org-apache-ignite-sink-flink-IgniteSink-Sir-tp10703p10750.html Sent from the Apache Ignite Users ma

Re: Flink Streamer Compatibility.

ignite-flink is a thin, one-class module, and yes, it's compatible with newest Apache Flink versions. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Flink-Streamer-Compatibility-tp10727p10755.html Sent from the Apache Ignite Users mailing list archive

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

Hi, I tried your sample and it works fine to me. In case of initialization error, exception would be thrown on IgniteSink constructor invocation step, but it looks like Holder was successfully intialized, but failed later. Could you please attach logs for provided example? -Dmitry. -- View thi

Re: Issue in starting IgniteSinkConnector with Distributed Worker mode

Hi, Could you please attach logs and thread dumps (in case of hang) if problem is still relevant? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p11161.html Sent from the Apache

Re: Can I let Ignite to do rebalance at a particular time?

Hi, Yes, you can set for caches that you want CacheConfiguration.setRebalanceMode(CacheRebalanceMode.NONE), and call IgniteCache.rebalance() when you need. To schedule rebalancing you may refer IgniteScheduler [1]. -Dmitry. [1] https://apacheignite.readme.io/v1.9/docs/cron-based-scheduling --

Re: Apache Ignite with log4J2 KafkaAppender - class not found

Hi, I suppose you need kafka log4j appender [1] in classpath. [1] https://mvnrepository.com/artifact/org.apache.kafka/kafka-log4j-appender -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Apache-Ignite-with-log4J2-KafkaAppender-class-not-found-tp11296p

Re: REST API authentication

Hi Ivan, REST API is based on Jetty server, so you need to configure SSL connector and certificates. Please refer [1, 2] for details. [1] https://apacheignite.readme.io/docs/rest-api#general-configuration [2] https://wiki.eclipse.org/Jetty/Howto/Configure_SSL -Dmitry. -- View this message in

Re: ignite messaging disconnection behaviour

Hi Kevin, You may use IgniteMessaging in async mode: IgniteMessaging msg = ignite.message().withAsync(); msg.sendOrdered("my-topic", objectToSend, 1); In that case you'll not wait for sending message and reconnections in if there was a failure. -Dmitry. -- View this message in context: http:

Re: Distributed callables: passing data and getting back results

Hi, If your tasks use the same data, then REPLICATED cache will be the best decision. But if you need for every compute task put new data to cache, it will slowdown processing, because entries must be distributed, copied and synchronized. The same rule is applicable for compute results: if you ne

Re: Can I let Ignite to do rebalance at a particular time?

Hi, Sorry, I confused you. For proper rebalance work you need to set rebalance mode to SYNC or ASYNC, rebalance delay to -1 and call IgniteCache.rebalance() on each node that participate in cache. The better way to do this is via compute broadcast task. Rebalance mode NONE disables rebalancing at

Re: Distributed callables: passing data and getting back results

Hi, Yes, you're right. You need to start Spring application and Ignite after that, ignite.sh is unable to start spring context. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Distributed-callables-passing-data-and-getting-back-results-tp11224

Re: Apache Ignite Query Entity String Array

Hi, You need to set value="L[java.lang.String;" and for querying you may use array_contains function. For example: ... WHERE array_contains(ABC, ?); Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Apache-Ignite-Query-Entity-String-Array-tp113

Re: [GridCachePartitionExchangeManager] Pending transaction deadlock detection futures

Hi, What operations in visorcmd you did? Please attach thread dumps (when cluster hangs) and logs from all nodes. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/GridCachePartitionExchangeManager-Pending-transaction-deadlock-detection-futures-

Re: Insert data in hdfs using ignite

Hi Prashant, Check if HADOOP_HOME set and add slash to the end of secondary file system uri (). Also it's not recommended to use hadoop-setup.sh script, follow instructions in readme [1]. [1] https://apacheignite-fs.readme.io/docs/installing-on-apache-hadoop -Dmitry. -- View this message in

Re: Can I inject resource bean from Spring into IgniteClosure

Hi, You may inject spring bean into IgniteCallable as well, just mark it transient and annotate with @SpringResource. There is no performance drop on services in comparison with compute, roughly speaking service is the same as compute job. So spring bean injection should work for both cases, choo

Re: ignite messaging disconnection behaviour

Hi Kevin, It seems that async mode has no effect for message sending, I've wrote a suggestion to fix this in dev list. But for now you could delegate message sending to separate thread just to release your main thread. I'll send follow up message to you with ticket number, if or when it will be op

Re: NullPointerException when using IGFS

Joe, It seems a bug, I've filed a ticket [1]. Could you please check if this problem exists in 1.8 version? [1] https://issues.apache.org/jira/browse/IGNITE-4862 Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/NullPointerException-when-using-

Re: cache replication factor

Hi Tuco, You're speaking about PARTITIONED cache with custom number of backups [1, 2]. You may specify how many copies partition will have. For example, You have 3 nodes and number of backups set to 1, that means each partition has 1 copy on other node. In other words, if one node failed - you'll

Re: Monitoring Cache - Data counters, Cache Data Size

Hi Binti, First of all, cache metrics must be enabled with CacheConfiguration.setStatisticsEnabled(true). But size and keySize show local values anyway, that looks like a bug. I've filed a ticket for that [1]. If you want, feel free to contribute. [1] https://issues.apache.org/jira/browse/IGNITE-

Re: [GridCachePartitionExchangeManager] Pending transaction deadlock detection futures

Hi, Do you use custom build? In logs Ignite version 1.6.12, but it uses stripped pool, which was introduced only in 1.8.2 and 1.9. Also there was a node stall, because of many disk operations (swap file). This doesn't lead to hang, but may reduce cache performance. Besides log files also thread d

Re: NullPointerException when using IGFS

Hi, Thanks for testing, hadoop specialists will fix it. Please use sequentialReadsBeforePrefetch = 64 as a workaround for now. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/NullPointerException-when-using-IGFS-tp11328p11486.html Sent from th

Re: ignite messaging disconnection behaviour

Hi Kevin, Unfortunately community decided to leave it as is, because messages are sent asynchronously by design, but connection establishing is not. That was made intentionally and user should take it into account and resolve depending on concrete situation. Thanks! -Dmitry. -- View this mess

Re: data consistency in atomic mode

Hi, In FULL_SYNC mode client will retry update to new primary node. So yes, cache will be consistent. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/data-consistency-in-atomic-mode-tp11719p11723.html Sent from the Apache Ignite Users mailing list arch

Re: Stoppin listen for topics in Ignite

What do you mean saying "all messages"? How do you detect that all messages were sent? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Stoppin-listen-for-topics-in-Ignite-tp11604p11724.html Sent from the Apache Ignite Users mailing list archive at Nabbl

Re: data consistency in atomic mode

Yes, you're correct, in this case atomic cache could be inconsistent and transactional cache will provide consistency guarantees. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/data-consistency-in-atomic-mode-tp11719p11746.html Sent from the Apache Ig

Re: NameNode sync using DUAL_ASYNC mode on IGFS

Hi, You may use it in cases when you use temporary files that should be removed after node stop, or any other data that don't require persistence. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/NameNode-sync-using-DUAL-ASYNC-mode-on-IGFS-tp11644p11756

Re: Ignite Affinity & Binary Configuration Issues

Hi Addo, There is no need to explicitly specify IdentityResolver. On marshaling step, hash code is got from object and recorded in BinaryObject, and it will be used for any affinity mapping, e.g. affinity run. Use IdentityResolver if you need customize hash code calculation, f.e. exclude some fiel

Re: OOM when using Ignite as HDFS Cache

Hi Shuai, Could you please take heap dump on OOME and find what objects consume memory? There would be a lot of byte[] objects, please find the nearest GC root for them. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/OOM-when-using-Ignite-as-

RE: OOM when using Ignite as HDFS Cache

Hi, The correct way here would be to understand where actually problem occurs and after that make decisions on how to solve it. > I also notice that Ignite write through file block size is set to 64MB. I > mean I write a file to Ignite with block size to 4GB, but I finally found > it on HDFS with

Re: Index

Hi Sambhav, You may find created indexes using web-console [1]. [1] https://ignite.apache.org/addons.html#web-console -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Index-tp11969p11980.html Sent from the Apache Ignite Users mailing list archive at Nab

Re: ScanQuery log all entries

Hi Sam, 1. Yes getAll() will bring all values to an on-heap collection, which may lead to OOME, so it should be used with caution. 2. Any query returns QueryCursor that lazily iterates over entries. You may do 1000 iterations over cursor and accumulate result in some collection. This will be just

Re: When is CacheStoreAdapter sessionEnd method called?

Hi, This method is called on transaction commit or rollback. Check that cache has atomicity mode TRANSACTIONAL and you always call Transaction.commit() or Transaction.rollback() for explicit transactions. If it doesn't help, please attach pet project that reproduces this issue, because in my case

Re: LocalDateTime field being ignored on Cassandra write through

Hi, please share your configurations. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/LocalDateTime-field-being-ignored-on-Cassandra-write-through-tp11986p12000.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: LocalDateTime field being ignored on Cassandra write through

Hi, I tried your configuration and it works fine for me. Please check attached project. I used Cassandra v3.0.13. cassandra-test.zip -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x

Re: ScanQuery log all entries

Hi, Yes, you understand correctly. Here is example: private static void sqlQuery() { IgniteCache, Person> cache = Ignition.ignite().cache(PERSON_CACHE); // SQL clause which selects salaries based on range. String sql = "salary > ? and salary <= ?"; // People with

Re: Compute calls happening on client node

Hi, You just need to specify cluster group: ignite.compute(ignite.cluster().forServers()).run(new IgniteRunnable() { @Override public void run() { System.out.println("This will be processed on server nodes only"); } }); There a various of p

Re: LocalDateTime field being ignored on Cassandra write through

Hi Guilherme, Now Ignite Cassandra store has hard mappings from java to Cassandra types: org.apache.ignite.cache.store.cassandra.common.PropertyMappingHelper#JAVA_TO_CASSANDRA_MAPPING If type is not in this map - it will be serialized. LocalDateTime is not there for compatibility reasons, and no

Re: LocalDateTime field being ignored on Cassandra write through

Guilherme, You may track feature development here [1] or contribute it by yourself. [1] https://issues.apache.org/jira/browse/IGNITE-5013 -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/LocalDateTime-field-being-ignored-on-Cassandra-write-through-tp11

Re: Error while building application

Hi, Please share full build log and pom.xml. Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-building-application-tp12027p12035.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: ScanQuery log all entries

Sam, Cursor iterator will go over whole result, but it will not hold in memory all dataset, just part limited by page size. In other words, it fetches 1024 entries, and when iterator points after last entry - loads another page with 1024 entries. So you shouldn't worry when results arrived - they

Re: BinaryObjectImpl.deserializeValue with specific ClassLoader

Hi Nick, Please attach stack trace, and what version of Ignite do you use? Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/BinaryObjectImpl-deserializeValue-with-specific-ClassLoader-tp12055p12080.html Sent from the Apache Ignite Users mailing

Re: What is the difference between starting a node using Java application, and manual starting?

Hi, If under manually started you mean using ignite.sh(.bat) script, then there actually is no difference, because at the end it calls the same Ignition.start() method (Spring configured app as well). But with programmatic starting you can run more than one node in single JVM. This may be useful i

Re: What is the difference between starting a node using Java application, and manual starting?

Hi Rick, Ignite loads plugins with ServiceLoader, so you anyway need to register your PluginProvier in META-INF/services even if you run it using Ignition. In case of ignite.sh, you need add jar with plugin classes to libs/ dir and again with set PluginProvider in it's META-INF/services. In other

Re: Error while building application

Hi, Try to use absolute imports: instead of org.apache.ignite.Ignite use _root_.org.apache.ignite.Ignite. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-building-application-tp12027p12220.html Sent from the Apache Ignite Users mail

Re: Serializer

Hi, You may use your custom collections as is - they will be deserialized in correct type. If you want to implement Binarylizable with additional serialization logic, you can use something like follows (but this approach will need intermediate object): private static class CustomList extends A

Re: Grid is in invalid state to perform this operation

Hi Sam, Was local node connected to remote cluster? Probably it was kicked off the cluster, because of closed connection. Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Grid-is-in-invalid-state-to-perform-this-operation-tp12360p12379.html Sent

Re: IGFS - Python and R clients

Hi Sergey, To use IGFS from non-JVM languages you may configure it as FS for Hadoop in IgfsMode.PRIMARY mode. After that you can configure connectivity from any supported language to Hadoop and it's file system. Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518

Re: Grid is in invalid state to perform this operation

Sam, Please attach logs from your node. -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Grid-is-in-invalid-state-to-perform-this-operation-tp12360p12411.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Cache Not working

Hi, Ignite and IgniteCache implement AutoCloseable interface, which means, if you use try-with-resources or explicitly call close() method it stops node and cache. Try not to stop Ignite node and cache while test. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.

Re: Sizing Guide

Hi, I'm not sure I understand your question, but if you need to calculate memory consumption, this might be helpful [1]. [1] https://apacheignite.readme.io/v1.9/docs/capacity-planning -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Sizing-Guide-tp12477

Re: export ignite data

Hi, Probably the reason of client reconnection was a long GC pause on it. Try to use scan query [1], it's liter than SQL, and check that you have enough of heap. [1] https://apacheignite.readme.io/v1.8/docs/cache-queries#scan-queries Thanks! -Dmitry -- View this message in context: http://ap

Re: BinaryFieldIdentityResolver

Hi, You forgot to pass configuration to Ignition.start() method :) Ignition.start(config); -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/BinaryFieldIdentityResolver-tp12896p13018.html Sent from the Apache Ignite Users mailing list archive at Nabble.c

Re: How to safely shut down an app with shared RDD without lossing data?

Hi, It's usually better approach to run client code on client nodes, because they don't keep cache data and, as a consequence, shutdown or restart doesn't change cache state. Another way is to configure cache with backups, f.e. in your case you have 2 server nodes, if you set CacheConfiguration.

Re: How to safely shut down an app with shared RDD without lossing data?

Hi, You're supplying function that creates IgniteConfiguration: CreateConfiguration(), modify it that it will set client mode when need: IgniteConfiguration.setClientMode(). -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-safely-shut-down-an-app-

Re: how to let client node connect to server node, not server connect to client

Hi Jeff, Unfortunately, you cannot avoid this and you need to open that ports (47100-47109) on client node, because communication must has ability to initiate connection in both directions. Also you may leave those ports open only for hosts where server nodes are running. Thanks! -Dmitry -- Vi

Re: Expired entry in cache with persistent store

Hi, This is a correct behavior, by design any cache evictions and expirations don't affect store, because cache usually keeps only hot data. If you set read though, then Ignite will request store in case if entry wasn't found in cache, otherwise it returns null and to load that data back in cache

Re: novalue (NULL) vs default zero for writeInt/readInt

Hi Sam, There is no method in public API that checks filed existense, but you may use readObject(). It will return null if field was not found, otherwise you'll need to unbox the value. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/novalue-NU

Re: How to create a compute tasks which uses Cache and transaction?

Hi, First of all, Java task class should be available on server, then you'll be able to run the task using it's class name [1]. In that task you may access cache with transaction using standard Ignite Java API [2]. You need start server only once, and then invoke task as many times as you want.

Re: Cache Not working

Hi, Sorry for late response. It looks like you close the stream and stop the node before any data got received. Try to remove try-with-resources from starting client node, creating cache and streamer. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cac

Re: Fully dynamic cache

Hi, You can dynamically create and change binary objects with BinaryObjectBuilder [1], but fields that you want to query must be specified on node startup at least with QueryEntity [2], but altering internal query tables at runtime is not possible for now. [1] https://apacheignite.readme.io/v2.0/

Re: Proper use of ignite semaphore

Hi, To make semaphore fail safe in your case you may set AtomicConfiguration to IgniteConfiguration with REPLICATED cache mode, so semaphore data will be stored on every node. Additionally check FifoQueueCollisionSpi [1] that will control jobs execution for you. [1] https://apacheignite.readme.io

Re: IgniteRDD SQL query stalled or extremly slow on large input argument

Hi, Could you please attach thread dumps from all nodes? Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IgniteRDD-SQL-query-stalled-or-extremly-slow-on-large-input-argument-tp13711p13859.html Sent from the Apache Ignite Users mailing list ar

Re: Monitor remote cache in Ignite

Hi, You may use Ignite Web Console for that purpose [1]. [1] https://ignite.apache.org/features/datavisualization.html Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Monitor-remote-cache-in-Ignite-tp13982p14022.html Sent from the Apache Ignit

Re: encounter issue on ignite 2.0

Hi, Could you please share your configurations? Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/encounter-issue-on-ignite-2-0-tp13812p14023.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite-cassandra module issue

Hi, Is it possible to provide a simple reproducer? Answering your second question, yes, you can use BinaryObject as persistence class name. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-cassandra-module-issue-tp13808p14025.html Sent f

Re: Common query in Ignite

Hi, 1. You may run query from client node [1] or with REST API [2]. Client mode requires that it should be accessible from cluster, at least 47500 and 47100 ports should be opened on machine with client node. REST allows calling queries and other Ignite API without opening that ports. 2. Java cli

Re: Streaming test

Hi, Could you please share your test project? Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Streaming-test-tp14039p14041.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Determine current number of Server Nodes

Hi Chris, You understand correctly that you need to subscribe for node joined event. Here is possible example of how to write it: private static class Listener implements IgnitePredicate { @IgniteInstanceResource private Ignite ignite; @Override public boolean apply(

Re: Data eviction to disk

Hi, You may check out the swap storage [1], but it will be useful if keys significantly smaller than values, because keys will be kept in memory. [1] https://apacheignite.readme.io/v1.8/docs/off-heap-memory#swap-space Thanks! -Dmitry -- View this message in context: http://apache-ignite-user

Re: Heap Memory Limit Set

Hi, This value is just a sum of available heaps on JVMs on which nodes are running. You may limit each node with -Xmx10g or -Xmx5g for example. Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Heap-Memory-Limit-Set-tp14560p14597.html Sent from th

Re: how does write request send to new node when rebalancing before affinity changed?

Hi, Cache requests will continue going to old nodes unless re-balancing finished. After re-balancing new affinity mappings applied and discarded the old ones, so you request only actual data. In details, before sending request to node, requester checks a last valid topology version, and gets affin

Re: Cache loader factory with peer class enabled mode

Hi, Peer class loading was designed for compute tasks deployment, it's not applicable for configuration classes or cache entries. So you have to copy that classes to all nodes. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cache-loader-factor

Re: Fields order in binary object.

Hi, It seems Ignite doesn't sort fields for binary objects by default. Use IGNITE_BINARY_SORT_OBJECT_FIELDS system property: -DIGNITE_BINARY_SORT_OBJECT_FIELDS=true or System.setProperty("IGNITE_BINARY_SORT_OBJECT_FIELDS", "true"); Thanks! -Dmitry -- View this message in context: http://apach

Re: Gridgain Stat Data

Hi Priya, I think you're looking for Ignite web console [1]. [1] https://ignite.apache.org/addons.html#web-console Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Gridgain-Stat-Data-tp14750p14868.html Sent from the Apache Ignite Users mailing

RE: Gridgain Stat Data

Yes, try Visor CLI, but it's very limited [1]. [1] https://apacheignite-tools.readme.io/docs/command-line-interface Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Gridgain-Stat-Data-tp14750p14870.html Sent from the Apache Ignite Users mailing

Re: Ignite PlugingProvider

Hi Luqman, ExtensionRegistry is used by IgnitePluginProcessor to replace internal Ignite interface implementations, but it's only used for MessageFormatter, MessageFactory and IoPool (search usages for IgnitePluginProcessor#extensions). So if you do not want to use your own implementation for that

Re: In which scenario the ignite nodes will shutdown by itself

Hi, Node may stop if it was segmented out of the cluster. Usually this happens because of long GC or network pauses, when node doesn't respond longer than failureDetectionTimeout. Please, attach Ignite (with -DIGNITE_QUIET=false JVM flag) and GC logs, this will help to understand more. Thanks! -

Re: Strange problems with Ignite native Persistence when Data exceeds Memory

Hi Roger, It looks like not all data could fit in memory and pages started to swap into disk. This means that too many pages marked as dirty that causes more often and longer checkpointing, that with WAL writes may significantly slowdown data uploading. Please attach Ignite and GC logs and try to

Re: Error while starting service grid with persistent store enabled

Hi, The big slowdown gives writing WAL into disk. You may increase throughput by setting lower fail safe requirements: set PersistentStoreConfigiration.setWalMode() to LOG_ONLY (data may be lost on power off) or BACKGROUND (data may be lost on process crash), or increase available memory and set l

RE: Activation: slow and: Ignite node crashed in the middle of checkpoint.

Hi Roger, The recovery message in logs is normal case when node was forced to stop. This only means that data are restoring from WAL on start. Slow activation doesn't look OK, it shouldn't take so long. Could you please restart grid with -DIGNITE_QUIET=false JVM flag and share logs? Thanks! -Dm

Re: TcpDiscoveryVmIpFinder handle IP change

Hi, It looks OK, I don't see any problems here. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/TcpDiscoveryVmIpFinder-handle-IP-change-tp16156p16198.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Use SLF4J in Ignite

Hi, Check where IGNITE_HOME env variable points to, Ignite may load libraries out of there. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Use-SLF4J-in-Ignite-tp16179p16199.html Sent from the Apache Ignite Users mailing list archive at Nabble.

Re: Update cache fail with IgniteInterruptedException

Hi Aaron, It looks like node is stopping. Do you have NODE FAILED, SEGMENTED or LEFT messages in logs? Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Update-cache-fail-with-IgniteInterruptedException-tp16224p16226.html Sent from the Apache Ignite Users

Re: In which scenario the ignite nodes will shutdown by itself

Hi Aaron, Do you have long GC pauses? As Bob said, large queries or transactions could move a lot of data to on-heap. F.e. regular SELECT will get all dataset into heap on server node and will respond to client with pages. But first of all try to find a reason of node segmentation first, it could

Re: IgniteAtomicSequence durability

Hi Mike, All atomics may be configured with IgniteConfiguration.setAtomicConfiguration() or Ignite.atomicSequence(), where you can specify number of backups, or set it as REPLICATED, but cannot configure persistent store. Only Ignite 2.1 can persist datastructures on disk. Thanks! -Dmitry. -

Re: getAsMap ??

Hi Chris, Collecting all data from cache to map is a bad idea, because it could be quite large and you may get OutOfMemoryError. Exactly for that purpose ScanQuery was designed [1]. You may set filter and using cursor get data: iterating over it (this will load entries from grid with batches), or

Re: problems in test ignite PersistentStore

Hi, 1. You need to set types for datastreamer just like for cache you did: var streamer = ig.dataStreamer[Int, String]("organization") 2. Check that classes from ignite/examples are in classpath. It's a maven module which has scala examples that you may play with. 3. [1, 2, 3] [1] https://ignit

Re: Performance of persistent store too low when bulb-loading

Hi, Please take about 5 thread dumps with interval in 1 sec. This will help to understand what threads busy with. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Performance-of-persistent-store-too-low-when-bulb-loading-tp16247p16257.html Sent

Re: Performance of persistent store too low when bulb-loading

Hi, The reason of slowdown might be the fact, that Ignite by default consumes 80% of available memory, which forces OS to start a lot of swapping, so all memory operations limited by disk speed. Try to reduce memory size [1]. [1] https://apacheignite.readme.io/v2.1/docs/memory-configuration#memor

RE: Strange problems with Ignite native Persistence when Data exceeds Memory

Hi Roger, The reason of slowdown might be the fact, that Ignite by default consumes 80% of available memory, which forces OS to start a lot of swapping, so all memory operations limited by disk speed. Try to reduce memory size [1]. [1] https://apacheignite.readme.io/v2.1/docs/memory-configuration

Re: CacheAtomicityMode and CacheMode

Hi, 1. In most cases that exception might be thrown if cache store cannot be updated. Regularly even on unstable topology you won't get it, so the easiest would be to do putAll() with failed keys, it should be finished successfully. 2. By default memory shared across all caches, so you may check

Re: Activation: slow and: Ignite node crashed in the middle of checkpoint.

Hi, Please share full logs and thread dumps, it's hard to understand the root cause. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Activation-slow-and-Ignite-node-crashed-in-the-middle-of-checkpoint-tp16144p16341.html Sent from the Apache Ign

Re: Performance of persistent store too low when bulb-loading

Hi, Could you please take dstat, Ignite and GC logs and few thread dumps when application is experiencing slowdown? Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Performance-of-persistent-store-too-low-when-bulb-loading-tp16247p16342.html Sen

Re: Performance of persistent store too low when bulb-loading

Use this command for dstat: dstat -cmdgs --fs > dstat.txt Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Performance-of-persistent-store-too-low-when-bulb-loading-tp16247p16345.html Sent from the Apache Ignite Users mailing list archive at Nabb

Re: getAsMap ??

Hi Chris, 1. Indexing may slowdown insertions, but in will not be used if no CacheConfiguration.setIndexedTypes() or CacheConfiguration.setQueryEntities() set. 2. It depends on conditions. If you have a lot of data, but you need to filter out a small set of them, then indexing may greatly help yo

Re: Error while starting service grid with persistent store enabled

Hi Rishikesh, Could you please create a reproducer project with config that fails with NPE? This will help to find a bug. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-starting-service-grid-with-persistent-store-enabled-tp15946p16

<    1   2   3   4   >