Webinar >> How to Use Spark With Apache Ignite for Big Data Processing

Hi Igniters! I'm going to talk about Apache Ignite Spark integration and run live demo examples during the following webinar: https://www.gridgain.com/resources/webinars/how-use-spark-apache-ignite-big-data-processing If you'd like to learn more about the existing API, take a look at some use

Re: IgniteCache.size() is hanging

Hi, Can you please provide the full server logs? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Remote Cluster ServiceGrid debug

Hi, There is too little information about your case. Which kind of debug you are going to have? Ignite has several monitoring tools. For example, you can use the web console: https://apacheignite-tools.readme.io/v2.8/docs/ignite-web-console Probably you can use it. BR, Andrei -- Sent

Re: Enabling swapPath causes invoking shutdown hook

Hi, Documentation looks not very clean for me. Probably you should prepare your operating system to use swap space. Can you try to prepare the swap file first as following: https://linuxize.com/post/how-to-add-swap-space-on-ubuntu-18-04/ And then choose this file. BR, Andrei -- Sent from:

Re: Fwd: Exceptions in C++ Ignite Thin Client on process exit

Hi, Are you sure that you don't have connectivity problems there? Is it possible to share full logs? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Node left from running cluster due to org.apache.ignite.internal.processors.cache.persistence.tree.CorruptedTreeException: Runtime failure on search row

Hi, Can you please clarify the version from which you upgraded? I know that it's possible that if you used a pretty old version then you should also rebuild your indexes during the upgrade because inline size calculation logic was changed in last releases. It can be done by removing index.bin

Re: Blocked system-critical thread has been detected

Hi, Your log doesn't have the full thread dumps and I can't find some information (e.g Topology Snapshots). However, I see that checkpoint thread was blocked for a long time: [02:45:50,849][SEVERE][tcp-disco-msg-worker-[3dac150e 10.20.4.18:47500]-#2][G] Blocked system-critical thread has been

Re: Enabling swapPath causes invoking shutdown hook

Hi, Can you please clarify your expectations? You expected that JVM process will be killed instead of gracefully stopping? What you are going to achieve? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: A question regarding cluster groups

Hi, 1)No, at the moment there is no such implementation out of the box. You should create your own implementation of data moving tool. 2)At the moment there is no such implementation too. However, I see that there is the discussion about it on developer user list:

Re: Too much network latency issue

Hi, I guess that some of your operations were slow because of load balancer work. Two ways of affinity calculation exist: 1)If readFromBackup = false then the node with primary partition will be chosen. Primary can be on different nodes. 2)If readFromBackup = true then the random node will be

Re: read-though tutorial for a big table

Hi, You can read the documentation articles: https://apacheignite.readme.io/docs/3rd-party-store In case if you are going to load the cache from 3-rd party store (RDBMS) then the default implementation of CacheJdbcPojoStore can take a lot of time for loading the data because it used JDBC

Re: SQL Error [08006]: Failed to communicate with Ignite cluster <-- BinaryObjectException: Not enough data to read the value

Hi, Can you please test the Apache Ignite 2.8. It should contain the following fix: https://issues.apache.org/jira/browse/IGNITE-11953 BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to access IGFS file written one node from other node in cluster ??

As was mentioned above IGFS was deprecated and not recommended for use. Just use native HDFS API for working with files: https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/fs/FileSystem.html In case if you have some SQL over HDFS (Hive, Impala) then you can set up the Ignite cache

Re: Real time sync ignite cache

Hi, Without cache stores, you can try to use ignite-spark integration but it will not provide the real-time synchronization. Also, you can try to set up some incremental data loading over JDBC, for example via apach sqoop. BR, Andrei -- Sent from:

Re: Python client: create cache with expiration policy

Yes, it's my fault. I double check the list of existed options and looks like there is no expire policy option there. I see that exists PROP_EAGER_TTL property: https://apacheignite.readme.io/docs/expiry-policies#section-eager-ttl But there are no options for expiration policies. Let me some

Re: AdaptiveLoadBalancingSpi not removing finished tasks from taskTops map

Hi, It looks like an issue that possible can be a reason for OOM exception. Is it possible to share the top consumers class list from the heap dump (it can be done via memory analyzer e.g Eclipse MAT)? Also, is it possible to provide the code and configuration that was used in your load

Re: Cache expiry policy is slow

Hi, Could you please share your reproducer of how you check that the expiration of the entries? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Regarding IGNITE_HOME/work/db folder - Snapshot and recovery

Hi, The error means that some of your data could be in inconsistency state because of, for example, stopping of the node during the checkpoint process. However, WAL and WAL archive can be required for cluster startup in some cases because they contain the recovery information for cache data. You

Re: Query on bean injection

Hi, Looks like the related issue has already discussed here: https://stackoverflow.com/questions/45269537/how-to-inject-spring-resources-into-apache-ignite-classes The main idea is using the: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteSpringBean.html BR, Andrei

Re: Python client: create cache with expiration policy

Hi, Yes, it should be possible. Please read the documentation from binaries: https://github.com/apache/ignite/blob/master/modules/platforms/python/docs/datatypes/cache_props.rst PROP_PARTITION_LOSS_POLICY: Partition loss policy: READ_ONLY_SAFE=0, READ_ONLY_ALL=1, READ_WRITE_SAFE=2,

Re: Real time sync ignite cache

Hi, What database do you use? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to use transaction.commitAsync()?

Hi, Yes, it should be fine. https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/lang/IgniteFuture.html#listen-org.apache.ignite.lang.IgniteInClosure- BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Efficiency of key queries

Hi, In the case of a single node, I don't think that you can speed up this process. But you can scale your performance by adding new nodes. It can be done using compute tasks and local SQL queries or local cache operation. It means that you will be able to run part of your login on every data

Re: Trouble with continuous queries

Hi, The good example of how it can be done you can see here: https://github.com/gridgain/gridgain-advanced-examples/blob/master/src/main/java/org/gridgain/examples/datagrid/query/ContinuousQueryExample.java You can set remote listener to handle changes on remote nodes and local listers for

Re: Cache#replace(K,V,V) implementation

Hi, It's true that Ignite provides the implementation for JSR107: https://ignite.apache.org/use-cases/caching/jcache-provider.html https://apacheignite.readme.io/docs/jcache Unfortunately, I don't have the details of how exactly it was implemented and can't suggest you in your questions but

Re: waiting for partition map exchange questions

Hi, Yes without logs it's not easy to understand what is the reason. Could you please attach them? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Trying to understand the capacity calculator

Hi, This calculator provides the approximated results but I will try to explain: 1)Does it mean that I need to give or take 3GB of physical RAM on the host and set OFF-HEAP value to 3GB? Not fully correct. Yes, you should have 3GB of RAM for OFF-HEAP. But also you should provide some memory for

Re: How to use UPDATE statement and set value to NULL

Hi, Here is a small example that works for me: IgniteCache cache = grid(1).cache("person"); cache.put(1, new Person("sun", 100)); cache.put(2, new Person("moon", 50)); String sql = "UPDATE person" + " SET name = ?" +

Re: How to automatic reset state of lost partitions?

Hi, Yes, it's the correct solution. Note that resetLostPartitions just returned the partitions to a normal state. So it makes sense to call it when all nodes from baseline will be online. In case if you have 3 nodes with 1 backup for all caches and two nodes go down and only one node back then

Re: any known issue with oracle and spring-ignite-data

Hi, Can you attach your cache configuration for your table that contains the itemId and storeId fields? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Best way to upsetting/delete records in Ignite from Kafka Stream?

Hi, Yes, looks like the KafkaStreamer doesn't support the DELETE behavior. It was created to loading data to Ignite. However, deleting data from Ignite is possible using Interface IgniteDataStreamer API:

Re: How to use enums in sql ‘where’ clause when using Ignite Web Console

Hi, Could you please share your CacheConfiguration where you set the EnumField as a field in QueryEntity (just to have the same configuration)? I will try to reproduce your issue and check how it works. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Exception while trying to insert data in Key/value map in ignite

Hi, Could you please provide more details: 1)Server configuration 2)Cache configuration 3)Logs 4)The example of the data that you are going to insert BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: The field name of the query result becomes uppercase

Hi, No, it's not possible to do because all the fields in Ignite SQL should be mapped to java fields. However, in java you can do next: @QuerySqlField private java.lang.String id; @QuerySqlField private java.lang.String Id; here id and Id will be different fields. But in H2 SQL

Re: LIKE operator on Array column in Apache ignite SQL

Hi, Ignite SQL engine supports only the next types: https://apacheignite-sql.readme.io/docs/data-types Also all existed functions you can see here: https://apacheignite-sql.readme.io/docs/sql-reference-overview So there is no way to work with arrays as DataTypes even if you set them as type

Re: DataRegionConfiguration is a FINAL class but prefer it not be

Hi, I think it was done to avoid the possible issues that can happen because users generally can't see the full logic from under the hood. If you going to suggest some improvement then better to create a thread on apache ignite development mail list:

Re: Best way to upsetting/delete records in Ignite from Kafka Stream?

Hi, You can use the Kafka streamer for these purposes: https://apacheignite-mix.readme.io/docs/kafka-streamer Also, take a look at this thread. It contains examples of how to work with JSON files:

Re: Eviction policy is not working for default and new data region

Hi, Could you please attach full XML configuration and java code that can reproduce this issue? You can upload your reproducer to GitHub for example. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite Inter node Communication security

Hi, Ignite supports only simple password authentication from the box. It doesn't contain any complex rights access. You can read more about it here: https://apacheignite.readme.io/docs/advanced-security In case if you require for authorization options you can implement the

Re: javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Some of DataStreamer operations failed [failedCount=1]

Hi, Could you please attach the full log file with: Caused by: javax.cache.CacheException: class org.apache.ignite.IgniteCheckedException: Some of DataStreamer operations failed [failedCount=1] at

Re: error in running shared rdd example with intellij

Hi, Possible that you change something in the source code. I attached the simple maven project with SharedRDDExample. SharedRddExample.zip Could you please try to run it? BR, Andrei -- Sent from:

Re: Failed to initialize wal (work directory contains incorrect number of segments) [cur=357, expected=10]

Hi, I was able to reproduce this issue. The details you can see at the next ticket: https://issues.apache.org/jira/browse/IGNITE-10840 BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Failed to initialize wal (work directory contains incorrect number of segments) [cur=357, expected=10]

Thank you, I will try to reproduce the same. Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Failed to initialize wal (work directory contains incorrect number of segments) [cur=357, expected=10]

No, I just try to get the details and reproduce the issue. Possible there is an issue here. I will return with an update soon. Also could you please provide the configuration of your nodes? Did you update the walArchivePath for all of your nodes? BR, Andrei -- Sent from:

Re: Failed to initialize wal (work directory contains incorrect number of segments) [cur=357, expected=10]

Hi, What is the version of Ignite you use? Did you set the walPath to the directory where before was walArchivePath? BR, Andei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: If I want to know how long it takes for data reading from the server side, where should I add logs?

Hi, Will be better if you shared your code. However, I see that you used persistence. So here are some reasons why you can see these drops: 1)You data region is less than full loaded data size stored on disk. In case if read operation can't find the value in RAM then it will read it from the

Re: Write Synchronization Mode per client

Hi, Cache in Ignite is a cluster wide storage for data. This data will be available around all clients. And it should work similarly for each of them. That's why the configuration can't be changed during runtime on the already started cache. I don't think that all your clients will use the same

Re: If I want to know how long it takes for data reading from the server side, where should I add logs?

Hi, Can you share your benchmark and explain what results you are expecting? Are you sure that there is no GC pauses at that moment? Ignite already have its own benchmarks that used Yardstick: https://apacheignite.readme.io/docs/perfomance-benchmarking Are you use them? If not possible you can

Re: Write Synchronization Mode per client

Hi, Synchronization mode is a part of the cache configuration. It will be set up at the cache starting. After that, the cache configuration can't be changed in runtime. The only case when cache configuration could be changed is when you destroy old cache and create a new one with the new

Re: Use of GridFutureAdapter$Node objects ?

Hi, Looks like it's a part of the current implementation. I will try to investigate it. However, as a workaround you can use the next code to decrease the possible memory allocation in case if you are going to load a lot of data: int chunk_size = 1000; try (IgniteDataStreamer

Re: diferrences between IgniteRdd and SparkRdd

Hi, The main difference between native Spark RDD and IgniteRDD is that Ignite RDD provides a shared in-memory view on data across different Spark jobs, workers, or applications, while native Spark RDD cannot be seen by other Spark jobs or applications. You can see the attached image that

Re: error in importing ignite 2.7 to netbeans

Please check that you set the scale profile because of without it the spark dependencies will not be added: ... scala src/main/spark org.apache.ignite

Re: error in importing ignite 2.7 to netbeans

Hi, Depends on how exactly you start the SharedRDDExample? 1)In case if you use the new maven project then possible you forgot to add dependencies for Ignite spark: org.apache.ignite ignite-core 2.7.0 org.apache.ignite

Re: Is it safe to decrease the data region size for a live cluster

Hi, Yes, it's safe in case if rest (256-132) GB of RAM is enough for your system working and other applications. You have persistence, so your data will not be missed. Data region size sets for every node and can be changed during node restart. However, you should take an account to the next

Re: Question about cpu usage and disk read speed on activation stage.

Hi, I was wrong. You can activate the cluster with not full baseline topology. Looks like you that your node that stopped during checkpoint and it is a reason of long recovery of the binary memory that takes a lot of time. Here is a ticket that should optimize this process:

Re: Question about cpu usage and disk read speed on activation stage.

Hi, I see from your log that you have two nodes in your baseline: [23:36:58,866][INFO][main][GridDiscoveryManager] ^-- Node [id=B3234010-F5BE-49CA-A57F-6676622BFF48, clusterState=INACTIVE] [23:36:58,867][INFO][main][GridDiscoveryManager] ^-- Baseline [id=2, size=2, online=1, offline=1]

Re: Register listeners before joining the cluster

Hi, Yes, I understand. You also can contribute this new event to Ignite: 1)Create the Jira issue - https://issues.apache.org/jira 2)Prepare the patch in a separate branch named ignite-X (where X is a number of JIRA ticket) 3)Create the pull request in GitHub to master branch -

Re: Scoped vs Singleton ignite client node in .net web api

Hi, Generally, you should have a working Ignite cluster somewhere that will store and process your requests. I am not sure that you really require the client node in your case. It will use additional memory and CPU. You can use several ways to work with Ignite cluster without fat client node:

Re: IgniteCheckedException when write and read made by different clients

Hi, I don't think so. However, you can try to use Integer instead of Enum values and proceeds it accordingly (It will require the changes in configuration) What is the reason why you can't move the class to correct package? BR, Andrei -- Sent from:

Re: Question about cpu usage and disk read speed on activation stage.

Hi, Could you share you Ignite node configuration and logs from startup? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Register listeners before joining the cluster

Hi, Depends on what you are going to archive: In case if you are going to just collect some information then you can use: https://apacheignite.readme.io/docs/ignite-life-cycle BEFORE_NODE_START Invoked before Ignite node startup routine is initiated. In case if you are going to make some

Re: Swap Space configuration - Exception_Access_Violation

Hi, Possible you face some of JDK issue. Could you please provide full error message from the dump-core file or log like next: EXCEPTION_ACCESS_VIOLATION (0xc005) at pc=0x5e5521f4, pid=2980, tid=0x3220 # # JRE version: Java(TM) SE Runtime Environment (8.0_131-b11) (build 1.8.0_131-b11)

Re: MyBatis L2 newby

Hi, I think that you could take a look at the next thread: http://apache-ignite-users.70518.x6.nabble.com/MyBatis-Ignite-integration-release-td2949.html This integration was tested with Ignite as I know: https://apacheignite-mix.readme.io/docs/mybatis-l2-cache

Re: Swapspace - Getting OOM error ?maxSize more than RAM

Hi, You faced that OOM issue because your cache was mapped to the default region with max size 6.4 GB instead of 500MB_Region with max size 64GB. I guess that you try to load more than 6.4 GB of data to this cache. Generally, you should set the required data region for every cache in case if it

Re: Read SQL table via cache api

Hi, Could you please set -DIGNITE_QUIET=false to turn off the quiet mode and re-attach the logs? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Read SQL table via cache api

Hi, I don't think that it's possible to understand a reason without logs. Please attach them here or possible if you can reproduce it then you may file a Jira issue and attach logs there with a full description of the problem. BR, Andrei -- Sent from:

Re: Does it affect the put, get, query operation when add or remove a node?

Hi, The general answer is yes because the rebalancing of data will be started and you will not be able to process data until partition map exchange will not be completed. https://apacheignite.readme.io/docs/rebalancing

Re: How to force ignite clear disk space

Hi, I thought that it was fixed here: https://issues.apache.org/jira/browse/IGNITE-8021 But possible you face another issue. No 2.7 isn't released now but you can use nightly builds to check it or build from the source code. In case if you can reproduce it then you may file the new Jira

Re: How to force ignite clear disk space

Thank you for details. I will check it in 2.6 release but I think that it should be fixed in 2.7. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Read SQL table via cache api

Hi, I think that information about it could be located in node log. Could you please provide the log of the node where you tries to read the data? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to force ignite clear disk space

Hi, I think that you face the issue related to the next ticket: https://gridgain.freshdesk.com/helpdesk/tickets/9049 After destroying of the cache remains some files that contain the configuration of the cache. But it should be already fixed in the latest version of Ignite. However, the files

Re: Cache stats like number of cache hits, misses, reads, write, avg

Hi, DataStreamer depends on the allowOverwrite flag. https://apacheignite.readme.io/docs/data-streamers#section-allow-overwrite The default value is false to get the best performance. But it also means that metrics will not be updated. If you set allowOverwrite true then data streamer will

Re: persistence when disk full

Hi, The expected behavior is that the only node without space will be failed. Could you please attach the logs from both of the nodes to get more details? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite issue during spark job execution

Hi, Looks like your JVM faces long garbage collection pauses. You can configure detailed GC logs to see how much time is spent in GC: https://apacheignite.readme.io/docs/jvm-and-system-tuning#section-detailed-garbage-collection-stats Also, you can follow next guide and add more heap:

Re: ignite 2.7 connection pool support?

Hi, Ignite data source should be supported in 2.7 release. The use case you can see in next test: https://github.com/apache/ignite/blob/master/modules/clients/src/test/java/org/apache/ignite/jdbc/thin/JdbcThinDataSourceSelfTest.java However, you can try to ask Taras according to

Re: Status of Spark Structured Streaming Support IGNITE-9357

Hi, Could you please re-create this issue on development user list: http://apache-ignite-developers.2346864.n4.nabble.com/ Development user list is the better place to discuss new functionality. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Multiple directories/filesystems for storagePath, walPath, walArchivePath

Hi, You can set the path to storagePath, walPath, walArchivePath in the node configuration using: https://apacheignite.readme.io/docs/durable-memory-tuning#section-separate-disk-device-for-wal But looks like it's not possible to set multiple values for each of them. BR, Andrei -- Sent

Re: Client connects to server after too long time interval (1 minute)

Hi, Could you please attach the XML configurations of your client and server nodes and logs? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite cannot access cache from listener after event “EVT_CACHE_STARTED” fired

Hi, The cache could be started but possible cluster wasn't activated yet. Could you please provide some information: 1)Did you see warnings or errors in the log? 2)Did you see this issue on normal cluster start or only on client restart? Also, I see that you use it in the class named server

Re: Streamer without client node?

Hi, You can use data streamers from the server node as well as from the client as I know. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SB2 with Ignite 2.6 Sample Application

Hi, In case if you have the example for integration with spring boot 2 then can try to contribute it to Ignite apache examples or provide the link here. Possible it will help other community members. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SB2 with Ignite 2.6 Sample Application

Hi, I don't think that Ignite has the example for exactly spring boot integration. But you can see the example for Spring integration. https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ignite/examples/misc/springbean/SpringBeanExample.java Do you have any problems

Re: what is Ignite Default atomicityMode

Hi, Yes, default atomicity mode is ATOMIC. Next code used by Ignite to set the atomicityMode initializeConfigDefaults method used for default config. It contains: if (cfg.getAtomicityMode() == null) cfg.setAtomicityMode(CacheConfiguration.DFLT_CACHE_ATOMICITY_MODE); So you

Re: My cluster can't activate after restart

Hi, What do you mean when say that 1)JDBC thin client isn't worked 2)cluster block in activate stage How you activate your cluster? Are you use the persistence? To get more logs try to add next option to java options of Ignite: -DIGNITE_QUIET=false BR, Andrei -- Sent from:

Re: Question about baseline topology.

Hi, Do you set backups in your cache configuration? By default in case if you have 2 data nodes without backups then you can face data loss when some of your nodes will go down. In this case, you may see not all data. But when this node will start (with persistence) and join to topology then

Re: Cache stats like number of cache hits, misses, reads, write, avg

Hi, Try to set setMetrcis for both regionCfg and storageCfg too. Is it help? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Cache stats like number of cache hits, misses, reads, write, avg

Hi, I tested that it works. I attached my code for the server node and configuration for the visor. Could you please check it? startActivate.java default-config.xml

Re: Cache stats like number of cache hits, misses, reads, write, avg

Hi, Could you please provide the full configuration of the node? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Sql execution with partitionId

Hi, It should work as described in the documentation. If the node with primary partitions will fail then the node with backups will be used. If there are no backups then an exception will be thrown. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Adding entry to partition that is concurrently evicted

Hi, This exception shows that one of your partitions was moved to the invalid state. It's not expected case and for investigation of the reason, we require log file too. Is it possible to provide it? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Adding entry to partition that is concurrently evicted

Hi, Could you please attach the configuration of the cluster and full log? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL Engine

Hi Igor, I think that optimizationd for Ignite better to discuss it on the Apache Ignite Developer list: http://apache-ignite-developers.2346864.n4.nabble.com/ BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite Select Query Performance

Hi, We can try to check can your configuration be improved but first of all could you please provide some details: 1)How many data nodes you used. 2)Data node configuration 3)Cache configuration or DML Create Table command for your cache (table) BR, Andrei -- Sent from:

Re: Failed to process selector key error

Hi, Your client was disconnected from the server. It could be because of different reasons: 1. Network problems on your client. 2. Very long GC pause on the server side. I guess that you face first because you note that possible you had the network problems. In this case, the server will not

Re: Ignite complains for low heap memory

Hi, The heap metrics that you see in topology message shows the max heap value that your cluster can use: Math.max(m.getHeapMemoryInitialized(), m.getHeapMemoryMaximum() Initial heap size (-Xms ) is different from the maximum (-Xmx). Your JVM will be started with Xms amount of memory and will

Re: How to use BinaryObject Cache API to query a table created from JDBC?

Hi, Try the next example and follow the same way for your: // Open the JDBC connection. try { Connection conn = DriverManager.getConnection("jdbc:ignite:thin://127.0.0.1;user=user;password=password"); //remove user password if you don't have security

Re: client probe cache metadata

Hi, You can get all caches configuration from Java API: IgniteCache cache = dr1Hub.getOrCreateCache("CACHE"); CacheConfiguration conf = cache.getConfiguration(CacheConfiguration.class); System.out.println("");

Re: Ignite TcpDiscoveryS3IpFinder and AWS VPC

Hi, According '127.0.0.1#47500', '0:0:0:0:0:0:0:1/0#47500': It's just the different views of the same address (localhost). For example, Ignite started on 10.0.75.1 could be available using next addresses from the same node: >>> Local node addresses: [LAPTOP-I5CE4BEI/0:0:0:0:0:0:0:1, >>>

Re: IgniteSparkSession exception:Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=null]

Hi, Can you provide the code and configuration? Next one works okay for me: //start the server Ignite ignite = Ignition.start("server_config.xml"); //activate the cluster ignite.cluster().active(); //create the spark session with daemon client node

Re: Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

Hi, I am not sure that it will work but you can try next: SparkSession spark = SparkSession .builder() .appName("SomeAppName") .master("spark://10.0.75.1:7077") .config(OPTION_DISABLE_SPARK_SQL_OPTIMIZATION, "false") //or true

  1   2   >