Objects in heap dump corresponding to binary and de-serialized version of entries

2016-11-30 Thread rishi007bansod
I have loaded customer table with 3,899,999 entries in cache. Following is heap dump for same. Which objects in this heap dump represents binary and de-serialized version of entries? *GridH2ValueCacheObject,

Re: SparkRDD with Ignite

2016-11-30 Thread Vidhya Gurumoorthi (vgurumoo)
Thanks for the reply, Val. Lookslike the issue is with having "null" fields in the database. Read that null fields are handled in Ignite 1.8 release. Is that right ? Thanks, Vidhya From: vkulichenko Sent: Wednesday,

Re: SparkRDD with Ignite

2016-11-30 Thread vkulichenko
It depends on how big your data set, where the data is coming from, etc. I don't think Ignite is a bottleneck here. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/SparkRDD-with-Ignite-tp9160p9319.html Sent from the Apache Ignite Users mailing list archive

Re: Creating a distributed cache via cacheManager (JCACHE)

2016-11-30 Thread vkulichenko
Hi, Try to remove configureAndStartCluster() call. I believe you actually have an exception during the CacheManager start. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Creating-a-distributed-cache-via-cacheManager-JCACHE-tp9310p9318.html Sent from the

Re: Cluster hung after a node killed

2016-11-30 Thread vkulichenko
Sam, It depends on the reason of this hang. If there is a bug, then most likely timeout will not help either :) Do you have a test that reproduces the issue? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cluster-hung-after-a-node-killed-tp8965p9317.html

Re: Failed to find configuration in: file:////tmp/shared.xml

2016-11-30 Thread Valentin Kulichenko
Hi, I responded you on StackOverflow: http://stackoverflow.com/questions/40891171/zookeeper-based-ignite-discovery-in-zeppelin-config-xml-not-working-even-after -Val On Wed, Nov 30, 2016 at 3:24 AM, pawantlor wrote: > I am using zookeeper based discovery for ignite

Re: Data in cache per node

2016-11-30 Thread Valentin Kulichenko
Andrew, I don't see why you think that the memory usage is different. Can you clarify this? -Val On Wed, Nov 30, 2016 at 12:52 AM, Andrew Dzyuba wrote: > No, all entries are similar and have approximately same size. One entry is > row of plane file and look like: >

Re: Unable to create cluster of Apache Ignite Server Containers running on individual VMs

2016-11-30 Thread vkulichenko
Hi, This configuration is incorrect: 127.0.0.1:47100..47509 172.26.116.67:47100..47509 First of all, since you're building a distributed cluster, you should not use loopback here. Put real addresses that discovery component binds to. Second of all, 47100 is a port for communication, not for

Re: Fetching large number of records

2016-11-30 Thread vkulichenko
Anil, JDBC driver actually uses the same Ignite API under the hood, so the results are fetched in pages as well. As for the query parser question, I didn't quite understand what you mean. Can you please give more details? -Val -- View this message in context:

Re: Limit the number of results query

2016-11-30 Thread vkulichenko
Hi, Memory is managed by JVM, Ignite doesn't do anything specific. So the more queries you execute in parallel, the more free memory you need. However, the maximum number of queries is not unlimited of course, it's limited by CPU resources. -Val -- View this message in context:

Not able to join cluster with Zookeeper based IP finder

2016-11-30 Thread ghughal
We are seeing intermittent issue where ignite node is not able to join the cluster for our specific configuration. Our ignite instances are part of spring boot application and it’s running inside docker container. These docker container gets deployed by marathon framework on mesos. When we try to

Creating a distributed cache via cacheManager (JCACHE)

2016-11-30 Thread veyroke
Hi Val, My team is working on a cache component, we want to take advantage of JSR-107. So instead of creating the cache via the Ignite.getOrCreate(..), a *cacheManager * gets exposed instead. I followed your recommendation on

Re: Cluster hung after a node killed

2016-11-30 Thread javastuff....@gmail.com
Hi Val, Killing the node that acquired the lock did not release it automatically and leads whole cluster in hung state, any operation on any cache (not related to lock) are in wait state. Cluster is not able to recover seamlessly. Looks like a bug to me. I understand lock timeout can be

Issue with SQL Query Performance - Post Rebalance Operation

2016-11-30 Thread Sri Ganesh V
Hi, We have configured Backups (ASYNC Mode) for each cache and the cache is partitioned across nodes. Cache - Off-Heap mode We see that once we start up a node, post rebalancing, the node participates in cache operations. Is there a way to make sure that the node is ready for cache operations

Re: Cassandra basic setup

2016-11-30 Thread Igor Rudyak
Regarding *cassandra-bootstrap.sh *and* ignite-bootstrap.sh* current documentation is up to date. These scripts are not automatically updated during release packaging process, according to the documentation (item 5 of *Configuration Details* section,

Save the date: ApacheCon Miami, May 15-19, 2017

2016-11-30 Thread Rich Bowen
Dear Apache enthusiast, ApacheCon and Apache Big Data will be held at the Intercontinental in Miami, Florida, May 16-18, 2017. Submit your talks, and register, at http://apachecon.com/ Talks aimed at the Big Data section of the event should go to

Re: Cache size in Partitioned mode as seen in visor

2016-11-30 Thread Mohammad Shariq
Hi Alexplz let me know if u got my question...or I need to explain more... For now can u can plz validate my understanding about cache size with backups in Partitioned modedoes backup count figure in visor cache size On Wednesday, November 30, 2016, Mohammad Shariq

Re: Cassandra basic setup

2016-11-30 Thread Denis Magda
Cross-posting to the dev list. Igor R., is this something that has to be fixed for 1.8 as well? The community is planning to send the new release for vote by the end of Friday, could you look into this issue by that time? — Denis > On Nov 30, 2016, at 3:00 AM, Riccardo Iacomini

Problem with ReentranLocks on shutdown of one node in cluster

2016-11-30 Thread vladiisy
Hi, i have a problem with my application using reentrant locks, they seems to going corrupt after one node leaves my cluster. The threads with locks hanging on GridCacheLockImpl.unlock for ever: ">>JUnit-Test-Worker-0" #160 prio=5 os_prio=0 tid=0x20d57800 nid=0x21f4 runnable

Re: Unable to create cluster of Apache Ignite Server Containers running on individual VMs

2016-11-30 Thread Piali Mazumder Nath
Hi Pawantlor, Thanks for your reply. I did my testing using Since its didn't work i tried using cloud.TcpDiscoveryVmIpFinder. In both the cases I am getting the same error. Forgot to correct it before posting. Is your containers running on Virtual Machine? On Wed, Nov 30, 2016 at 5:44 AM,

Re: Cache size in Partitioned mode as seen in visor

2016-11-30 Thread Mohammad Shariq
Hi Alex I will run the same in example in my personal laptop..currently bcoz of security restrictions I cannot copy and paste the visor output and config xml outside my corporate intranet...probably I will replicate the scenario in my personal computer... For now can u can plz validate my

Re: Cache size in Partitioned mode as seen in visor

2016-11-30 Thread Alexey Kuznetsov
Hi, Mohammad! Could you provide. 1) Cache config. 2) Visor command you used. 3) Visor output. We will try to help. On Wed, Nov 30, 2016 at 9:20 PM, Mohammad Shariq wrote: > I have a partitioned cache size of 15000 and 4 server nodes with backup of > 1. Through visor

Re: Cache size in Partitioned mode as seen in visor

2016-11-30 Thread Mohammad Shariq
I have a partitioned cache size of 15000 and 4 server nodes with backup of 1. Through visor each node is showing a size of around 7500. Also, if I decrease or increase backup, the cache size on each node stays the same. I think since it is partitioned mode ...size of each node should be 15000/4

Re: Cluster hung after a node killed

2016-11-30 Thread thammoud
Hi Val, I am curious as to how will ignite cluster behave with a killed node that is in an active transaction with implicit cache locks. Thank you. BTW, when will 1.8 be released? -- View this message in context:

Re: Unable to create cluster of Apache Ignite Server Containers running on individual VMs

2016-11-30 Thread pawantlor
I feel you should use "vm.TcpDiscoveryVmIpFinder" instead of cloud. What the error after you use "vm.TcpDiscoveryVmIpFinder"? I am using container based setup using zookeeper based discovery and its working fine. -- View this message in context:

Failed to find configuration in: file:////tmp/shared.xml

2016-11-30 Thread pawantlor
I am using zookeeper based discovery for ignite cluster and ignite nodes are getting properly connected. When i am setting same config.xml file in zeppelin ignite interpreter in , I am not able to run the ignite. it fails with below exception. *It gives me below error on zepplin:* Failed to find

Unable to establish connection to Ignite server

2016-11-30 Thread Sri Ganesh V
Hi, We were executing few SQL queries on Apache Ignite to test the performance using JDBC. Connection con = DriverManager.getConnection("jdbc:ignite:cfg://cache=XYZ_CACHE:distributedJoins=false@file:///C:\\ignite-client-config-with-timeout.xml"); We had an

Re: Cassandra basic setup

2016-11-30 Thread Riccardo Iacomini
Hi Igor, I would like to highlight to you another discrepancy I noticed while trying to build the cassandra/ignite/ganglia cluster test in AWS using the provided framework. I've build Ignite 1.7 from source, but the version hard-coded for the modules in the *cassandra-bootstrap.sh *and*

Re: Ignite 1.6.10 performance issue in ODBC connections

2016-11-30 Thread thomastechs
Hello, Any help on this is much appreciable.. Thanks, Thomas. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-1-6-10-performance-issue-in-ODBC-connections-tp9266p9292.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Cache transformations

2016-11-30 Thread Vladislav Pyatkov
Hi, DataStreamer is the best way to load data to cache (even localLoadCache was implemented over a streamer). I just want to say, you should not use a DataStreamer in a thread of Ignite compute (do it asynchronously). Also you can use one instance of Streamer by node, if you want to better

Re: Cache transformations

2016-11-30 Thread nskovpin
Thanks, your answer solved my speed problem. But what about saving data into a cache? Is there a good approach to save my entities directly in local nodes? I know that ignite has a IgniteCache.localLoadCache() method, but it requires a CacheStore (I dont need it). -- View this message in

Re: Data in cache per node

2016-11-30 Thread Andrew Dzyuba
No, all entries are similar and have approximately same size. One entry is row of plane file and look like: "90 \t 35.985331 \t 27.184144596 \t Россия, Воронеж г., Красноград г., Лунная аллея., д. К800 (маг) \t 45.981361 \t 17.184149959 \t Россия, Воронеж г., Красноград г.,