Re: Number of partitions of IgniteRDD

Hi Val, I am creating DataFrame using below code -  public DataFrame getStockSimulationReturnsDataFrame(LocalDate businessDate,String stock){ /* * If we use sql query , we are assuming that data is in cache. * */ String sql = "select simulationUUID,stockReturn from STOCKSIMULATIONRETURNSVAL w

Re: Ignite near cache Problem

suhuadong wrote > I start distributed cache called "myCache" by invoke > ignite.getOrCreateCache(new CacheConfiguration String>("myCache")), and restart disrtibuted cache called "myCache", > with near cache by invoke ignite.getOrCreateNearCache("myCache", nearCfg) > ,so cause IgniteChec

Re: Ignite cache data size problem.

Hi Kevin, Ignite Visor [1] provides 'gc' command that performs GC on all nodes. You can also use any other tool, e.g. VisualVM. [1] https://apacheignite.readme.io/docs/command-line-interface -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-cache-dat

Re: Ignite Client Blocks On Ignite Server Restart

Hi Colin, I'm not sure that you have the same issue that Ken has. Is it possible for you to share your test with us? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Client-Blocks-On-Ignite-Server-Restart-tp4554p4679.html Sent from the Apache Ignite

Re: How to validate that what was retrieved from Ignite cache is not NULL or empty?

Hi, Your expectation is correct. The second IgniteRDD will connect to the same Ignite cache that will already have all the data. This was you can share the data between applications. Zero in 'IgniteRDD[0]' string is just an ID within SparkContext, so it doesn't tell anything about the cached data

Re: Ignite near cache Problem

Hi, Can you please properly subscribe to the mailing list so that the community can receive email notifications? Here is the instruction: http://apache-ignite-users.70518.x6.nabble.com/mailing_list/MailingListOptions.jtp?forum=1 suhuadong wrote > hi team, > Version of igntie is 1.5.0.final. > >

Re: Running gridgain yardstick

Yardstick is designed to run benchmarks in distributed environments. Server hosts, driver hosts and benchmark run configurations are provided in a configuration file (see [1] for example). You can then run benchmark-run-all.sh and provide this file, everything will happen automatically. All partici

Re: Client fails to connect - joinTimeout vs networkTimeout

Hi Binti, Yes, you should set 'excludeNeighbors' property on the affinity function: -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Client-fails-to-connect-joinTimeout-vs-networkTimeout-tp4419p4675.html Sent from the Apache Ignite Use

Re: Continuous Queries

BTW, you can also download the nightly build to try the new functionality: https://ignite.apache.org/community/contribute.html#nightly-builds -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Continuous-Queries-tp4440p4674.html Sent from the Apache Ignite Use

Re: how to fetch data when its loaded using cache.loadCache(null,100_00)?

Hi Ravi, I believe you already had the similar issue. You should always make sure that Hibernate entity is fully initializes before you close the Hibernate session and store the value in cache. If this doesn't help, please show the whole trace (looks like it's truncated). -Val -- View this me

Re: Continuous Queries

Hi, As far as I know, it's very close and should be sent for a vote soon. I would recommend to monitor the dev list [1] for the latest news. [1] http://ignite.apache.org/community/resources.html#mail-lists -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/C

Re: Number of partitions of IgniteRDD

Hi Vij, How do you check the number of partitions and what are you trying to achieve? Can you show the code? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Number-of-partitions-of-IgniteRDD-tp4644p4671.html Sent from the Apache Ignite Users mailing list a

Re: Ignite & Kubernetes

Ignite does not have any specific Kubernetes integration, however, if it supports TCP/IP, which I am pretty sure it does, then we can easily do auto-discovery there using our static IP discovery: https://apacheignite.readme.io/docs/cluster-config#static-ip-based-discovery Also, it is likely that

Raffle - Free Ticket to In-Memory Computing Summit, May 23-24, San Fran

We are raffling off a limited number of conference tickets to the In-Memory Computing Summit which is May 23-24 at the Grand Hyatt San Francisco. Link to Raffle Registration Page: http://go.gridgain.com/IMCS-2016_Raffle.html Winners will be randomly selected each week leading up to the conference

How to validate that what was retrieved from Ignite cache is not NULL or empty?

I'm trying to store a Spark RDD in the Ignite cache. My distilled code is something like this: val igCfg = new MyIgniteConfiguration().setPeerClassLoadingEnabled(true) val igContext = new IgniteContext[(Int,Int), List[Double]](sc, ()=>igCfg) val igCacheCfg = new CacheConfiguration[(Int,Int), List[

Re: Ignite Installation with Spark under CDH

Vladimir, I fixed this by changing the way I start Ignite based on a recommendation from another post here and the OOME has gone: ignite.sh -J-Xmx10g The data that I put in cache is about 1.5GB Thank you, -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-

Re: Running gridgain yardstick

Ok got it. So, say, I want to run the IgnitePutGetBenchmark.java to test the Ignite PutGet, so how do I run it?? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Running-gridgain-yardstick-tp4559p4664.html Sent from the Apache Ignite Users mailing list archive at

Ignite & Kubernetes

Hi all, Is anyone working with Ignite & kubernetes? Moreover I’d like to understand how it would be possible to do auto discovery of new Ignite nodes. Thanks, Christos

Re: Client fails to connect - joinTimeout vs networkTimeout

Is there a way to configure backups node on a different physical host in such a scenario? I do not want the primary and back up on the same host in the event that host crashes. Thanks, Binti -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Client-fails-to-connec

Re: Number of partitions of IgniteRDD

Thanks Vladimir, As I said have used RendezvousAffinityFunction and have not done any changes yet I am getting only 1 partition for IgniteRDD. Could you please help me what could be the issue. Regards,Vij On Thursday, April 28, 2016 2:22 PM, Vladimir Ozerov wrote: Hi Vij, Looks like I

Re: how to fetch data when its loaded using cache.loadCache(null,100_00)?

i am getting this error while fetching cache.get(1); at client side Exception in thread "main" org.hibernate.LazyInitializationException: could not initialize proxy - no Session at org.hibernate.collection.internal.AbstractPersistentCollection.withTemporarySessionIfNeeded(AbstractPersiste

how to fetch data when its loaded using cache.loadCache(null,100_00)?

i loaded my data into cache from database id fname Lname 1 ravi puri 2 ravi load 3 ravi nikita configuration usign cache.loadCache(null,10). but i want to access data from cache. so how can i do it? -- View this message in context: http://apache-ign

Re: Continuous Queries

Do you know when version 1.6 will release? This function is important to me. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Continuous-Queries-tp4440p4651.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: SQL Aliases are not interpreted correctly

Jun, I implemented support for aliases generation in Schema Import Utility and pushed to master. Please try with latest nightly-build https://ignite.apache.org/community/contribute.html#nightly-builds On Wed, Apr 20, 2016 at 2:02 PM, jan.swaelens wrote: > Superb, that would really do the tric

Re: Number of partitions of IgniteRDD

Hi Vij, Looks like I already answered you on Gitter. Partition number depends solely on cache configuration, namely on *AffinityFunction *set through* CacheConfiguration.setAffinity()* method. Vladimir. On Thu, Apr 28, 2016 at 9:01 AM, vijayendra bhati wrote: > Hi, > > Can anybody let me know

Re: Cache Connection taking time while using IgniteRDD on Spark executor

Hi Vij, For now - yes, I would say it is expected startup time because Ignite has to perform some actions to join the cluster. On the other hand, I agree with Valentin, that this definitely should be improved for client connections. I would say that <1s would be a good number for me. Vladimir. O

Re: Ignite Installation with Spark under CDH

Hi Michael, Did you have a chance to analyze heap dump to understand what caused OOME? As per *IgniteConfiguration*, it is made non-serialziable intentionally, because we do not expect it to be passed over the wire. Could you please provide a stack trace where you see it is being serialized? Vlad

Re: Ignite Client Blocks On Ignite Server Restart

In the case of the test that I am executing, high contention caused by the test running as an Ignite client is causing not only the client but the whole cluster to become unresponsive upon subsequent destruction of the cache. The only way to get it to respond again seems to be to kill the client JV