Re: Blogging about new .NET features

Denis, sure, I think I'll start with "What's new in Ignite.NET 1.8" and write in more detail about big features later. On Wed, Nov 23, 2016 at 9:34 PM, Denis Magda wrote: > Pavel, > > Do you mind blogging about ASP.NET session state [1] and Entity Framework > 2nd level

Re: Blocked get operation problem

Hi Val, Yes i access same key from all threads, even from all nodes probably 6 access per second. For now i can't reach this tps with 56core x 3 server = 168 core. All get operations are made from servers. Seems like locking the keys causes the problem. Cus i see lots of threads waiting for a

Lock and Failed to unlock keys exception

Hi, I am trying to implement distributed ID generators using lock and caches. I wrote some codes like this, but it always throw exception "Failed to unlock keys exception". The code may runs in different JVM/hosts. Do I misuse the lock feature? Thanks in advance.

Re: Swap space

I see it is evicting the entries to swap. there was an email chain that says about memory leak in case of off-heap + swap + eviction. Do you remember and have any workaround ? Thanks On 24 November 2016 at 10:25, vkulichenko wrote: > It is needed, without

Failed to running hadoop accelerator

hi, I am new to ignite. I downloaded "apache-ignite-hadoop-1.7.0-bin.zip". I unzip it and configured it as the doc "https://apacheignite-fs.readme.io/docs/installing-on-apache-hadoop; says. When I try to run the script "ignite.sh", it gave out the exception: class

Re: Swap space

It is needed, without eviction policy entries will not be evicted. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Swap-space-tp8156p9173.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Swap space

HI Val, When max heap is set, explicit eviction policy is not needed. correct ? Thanks. On 21 November 2016 at 23:42, vkulichenko wrote: > An entry will go to swap only if it's evicted from the cache [1]. If > eviction > policy is not configured, this will

Re: Cluster can not let more than one client to do continuous queries

continueclient.jar I have disabled peer class loading. The attachment is the test project about it. CacheContinuousAsyncQueryClient11 and CacheContinuousAsyncQueryClient12 are RemoteFilterFactory with a parameter,

Re: Can ignite accelerate a single spark job by using IGFS?

I will try it. Thanks. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Can-ignite-accelerate-a-single-spark-job-by-using-IGFS-tp9167p9170.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Can ignite accelerate a single spark job by using IGFS?

You can load the original dataset into memory and use it when running all you jobs. As long as data is in memory, you will get performance improvement. -Val -- View this message in context:

Can ignite accelerate a single spark job by using IGFS?

Hi, I know igniteRDD can be used to improve spark jobs by sharing the RDD among spark jobs. However, in our situation, all the spark jobs are independent and they don't need to share others' RDDs. Can I put all my data in IGFS to improve a single spark job's performance? -- View this

Re: SparkRDD with Ignite

Have spark version 1.6.1 with apache-ignite-1.6.0-src. Have spark installed on all 10 nodes, but, have ignite installed on only one node (master). Is that an issue ? Tried the below lines and its been running for the past 20 mins without any errors... scala> val rdd = df2.map(row =>

Re: SparkRDD with Ignite

What version of Scala do you have? Also why are you on Ignite 1.6? Can you switch to 1.7? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/SparkRDD-with-Ignite-tp9160p9165.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: SparkRDD with Ignite

Thanks, Val. Yes, the executor was missing the driver. I added the driver and that eliminated the driver missing warning and now see java.lang.NoSuchMethodError: at at org.apache.ignite.spark.IgniteRDD$$anonfun$saveValues. This is a warning though. See Error only on threshold limit exception

Apache Ignite Contribution: Kubernetes, Streaming, Data Structures and More

Guys, If someone of you locates in the U.S. and doesn’t know how to spend upcoming holidays effectively I would remind that Ignite might make this days more colorful and memorable. What you need to do is to pick up a ticket of interest and contribute it to the project.

Re: SparkRDD with Ignite

Where is this exception failing? Is it on executor node? Does it work if you execute something like foreachPartition on the original RDD? For now it just looks like the executors just miss the Oracle driver and therefore can't load rows from the database. Ignite is not even touched yet at this

Re: Throwing and catching user exceptions in Ignite Services

That's a good point. Can you create a Jira ticket for this? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Throwing-and-catching-user-exceptions-in-Ignite-Services-tp9143p9161.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

SparkRDD with Ignite

Have been extensively trying to integrate spark rdd's with ignite. We have spark version 1.6.1 with apache-ignite-1.6.0-src. Tried out the example in "https://apacheignite-fs.readme.io/docs/testing-integration-with-spark-shell​; and it is working fine. However, all efforts w.r.t connecting to

Re: Apache Ignite vs alluxio

Hi, Take a look at Hadoop Accelerator [1]. I think it fits your use case very well. It will accelerate your map-reduce jobs even before you start moving data in memory because it replaces Hadoop's map-reduce engine. On top of that you can use IGFS which is an in-memory file system and which can

Re: Blocked get operation problem

Tolga, Are you accessing the same key all the time? How many entries do you have in cache? What cache provider did you use before? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Blocked-get-operation-problem-tp9133p9158.html Sent from the Apache Ignite

Re: Memory overhead for single cache entry in ignite

Hi, Most of the entries on your screenshot are not related to entry overhead and I don't really understand how you got these 14.4KB. I would recommend you to load more entries (hundreds at least) and check how the memory consumption grows. Otherwise you data is to small and negligible when

Re: Cassandra basic setup

Hi Riccardo, *CassandraAdminCredentials *class is only available in Ignite unit tests sources. If you want to use it you should build Ignite from source code. Such way, it will create *ignite-cassandra-tests-${project.version}.zip* where jar may find jar file containing all the test classes.

Blogging about new .NET features

Pavel, Do you mind blogging about ASP.NET session state [1] and Entity Framework 2nd level cache [2] support after 1.8 release goes public? Also I would remind everyone in the community that it’s always welcomed to share your experience or Ignite related news over blog posts. We track all the

Cassandra basic setup

Following the example provided in the docs, I am trying to setup a basic Ignite cluster using Cassandra as persistent store. I've downloaded ignite 1.7 and created the configuration files. Ignite does read them at startup, but I get this error

Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi Again, In addition to the datastructures_0 that is growing which is not a cache that i have created. Through JMX to my EventsCache mentioned above where retained memory reside i can see using the CacheLocalMetricsMXBeanImpl the following attributes: KeySize 403 Size 403 TxCommittedVersionsSize

Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi i did call the name method and i got "datastructures_0" which is not a cache that i have created. the size count now is at 13.5k, I am using an ignite queue, is it possible that this is created internally by ignite for the queue or some internal ignite cache? Thanks On Wed, Nov 23, 2016 at

Re: Memory consumption in apache ignite

Hi, The main point of doing that was not to give data classes to server, that it would be unable to deserialize values on his size and force to use binary format. But if server doesn't know classes (data classes are not available in classpath) the only way to enable SQL queries is via

Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi, To get to know what cache represents CacheMetricsMXBean you can call name() method of it. And yes, it's worth to check if that entries cause your problem. -- View this message in context:

Re: Cluster can not let more than one client to do continuous queries

Hi, I'm not able to reproduce exact your issue, but found that there problem if enabled peer class loading [1]. Could you please give me al your configurations and full logs? And it would be very helpful if you create toy project which reproduces the problem. Thanks! [1]:

Re: SELECT with ORDER BY and pagination

Denis, It will be done as part of huge SQL pipeline rework here: https://issues.apache.org/jira/browse/IGNITE-3860 Sergi 2016-11-21 21:10 GMT+03:00 Denis Magda : > Sergi, > > Do we already have a ticket for that optimization? > > — > Denis > > On Nov 21, 2016, at 4:28 AM,

Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi i have added JMX to my application to monitored the primary and backup cache size. it will take a couple of days untill the issue occurs. While scanning through JMX of ignite there is an entry "datastructures_0" under "My_Cluster" group, more specifically beans:

Re: Apache Ignite vs alluxio

Hi Franke, Let me clarify our situation more detailed. We want to store all our data in memory and all the job will never access the backend data. However, we still need backend storage such as HDFS to persist in memory data asynchronously in case of data lose which is caused by node failure.

Re: Apache Ignite vs alluxio

hi vincent, I've got the idea that load backend data in the cache will effect the performance. However, in our situation, we will store all the data in memory. For example, assume that we have a 10GB file all in memory. All the data is pinned in memory(Does ignite support pinning date in

Throwing and catching user exceptions in Ignite Services

I asked this question on SO roughly 2 weeks ago: http://stackoverflow.com/questions/40545051/catch-user-exception-in-remote-service-at-caller-level My intention is to deploy Service A and Service B, then call a method of Service B inside Service A utilizing the IgniteServices serviceProxy. Each

Re: Apache Ignite vs alluxio

As already said, it is not really a cache use case. Aside, performance tests on single nodes simply do not make sense for a distributed system. Maybe you can describe in more detail your real use case and we can help you. There are many area where you can tune and cache is only one possibility.

Re: Apache Ignite vs alluxio

Hi, As any intermediate, Alluxio or Ignite have overhead which is the time to load backend data in the cache and then read from the cache so there may be use cases that doesn't suite to cache. And I think your very simple job doesn't leverage cache whatever cache you use. In my point of view there