whether IgniteHadoopIgfsSecondaryFileSystem will cache HDFS filein IGFS?

2016-06-02 Thread Jason
It is not obviously performance difference between hdfs and IgniteHadoopIgfsSecondaryFileSystem this is my configuration core-site.xml mapred-site.xml default-config.xml 36FEFA05@EB25BF62.1F2A5157 Description: Binary data 3104F80D@EB25BF62.1F2A5157 Description: Binary data 34FEF805@EB

Re: Unexpected performance issue with SQL query followed by error

2016-06-02 Thread jan.swaelens
Sure I can give that a try, so I start multiple nodes and define a collocation key on the tables being joined together (from the many object to the single cardinality ones)? The data is being pulled to populate a work list for users, sort of a jira issue list for example. So the data goes to the c

?????? put data and then get it , but it returns null in sometimes

2016-06-02 Thread ????????
thank you, and is there any similar problem before ?? I want to know how it is produced ? Yes , we can upgrade it, but because we made a lot of development based on version 1.4.0, so it will take a lot of time to upgrade to 1.6.0 -- -- ??: "Alex

Re: put data and then get it , but it returns null in sometimes

2016-06-02 Thread Alexey Goncharuk
Can you try upgrading to 1.6 and check if the problem still reproduced? There has been fixed a lot of issues in the last two versions, so it is very likely this one will go away after an upgrade. 2016-06-02 22:06 GMT-07:00 往事如烟 : > Thank you , and we are using ignite 1.4.0 > > --

?????? put data and then get it , but it returns null in sometimes

2016-06-02 Thread ????????
Thank you , and we are using ignite 1.4.0 -- -- ??: "Alexey Goncharuk";; : 2016??6??3??(??) 1:02 ??: "user"; : Re: put data and then get it , but it returns null in sometimes Hi, Which version of Ignite are you using?

Re: put data and then get it , but it returns null in sometimes

2016-06-02 Thread Alexey Goncharuk
Hi, Which version of Ignite are you using? 2016-06-02 21:55 GMT-07:00 往事如烟 : > thanks for your answer, I don't use configure file, so almost we used the > default value, only set some items as follows: > > *CacheConfiguration cacheCfg = new > CacheConfiguration<>("testName");* > > *cacheCfg.setW

?????? put data and then get it , but it returns null in sometimes

2016-06-02 Thread ????????
thanks for your answer, I don't use configure file, so almost we used the default value, only set some items as follows: CacheConfiguration cacheCfg = new CacheConfiguration<>("testName"); cacheCfg.setWriteSynchronizationMode(CacheWriteSynchronizationMode.FULL_SYNC); cacheCfg.setCacheMode(Cache

Re: Ignite Write Behind performance

2016-06-02 Thread Denis Magda
Hi, Most likely your write-behind Threads can’t keep up with volume of data that is aggregated in the write-behind buffer and you get with the situation when from time to time writing to the DB is performed in the sync mode from system Thread(s). I would suggest you playing with the following

Re: put data and then get it , but it returns null in sometimes

2016-06-02 Thread Denis Magda
Hi, Do you set CacheConfiguration.readFromBackup to “true”? Please share full configuration of your cache. — Denis > On Jun 3, 2016, at 6:06 AM, 往事如烟 wrote: > > Hi all, > I have encountered a very strange problem, described as follows: > first , put(1, 2) to the cache in sync mode

put data and then get it , but it returns null in sometimes

2016-06-02 Thread ????????
Hi all, I have encountered a very strange problem?? described as follows: first , put(1, 2) to the cache in sync mode and the cache is atomic mode; then, I immediately invoke get(1) in sync mode to get key=1, expect it returns 2; however, it returns null; this quest

Re: Re: About benchmark and scalability testing

2016-06-02 Thread hu...@neusoft.com
Hi, thanks. I got it. The following question, do you think, yardstik is suitable for making performance testing for Gemfire, another popular In-Memory product? or has somebody made this test already? Bob From: Vladislav Pyatkov Date: 2016-06-02 19:11 To: user@ignite.apa

Discovering Topics that are being listened to

2016-06-02 Thread nickg
Hi all, I'm currently writing a messaging application using Apache Ignite (for a proof of technology), and was using Topic Based Messaging for the communications. Everything works well, *IF* the two clients/nodes have agreed on a specified topic

Cache.put delays

2016-06-02 Thread bintisepaha
We are using ignite 1.5.0-final version. While testing on a single server node we see this behavior with cache.put(). We know we have just loaded an object in the cache from the DB Store, as soon as that is put in the cache, the writebehind is also kicked off. But right after loading it when we do

Ignite Write Behind performance

2016-06-02 Thread amitpa
Hello, I am struggling with improving ignite transaction performance. However this is another problem However if I am doing write behind and the writes are slow, I am seeing that the over all performance of teh grid drops. Is there any configuration that I can do to make ignite performance stabl

Re: Simulating Graph Dependencies With Ignite

2016-06-02 Thread pragmaticbigdata
1. I will need to instrument and calculate the size of the ProductDetail object. It has 7 Double attributes along with a String. ~ 100-150 bytes. 2. Below is the code that fails Map> resultMap = productCache.invokeAll(keyList.stream() .map(String::valueOf).collect(Collectors.toSet

Re: Ignite-hibernate latest version is not available in maven central

2016-06-02 Thread Anton Vinogradov
Hi, You can use non-apache mvn repositories contain full list of Apache Ignite artifacts. For example you can add dependency to this one: http://www.gridgainsystems.com/nexus/content/repositories/external/org/apache/ignite/ignite-hibernate/ We just uploaded release tags 1.5.0-final and 1.6.0 witho

Re: Unexpected performance issue with SQL query followed by error

2016-06-02 Thread Alexei Scherbakov
No, I think you wouldn't get increase for this particular query, because it contains big result set, which has to be downloaded to client over network. But you can split the task between multiple nodes, run every job locally and get result faster. To achive what you can use affinity collocation [1]

Re: Simulating Graph Dependencies With Ignite

2016-06-02 Thread Alexei Scherbakov
1. What's the memory size of ProductDetail? 2. Possibly the coding error. Share the code, I'll take a look. 2016-06-02 13:55 GMT+03:00 pragmaticbigdata : > Thanks Alexei for the responses > > 1. Ok I will try out the GC settings and off heap memory usage. > > I have a cache of IgniteCache where

Re: Simulating Graph Dependencies With Ignite

2016-06-02 Thread pragmaticbigdata
Thanks Alexei for the responses 1. Ok I will try out the GC settings and off heap memory usage. I have a cache of IgniteCache where ProductDetails is my custom model. I have implemented custom logic using directed acyclic graphs. 2. I tried executing it with cache.invokeAll. The first run faile

Re: About benchmark and scalability testing

2016-06-02 Thread Vladislav Pyatkov
Hello, In addition, banchmarks for Apache Ignite are made using yardstik[1] framework. Сan be found in the project ignite-yardstick[2] [1]: https://github.com/yardstick-benchmarks [2]: https://github.com/apache/ignite/tree/master/modules/yardstick On Thu, Jun 2, 2016 at 1:49 PM, Alexei Scherbako

Re: About benchmark and scalability testing

2016-06-02 Thread Alexei Scherbakov
Hi, Some benchmarks are available on GridGain site: http://www.gridgain.com/resources/benchmarks/ignite-vs-hazelcast-benchmarks/ I think Ignite can't be fully tested using SQL related benchmarks, because Ignite only supports SELECTs. Therefore, I recommend to measure Ignite's performance using

Persistent storage with Ignite C++

2016-06-02 Thread Graham Bull
We'd like to use Ignite with persistent storage. However, I'm not sure if our scenario is feasible. We'll be using Ignite C++. From the documentation it seems as though this provides a limited subset of the full Java version. There's no compute functionality, but that's coming soon. But more impor

Re: Simulating Graph Dependencies With Ignite

2016-06-02 Thread Alexei Scherbakov
Hi Amit. 1) Performance degradation may be caused by long GC pauses. Please check [1] for hints on how to set up GC settings properly. If you plan to have very large caches, I recommend using OFFHEAP_TIERED mode [2] I assume you take the aproach like IgniteCache> How many cells do you have in sin

About benchmark and scalability testing

2016-06-02 Thread hu...@neusoft.com
Hi, Is there somebody making the performance testing for Ignite? Who used the Benchmark Factory™ or BenchmarkSQL which supports TPC-C to test Ignite? I want to know how does Ignite compare with mysql or oracle in OLTP. Or, where can I find the related article? Any guidance

One failing node stalling the whole cluster

2016-06-02 Thread Daniel López
Hi there, We are using Ignite 1.5.0 and we are experiencing a strange issue where one node stalls the others node in the cluster. We are using CacheMode.REPLICATED caches to store data on heap on several nodes to improve latency. In one of the latest upgrades someone introduced a bug in the system

Re: ClassNotFoundException with affinity run

2016-06-02 Thread pragmaticbigdata
Ok great. That explains why the app worked after the jar deployment. Thanks. I wonder if you have any inputs on the performance issues I am experiencing with updating an ignite cache. It is tracked on a different discussion thread. -- View this message in context: http://apache-ignite-users.70

Re: ClassNotFoundException with affinity run

2016-06-02 Thread vkulichenko
Hi, Peer class loading can be used for computations (like the closure that you pass to affinityRun method), but not for the model classes that are stored in cache. That's why the closure is successfully sent to the server node, but fails on the localPeek - it tries to deserialize the value, but do