Re: Local node SEGMENTED. Data Lost on a Partitioned Cache with backups of 3

Hi Raja, You are right, when node left the grid new backup should be created if at least one copy of data exists. I mean that you can loose data if you start to load data on a node which left the grid unexpectedly, so some of data would be on segmented node only. As you say you use Hadoop/Yarn, b

Re: CPU Usage on distributed queries

Hi, Do the two nodes with the highest load reside on the same physical machine? If that is so and the queries were run from that machine, then I could assume that the cpu load is due to the reduce step being held there. Kind regards, Alex 3 апр. 2017 г. 8:45 PM пользователь "vdpyatkov" написал:

Re: Apache ignite persistant store implementation

Hi Sweta, You should to start server node to Ignite could keep cache data in memory. On Tue, Apr 4, 2017 at 8:43 AM, sweta Das wrote: > Hi > I have few clarifications on the read and write through implementation of > ignite cache. > I have a mysql database with a simple table (1 int key and 2 c

Re: A question about cluster configuration (Are there any way to make client connection faster?)

Hi, Specifying a port range leads to more ports to be scanned and checked, so the delay is bigger. But the whole time highly depends on many factors: cache config, network latencies, system load on nodes etc. Kind regards, Alex 3 апр. 2017 г. 9:08 PM пользователь "vdpyatkov [via Apache Ignite Us

Re: NameNode sync using DUAL_ASYNC mode on IGFS

Hi Massayuki, Ignite itself does not have a concept of a NameNode. It goes directly to the cluster node responsible for storing the data based on a key's hashcode. The only time when a NameNode would come into a play, is when Hadoop HDFS is configured as an underlying write-through file system. B

Apache ignite persistant store implementation

Hi I have few clarifications on the read and write through implementation of ignite cache. I have a mysql database with a simple table (1 int key and 2 columns of String). I know that I have to start a ignite client node with cache store configuration. But do I also need to start the server node

continuous query equivalent to cache.get ?

Hi, I want to get continuous updates of the value of a certain key on a certain cache, so I thought of a continuous query based on an initial query like this: SELECT _value from CACHE where _key=KEY Questions: - is this possible with this syntax? - is this an SQL Query (the initial query I m

Re: Local node SEGMENTED. Data Lost on a Partitioned Cache with backups of 3

Hi Andrew, Thanks for the reply. Here is the configuration that I use for the cluster. Because we have are maintaining 3 data copies in the cluster, if data loading from node is failed then it should be able to get the data from other node. isn't it? Thanks in advance for your support Raja ht

Re: Local node SEGMENTED. Data Lost on a Partitioned Cache with backups of 3

Hi Raja, Data loss can happend if rebalance is not finished by some reason between nodes failures. Also you can loss data that is being loaded from segmented node when failure happens. Would you please attach ignite configuration? On Mon, Apr 3, 2017 at 9:43 PM, Raja wrote: > Hi, > > I have a

Re: SpringCacheManager

Hi Vishal, SpringCacheManager is wrapper to Ignite instance. So, all Ignite features should be supported. What do you mean by "Auto refresh"? On Mon, Apr 3, 2017 at 5:38 PM, vishal jain wrote: > Hi, > > > Does "SpringCacheManager" supports Write Behind, Auto refresh etc? > > If not then what i

Re: Ignite may start more service instances per node than maxPerNodeCount in case of manual redeploy

Hi Evgeniy, Looks like a bug. I've created a ticket [1]. Seems, this reporoduced only when service deployment with dynamic approach. When Ignite starts with service configured - all looks fine for me. [1] https://issues.apache.org/jira/browse/IGNITE-4907 On Mon, Apr 3, 2017 at 4:26 PM, Evgeniy I

Re: Any plan for a book on Apache Ignite

We have made a huge update of the book High performance in-memory computing with Apache Ignite . We have completed the book review and proofreading (from the scratch). If you already have the copy of the book, please do not forget to update. Also, don't hesitate to giv

Re: Stoppin listen for topics in Ignite

Sorry, I don't understand. Why do you call stopListen if you still can receive messages? Basically, if you do this concurrently, there is a race condition and you don't know whether listener will be called or not for all messages. -Val -- View this message in context: http://apache-ignite-user

Local node SEGMENTED. Data Lost on a Partitioned Cache with backups of 3

Hi, I have a Ignite cluster deployed on Hadoop/Yarn with cache configuration as follow Cache Mode : Partitioned Backups : 3 Default Segmentation behavior. Two nodes went down with "Local node SEGMENTED" error around same time at 7:00 AM and the another node failed with the same error around

Re: A question about cluster configuration (Are there any way to make client connection faster?)

Hi If you are use port range, than this can consume more time, because Discovery SPI try to connect to by all port in range. But If you are specified single port, connection should be fast. Why are you think that delay occur on discovery phase? -- View this message in context: http://apache-ig

Re: CPU Usage on distributed queries

Hi, How was Ignite nodes and physical machines mapped? Where Ignite nodes more there is CPU utilization greater, isn't it? Where were SQL query generated (on one of a srever node or other)? I think, CPU utilization shuold be same over of nodes, because SQL executed as Map Reduce task. -- View

Re: Distributed Closures VS Executor Service

Hi, 1) The better way using DataStreamer API. More details you can find there [1]. 2) Internal implementation SQL works in similar fashion. The query will be parsed and split into multiple map queries and a single reduce query. All the map queries are executed on all the data nodes where cache da

Re: Client near cache with Apache Flink

What is the source of your data in case *without* Ignite cache? I'm trying to understand your design without Ignite. What does your code instead of nearCache.get(key)? Also the code snippet that creates code still should fail because it try to create near cache for original cache that doesn't exis

Re: 2.0

Hi Nikolai, Yes. It is working :). and vertx-ignite cluster also joined the cluster now :) . not sure how it started working :) Thanks. On 3 April 2017 at 21:44, Nikolai Tikhonov wrote: > I mean that host equals machine. Can you try to start nodes with > TcpDiscoveryVmIpFinder and check that

Re: Pessimistic TXN did not release lock on a key, all subsequent txns failed

Sorry for the late response. We do not close/destroy caches dynamically. could you please explain this NPE? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Pessimistic-TXN-did-not-release-lock-on-a-key-all-subsequent-txns-failed-tp10536p11676.html Sent from the A

Re: ScanQuery With BinaryObject

Hi David, Scan query results are never cached. It looks like your IgniteBiPredicate implementation is cached on server side. Try to move this class to upper level or make it inner and make "prefix" configurable with class constructor. This should work. On Mon, Apr 3, 2017 at 9:24 AM, David Li wr

Re: 2.0

I mean that host equals machine. Can you try to start nodes with TcpDiscoveryVmIpFinder and check that ignite will be work properly? On Mon, Apr 3, 2017 at 7:08 PM, Anil wrote: > Hi Nikolai, > > What do you mean by hosts ? Two machines able to connect each other. > > Thanks > > On 3 April 2017 a

Re: Storing JSON data on Ignite cache

Hi Austin, There is no way to query binary data as Ignite does not know its structure. You should deserialize data before store it with Ignite or store it as BinaryObjects. The first approach required all Ignite nodes should have data structure classes in their classpathes. The second one require

Re: 2.0

Hi Nikolai, What do you mean by hosts ? Two machines able to connect each other. Thanks On 3 April 2017 at 21:12, Nikolai Tikhonov wrote: > Hi Anil, > > Are you sure that you this addresses (172.31.1.189#47500, > 172.31.7.192#47500) reacheable from the hosts? Could you check it by telnet? > >

Re: Eager TTL and query

Hi, "When entry accessed" is mind that entry will be involved by IgniteCache API (put/get/invoke and etc). In during operation ttl will be checked. Ignite SQL doesn't update ttl and entry won't be removed. On Mon, Apr 3, 2017 at 4:28 PM, Tolga Kavukcu wrote: > Hi Everyone, > > I have a questi

Re: Client near cache with Apache Flink

Hi, The code is not all there but i think it's the important one. Cache access: this.nearCache.get(key); (Mentioned above) Cache name comes from table.getName() which, for instance, can be "LK_SUBS_UPP_INST". Data in ignite cache: String key and Object[] value. For now I only have one record for e

Re: Storing JSON data on Ignite cache

Hi, Seems you have to use Cache's query method with transformer. public QueryCursor query(Query qry, IgniteClosure transformer); Usage example: IgniteClosure, Integer> transformer = new IgniteClosure, Integer>() { @Override public Integer apply(Cache.Entry e) { return e

Re: Client near cache with Apache Flink

Hi, it still doesn't describe your use case in details. How exactly do you use Ignite cache in your system? What kind of data do you cache and what source of this data in case without Ignite? Also it looks strange for me that you try to create near cache with name that doesn't match with original

Re: 2.0

Hi Anil, Are you sure that you this addresses (172.31.1.189#47500, 172.31.7.192#47500) reacheable from the hosts? Could you check it by telnet? On Mon, Apr 3, 2017 at 12:20 PM, Anil wrote: > Hi Val, > > I tried without vertx and still nodes not joining the cluster. Looks like > the issue is not

Re: SpringBoot Integration

Hi Vishal, See Ignite exmples source code: - org.apache.ignite.examples.misc.springbean.SpringBeanExample. - org.apache.ignite.examples.datagrid.store.spring.CacheSpringStoreExample Also test project [1] may be helpful [1] https://github.com/Normal/apache-ignite-testproject/tree/master

Re: Error while running query against Ignite Server Node

Hi, It's looks that you have long gc pause in your application. Did you see in logs any message related with changing topology (node fail, node left, node join and etc)? Could you enable gc logs and check it (for example -Xloggc:./gc.log -XX:+PrintGCDetails -verbose:gc)? On Sun, Apr 2, 2017 at 1:

SpringCacheManager

Hi, Does "SpringCacheManager" supports Write Behind, Auto refresh etc? If not then what is the alternative approach to implement these in Spring-Ignite based application. Thanks, Vishal

Re: Server Client Connection

Yes, it's absolutely ok. Do not worry:) On Mon, Apr 3, 2017 at 5:01 AM, woo charles wrote: > Hi, > > > >I have created 5 server nodes in 5 jvm process in 3 jvms. > To be honest this point is not clear for me. Could you please describe how > you run 5 jvm process in 3 jvms? > Sorry for confused y

Eager TTL and query

Hi Everyone, I have a question about cache ttl. I understand that when eager ttl is set to true for a cache, a thread created and expired entries are cleaned but this can cause some heap usage. Otherwise i can set eager ttl to false, when entry accessed ignite checks if entry expired or not it is

Ignite may start more service instances per node than maxPerNodeCount in case of manual redeploy

Hello. Recently we discovered that if a service is configured in IgniteConfiguration with e.g. maxPerNodeCount equal to 1 and totalCount equal to 3, we start-up 2 Ignite nodes - then cancel the service after some time and redeploy it with the same config as ignite.services().deploy(...) - we

Storing JSON data on Ignite cache

Hi, My Ignite version is 1.9.0 I am pushing JSON object into Ignite's cache using Apache Nifi's : GetKafka => PutIgniteCache processors. I could able to save the data in cache but the data it is in byte array format how can I query this. My Json object looks like this : {"id":1, "name":"USA", "

SpringBoot Integration

Hi, I am new to ignite and am planning to use ignite as IMDG in my spring boot application. Do we have any spring template (Spring Data or JDBC based) for cache Load etc, any pointers will be highly appreciated. Thanks, VJ

Re: ignite messaging disconnection behaviour

Hi Kevin, Unfortunately community decided to leave it as is, because messages are sent asynchronously by design, but connection establishing is not. That was made intentionally and user should take it into account and resolve depending on concrete situation. Thanks! -Dmitry. -- View this mess

Re: [GridCachePartitionExchangeManager] Pending transaction deadlock detection futures

Hi ght230, I think that Visor CMD should work in client mode, but it is not implemented yet. Please create issue in Ignite JIRA for that. On Sat, Apr 1, 2017 at 1:41 PM, ght230 wrote: > I want to know should Visor CMD be worked in client mode or daemon mode? > > > > -- > View this message in co

Re: Stoppin listen for topics in Ignite

Dear vkulichenko,I want to listen ignMessage.send and IgnitePredicate execution. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Stoppin-listen-for-topics-in-Ignite-tp11604p11656.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

A question about cluster configuration (Are there any way to make client connection faster?)

The ignite configuration in my app.config (and web.config) is like below: 48500 192.168.1.100:48500 48100 With that configuration, a client on the same network (on a different computer) connects around 10-12 seconds. If I

Re: 2.0

Hi Val, I tried without vertx and still nodes not joining the cluster. Looks like the issue is not because of vertx. Thanks On 3 April 2017 at 12:13, Anil wrote: > Hi Val, > > Can you help me in understanding following - > > 1. I see empty files created with 127.0.0.1#47500 and > 0:0:0:0:0:0:0

Re: Distributed Closures VS Executor Service

Hello Christo and thank you for your feedback. For the moment we have a Relational Database that is not distributed or partitioned. We have given some thought for configuring at least some database tables as cache store to Ignite and it not something that we exclude. Just for the moment due to so