Re: webconsole generated project - cache load performance

2018-09-14 Thread Alexey Kuznetsov
Hi! Could you provide more details? Ignite version? DB Vendor and version you are loading data from? Ignite cluster size (number of nodes)? Does each node in cluster run on separate host? Attach your generated project and DDL of data you are loading. On Sat, Sep 15, 2018 at 2:18 AM wt wrote:

Huge Query order by PK causes OOMKilled

2018-09-14 Thread Renato Melo
I am running on Kubertes three nodes. 32 caches are replicated across these 3 nodes. Currently each node is Limited to 10 cpus and 30 Gigabits of memory. Caches are persisted. Max heap memory is set to 18g. Before running the query, with all nodes up and connect, I ran top and I see that

Handling split brain with Zookeeper and persistence

2018-09-14 Thread eugene miretsky
Hi, What are best practices for handling split brain with persistence? 1) Does Zookeeper split brain resolver consider all nodes as the same (client, memory only, persistent). Ideally, we want to shut down persistent nodes only as last resort. 2) If a persistent node is shut down, we need to

multiple tables in same cache - is it possible

2018-09-14 Thread wt
i have read that the preferred way is to have a cache per table. Is it however possible to have multiple tables in a single cache to make the administration of that cache simpler. what are the sort of problems that would surface if this were to be done? thanks -- Sent from:

Backup failover with persistence

2018-09-14 Thread eugene miretsky
What is the process when a node goes down and then restarts? Say backups = 1. We have node A that is primary for some key, and node B that is back up. Node A goes down and then restarts after 5 min. What are the steps? 1) Node A is servicing all traffic for key X 2) Node A goes down 3) Node B

webconsole generated project - cache load performance

2018-09-14 Thread wt
Hi Is there a way to make the loading run faster for a project that has been generated by the web console. I am loading 4 million records and it is taking 30+ minutes -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Configurations precedence and consistency across the cluster

2018-09-14 Thread eugene miretsky
Thanks for the response! A few more follow up questions: 1) How can we chance configurations of persistent caches (replication and recovery settings for example)? 2) For client related settings, are the settings taken from the server config, or client config (partitionLosePolicy or SQL table

Using compute().call from a Service has P2P class loading feature?

2018-09-14 Thread xero
Hello, I have a question about p2p class loading. My topology is 1 dedicated server, 1 client. I have deployed a Service in the ignite client node (selecting clusterGroup forClients) from which I'm trying to execute a compute() to the server node. The IgniteCallable that I'm sending to call() is

Re: Service not found for a deployed service

2018-09-14 Thread Denis Mekhanikov
Did you manage to reproduce the problem? Denis пн, 6 авг. 2018 г. в 14:39, Calvin KL Wong, CLSA : > Hi Denis, > > > > >> Did Service#init() method throw any exceptions? > > No, we didn’t see any exception. > > > > I will get a stack trace if I can reproduce it. > > > > Thanks, > > Calvin > > >

Re: Need help for setting offheap memory

2018-09-14 Thread Denis Mekhanikov
So, Amol, Did you look at the heap dump? Denis пн, 6 авг. 2018 г. в 18:46, Amol Zambare : > Hi Alex, > > Here is the full stack trace > > [INFO][tcp-disco-sock-reader-#130][TcpDiscoverySpi] Finished serving > remote node connection > [INFO][tcp-disco-sock-reader-#653][TcpDiscoverySpi] Started

Re: Can't connect VisualVM to Ignite 2.4, 2.6 process on windows

2018-09-14 Thread Alew
Hi! Actually there was no OOME before VisualVM connect attempt. There is a point in time after Ignite start after that it is not possible to conect VisualVM to Ignite. I can connect them successfully on different computer. I think this is an environment specific bug, somehow related to

SQL query and Indexes architecture

2018-09-14 Thread eugene miretsky
Hello, Trying to understand how exactly SQL queries are executed in Ignite. A few questions 1. To what extent is H2 used? Does it store the data? Does it create the indexes? Is it used only for generating execution plans? I believe that all the data used to be stored in H2, but with

Re: the right way to reset an ignite instance

2018-09-14 Thread Evgenii Zhuravlev
Hi, You can just delete work directory and db & wal directories if you set them explicitly. Evgenii пт, 14 сент. 2018 г. в 16:53, es70 : > What is the right way to reset an ignite instance to the initial state > (just > like if I just installed it) > > BR > Evgeny > > > > -- > Sent from:

ignite - what ports should be open on a linux machine

2018-09-14 Thread es70
what ports should be open on a linux machine? I opened the following ports in respect of my config 10800 - client 11211:11220 58500:58520, 58100:58109 58400:58409 is this right? Should I open any other ports? I'm asking because I see that it take some considerable time for the nodes to

the right way to reset an ignite instance

2018-09-14 Thread es70
What is the right way to reset an ignite instance to the initial state (just like if I just installed it) BR Evgeny -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ./control.sh --baseline doesn't list nodes on a linux machines

2018-09-14 Thread es70
before I got the cluster to the active state I had deleted the /work folders on the 3 machines. Then I deleted the /work folders once again, added a Windows machine (amended configs and firewall accordingly) to those 3 so to have a mixed cluster of 4 machines. I could not activate the new

Re: Network Segmentation

2018-09-14 Thread eugene miretsky
What does it provide on top of the Zookeeper split brain resolver? https://apacheignite.readme.io/docs/zookeeper-discovery On Fri, Sep 14, 2018 at 3:59 AM Kopilov wrote: > luqmanahmad, what does this plugin definitely do? > Can it help to avoid segmentation or only to detect them? > Can it be

Re: Ignite Visor cache not active

2018-09-14 Thread ezhuravlev
Hi, Can you show the topology which Visor prints? Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ./control.sh --baseline doesn't list nodes on a linux machines

2018-09-14 Thread ezhuravlev
If you just started 3 nodes and you have topology version 20, then, probably, you have started visor started somewhere, because even daemon nodes can store topology version. Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Does ignite supported calculated columns ?

2018-09-14 Thread ezhuravlev
Hi, How often do you access it? Maybe it would be better to calculate it each time you access it in getter method? Alternatively, you can implement Binarylizable interface and calculate this column there, before serializing it. Evgenii -- Sent from:

Re: KafkaStreamer and IgniteDataStreamer dynamic cache name

2018-09-14 Thread akurbanov
Hello, If you have some way to determine required cache name for update from your data model, then you can implement custom StreamVisitor for the DataStreamer, code example is on the same page. -- Sent from:

Re: Question about Caching, Console, and PeerClassLoading

2018-09-14 Thread Ilya Kasnacheev
Hello! Peer Class Loading only covers loading of various runnables (queries, lambdas, services, etc, etc). It does not cover key/value classes for your caches. Moreover, it could not do anything if you had two different versions of those in your cluster. The recommendation here is either to

Re: Can't connect VisualVM to Ignite 2.4, 2.6 process on windows

2018-09-14 Thread Ilya Kasnacheev
Hello! I don't think you can connect VisualVM to JVM in OutOfMemory state. You can try to use jmap to take heap dump, failing that, try to increase heap size and/or connect before it goes into OOM. Regards, -- Ilya Kasnacheev пт, 14 сент. 2018 г. в 0:43, Alew : > Hi! > > I was suggested to

Re: ./control.sh --baseline doesn't list nodes on a linux machines

2018-09-14 Thread Alex Plehanov
In your previous post was a message: "Current topology version: 20". It does not look like a cluster with 3 nodes just started. So, I think the cluster was not restarted correctly, it still was in compatibility mode. In your last post, it was restarted correctly and not in compatibility mode

Re: ./control.sh --baseline doesn't list nodes on a linux machines

2018-09-14 Thread es70
UPDATE to the previous post - after my last message I started the visor and saw that there were some ignite processes running. Looks like that started some before. So I killed those leftovers and started the cluster from fresh. Now I can see the baseline [root@adp-apachelg01 bin]# ./control.sh

Re: Network Segmentation

2018-09-14 Thread Kopilov
luqmanahmad, what does this plugin definitely do? Can it help to avoid segmentation or only to detect them? Can it be useful for my current problem: http://apache-ignite-users.70518.x6.nabble.com/Unreasonable-segmentation-in-Kubernetes-on-one-node-reboot-tp24102.html ? -- Sent from:

Re: ./control.sh --baseline doesn't list nodes on a linux machines

2018-09-14 Thread es70
Hi Alex I did it accordingly to your advice. Well the cluster seems to be active but I still can't see the baseline nodes. [root@adp-apachelg01 bin]# ./control.sh --baseline Control utility [ver. 2.6.0#20180710-sha1:669feacc] 2018 Copyright(C) Apache Software Foundation User: root

Performance of SQL query by partial primary key

2018-09-14 Thread Ray
I have some trouble understanding how Ignite maintain primary key. This document https://apacheignite.readme.io/docs/memory-architecture#section-b-trees-and-index-pages says "The cache keys are also stored in B+ trees and are ordered by their hash code values." So if I create a table using this