What is H2 Database.

2018-09-20 Thread Malashree
What is H2 Database how it helps us in Apache Ignite. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: YCSB Benchmark

2018-09-20 Thread Ivan Artiukhov
Hi! 1) Are you running Ignite and YCSB nodes on the same machine? How many YCSB nodes do you start? 2) What DataRegionConfiguration do you set in ignite.xml config file? Does the whole dataset of 1M entries fit in RAM ()? 3) Do other Ignite parameters have the same value as in the blog post you

Re: Setting performance expectations

2018-09-20 Thread Daryl Stultz
is my understanding correct, that you first select 400k records from DB, DB is remote and this takes 700ms, then you select all these 400k records from Ignite and now it takes 500ms, but in this case ignite is a local embedded node? All of this runs on my laptop, no network involved. MacBook

Re: Too Many open files (native persistence bin files)

2018-09-20 Thread Dmitriy Pavlov
Hi, Is it reproduced if you remove direct io from class path? Sincerely Dmitry Pavlov вт, 18 сент. 2018 г., 16:01 Evgenii Zhuravlev : > Hi, > > How many caches do you have? > > Evgenii > > вт, 18 сент. 2018 г. в 15:38, kvenkatramtreddy >: > >> one correction: lsof showing the information for

Re: IgniteSparkSession exception:Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=null]

2018-09-20 Thread vkulichenko
Does the configuration file exist on worker nodes? I looks like it actually fails to start there for some reason, and then you eventually get this exception. Are there any other exception in worker/executor logs? -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

2018-09-20 Thread vkulichenko
If join is indexed and collocated, it still can be pretty fast. Do you have a particular query that is slower with optimization than without? -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ignite.events().remoteListen unmarshal0 throw class not found

2018-09-20 Thread vkulichenko
Can you show the full trace? Most likely it's failing on server side because you don't actually have the class there. -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Query 3x slower with index

2018-09-20 Thread eugene miretsky
Thanks Ilya, Tried it, no luck. It performs the same as when using category_id index alone (slow). Any combindation I try either uses AFFINITY_KEY or category index. When it uses category index it runs slowers. Also, when AFFINITY_KEY key is used, the jobs runs on 32 threads (my query

Re: Message grid failure due to userVersion setting

2018-09-20 Thread Ilya Kasnacheev
Hello! I think we should just wait for someone to tackle IGNITE-7905 (or actively contribute for a chance). Regards, -- Ilya Kasnacheev вт, 18 сент. 2018 г. в 21:59, Dave Harvey : > Thanks Ilya, > > As I understand this a bit more, it

ignite.events().remoteListen unmarshal0 throw class not found

2018-09-20 Thread wangsan
A server and a client, then client call: line_1: CacheNodeFilter rmtFilter = new CacheNodeFilter(serviceType, uuid); line_2: ignite.events().remoteListen(listenerDispatcher, rmtFilter, EventType.EVT_CACHE_OBJECT_EXPIRED); I am quite sure all the server and client have the class

Re: Unable to get the ignite cache metrics

2018-09-20 Thread ezhuravlev
Hi, Looks like you try to access local cache metrics on client node, which will be empty, because clients doesn't store cache. Try to use CacheClusterMetricsMXBeanImpl instead. Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Inconsistent data.

2018-09-20 Thread Mikhail
Hi Shrikant, What kind of requests do you mean? If you make affinity calls, ignite always sends the task to a node which has data, if new node doesn't have data, tasks just won't go to this node. Could you please explain in more details what you mean by requests? Thanks, Mike. -- Sent from:

Re: Setting performance expectations

2018-09-20 Thread Mikhail
Hi Daryl, Could you please share with us your benchmark? is my understanding correct, that you first select 400k records from DB, DB is remote and this takes 700ms, then you select all these 400k records from Ignite and now it takes 500ms, but in this case ignite is a local embedded node?

Re: Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

2018-09-20 Thread Ray
Hi Val, thanks for the reply. I'll try again and let you know if I missed something. By "Ignite is not optimized for join", I mean currently Ignite only supports nest loop join which is very inefficient when joining two large table. Please refer to these two tickets for details.

Re: Data migration using persistent Queues

2018-09-20 Thread ipsxd
Yes, Ignite Queue. In the mean time I did some tests and it seems that adding fields is not a problem but removing or doing some more complicated stuff would be. Another option is to implement Externalizable and implement the logic there. So I think a good approach would be a combination between

Re: ScanQuery throwing Exception for java Thin client while peerclassloading is enabled

2018-09-20 Thread Ilya Kasnacheev
Hello! Not unless you have value class on server nodes. If you don't have value class available (or key for that matter) you are restricted ro BinaryObject's. Regards, -- Ilya Kasnacheev ср, 19 сент. 2018 г. в 10:26, Saby : > Hi Ilya, > Thanks for your response, yes I had tried with

Re: Ignite service for redhat/centos

2018-09-20 Thread Ilya Kasnacheev
Hello! We have RPM build which may be a good starting point. It has service template. Regards, -- Ilya Kasnacheev чт, 20 сент. 2018 г. в 13:59, Nadba : > Do we have this feature in 2.6? How do we run ignite as a service or a > process detached from console? Any solution other than nohup and

Re: .net decimal being stored as Other in ignite.

2018-09-20 Thread Ilya Kasnacheev
Hello! This problem I do not observe. I can see values with decimal points in dbeaver. Regards. -- Ilya Kasnacheev чт, 20 сент. 2018 г. в 13:43, wt : > thanks, just another FYI , the values in that column cut off anything after > the decimal point while it is other so 3.456 becomes 3 > > for

Re: Ignite service for redhat/centos

2018-09-20 Thread Nadba
Do we have this feature in 2.6? How do we run ignite as a service or a process detached from console? Any solution other than nohup and &? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: .net decimal being stored as Other in ignite.

2018-09-20 Thread wt
thanks, just another FYI , the values in that column cut off anything after the decimal point while it is other so 3.456 becomes 3 for now we are storing as a string and casting to decimal when we query -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Query 3x slower with index

2018-09-20 Thread Ilya Kasnacheev
Hello! > 2) ga_customer_and_category_id: on customer_id and category_id Have you tried to do an index on category_id first, customer_id second? Note that Ignite will use only one index when joining two tables and that in your case it should start with category_id. You can also try adding

Re: IgniteUtils enables strictPostRedirect in a static block

2018-09-20 Thread Ilya Kasnacheev
Hello! I have a feeling that those lines were left there inadvertently. The correct insertion of this prop is in GridUpdateNotifier class. Can you file a ticket about this problem? Regards, -- Ilya Kasnacheev вт, 18 сент. 2018 г. в 23:31, xero : > Hi, > Does anyone have information about

Re: connecting to Zookeeper cluster using SSL/TLS Connection

2018-09-20 Thread Ilya Kasnacheev
Hello! Have you tried specifying zookeeper.client.secure If you want to connect to the server secure client port, you need to set this property to *true* on the client. This will connect to server using SSL with specified credentials. Note that it requires the Netty client.

Re: ***UNCHECKED*** new CacheConfiguration always returns same instance

2018-09-20 Thread Ilya Kasnacheev
Hello! hashCode is implemented by MutableConfiguration (from JCache) which only takes a subset of fields into account. Why is this a problem for you? Regards, -- Ilya Kasnacheev ср, 19 сент. 2018 г. в 10:21, kcheng.mvp : > here is a simple test code > > CacheConfiguration cacheCfg = new

Re: Off heap constantly grow on use BinaryObject as field of cached data

2018-09-20 Thread Serg
Hello Ilya, I have found that cause of problem the objects which have different size of data. As result I have situation where pageFillFactor increased and offHeapSize is decreased and this trend never end. Grafana screen:

Re: IgniteSparkSession exception:Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=null]

2018-09-20 Thread yangjiajun
The configuration is from:https://github.com/apache/ignite/blob/master/examples/config/example-default.xml. The code runs well with spark local[*].But it throws exception when I run it with my spark standalone cluster which has a master node and a worker node.The exception is in the sql

Re: IgniteSparkSession exception:Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=null]

2018-09-20 Thread aealexsandrov
Hi, Can you provide the code and configuration? Next one works okay for me: //start the server Ignite ignite = Ignition.start("server_config.xml"); //activate the cluster ignite.cluster().active(); //create the spark session with daemon client node