Re: Loading similar data to specific instance and not all instances

2017-07-06 Thread Aiden
Hello all, I'm totally a newbie here, so just bear with me. I followed through this link: https://github.com/apache/ignite/blob/master/modules/core/src/main/java/org/apache/ignite/cache/affinity/AffinityKeyMapper.java

Re: slow performance when using order by clause

2017-07-06 Thread neerajbhatt
explain plan without order by FROM ITEMCACHE.ITEM T__Z0 /* ITEMCACHE.ITEM_RATING_IDX: RATING = ?1 */ /* WHERE (T__Z0.RATING = ?1) AND ((T__Z0.DOWNLOADS = ?3) AND (T__Z0.REVIEWS = ?2)) */ INNER JOIN IGPCACHE.RANK R__Z1 /* IGPCACHE.RANK_UNIQUESKUID_IDX: UNIQUESKUID =

RE: IGNITE-4548 does not seem to be completely fixed

2017-07-06 Thread Gordon Reid (Nine Mile)
Hi Mikhail, Thanks for looking at this. I will create a reproducer for you. Thanks, Gordon. From: Mikhail Cherkasov [mailto:mcherka...@gridgain.com] Sent: Tuesday, 4 July 2017 2:14 AM To: user@ignite.apache.org Subject: Re: IGNITE-4548 does not seem to be completely fixed Hi Gordon, Could you

RE: Ignite very very chatty when java server nodes and .net client when using Service Grid

2017-07-06 Thread Gordon Reid (Nine Mile)
Hi Pavel, Yes that’s correct, in this case we were calling Ignite.GetServices().GetServiceProxy() every second. When the .NET client is remote from the java server, this caused a large amount of traffic. As service descriptors for services that were not even deployed (so basically all the serv

Re: High heap on ignite client

2017-07-06 Thread Anil
Hi Alex, Thanks. i have changed the swapiness to avoid sys time > user time. and did test but no luck. What do you mean by "apps/containers running on same physical machine" ? You mean on kube instance ? if yes, yes there are number of services/containers running on same kube cluster/instance.

Re: Connecting to remote host from client gives error

2017-07-06 Thread vkulichenko
Then it might be blocked by firewall. These messages simply mean that client can't establish connection with this socket address. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Connecting-to-remote-host-from-client-gives-error-tp14395p1.html Sent from

Re: cassandra cache store with port

2017-07-06 Thread vkulichenko
Srini, Please refer to [1] for information on how to use the store and configuration examples. If default port is not 9042, then I don't see an issue. You have to either explicitly specify your default port, or provide all addresses as host:port strings. [1] https://apacheignite-mix.readme.io/do

Re: frequet disconnection in ignite cluster

2017-07-06 Thread tysli2016
Hi Rishi, seems it's not a good idea to connect ignite repeatedly, I observed a similar memory issue. would you mind to share your server configurations (cores, memory)? http://apache-ignite-users.70518.x6.nabble.com/Ignite-1-6-0-suspected-memory-leak-from-DynamicCacheDescriptor-td9443i20.html h

Re: frequet disconnection in ignite cluster

2017-07-06 Thread ignite_user2016
Thank you.. Val for all your help. I will investigate further.. We are monitoring ignite every 5 mins with shell script could that cause memory to go high ? Take Care, Rishi > On Jul 6, 2017, at 4:50 PM, vkulichenko [via Apache Ignite Users] > wrote: > > Rishi, > > This is usually caused

Re: cache partitions

2017-07-06 Thread Alexey Kuznetsov
Hi! What Ignite version do you use? Also attach server and clients nodes configuration. We will try to reproduce. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/cache-partitions-tp14063p14440.html Sent from the Apache Ignite Users mailing list archive at Nabble

Re: Ignite web console

2017-07-06 Thread Alexey Kuznetsov
What version of ignite are you using? May be Docker will be more suitable for you? See: https://apacheignite-tools.readme.io/docs/docker-deployment -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-web-console-tp13659p14439.html Sent from the Apache Ignite

Re: Connecting to remote host from client gives error

2017-07-06 Thread Abhishek Gupta
Yes I do have a server nodes which is hosted on this ip address port 10.133.71.210:47500", I have run it by running ignite.sh. It does not seem to be working. Any idea? -Abhishek On Fri, Jul 7, 2017 at 4:24 AM, vkulichenko wrote: > You're starting a client node and it connect to server cluster

Re: Event Listeners

2017-07-06 Thread javastuff....@gmail.com
Cached data change notifications are used in multiple use-cases. Here is one - We have OFFHEAP distributed Ignite cache fronted by JVM level local copy. It is similar to what Near cache would work. However, Ignite Near cache (JVM level local copy) also get serialized/de-serialized. which results i

Re: cassandra cache store with port

2017-07-06 Thread srini kandula
Hi Val, Yes, Cassandra listening to port other than 9042. Yes, I'm following the the tests approach. Should I explicitly create cache configuration at runtime and set it to the ignite instance? Looking at the hibernate example, cache config instance is created with in. Should I

Re: Cache refresh because of hibernate versioning mechanism.

2017-07-06 Thread vkulichenko
Hi Czeslaw, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. cszczotka wrote > I’m using cache with read-through/w

Re: Connecting to remote host from client gives error

2017-07-06 Thread vkulichenko
You're starting a client node and it connect to server cluster. Do you have any server nodes? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Connecting-to-remote-host-from-client-gives-error-tp14395p14434.html Sent from the Apache Ignite Users mailing list

Re: Compute Node computation on data node

2017-07-06 Thread vkulichenko
Hi, Please take a look and play with examples provided by Ignite: https://github.com/apache/ignite/tree/master/examples/src/main/java/org/apache/ignite/examples/computegrid They show how to do this kind of basic operations. -Val -- View this message in context: http://apache-ignite-users.705

Re: Ignite 2.0 vs Ignite 1.7 (or later)

2017-07-06 Thread vkulichenko
Hi, What exactly is consuming the memory? Do you have a heap dump? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-2-0-vs-Ignite-1-7-or-later-tp14401p14432.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Event Listeners

2017-07-06 Thread vkulichenko
Sam, What is the business use case behind this? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Event-Listeners-tp8306p14431.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite 1.6.0 suspected memory leak from DynamicCacheDescriptor

2017-07-06 Thread vkulichenko
Tom, It sounds like these jobs are triggered pretty frequently. So why not create a small application that will create an embedded client once and also have an internal timer or cron based scheduler to execute jobs periodically. You can do the topology check within this application as well, instea

Re: Optimum CacheConfiguration for cross cache join SQL queries

2017-07-06 Thread vkulichenko
iostream wrote > Hi, > > I have 2 caches, each with POJO values that look like - > > public class Value1 { > > @QuerySqlField(index = true) > private Long a; > > @QuerySqlField(index = true) > private String b; > > } > > public class Value2 { > > @QuerySqlField(

Re: Optimum CacheConfiguration for cross cache join SQL queries

2017-07-06 Thread vkulichenko
Hi, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. -- View this message in context: http://apache-ignite-use

RE: Dynamically update the Cache Configuration without restsrting client and serve

2017-07-06 Thread vkulichenko
Priya, There are no configuration properties that can be changed in runtime. However, most of your requirements seem to be related to dynamic schema change. This already happens transparently on object level thanks to binary format [1] used as a default data storage format. On SQL level this will

Re: Mix in cache keys objects with different types.

2017-07-06 Thread vkulichenko
Alexander, It doesn't matter if you use SQL. Without SQL it should work though. Did you get any exception when you tried this? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Mix-in-cache-keys-objects-with-different-types-tp14354p14426.html Sent from the A

Re: The client does not receive response after closure completion...

2017-07-06 Thread vkulichenko
Hi Alexander, Ticket for this already exists for a while: https://issues.apache.org/jira/browse/IGNITE-5189 You can try to set java.net.preferIPv4Stack=true system property, usually it helps to avoid this exception. -Val -- View this message in context: http://apache-ignite-users.70518.x6.na

Re: FairAffinityFunction in Ignite 2.0

2017-07-06 Thread vkulichenko
Hi Alexander, This function provided inconsistent mapping for caches created on different topology versions. Basically this means that collocation was not working properly in some scenario, so we decided to get rid of this function. Please use RendezvousAffinityFunction instead. -Val -- View t

Re: Ignite Information

2017-07-06 Thread vkulichenko
Hi, See CacheConfiguration#nodeFilter property. It's just a predicate that filters out nodes, cache will be deployed only on those for which filter returns true. The easiest way would be to set custom attributes via IgniteConfiguration#userAttributes and filter out using AttributeNodeFilter which

Re: Starting the Server

2017-07-06 Thread vkulichenko
Try to set java.net.preferIPv4Stack=true system property on all nodes. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Starting-the-Server-tp14398p14422.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Unable to connect from Windows Java client to Linux server cluster (ignite 2.0.0)

2017-07-06 Thread vkulichenko
Hi Roger, This is a known issue: https://issues.apache.org/jira/browse/IGNITE-5189 Try to set java.net.preferIPv4Stack=true system property. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Unable-to-connect-from-Windows-Java-client-to-Linux-server-cluster

Re: frequet disconnection in ignite cluster

2017-07-06 Thread vkulichenko
Rishi, This is usually caused by either network or memory issues. Check that you don't have any network glitches and that there are no GC pauses, memory leaks, etc. on the nodes. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/frequet-disconnection-in-igni

Re: cassandra cache store with port

2017-07-06 Thread vkulichenko
Hi Srini, Is Cassandra listening to port other than 9042? Also how do you configure Cassandra store? connection.properties file is used only in tests, Ignite doesn't actually provide this way of configuring. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com

Re: Volatile Kubernetes Node Discovery

2017-07-06 Thread vkulichenko
Hi Stephen, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. macdonagh wrote > Are there logs which will show the

Re: Large Key, eg UUID or String

2017-07-06 Thread vkulichenko
Hi Roger, It's perfectly fine to use UUID as a key. In case of composite key I would recommend to create a class with multiple fields to encapsulate all values there. Auto generation is not supported, at least for now. -Val -- View this message in context: http://apache-ignite-users.70518.x6

Large Key, eg UUID or String

2017-07-06 Thread Roger Fischer (CW)
Hello, are there any concerns about larg-ish keys, like a UUID? What if even larger, like a string of variable length? I am using Ignite SQL. Some objects have a single primary key, and in most cases it is a UUID. I am trying to decide if we should a) create an artificial key (long) and have a

Getting Started with Apache® Ignite™ (Part 5)

2017-07-06 Thread Dieds
Getting Started with Apache® Ignite™ (Part 5). Akmal Chaudhri pens the fifth article in this blog series focusing this time on the support for a distributed SQL database. http://bit.ly/2suoIMc -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Getting-Started-with-A

Re: Use AtomicLong or AtomicSequence in Streaming

2017-07-06 Thread waterg
Hi Val, yes, this is the same issue. Appreciate helping out. Jessie -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Use-AtomicLong-or-AtomicSequence-in-Streaming-tp14350p14413.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

cassandra cache store with port

2017-07-06 Thread srini kandula
Hi, I'm using spring based cassandra cache store. In connection.properties, contact.points=some-ip-address (working) contact.point=some-host-name(working) contact.points=some-ip-address:9042 (not working) contact.point=some-host-name:9042(not working)

frequet disconnection in ignite cluster

2017-07-06 Thread ignite_user2016
hello Igniters, we are seeing frequent disconnection between ignite instances, we have IP based clusters which has following configuration - Ignite version - 1.7.0

Unable to connect from Windows Java client to Linux server cluster (ignite 2.0.0)

2017-07-06 Thread Roger Fischer (CW)
Hello, I am unable to make a connection from a client on Windows to an Ignite server cluster running on 3 Linux machines. I have checked firewall settings on both. I am running a 3-node cluster of Ignite (2.0.0) on Centos 7. The nodes are connected to the same Ethernet switch. The cluster is es

Re: Passing parameters to IgniteBiPredicate

2017-07-06 Thread Guilherme Melo
Hello Taras, thanks, this example is showing a normal query with a fixed value, this is working, the problem is passing a parameter to the predicate. Cheers, Guilherme Melo www.gmelo.org On 6 July 2017 at 22:18, Taras Ledkov wrote: > Hi, > > Sure, please take a look at the example: > https://g

Re: IGFS - Python and R clients

2017-07-06 Thread nsemichev
I configured HDFS Client on Ubuntu 16.04 and I can successfully run this command: hdfs --config /etc/hadoop/conf/ dfs -ls / The config parameter takes the file core-site.xml from etc/hadoop/conf/ >From core-site.xml fs.default.name igfs://igfs@10.200.10.1:10500 Then I tried using Py

RE: Small value for IGNITE_ATOMIC_CACHE_DELETE_HISTORY_SIZE

2017-07-06 Thread charly
Thanks for all your answers Ilya! From: Ilya Lantukh [via Apache Ignite Users] [ml+s70518n14271...@n6.nabble.com] Sent: Monday, July 03, 2017 9:20 AM To: Charly Dessart Subject: Re: Small value for IGNITE_ATOMIC_CACHE_DELETE_HISTORY_SIZE Yes, such races dur

Starting the Server

2017-07-06 Thread sanaraya
Hi , I am getting below Exception while starting the ignite.sh . at org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1334) at org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1398) at o

Re: Passing parameters to IgniteBiPredicate

2017-07-06 Thread Taras Ledkov
Hi, Sure, please take a look at the example: https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ignite/examples/datagrid/CacheQueryExample.java#L155 On 06.07.2017 11:13, Guilherme Melo wrote: Hello, I am having problems submitting a query to the service from a clien

Compute Node computation on data node

2017-07-06 Thread abhishek dutta gupta
How I can do the computation on compute node and data node? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Compute-Node-computation-on-data-node-tp14396.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Connecting to remote host from client gives error

2017-07-06 Thread abhishek dutta gupta
[01:34:23] REST protocols do not start on client node. To start the protocols on client node set '-DIGNITE_REST_START_ON_CLIENT=true' system property. [01:34:23] Failed to connect to any address from IP finder (will retry to join topology every 2 secs): [/10.133.71.210:47500] [01:39:24] Failed to c

Re: verify me

2017-07-06 Thread Pavel Tupitsyn
Verified! :) On Thu, Jul 6, 2017 at 4:26 PM, Abhishek Gupta < abhishekduttagupta2...@gmail.com> wrote: > Hi, > > Please verify me >

verify me

2017-07-06 Thread Abhishek Gupta
Hi, Please verify me

Re: Loading similar data to specific instance and not all instances

2017-07-06 Thread Michael Cherkasov
Hi Aiden, You need to set an AffinityKeyMapper for your cache. Read javadoc for details: https://github.com/apache/ignite/blob/master/modules/core/src/main/java/org/apache/ignite/cache/affinity/AffinityKeyMapper.java Thanks, Mikhail. 2017-07-06 15:08 GMT+03:00 Aiden <1994hsekar1...@gmail.com>:

Re: slow performance when using order by clause

2017-07-06 Thread Andrey Mashenkov
Hi Neeraj, Does query plans differ 'with' and 'without' GroupBy ? On Thu, Jul 6, 2017 at 3:34 PM, neerajbhatt wrote: > Hi All > > We are running below query on two caches (item and rank) > > SELECT T._VAL FROM ITEMCACHE.Item as T, IGPCACHE.Rank r WHERE T.uniqueSkuId > = r.uniqueSkuId AND T.rati

slow performance when using order by clause

2017-07-06 Thread neerajbhatt
Hi All We are running below query on two caches (item and rank) SELECT T._VAL FROM ITEMCACHE.Item as T, IGPCACHE.Rank r WHERE T.uniqueSkuId = r.uniqueSkuId AND T.rating=? AND T.reviews=? AND T.downloads=?+ " order by rank desc limit 10 while we are getting good result (~10 ms in 1.4 million of i

Re: High heap on ignite client

2017-07-06 Thread afedotov
Hi, I've taken a look at the logs. I don't see huge heap consumption but from the GC log for node1 I can see that in a couple of GCs real time is greater than user and sys time, as well as in some cases sys time is higher than the user time. Taking into account that you are running kubernetes and

Loading similar data to specific instance and not all instances

2017-07-06 Thread Aiden
So i'm really new to apache ignite here. What i'm trying to do is load data having similar properties to a single rather than it being loaded to random instances. For example, say that some data of this form: ROLL_NO 34569 12349 34439 45329 32359 43549 53259 342

Re: Ignite Information

2017-07-06 Thread mimmo_c
Thanks for reply. How Can I use node filter? I did not find any information about it. Thank you. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Information-tp14330p14386.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

RE: Group index taking too much time

2017-07-06 Thread neerajbhatt
Yes we saw execution plan and everything seems ok in group index, Thanks for help, When we moved from group index to individual index performance increased by 20 times (close to 5 ms) Thanks -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Group-index-taking-too-

Re: Poor cross cache join SQL performance (v2.0.0)

2017-07-06 Thread afedotov
Could you please share the reproducer? Kind regards, Alex 6 июля 2017 г. 11:18 AM пользователь "iostream [via Apache Ignite Users]" < ml+s70518n14382...@n6.nabble.com> написал: > Hi Alex, > > Yes Value2.class was already added to indextypes. > > I am only reading the value which is why copyOnRea

Re: Ignite very very chatty when java server nodes and .net client when using Service Grid

2017-07-06 Thread Pavel Tupitsyn
Hi Gordon, I see that you solved the problem, but I'm still curious: what did you have and what did you change to solve this? Did you call Ignite.GetServices().GetServiceProxy() every second, or something else? Thanks, Pavel On Thu, Jul 6, 2017 at 3:07 AM, Gordon Reid (Nine Mile) < gordon.r...@

Re: Poor cross cache join SQL performance (v2.0.0)

2017-07-06 Thread iostream
Hi Alex, Yes Value2.class was already added to indextypes. I am only reading the value which is why copyOnRead is set to "false". -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Poor-cross-cache-join-SQL-performance-v2-0-0-tp14373p14382.html Sent from the Apach

FairAffinityFunction in Ignite 2.0

2017-07-06 Thread Alexander Ivanov
Hi! In Ignite 2.0 missing FairAffinityFunction. Why? Alexander -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/FairAffinityFunction-in-Ignite-2-0-tp14381.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Passing parameters to IgniteBiPredicate

2017-07-06 Thread Guilherme Melo
Hello, I am having problems submitting a query to the service from a client. Using the example from the documentation: IgniteCache cache = ignite.cache("mycache"); int sal = 100// Find only persons earning more than 1,000.try (QueryCursor cursor = cache.query(new ScanQuery((k, p) -> p.getSalary()

Re: Poor cross cache join SQL performance (v2.0.0)

2017-07-06 Thread afedotov
Hi, Add Value2 to the list of the indexed classes (setIndexedTypes). What is the reason for setting copyOnRead(false)? If the problem still stands after the fix, please check GC or take a JFR. Kind regards, Alex 6 июля 2017 г. 7:29 AM пользователь "iostream [via Apache Ignite Users]" < ml+s7051