RE: Ignite Thin Client Continuous Query

2018-09-11 Thread vkulichenko
Gordon, Generally, having CQ on thin client would definitely be awesome. My only point is that thin client has several technical limitations that would introduce multiple "ifs" into the functionality. What exactly those ifs are, and weather there is still value with all those ifs, is a big

Re: ignte cluster hang with GridCachePartitionExchangeManager

2018-09-11 Thread wangsan
Yes , It was blocked when do cache operation in discovery event listeners when node left events arrival concurrently. I just do cache operation in another thread. Then the listener will not be blocked. The original cause may be that discovery event processor hold the server latch.when do cache

Re: IgniteUtils NoClassDefFoundError

2018-09-11 Thread akurbanov
Hello, Did you properly set IGNITE_HOME pointing to binaries/build sources? Regards -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite data can't be recovered after node fail

2018-09-11 Thread smovva
Where you able to resolve this? I'm in a very similar situation. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Node keeps crashing under load

2018-09-11 Thread eugene miretsky
Thanks Ilya, We are writing to Ignite from Spark running in EMR. We don't know the address of the node in advance, we have tried 1) Set localHost in Ignite configuration to 127.0.0.1, as per the example online 2) Leave localHost unset, and let ignite figure out the host I have attached more logs

RE: Ignite Thin Client Continuous Query

2018-09-11 Thread Gordon Reid (Nine Mile)
Hi Val, It's a very simple, and I would say a very common use case. We want to send a filter to the grid, receive a snapshot, and then receive a continuous stream of updates that match that filter. Consider a trading window, showing a grid of stocks. I want to subscribe to the continuously

RE: Ignite Thin Client Continuous Query

2018-09-11 Thread Gordon Reid (Nine Mile)
In my humble opinion there is a huge value here. We have these fantastic APIs between our cluster nodes, why should we have to go and use different APIs, and different serialization techniques in our end user apps? It’s totally acceptable that the reliability, and guaranteed delivery aspects

RE: Ignite Thin Client Continuous Query

2018-09-11 Thread Gordon Reid (Nine Mile)
Thanks Alexy, yes we have considered this approach. But I would normally consider this type of architecture an optimization, not a base requirement. It’s rather heavy and to me only makes sense when we have a large number of end users and we want to minimize bandwidth to the remote locations.

Re: Ignite Thin Client Continuous Query

2018-09-11 Thread vkulichenko
Gaurav, Web Console receives updates from web agent which periodically polls the cluster. -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite Thin Client Continuous Query

2018-09-11 Thread Gaurav Bajaj
Guys, Just wondering how does webconsole receievs updates from server continuously? Regards, Gaurav On 11-Sep-2018 10:31 PM, "Valentin Kulichenko" < valentin.kuliche...@gmail.com> wrote: > Igor, > > I just think that we're dealing with a trade off here, and that if we > implement CQ for thin

Re: Ignite Thin Client Continuous Query

2018-09-11 Thread Valentin Kulichenko
Igor, I just think that we're dealing with a trade off here, and that if we implement CQ for thin client, we will either end with a client that is not "thin" anymore, or semantics and guarantees of CQ would change so drastically that it would be a completely different feature. Either way, it's a

Re: Configuring TcpDiscoveryKubernetesIpFinder

2018-09-11 Thread Jeff Simon
Hi Val, Ok, for smaller files inline is much cleaner, and that's what we prefer. But I agree, for larger files its not such a good idea. Wew would really like to avoid having configuration spread out all over the place. Really, all we need to do is set the service name...we don't want to use

Re: Configuring TcpDiscoveryKubernetesIpFinder

2018-09-11 Thread vkulichenko
Jeff, Ignite configuration is an XML file which can be quite large. What is the reason for the requirement to specify it inline? -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

IgniteUtils enables strictPostRedirect in a static block

2018-09-11 Thread xero
Hello Igniters, We noticed that IgniteUtils class has a static initialization block (line 796 in version 2.6) in which System properties are being changed. In particular, the property "http.strictPostRedirect" is set to "true". This could change how an application behaves when referencing any

Configuring TcpDiscoveryKubernetesIpFinder

2018-09-11 Thread Jeff Simon
Hi, I'm using the guide at https://apacheignite.readme.io/docs/stateless-deployment to get an ignite instance running. Per that document, to configure TcpDiscoveryKubernetesIpFinder you need to create a spring config file, and then point to it using the CONFIG_URI env var. - name:

Re: Load balancing ignite get requests

2018-09-11 Thread ezhuravlev
Hi, Well, it depends on a lot of things - if you have small amount of the data, which can easily fit in memory on each node, then, you can use Replicated cache. On the other hand, if you have quite big dataset, you may consider using Partitioned cache and executing affinity runs. Evgenii --

Re: Partition map exchange in detail

2018-09-11 Thread Ilya Lantukh
1) It is. 2a) Ignite has retry mechanics for all messages, including PME-related ones. 2b) In this situation PME will hang, but it isn't a "deadlock". 3) Sorry, I didn't understand your question. If a node is down, but DiscoverySpi doesn't detect it, it isn't PME-related problem. 4) How can you

Speakers needed for Apache DC Roadshow

2018-09-11 Thread Rich Bowen
We need your help to make the Apache Washington DC Roadshow on Dec 4th a success. What do we need most? Speakers! We're bringing a unique DC flavor to this event by mixing Open Source Software with talks about Apache projects as well as OSS CyberSecurity, OSS in Government and and OSS Career

Re: Error installing Ignite on K8s

2018-09-11 Thread Jeff Simon
Hi Denis, Yes, all of our apps reside in k8s, so there would be no need for external access. Thanks for the info! Jeff From: Denis Magda Reply-To: "user@ignite.apache.org" Date: Tuesday, September 11, 2018 at 8:30 AM To: "user@ignite.apache.org" Subject: Re: Error installing Ignite on K8s

Re: Error installing Ignite on K8s

2018-09-11 Thread Denis Magda
Jeff, The sessionAffinity is needed only if you plan to access Ignite cluster deployed in K8 from an application deployed outside of it. For instance, it will ensure that a remote JDBC session will stick to a specific Ignite pod. However, if all your applications are deployed in K8 as well then

Re: The system cache size was slowly increased

2018-09-11 Thread ezhuravlev
Hi, What do you mean by " system memory cache also grows "? How do you see this? Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Error installing Ignite on K8s

2018-09-11 Thread Jeff Simon
Yes if I remove session affinity it works. So my question is does ignite require sessionAffinity? And to be honest, I'm not really sure what we are using ignite for since it seems to be a multi-purpose app. I think we are going to use for caching. So would session affinity be required for

Re: a node fails and restarts in a cluster

2018-09-11 Thread es70
Hi Pavel I've prepared the logs you requested. Please download it from this link https://cloud.mail.ru/public/A9wK/bKGEXK397 hope this will help regards, Evgeny -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Error with Spark + IGFS (HDFS cache) through Hive

2018-09-11 Thread Evgenii Zhuravlev
Hi, Do you really need to use Hive here? You can just use Spark integration with Ignite, which allows to run sql: DataFrame( https://apacheignite-fs.readme.io/docs/ignite-data-frame) or RDD( https://apacheignite-fs.readme.io/docs/ignitecontext-igniterdd). For sure, this solution will work much

Re: Off heap constantly grow on use BinaryObject as field of cached data

2018-09-11 Thread Ilya Kasnacheev
Hello! So I was increasing amount of RAM in the memory model, and it turns out that Off-Heap usage will not grow past: 2018-09-11 12:47:46,603 INFO [pub-#290] log4j.Log4JLogger (Log4JLogger.java:566) - # 2018-09-11 12:47:56,605 INFO [pub-#292]

Re: Ignite Thin Client Continuous Query

2018-09-11 Thread Igor Sapego
Guys, Personally, I do not see any problems, why we can not implement Continuous Queries for thin clients. This will require a decent amount of work, and will not give such strong guaranties as thick clients give (for example, on server crash thin client will get an exception and will need to

Re: Ignite Thin Client Continuous Query

2018-09-11 Thread Alexey Kuznetsov
Gordon, How about to start several client nodes "near" to cluster and use them as "proxies" for your desktop GUI apps? You may write some code that will push data from client node to you GUI app. This will require some coding of course. -- Alexey Kuznetsov

Re: How to create tables with JDBC, read with ODBC?

2018-09-11 Thread Igor Sapego
Nice to hear. Please, keep us updated about what QLIK thinks about the issue. Thank you in advance Best Regards, Igor On Mon, Sep 10, 2018 at 10:50 PM limabean wrote: > Thank you very much for the thorough discussion/explanation and pending fix > for public schemas. Much appreciated ! > >

Re: Unable to connect ignite pods in Kubernetes using Ip-finder

2018-09-11 Thread rishi007bansod
"serviceAccountName: ignite" should be present in Pod Deployment specification as mentioned by Anton in post https://stackoverflow.com/questions/49395481/how-to-setmasterurl-in-ignite-xml-config-for-kubernetes-ipfinder/49405879#49405879

Re: Fulltext matching

2018-09-11 Thread Ilya Kasnacheev
Hello! The only way to know if it will be accepted is to fill those tickets and pull-requests (and then write about it on developers list) Regards, -- Ilya Kasnacheev вт, 11 сент. 2018 г. в 0:04, Courtney Robinson : > Hi, > Thanks for the response. > I went ahead and implemented a custom

Re: Off heap constantly grow on use BinaryObject as field of cached data

2018-09-11 Thread Serg
Hi Ilya, I created reproducer with two tests https://github.com/SergeyMagid/ignite-reproduce-grow-memory Differents in this tests only is data which inserted to cache. I have previously suppose that problem caused with BinaryObject only but I reproduced this problem without BinaryObject too.

Re: IgniteUtils NoClassDefFoundError

2018-09-11 Thread Павлухин Иван
Hi Jack, Could you provide logs and full console output? NoClassDefFoundError -- can be thrown when class in question is on classpath but fails to initialize (e.g. exception thrown from static initializer). 2018-09-11 6:05 GMT+03:00 Jack Lever : > Hi All, > > I'm getting an error on application