Re: Professional Ignite Course

2019-09-26 Thread Alexey Zinoviev
Great course! чт, 26 сент. 2019 г. в 03:56, sri hari kali charan Tummala < kali.tumm...@gmail.com>: > I did went trough the course and I asked pluralsight to add more, in the > next course I would like to see ignite installation on aws and spark + > ignite integration. > Real time analytics with

Re: nodes are restarting when i try to drop a table created with persistence enabled

2019-09-26 Thread Shiva Kumar
Hi dmagda, When I insert many records (~ 10 or 20 million) to the same table and try to drop table or delete records from the table, nodes are restarting, the restarts happens In the middle of drop or delete operation. According to the logs the cause for restart looks like OOM in the data region.

Re: Application for Ignite Contributor

2019-09-26 Thread Dmitriy Pavlov
Hi Deepak, Thank you for your interest in Apache Ignite. Have you ever considered the applicability of usage of Apache Ignite in Apache OFBiz. Would it be useful as scalable storage? As storage option? Maybe we can think about some integration of these two projects. WDYT? One more thing, do you

Re: Application for Ignite Contributor

2019-09-26 Thread Deepak Nigam
Yes, Dmitry. Recently I did one small PoC for integrating OFBiz with Ignite in an attempt to improve the performance of OFBiz in large data fetching. I tried with both in-memory and persistence mode and the initial results of this PoC were awesome. Regarding static code inspections, as of now, I

Re: How to update QueryEntities property of CacheConfiguration for existing/already created cache

2019-09-26 Thread siva
Hi Pavel, I have some queries related to cache groups ,if you help it will be useful for us. *instead of one cache per company, use one cache group per company. * 1.What is the performance impact =>Is there any number of cache group limitations? here cachegroups proportional to tenants 2.

Re: Application for Ignite Contributor

2019-09-26 Thread Deepak Nigam
Please accept my sincere apologies for the typo in your name, Dmitriy. Thanks & Regards -- Deepak Nigam On Thu, Sep 26, 2019 at 3:22 PM Deepak Nigam wrote: > Yes, Dmitry. > > Recently I did one small PoC for integrating OFBiz with Ignite in an > attempt to improve the performance of OFBiz in la

Re: distributed sql join not working as mentioned in documentation

2019-09-26 Thread Shiva Kumar
Hi Evgenii, Even with *where condition*, I am getting the same error. I have some use case where I can't collocate tables data, as Ignite doc says non-collocated distributed join or cross join is supported in Ignite I am trying to use that but getting this exception when I create tables in replicat

Re: How to update QueryEntities property of CacheConfiguration for existing/already created cache

2019-09-26 Thread Pavel Tupitsyn
Too many things come into play here, the only way to know is to test both approaches on your use case. By the way, do you have the same table set for every tenant? It may be beneficial to group caches not by tenant, but by data size and type. On Thu, Sep 26, 2019 at 12:56 PM siva wrote: > Hi P

RE: liveness and rediness probe configuration for Ignite on kubernetes

2019-09-26 Thread M. Ilya
Hi Shiva, Could you please check that ignite-rest-http library is added to OPTION_LIBS environment parameter, i.e.: containers: - name: ignite image: apacheignite/ignite:2.6.0 env: - name: OPTION_LIBS value: ignite-kubernetes,ignite-rest-http If this

Re: How to update QueryEntities property of CacheConfiguration for existing/already created cache

2019-09-26 Thread siva
*do you have the same table set for every tenant?* Yes right now,we have same table schema for each tenant -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Apache Ignite Cloud Formation Template

2019-09-26 Thread sri hari kali charan Tummala
Hi All, did anyone have an cloud formation example for deploying Apache Ignite on AWS or steps to deploy or some successful deployment of Ignite onto AWS. this below blog has missing artifacts so not working. https://aws.amazon.com/blogs/big-data/real-time-in-memory-oltp-and-analytics-with-apach

Re: Perfomance drop

2019-09-26 Thread Ilya Kasnacheev
Hello! Unfortunately it's hard to say, I'm afraid you will have to debug it or break down your tasks until you see what step causes this issue. Regards, -- Ilya Kasnacheev ср, 11 сент. 2019 г. в 20:57, Кузин Никита (Nikita Kuzin) < nku...@iitdgroup.ru>: > Hello! > > How we can debug it to fin

Re: Apache Ignite Cloud Formation Template

2019-09-26 Thread sri hari kali charan Tummala
Hi Community, this doesn't launch a multinode ignite cluster am I right? it just launches a single node ignite cluster on one ec2 instance. https://apacheignite.readme.io/docs/aws-deployment Thanks Sri On Thu, Sep 26, 2019 at 8:49 AM sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote:

Re: What are minimal thread pools for grid clients?

2019-09-26 Thread Ilya Kasnacheev
Hello! I recommend keeping all pools at something like 4. Ignite clients can run a lot of operations (they can do compute, they use cache store when load is transactional, they run visor tasks, etc) so it's better to not zero out all pools outright. Regards, -- Ilya Kasnacheev вт, 24 сент. 20

Re: Huge number of .classname files

2019-09-26 Thread Ilya Kasnacheev
Hello! If you have a lot of these classes, this may mean you have some problems with marshalling: Ignite considers a lot of what you have in your program different types. This may cause issues. Those files are very small so I don't think it should cause issues. Client will usually re-populate the

Re: distributed sql join not working as mentioned in documentation

2019-09-26 Thread Ilya Kasnacheev
Hello! This is an interesting situation to consider. Have you tried *SELECT* * *FROM* City *AS* c *join* (SELECT * FROM Person) *AS* p; ? Otherwise, I don't think we support joins without conditions, unless most of tables are replicated. Regards, -- Ilya Kasnacheev чт, 26 сент. 2019 г. в 13:

Re: index corrupted error : org.apache.ignite.internal.processors.cache.persistence.tree.CorruptedTreeException: Runtime failure on search row

2019-09-26 Thread Ilya Kasnacheev
Hello! It's recommended to upgrate to 2.7.6 because it contains persistence corruption fixes. Regards, -- Ilya Kasnacheev чт, 26 сент. 2019 г. в 12:04, Shiva Kumar : > Hi Igor, > Thanks for the response! > The version I am using is 2.7.0 > Unfortunately, I do not have logs of all the nodes, b

Re: Grid suddenly went in bad state

2019-09-26 Thread Ilya Kasnacheev
Hello! "Failed to read data from remote connection" in absence of other errors points to potential network problems. Maybe you have short idle timeout for TCP connections? Maybe they get blockaded? Regards, -- Ilya Kasnacheev вт, 24 сент. 2019 г. в 20:46, Abhishek Gupta (BLOOMBERG/ 731 LEX) <

Re: Grid suddenly went in bad state

2019-09-26 Thread Abhishek Gupta (BLOOMBERG/ 731 LEX)
Thanks for the response Ilya. So from a sequence of events perspective, first the logs show "Partition states validation has failed for group" for many minutes. And only after that we see the "Failed to read data from remote connection" caused by "java.nio.channels.ClosedChannelException". So

Re: DataStreamer addData takes lot of time after 500 million writes

2019-09-26 Thread Ilya Kasnacheev
Hello! This would happen if you have any non-inlined indexes. You need to load a lot of pages for every write and you are running out of offheap. 4G is a tiny offheap. Regards, -- Ilya Kasnacheev вс, 15 сент. 2019 г. в 15:49, KR Kumar : > Hi all - Why data streamer take lot of time randomly

Re: Application for Ignite Contributor

2019-09-26 Thread Dmitriy Pavlov
Hi Deepak, No problem, since both options are understandable :) I am happy to hear from you about good results you've got in this PoC. Have you written a blog or article on this subject? I would be happy to repost it. Warm regards, Dmitriy Pavlov чт, 26 сент. 2019 г. в 12:59, Deepak Nigam : >

Re: Application for Ignite Contributor

2019-09-26 Thread Deepak Nigam
Thanks Denis. I am interested in Machine Learning and Cache. On Thu, Sep 26, 2019, 1:19 AM Denis Magda wrote: > Hi Deepak and welcome! > > Sorry for the late response. You sent this message to the user list, > forwarded it to the dev list. > > I added you to the Ignite contributors list in JIRA

Re: Application for Ignite Contributor

2019-09-26 Thread Denis Magda
Deepak, let me introduce you to Alexey Zinoviev who is among main maintainers of Ignite ML. Alexey, you’ll definitely find interesting and cumbersome tasks for Deepak ;) Denis On Thursday, September 26, 2019, Deepak Nigam wrote: > Thanks Denis. I am interested in Machine Learning and Cache. > >

Re: Apache Ignite Cloud Formation Template

2019-09-26 Thread Denis Magda
Hello Sri, You’re right, you need to start several aws instances to create a distributed cluster if you follow the guide below. Ignite configuration for all the nodes/instances has to have a properly configured IPFinder. You can use a static IP finder if IPs are know in advance or AWS IPfinder if

Re: Apache Ignite Cloud Formation Template

2019-09-26 Thread sri hari kali charan Tummala
looks complex and hard to get it right, it would be nice if Ignite community builds one working cloud formation template to launch ignite cluster and in the cloud formation template output a JDBC connection for connecting ignite cluster which would be awesome. Many would leverage this stack to bui

Re: Application for Ignite Contributor

2019-09-26 Thread Alexey Zinoviev
Hi, Deepak, this is an Umbrella ticket for newbies in ML https://issues.apache.org/jira/browse/IGNITE-9281 I'll freshen up it and add more tasks next week to have more option to start with ML Of course, you could free contact with me here, on dev-list, or on github by mention @zaleslaw preparing P