Re: Caches have distinct sets of data nodes
Hi, My data is affinity collocated. The issue is my 2nd node is not in a baseline yet. Persistent cache had not been re-balanced yet but non persistent cache had been done. Distributed join is not a good choice for us because of performance. I'm thinking about those solutions : 1. Don't sent request out of baseline node 2. Don't automatically re-balanced none persistent caches when cluster is persistent enabled. 3. Add node to baseline right after it join cluster. Is it possible to do this ? On Thu, Mar 21, 2019 at 6:15 PM Ilya Kasnacheev wrote: > Hello! > > Ignite assumes that your data is affinity collocated. While rebalancing is > in process, obviously this is not the case. > > I think you can have this problem go away by setting > distributedJoins=true. Have you tried that? Note that there is a > potentially large performance impact. > > Regards, > -- > Ilya Kasnacheev > > > чт, 21 мар. 2019 г. в 14:08, Tâm Nguyễn Mạnh : > >> Hi Igniters, >> >> Today i got this exception during testing cluster scaling. >> I have 2 caches X and Y in cluster, X is persistent and Y is none >> persistent. >> >> 1. I start 1st node A and activate cluster and populate data for X and Y >> 2. I start 2nd node B but not yet update topology. Few seconds later Y >> had been auto rebalanced. >> >> In A we have both X and Y data but in B we only have Y. Exception will be >> thrown when I try to join X and Y in sql query: Caches have distinct sets >> of data nodes [cache1=X, cache2=Y] >> AB >> == == >> XY >> Y >> . >> I think it because of none persistent data is automaticly rebalanced >> whenver a node is join into cluster (event not in baseline yet) but not >> persistent data. Persistent data is only rebalanced whenever baseline is >> changed. Is it correct? And how do i prevent this exception during scaling ? >> >> -- >> Thanks & Best Regards >> >> Tam, Nguyen Manh >> >> -- Thanks & Best Regards Tam, Nguyen Manh
Caches have distinct sets of data nodes
Hi Igniters, Today i got this exception during testing cluster scaling. I have 2 caches X and Y in cluster, X is persistent and Y is none persistent. 1. I start 1st node A and activate cluster and populate data for X and Y 2. I start 2nd node B but not yet update topology. Few seconds later Y had been auto rebalanced. In A we have both X and Y data but in B we only have Y. Exception will be thrown when I try to join X and Y in sql query: Caches have distinct sets of data nodes [cache1=X, cache2=Y] AB == == XY Y . I think it because of none persistent data is automaticly rebalanced whenver a node is join into cluster (event not in baseline yet) but not persistent data. Persistent data is only rebalanced whenever baseline is changed. Is it correct? And how do i prevent this exception during scaling ? -- Thanks & Best Regards Tam, Nguyen Manh
Support User defined aggregate function ?
Hi Igniters, Can we support user defined aggreate function ? -- Thanks & Best Regards Tam, Nguyen Manh
Re: Support User defined aggregate function ?
Hi, Sorry for that I will move this to u...@ignite.apache.or. Thank you On Wed, Mar 20, 2019 at 8:45 PM Ilya Kasnacheev wrote: > Hello! > > As far as I know there is no such support. It is recommended to use > job/task API instead: > https://apacheignite.readme.io/docs/compute-tasks > > Regards, > -- > Ilya Kasnacheev > > > ср, 20 мар. 2019 г. в 09:24, Tâm Nguyễn Mạnh : > >> Hi Igniters, >> >> Can we support user defined aggreate function ? >> >> -- >> Thanks & Best Regards >> >> Tam, Nguyen Manh >> > -- Thanks & Best Regards Tam, Nguyen Manh
Re: Deadlocked while Get/Set at the time ?
Hi, Thank you for your advise. I will try with SortedDictionary. But I am wondering it's only workaround. Should it be handle natively in Ignite Core, shouldn't it ? How do you thing ? On Fri, Mar 15, 2019 at 8:38 PM Ilya Kasnacheev wrote: > Hello! > > I imagine you can use a SortedDictionary. > > Regards, > -- > Ilya Kasnacheev > > > пт, 15 мар. 2019 г. в 16:02, Tâm Nguyễn Mạnh : > >> Hi, >> >> Yes im using .Net ThinClient putAll method. It requires >> IEnumerable> as input. What should I do ?, please >> advise me >> >> >> https://ignite.apache.org/releases/latest/dotnetdoc/api/Apache.Ignite.Core.Client.Cache.ICacheClient-2.html#Apache_Ignite_Core_Client_Cache_ICacheClient_2_PutAll_System_Collections_Generic_IEnumerable_System_Collections_Generic_KeyValuePair__0__1___ >> >> >> On Fri, Mar 15, 2019 at 5:55 PM Ilya Kasnacheev < >> ilya.kasnach...@gmail.com> wrote: >> >>> Hello! >>> >>> Are you using putAll()? please make sure to always pass TreeMap (or >>> other sorted map) to putAll since it is possible to get a deadlock when >>> using HashMap (since keys are unordered). >>> >>> Regards, >>> -- >>> Ilya Kasnacheev >>> >>> >>> пт, 15 мар. 2019 г. в 06:18, Tâm Nguyễn Mạnh >> >: >>> >>>> Hi Igniters, >>>> >>>> Today I run a loadtest for my system that use Ignite as a Cache Service >>>> but 1 of my nodes got crashed because of DeadLocked. >>>> >>>> Could you please help me to prevent this. >>>> >>>> -- >>>> Thanks & Best Regards >>>> >>>> Tam, Nguyen Manh >>>> >>>> >> >> -- >> Thanks & Best Regards >> >> Tam, Nguyen Manh >> >> -- Thanks & Best Regards Tam, Nguyen Manh
Re: Deadlocked while Get/Set at the time ?
Hi, Yes im using .Net ThinClient putAll method. It requires IEnumerable> as input. What should I do ?, please advise me https://ignite.apache.org/releases/latest/dotnetdoc/api/Apache.Ignite.Core.Client.Cache.ICacheClient-2.html#Apache_Ignite_Core_Client_Cache_ICacheClient_2_PutAll_System_Collections_Generic_IEnumerable_System_Collections_Generic_KeyValuePair__0__1___ On Fri, Mar 15, 2019 at 5:55 PM Ilya Kasnacheev wrote: > Hello! > > Are you using putAll()? please make sure to always pass TreeMap (or other > sorted map) to putAll since it is possible to get a deadlock when using > HashMap (since keys are unordered). > > Regards, > -- > Ilya Kasnacheev > > > пт, 15 мар. 2019 г. в 06:18, Tâm Nguyễn Mạnh : > >> Hi Igniters, >> >> Today I run a loadtest for my system that use Ignite as a Cache Service >> but 1 of my nodes got crashed because of DeadLocked. >> >> Could you please help me to prevent this. >> >> -- >> Thanks & Best Regards >> >> Tam, Nguyen Manh >> >> -- Thanks & Best Regards Tam, Nguyen Manh
