[jira] [Created] (IGNITE-12671) Update of partition's states can stuck when rebalance completed during exchange

2020-02-12 Thread Vladislav Pyatkov (Jira)
Vladislav Pyatkov created IGNITE-12671: -- Summary: Update of partition's states can stuck when rebalance completed during exchange Key: IGNITE-12671 URL: https://issues.apache.org/jira/browse/IGNITE-12671

Re: IGNITE-12361 Migrate Flume module to ignite-extensions

2020-02-12 Thread Evgenii Zhuravlev
Hi Saikat, I left a couple of comments in pr: https://github.com/apache/ignite-extensions/pull/4#pullrequestreview-357891629. Please tell me what do you think about it. Best Regards, Evgenii вт, 11 февр. 2020 г. в 17:15, Saikat Maitra : > Hi, > > Can someone please help in review for these foll

Re: Apache Ignite 2.8 RELEASE [Time, Scope, Manager]

2020-02-12 Thread Denis Magda
Hi Maxim, Do you have any understanding in regards to documentation readiness? I do remember Nikolay was creating a page for the new metrics framework and Artem stepped in as a reviewer. But not sure if that supposedly the largest item is completed and if the other pages need to be updated. - Den

[jira] [Created] (IGNITE-12670) .NET: Calculate IAffinity.GetPartition locally for default affinity

2020-02-12 Thread Pavel Tupitsyn (Jira)
Pavel Tupitsyn created IGNITE-12670: --- Summary: .NET: Calculate IAffinity.GetPartition locally for default affinity Key: IGNITE-12670 URL: https://issues.apache.org/jira/browse/IGNITE-12670 Project:

[jira] [Created] (IGNITE-12669) Remove not used rebalanceDelay from production code

2020-02-12 Thread Maxim Muzafarov (Jira)
Maxim Muzafarov created IGNITE-12669: Summary: Remove not used rebalanceDelay from production code Key: IGNITE-12669 URL: https://issues.apache.org/jira/browse/IGNITE-12669 Project: Ignite

Re: [VOTE] Allow or prohibit a joint use of @deprecated and @IgniteExperimental

2020-02-12 Thread Alexey Goncharuk
-1 Prohibit: My justification builds solely on the possibility to encourage a user to switch to an API that will be changed and later break the compilation.

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
Maxim, rebalanceDelay was introduced before the BLT appear in the product to solve scenarios which are now solved by BLT. It's pointless for me having it in the product since BLT was introduced. I do not think delaying rebalancing per cache group has any meaning. I cannot image any reason for it

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Alexey Zinoviev
Yes, you are right. Missed resources, I'll remove them tomorrow ср, 12 февр. 2020 г. в 16:23, Stepan Pilschikov : > With mnist_tf_model in same directory > All others looks right > > ср, 12 февр. 2020 г. в 16:21, Stepan Pilschikov >: > >> Hmm, interesting, got it >> Also found >> apache-ignite-2

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Stepan Pilschikov
With mnist_tf_model in same directory All others looks right ср, 12 февр. 2020 г. в 16:21, Stepan Pilschikov : > Hmm, interesting, got it > Also found apache-ignite-2.8.0-bin/examples/src/main/resources/models/mleap > I think its also should be removed then > > ср, 12 февр. 2020 г. в 16:11, Alexe

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Stepan Pilschikov
Hmm, interesting, got it Also found apache-ignite-2.8.0-bin/examples/src/main/resources/models/mleap I think its also should be removed then ср, 12 февр. 2020 г. в 16:11, Alexey Zinoviev : > Please, have a look to the next ticket > https://issues.apache.org/jira/browse/IGNITE-12659 > Also tensorf

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Maxim Muzafarov
Alexey, Why do you think delaying of historical rebalance (on BLT node join) for particular cache groups is not the real world use case? Probably the same topic may be started on user-list to collect more use cases from real users. In general, I support reducing the number of available rebalance

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Alexey Zinoviev
Please, have a look to the next ticket https://issues.apache.org/jira/browse/IGNITE-12659 Also tensorflow packages are blockers for IGFS deprecation and removal. ср, 12 февр. 2020 г. в 15:58, Alexey Zinoviev : > They are not lost, they are removed from release branch due to a lot of > bugs, cves

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Alexey Zinoviev
They are not lost, they are removed from release branch due to a lot of bugs, cves and so on, don't worry about that. ср, 12 февр. 2020 г., 14:31 Stepan Pilschikov : > Also lost ignite-ml-tensorflow-model-parser and ignite-tensorflow in > libs/optional > > > ср, 12 февр. 2020 г. в 14:25, Stepan P

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
Maxim, In general rebalanceDelay is used to delay/disable rebalance then topology is changed. Right now we have BLT to avoid unnecesary rebalancing when topology is changed. If a node left from cluster topology no rebalancing happens until the node explicitly removed from baseline topology. I wou

[jira] [Created] (IGNITE-12668) Extend test coverage for plugin providers configuration

2020-02-12 Thread Andrey N. Gura (Jira)
Andrey N. Gura created IGNITE-12668: --- Summary: Extend test coverage for plugin providers configuration Key: IGNITE-12668 URL: https://issues.apache.org/jira/browse/IGNITE-12668 Project: Ignite

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Maxim Muzafarov
Alexey, > All scenarios where rebalanceDelay has meaning are handled by baseline > topology now. Can you, please, provide more details here e.g. the whole list of scenarios where rebalanceDelay is used and how these handled by baseline topology? Actually, I doubt that it covers exactly all the

[jira] [Created] (IGNITE-12667) Falky test FailureProcessorThreadDumpThrottlingTest.testThrottlingPerFailureType

2020-02-12 Thread Andrey N. Gura (Jira)
Andrey N. Gura created IGNITE-12667: --- Summary: Falky test FailureProcessorThreadDumpThrottlingTest.testThrottlingPerFailureType Key: IGNITE-12667 URL: https://issues.apache.org/jira/browse/IGNITE-12667

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Stepan Pilschikov
Also lost ignite-ml-tensorflow-model-parser and ignite-tensorflow in libs/optional ср, 12 февр. 2020 г. в 14:25, Stepan Pilschikov : > But now have new problems > I build ignite-2.8 build on TC > https://ci.ignite.apache.org/buildConfiguration/Releases_ApacheIgniteMain_ReleaseBuild/5043672 > Pre

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Stepan Pilschikov
But now have new problems I build ignite-2.8 build on TC https://ci.ignite.apache.org/buildConfiguration/Releases_ApacheIgniteMain_ReleaseBuild/5043672 Previous https://ci.ignite.apache.org/buildConfiguration/Releases_ApacheIgniteMain_ReleaseBuild/4988324 New build much lighter Previous: 5.7 Gb Cu

[jira] [Created] (IGNITE-12666) Provide cluster performance profiling tool

2020-02-12 Thread Amelchev Nikita (Jira)
Amelchev Nikita created IGNITE-12666: Summary: Provide cluster performance profiling tool Key: IGNITE-12666 URL: https://issues.apache.org/jira/browse/IGNITE-12666 Project: Ignite Issue T

Re: ML examples EvaluatorExample and MultipleMetricsExample looks the same

2020-02-12 Thread Stepan Pilschikov
Thanks for fix Duplicated examples deleted and tutorial works on real (1+ node) cluster now I think ticket can be closed, have no power here вт, 11 февр. 2020 г. в 20:44, Alexey Zinoviev : > Sorry, for that, but I it touches ML-related stuff only and doesn't > influence on any another module. > I

[jira] [Created] (IGNITE-12665) SQL: Potential race on MapResult close.

2020-02-12 Thread Andrey Mashenkov (Jira)
Andrey Mashenkov created IGNITE-12665: - Summary: SQL: Potential race on MapResult close. Key: IGNITE-12665 URL: https://issues.apache.org/jira/browse/IGNITE-12665 Project: Ignite Issue Ty

Re: [VOTE] Allow or prohibit a joint use of @deprecated and @IgniteExperimental

2020-02-12 Thread Sergey Chugunov
-1 Prohibit. To me as a developer the situation when old but stable API is deprecated with only experimental (thus unstable/unfinished) alternative is very far from comfortable. And from outside folks it may look like as a sign of immature processes inside Ignite community (which is definitely not

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
I've meant baseline topology. ср, 12 февр. 2020 г. в 12:41, Alexei Scherbakov < alexey.scherbak...@gmail.com>: > > V.Pyatkov > > Doesn't rebalance topology solves it ? > > ср, 12 февр. 2020 г. в 12:31, V.Pyatkov : > >> Hi, >> >> I am sure we can to reduce this ability, but do not completely. >> W

[jira] [Created] (IGNITE-12664) Failed to dump debug information. Failed to create string representation of binary object.

2020-02-12 Thread Ivan Pavlukhin (Jira)
Ivan Pavlukhin created IGNITE-12664: --- Summary: Failed to dump debug information. Failed to create string representation of binary object. Key: IGNITE-12664 URL: https://issues.apache.org/jira/browse/IGNITE-12664

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
V.Pyatkov Doesn't rebalance topology solves it ? ср, 12 февр. 2020 г. в 12:31, V.Pyatkov : > Hi, > > I am sure we can to reduce this ability, but do not completely. > We can use rebalance delay for disable it until manually triggered. > > CacheConfiguration#setRebalanceDelay(-1) > > It may helpf

Re[4]: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Zhenya Stanilovsky
How can i understand it from documentation ?   If Ignite persistence is enabled, Ignite enforces the   baseline topology   concept which represents a set of server nodes in the cluster that will persist data on disk.   >No, baseline is supported for im-memory caches as well. > >ср, 12 февр. 2020

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread V.Pyatkov
Hi, I am sure we can to reduce this ability, but do not completely. We can use rebalance delay for disable it until manually triggered. CacheConfiguration#setRebalanceDelay(-1) It may helpful for cluster where can not allow performance drop from rebalance at any time. -- Sent from: http://apa

Re: Re[2]: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
No, baseline is supported for im-memory caches as well. ср, 12 февр. 2020 г. в 12:18, Zhenya Stanilovsky : > > > But baseline, it`s about persistence [1] isn`t it? I wrote about > pure inmemory case. > > [1] https://apacheignite.readme.io/docs/baseline-topology > >Vyacheslav, Evgeny, > > > >All s

Re[2]: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Zhenya Stanilovsky
But baseline, it`s about persistence [1] isn`t it? I wrote about pure inmemory case.   [1] https://apacheignite.readme.io/docs/baseline-topology >Vyacheslav, Evgeny, > >All scenarios where rebalanceDelay has meaning are handled by baseline >topology now. > >ср, 12 февр. 2020 г. в 12:00, Alexei S

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
Vyacheslav, Evgeny, All scenarios where rebalanceDelay has meaning are handled by baseline topology now. ср, 12 февр. 2020 г. в 12:00, Alexei Scherbakov < alexey.scherbak...@gmail.com>: > Sergey, > > The ticket looks outdated. > In fact this is already implemented. > > ср, 12 февр. 2020 г. в 11:

RE: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Sergey-A Kosarev
Classification: Public Alexey, then I don't have objections. -Original Message- From: Alexei Scherbakov [mailto:alexey.scherbak...@gmail.com] Sent: 12 February 2020 12:01 To: dev Subject: Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality Sergey, The ticket looks outdat

[jira] [Created] (IGNITE-12663) Let's limit all thread pools' sizes to 3 in tests

2020-02-12 Thread Ilya Kasnacheev (Jira)
Ilya Kasnacheev created IGNITE-12663: Summary: Let's limit all thread pools' sizes to 3 in tests Key: IGNITE-12663 URL: https://issues.apache.org/jira/browse/IGNITE-12663 Project: Ignite

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
Sergey, The ticket looks outdated. In fact this is already implemented. ср, 12 февр. 2020 г. в 11:58, Sergey-A Kosarev : > Classification: Public > > Hi, Alexey. > I believe it can't be done until in-memory caches will use baseline > topology [1]. > In our case we are using rebalanceDelay for in

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Vyacheslav Daradur
Hi, Alexei! CacheConfiguration#getRebalanceDelay was extremely useful for the caches backed by @CacheLocalStore to prevent rebalancing during full cluster startup/shutdown. But @CacheLocalStore annotation is deprecated also. I think "rebalancing delay" stuff might be useful for replicated cached

RE: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Sergey-A Kosarev
Classification: Public Hi, Alexey. I believe it can't be done until in-memory caches will use baseline topology [1]. In our case we are using rebalanceDelay for in-memory caches. [1] https://issues.apache.org/jira/browse/IGNITE-8414 Kind regards, Sergey Kosarev -Original Message- From

Re: [DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Zhenya Stanilovsky
I know guys who use this setting (may be erroneously)  = MAX_INT for real rebalance delaying (very small sla) grid without persistence. But i don`t know further algo, may be if backup nodes  become extremely small they creates the same cluster near it. Can ignite simple disable rebalance?   >F

[DISCUSSION] Deprecation of obsolete rebalancing functionality

2020-02-12 Thread Alexei Scherbakov
Folks, I want to deprecate some obsolete functionality related to rebalancing. Details in [1] Any objections ? [1] https://issues.apache.org/jira/browse/IGNITE-12662 -- Best regards, Alexei Scherbakov

[jira] [Created] (IGNITE-12662) Get rid of CacheConfiguration#getRebalanceDelay and related functionality.

2020-02-12 Thread Alexey Scherbakov (Jira)
Alexey Scherbakov created IGNITE-12662: -- Summary: Get rid of CacheConfiguration#getRebalanceDelay and related functionality. Key: IGNITE-12662 URL: https://issues.apache.org/jira/browse/IGNITE-12662