[GitHub] ignite pull request #3727: Improve OS config suggestions

2018-03-30 Thread reed-sandberg
GitHub user reed-sandberg opened a pull request: https://github.com/apache/ignite/pull/3727 Improve OS config suggestions * Acknowledge SWAPPINESS reduction using a range (<= 10). You can merge this pull request into a Git repository by running: $ git pull https://github.com/re

[GitHub] ignite pull request #3726: IGNITE-6815 NPE when using expiry policy

2018-03-30 Thread reed-sandberg
GitHub user reed-sandberg opened a pull request: https://github.com/apache/ignite/pull/3726 IGNITE-6815 NPE when using expiry policy * storeLoadedVal needs to be set at each branch of these conditionals or NPE in inevitible. A recent update on this Jira says

Re: Rebalancing - how to make it faster

2018-03-30 Thread Denis Magda
Ilya, Just came across the IEP put together by you: https://cwiki.apache.org/confluence/display/IGNITE/IEP-16%3A+Optimization+of+rebalancing Excellent explanation, thanks for aggregating everything there. Two tickets below don't have a fixed version assigned: https://issues.apache.org/jira/brows

Fwd: [jira] [Comment Edited] (IGNITE-6815) "Unexpected exception during cache update" via NullPointerException thrown using TouchedExpiryPolicy

2018-03-30 Thread Dmitry Pavlov
Hi Igniters, Who could advice me how to create PR from these commits? Should PR be always created by commit author? Hi Reed, could you please create PR so we could run tests on continious integration? Sincerely, Dmitriy Pavlov -- Forwarded message - From: Reed Sandberg (JIRA)

[jira] [Created] (IGNITE-8091) Create a documentation section describing metrics and monitoring facilities

2018-03-30 Thread Denis Magda (JIRA)
Denis Magda created IGNITE-8091: --- Summary: Create a documentation section describing metrics and monitoring facilities Key: IGNITE-8091 URL: https://issues.apache.org/jira/browse/IGNITE-8091 Project: Ig

Shouldn't we merge IEP-7 with IEP-5?

2018-03-30 Thread Denis Magda
Igniters, After looking at IEP-7 [1] and IEP-5, I couldn't get the main difference between them. My guess that pages have to be merged in one enhancement proposals. Anton V., Alex G., as creators of the pages, what's your opinion on this? [1] https://cwiki.apache.org/confluence/display/IGNITE/I

Re: Ignite Durable Memory & Persistent Store introduction for developers

2018-03-30 Thread Denis Magda
Ivan, Sure, not a problem. Did more, created a hard-not-to-notice block titled Pages Write Throttling in a Nutshell. Thanks! Denis On Fri, Mar 30, 2018 at 10:00 AM, Ivan Rakov wrote: > Denis, thanks for pointing this out. > > I think that section on readme.io is good enough. > I'd only recom

Re: Memory usage per cache

2018-03-30 Thread Denis Magda
Dmitriy G., Alexey, What happens with CacheMetrics.getOffHeapAllocatedSize metric? Don't see it mentioned in the tickets. - Will it return a value of a respective cache group if the cache is the only one in the group. - What will it return if there are several caches in a group? -- Deni

Re: Ignite Durable Memory & Persistent Store introduction for developers

2018-03-30 Thread Ivan Rakov
Denis, thanks for pointing this out. I think that section on readme.io is good enough. I'd only recommend to highlight "write throttling algorithm" words with link to "Pages Write Throttling" section of "Persistence under the hood". What's already described on readme.io is enough for "Durable

Re: Ignite Durable Memory & Persistent Store introduction for developers

2018-03-30 Thread Dmitry Pavlov
Hi Ivan, Excellent addition to the article. Thank you very much for contribution. I hope Igniters, especially Native Persistence experts will follow your lead. Sincerely, Dmitriy Pavlov пт, 30 мар. 2018 г. в 11:38, Ivan Rakov : > Igniters, > > I've added some info about Pages Write Throttling

Re: Ignite Durable Memory & Persistent Store introduction for developers

2018-03-30 Thread Denis Magda
Hi Ivan, Should we update the write-throttling section on readme.io? It makes sense to do if any recommendations have changed: https://apacheignite.readme.io/docs/durable-memory-tuning#section-pages-writes-throttling The compaction technique will be introduced and described on readme: https://iss

[jira] [Created] (IGNITE-8090) Explain disk space compaction by WAL and compaction techniques

2018-03-30 Thread Denis Magda (JIRA)
Denis Magda created IGNITE-8090: --- Summary: Explain disk space compaction by WAL and compaction techniques Key: IGNITE-8090 URL: https://issues.apache.org/jira/browse/IGNITE-8090 Project: Ignite

Re: IGNITE-3999 review

2018-03-30 Thread Nikolay Izhikov
I will take a look at the next week. В Пт, 23/03/2018 в 09:50 +0700, Alexey Kuznetsov пишет: > Vladimir, > > As SQL expert, could you review this PR? > > In this PR QueryEntity.java was changed. And it may impact whole SQL engine. > signature.asc Description: This is a digitally signed message

Re: Code inspection

2018-03-30 Thread Andrey Kuznetsov
Hi, Dmitry! To me, it's better to disable the following: Unnecessary 'this' qualifier -- this will, for example, warn on well-formed constructors. 'if' statement could be replaced with conditional expression -- let's decide on common sense basis whether it's appropriate, forceful refactorings co

Re: Code inspection

2018-03-30 Thread Dmitry Pavlov
Bumping up. Igniters, please reply and provide feedback on inspections settings. I really prefer that we will merge inspections to codebase with clear acknowledgment from active community members. чт, 29 мар. 2018 г. в 12:03, Alexey Goncharuk : > From what I see, it should be rather easy to get

Re: IGNITE-3999 review

2018-03-30 Thread Dmitry Pavlov
Hi Vladimir, When you could take a look? Sincerely, Dmitriy Pavlov пт, 23 мар. 2018 г. в 5:50, Alexey Kuznetsov : > Vladimir, > > As SQL expert, could you review this PR? > > In this PR QueryEntity.java was changed. And it may impact whole SQL > engine. > > -- > Alexey Kuznetsov >

Re: MTCGA: Hot failures

2018-03-30 Thread Dmitry Pavlov
Hi Igniters, Let me share some updates on test failures: Basic [2] https://issues.apache.org/jira/browse/IGNITE-8079 - probably the same problem with https://issues.apache.org/jira/browse/IGNITE-7708 Binary Objects (Simple Mapper Basic)

[jira] [Created] (IGNITE-8089) Cache group presence assertion failed in (PM) exchange in IgniteStandByClientReconnectToNewClusterTest

2018-03-30 Thread Dmitriy Pavlov (JIRA)
Dmitriy Pavlov created IGNITE-8089: -- Summary: Cache group presence assertion failed in (PM) exchange in IgniteStandByClientReconnectToNewClusterTest Key: IGNITE-8089 URL: https://issues.apache.org/jira/browse/IGN

[jira] [Created] (IGNITE-8088) Flaky assertion in testJoinClientStaticCacheConfigurationOnJoin for cache presence

2018-03-30 Thread Dmitriy Pavlov (JIRA)
Dmitriy Pavlov created IGNITE-8088: -- Summary: Flaky assertion in testJoinClientStaticCacheConfigurationOnJoin for cache presence Key: IGNITE-8088 URL: https://issues.apache.org/jira/browse/IGNITE-8088

[jira] [Created] (IGNITE-8087) Assertion error in time to rebalancing

2018-03-30 Thread Vladislav Pyatkov (JIRA)
Vladislav Pyatkov created IGNITE-8087: - Summary: Assertion error in time to rebalancing Key: IGNITE-8087 URL: https://issues.apache.org/jira/browse/IGNITE-8087 Project: Ignite Issue Type:

Re: Memory usage per cache

2018-03-30 Thread Alexey Goncharuk
Yes, I think we can maintain this metric inside lock ownership change callbacks. 2018-03-30 17:34 GMT+03:00 Dmitriy Setrakyan : > I think "getLockedKeysCount" is better. Can we easily return this count > without traversing all the transactions? > > > > On Fri, Mar 30, 2018 at 7:32 AM, Alexey Gonc

[jira] [Created] (IGNITE-8086) Flaky test timeouts in Activate/Deactivate Cluster suite

2018-03-30 Thread Dmitriy Pavlov (JIRA)
Dmitriy Pavlov created IGNITE-8086: -- Summary: Flaky test timeouts in Activate/Deactivate Cluster suite Key: IGNITE-8086 URL: https://issues.apache.org/jira/browse/IGNITE-8086 Project: Ignite

[GitHub] ignite pull request #3725: GG-13657

2018-03-30 Thread ilantukh
GitHub user ilantukh opened a pull request: https://github.com/apache/ignite/pull/3725 GG-13657 You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-gg-13657 Alternatively you can review and apply these

[GitHub] ignite pull request #3724: IGNITE-8012: CPP: Changed passing by values by pa...

2018-03-30 Thread isapego
GitHub user isapego opened a pull request: https://github.com/apache/ignite/pull/3724 IGNITE-8012: CPP: Changed passing by values by passing by reference You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite igni

[jira] [Created] (IGNITE-8085) Flaky failures in Ignite Client Nodes test suite: Remote node could not start.

2018-03-30 Thread Dmitriy Pavlov (JIRA)
Dmitriy Pavlov created IGNITE-8085: -- Summary: Flaky failures in Ignite Client Nodes test suite: Remote node could not start. Key: IGNITE-8085 URL: https://issues.apache.org/jira/browse/IGNITE-8085

Re: Memory usage per cache

2018-03-30 Thread Dmitriy Setrakyan
I think "getLockedKeysCount" is better. Can we easily return this count without traversing all the transactions? On Fri, Mar 30, 2018 at 7:32 AM, Alexey Goncharuk < alexey.goncha...@gmail.com> wrote: > Dmitriy, > > getLockedKeys returns only the number of locked keys, not the keys > themselves.

Re: Memory usage per cache

2018-03-30 Thread Alexey Goncharuk
Dmitriy, getLockedKeys returns only the number of locked keys, not the keys themselves. Looks like the method name is confusing, should we rename it to getLockedKeysNumber? --AG 2018-03-30 16:24 GMT+03:00 Dmitriy Setrakyan : > Dmitriy, > > For transactions, are these separate metrics for each t

[GitHub] ignite pull request #3723: IGNITE-8013: CPP: Added check of pending snapshot...

2018-03-30 Thread isapego
GitHub user isapego opened a pull request: https://github.com/apache/ignite/pull/3723 IGNITE-8013: CPP: Added check of pending snapshots in GetHandler You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-

Re: Memory usage per cache

2018-03-30 Thread Dmitriy Setrakyan
Dmitriy, For transactions, are these separate metrics for each transaction or aggregates for all of them? If these are aggregates, then methods like "getLockedKeys" may produce a very large collection, which on top of everything else, will be very difficult to create. D. On Fri, Mar 30, 2018 at

[jira] [Created] (IGNITE-8084) Unlock write lock in DataStreamerImpl

2018-03-30 Thread Ivan Fedotov (JIRA)
Ivan Fedotov created IGNITE-8084: Summary: Unlock write lock in DataStreamerImpl Key: IGNITE-8084 URL: https://issues.apache.org/jira/browse/IGNITE-8084 Project: Ignite Issue Type: Improvemen

[jira] [Created] (IGNITE-8083) Direct Message types for mongo request/responses duplicate other message' direct type.

2018-03-30 Thread Max Shonichev (JIRA)
Max Shonichev created IGNITE-8083: - Summary: Direct Message types for mongo request/responses duplicate other message' direct type. Key: IGNITE-8083 URL: https://issues.apache.org/jira/browse/IGNITE-8083

[jira] [Created] (IGNITE-8082) No management bean for ZookeeperDiscoverySpi

2018-03-30 Thread Max Shonichev (JIRA)
Max Shonichev created IGNITE-8082: - Summary: No management bean for ZookeeperDiscoverySpi Key: IGNITE-8082 URL: https://issues.apache.org/jira/browse/IGNITE-8082 Project: Ignite Issue Type: B

[GitHub] ignite pull request #3722: Ignite 7772

2018-03-30 Thread andrey-kuznetsov
GitHub user andrey-kuznetsov opened a pull request: https://github.com/apache/ignite/pull/3722 Ignite 7772 For TeamCity testing You can merge this pull request into a Git repository by running: $ git pull https://github.com/andrey-kuznetsov/ignite ignite-7772 Alternatively yo

[GitHub] ignite pull request #3721: IGNITE-8080 Avoid updating tx entries twice

2018-03-30 Thread Jokser
GitHub user Jokser opened a pull request: https://github.com/apache/ignite/pull/3721 IGNITE-8080 Avoid updating tx entries twice You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-8080 Alternatively yo

[GitHub] ignite pull request #3496: IGNITE-7657: Minor style fixes: imports, forgotte...

2018-03-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/3496 ---

Re: Memory usage per cache

2018-03-30 Thread Dmitriy Govorukhin
Folks, I created 2 Jira issue for new metrics. Also, I think they will be useful. Let's discuss in comments. - Add new metrics for data storage IGNITE-8078 - Implement new JMX metrics for transactions IGNITE-8077

Re: Ignite Durable Memory & Persistent Store introduction for developers

2018-03-30 Thread Ivan Rakov
Igniters, I've added some info about Pages Write Throttling and WAL compaction to the "Ignite Persistent Store - under the hood" document. Please let me know if anything is not clear enough. Best Regards, Ivan Rakov On 26.03.2018 0:18, Dmitry Pavlov wrote: Hi Igniters, I've done several upd

Re: Apache Ignite nightly nuget upload

2018-03-30 Thread Petr Ivanov
Nice, we’ll stick to the MyGet then. Can you prepare “apache-ignite-maven-nightly” feed and pass API key for it if you have account at MyGet? > On 30 Mar 2018, at 11:25, Pavel Tupitsyn wrote: > >> Apache’s way > See [1]: there is no specific place for nightly builds. We can use whatever > f

Re: Apache Ignite nightly nuget upload

2018-03-30 Thread Pavel Tupitsyn
> Apache’s way See [1]: there is no specific place for nightly builds. We can use whatever fits better. The main theme there is that we are discouraged from exposing nightly builds to end users. [1] http://www.apache.org/legal/release-policy.html#host-rc On Fri, Mar 30, 2018 at 11:14 AM, Petr Iv

Re: Apache Ignite nightly nuget upload

2018-03-30 Thread Petr Ivanov
No, currently nightly maven artifacts are not uploaded anywhere. Yet, I’d like to research firstly Apache’s way of storing and providing nightly artifacts. > On 30 Mar 2018, at 11:11, Pavel Tupitsyn wrote: > > By the way, MyGet supports Maven. > > - Do we put nightly Maven artifacts somewhere

Re: Apache Ignite nightly nuget upload

2018-03-30 Thread Pavel Tupitsyn
By the way, MyGet supports Maven. - Do we put nightly Maven artifacts somewhere already? - If not, should we put them on MyGet? On Fri, Mar 30, 2018 at 11:09 AM, Pavel Tupitsyn wrote: > Awesome, I like that version reflects the date! > > On Fri, Mar 30, 2018 at 10:32 AM, Petr Ivanov wrote: > >

Re: Apache Ignite nightly nuget upload

2018-03-30 Thread Pavel Tupitsyn
Awesome, I like that version reflects the date! On Fri, Mar 30, 2018 at 10:32 AM, Petr Ivanov wrote: > Thanks, Pavel! > > > I’ve successfully moved nightly nuget uploading task to “[APACHE IGNITE > NIGHTLY RELEASE] #3 :: Assemble Nuget Packages” [1] configuration. Marking > previous configuratio

Re: Apache Ignite nightly nuget upload

2018-03-30 Thread Petr Ivanov
Thanks, Pavel! I’ve successfully moved nightly nuget uploading task to “[APACHE IGNITE NIGHTLY RELEASE] #3 :: Assemble Nuget Packages” [1] configuration. Marking previous configuration as obsolete. Artifacts in the MyGet Gallery [2] are updated. [1] https://ci.ignite.apache.org/viewType.html