Re: Benchmarking

2018-08-10 Thread Ilya Suntsov
. Also, you can use dedicated AWS instances for benchmarking. Pay attention to the fact that sometimes our benchmarks can show unstable results in case of non-dedicated instances. 2018-08-09 21:09 GMT+03:00 Vyacheslav Daradur : > Huge +1, for a public benchmarking tool and the Docker ba

Re: Benchmarking

2018-08-09 Thread Pavel Kovalenko
Vinogradov : > Igniters, > > All critical code changes should be covered by benchmarks. > Currently, community have no dedicated benchmarking service. > > Everyone can run yandstick locally, but this seems to be useless. > You have to run cluster on 4 clients and 4 servers, at

Benchmarking

2018-08-09 Thread Anton Vinogradov
Igniters, All critical code changes should be covered by benchmarks. Currently, community have no dedicated benchmarking service. Everyone can run yandstick locally, but this seems to be useless. You have to run cluster on 4 clients and 4 servers, at least. Currently it is not possible for me

Re: Ignite Benchmarking Rules

2017-09-22 Thread Konstantin Boudnik
the moment of writing. On Sat, Sep 16, 2017 at 12:06 AM, Dmitriy Setrakyan <dsetrak...@apache.org> wrote: > Cos, > > I think Apache BigTop is using servers provided by Amazon. Can you make a > suggestion on how can Ignite community get a few servers from Amazon for > benchmarking as

Re: Ignite Benchmarking Rules

2017-09-15 Thread Dmitriy Setrakyan
Cos, I think Apache BigTop is using servers provided by Amazon. Can you make a suggestion on how can Ignite community get a few servers from Amazon for benchmarking as well? D. On Fri, Sep 15, 2017 at 5:57 AM, Anton Vinogradov <a...@apache.org> wrote: > Guys, > > I fully agree

Re: Ignite Benchmarking Rules

2017-09-15 Thread Anton Vinogradov
specific number for > benchmarking. > > Can we start from reference hardware configuration: Num of CPU, RAM and > HDD(SDD?) configuration, network configs, etc. > > Can someone share that kind of knowledge - Which hardware is best for > Ignite benchmarking? > > I found some number

Re: Ignite Benchmarking Rules

2017-09-15 Thread Nikolay Izhikov
Hello, Dmitriy. I think experienced members of community have specific number for benchmarking. Can we start from reference hardware configuration: Num of CPU, RAM and HDD(SDD?) configuration, network configs, etc. Can someone share that kind of knowledge - Which hardware is best

Re: Ignite Benchmarking Rules

2017-09-14 Thread Dmitriy Setrakyan
Alexey, I completely agree. However, for the benchmarks to be useful, then need to be run on the same hardware all the time. Apache Ignite does not have servers sitting around, available to run the benchmarks. Would be nice to see how other projects address it. Can Amazon donate servers for the

Ignite Benchmarking Rules

2017-09-14 Thread Aleksei Zaitsev
Hi, Igniters. Recently I’ve done some research in benchmarks for Ignite, and noticed that we don’t have any rules for running benchmarks and collecting result from them. Although sometimes we have tasks, which results need to be measured. I propose to formalize such things as: * set of

Re: Ignite Benchmarking page on readme.io

2017-09-11 Thread Dmitriy Setrakyan
look bad. Also, benchmarking is a very common topic during evaluation process and deserves a spot up top. I would still place it under Basic Concepts for now. You can always move it to a separate section once we have more content.

Re: Ignite Benchmarking page on readme.io

2017-09-11 Thread Denis Magda
setrak...@apache.org> wrote: > > Several comments: > I would place this page directly under the top Basic Concepts section > I would rename the link to Benchmarking (performance is assumed) > I would add a few benchmark runs with examples graphs there > D. > > On Mon, Sep

Re: Ignite Benchmarking page on readme.io

2017-09-11 Thread Dmitriy Setrakyan
Several comments: 1. I would place this page directly under the top Basic Concepts section 2. I would rename the link to Benchmarking (performance is assumed) 3. I would add a few benchmark runs with examples graphs there D. On Mon, Sep 11, 2017 at 5:03 PM, Denis Magda <

Re: Ignite Benchmarking page on readme.io

2017-09-11 Thread Denis Magda
I’ve done the primarily review and rename the page address. That’s it: https://apacheignite.readme.io/docs/perfomance-benchmarking <https://apacheignite.readme.io/docs/perfomance-benchmarking> Prachi, please do the final review. The page is already online. — Denis > On Sep 8, 2017, at

Re: Ignite Benchmarking page on readme.io

2017-09-08 Thread Aleksei Zaitsev
Thanks. Here is a direct link on the new page about Ignite Benchmarking(hidden for now): https://apacheignite.readme.io/v2.1/docs/perfomance-tests. Please review. Mostly it was aggregated from the information in the repo 07.09.2017, 20:57, "Dmitriy Setrakyan" <dsetrak...@apache.org

Re: Ignite Benchmarking page on readme.io

2017-09-07 Thread Dmitriy Setrakyan
Actually, it can be contributed directly to readme.io. Alexey, I just sent you an invite. You can create a new page for benchmarking and make it invisible for now, while you are working on it. If you need us to review it, please send a direct link to it here. D. On Thu, Sep 7, 2017 at 8:26 AM

Re: Ignite Benchmarking page on readme.io

2017-09-07 Thread Anton Vinogradov
any information about Apache Ignite > benchmarking on our site https://apacheignite.readme.io. I want to add > such a page, but I can’t find appropriate section for it. I suggest to make > new section named ‘Tests and Benchmarking’ and put all information about > benchmaring in sec

Ignite Benchmarking page on readme.io

2017-09-07 Thread Aleksei Zaitsev
Hi, guys. Issue[1] stated that we have not any information about Apache Ignite benchmarking on our site https://apacheignite.readme.io. I want to add such a page, but I can’t find appropriate section for it. I suggest to make new section named ‘Tests and Benchmarking’ and put all information

[jira] [Created] (IGNITE-6278) Add benchmarking page to readme.io

2017-09-06 Thread Aleksei Zaitsev (JIRA)
Aleksei Zaitsev created IGNITE-6278: --- Summary: Add benchmarking page to readme.io Key: IGNITE-6278 URL: https://issues.apache.org/jira/browse/IGNITE-6278 Project: Ignite Issue Type: Wish

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-10 Thread Denis Magda
te 1.9 benchmarking purposes. If you’re happy with it then Oleg is free to merge the changes into 1.9 and release them there. — Denis > On Feb 10, 2017, at 2:50 AM, Oleg Ostanin <oosta...@gridgain.com> wrote: > > I'm sorry, there wasn't any problem with the build, it was local pr

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-10 Thread Oleg Ostanin
t;>> On Jan 27, 2017, at 2:13 AM, Oleg Ostanin <oosta...@gridgain.com> >>>> wrote: >>>> >>> >>>> >>> Hi! >>>> >>> >>>> >>> I've changed the README.txt and DEVNOTES.txt f

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-10 Thread Oleg Ostanin
DME.txt and DEVNOTES.txt files. Also added a >>> simple >>> >>> config file for quick and easy start. Please take a look at them and >>> tell >>> >>> me what you think. >>> >>> >>> >>> https://github.com/apac

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-09 Thread Oleg Ostanin
https://github.com/apache/ignite/pull/1471 >> >>> >> >>> On Wed, Dec 28, 2016 at 8:59 AM, Ilya Suntsov <isunt...@gridgain.com> >> >> wrote: >> >>> >> >>>> Denis, >> >>>> >> >>>> I

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-09 Thread Oleg Ostanin
gt; > >>>> Denis, > >>>> > >>>> I think we can remove all configs except: > >>>> > >>>> benchmark-multicast.properties > >>>> > >>>> benchmark.properties > >>>> > >>

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-03 Thread Denis Magda
;>>>> - What is the difference between "Building from standalone sources" >>>> and >>>>>>>> "Building from Ignite Sources"? In my understanding, a user >> downloads >>>>>>>> Apache Ignite release that has all

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-02 Thread Oleg Ostanin
gt; wrote: > >>>>> > >>>>> Hi! > >>>>> > >>>>> I've changed the README.txt and DEVNOTES.txt files. Also added a > simple > >>>>> config file for quick and easy start. Please take a look at them and > >

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-02-01 Thread Denis Magda
added a simple >>>>> config file for quick and easy start. Please take a look at them and >> tell >>>>> me what you think. >>>>> >>>>> https://github.com/apache/ignite/pull/1471 >>>>> >>>>> On Wed, Dec

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-01-31 Thread Denis Magda
; ignite-base-config.xml >>>> >>>> ignite-localhost-config.xml >>>> >>>> ignite-multicast-config.xml >>>> >>>> 2016-12-28 2:49 GMT+03:00 Denis Magda <dma...@apache.org>: >>>> >>>>> I would h

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2017-01-30 Thread Denis Magda
ml >> >> ignite-localhost-config.xml >> >> ignite-multicast-config.xml >> >> 2016-12-28 2:49 GMT+03:00 Denis Magda <dma...@apache.org>: >> >>> I would have only those configs that are useful. Ilya Suntsov, basing on >>> your ex

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-27 Thread Ilya Suntsov
re useful. Ilya Suntsov, basing on > your experience, please suggest which configs makes sense to include into > every Ignite release. > > Oleg, also please note that community decided to include not only the > benchmarking binaries but the sources as well into every Apache Ignit

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-27 Thread Denis Magda
I would have only those configs that are useful. Ilya Suntsov, basing on your experience, please suggest which configs makes sense to include into every Ignite release. Oleg, also please note that community decided to include not only the benchmarking binaries but the sources as well

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-27 Thread Oleg Ostanin
stick' and put there yardstick binaries? >> >>>>>>>> >> >>>>>>>> >> >>>>>>>> On Sun, Dec 18, 2016 at 10:02 PM, Denis Magda <dma...@apache.org >> > >> >>>>>> wro

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-27 Thread Oleg Ostanin
t;>> https://issues.apache.org/ > >>>>>>>>> jira/browse/IGNITE-4212). > >>>>>>>>> > >>>>>>>>> The whole purpose of the ticket is to automate benchmarks > >> execution > >>>>>&g

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-20 Thread Denis Magda
the ticket is to automate benchmarks >> execution >>>>>> for >>>>>>>>> the end user for a specific Ignite release. Now he/she needs to go >>>>>>> through >>>>>>>>> a number of steps like build, configure, run strictly following >

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Dmitriy Setrakyan
script > >> needs > >> >>>>> benchmarks' lib which makes sense to put under “libs/optional” > >> folder. > >> >>>>> > >> >>>>> If someone wants to modify the source of an existed benchmark or > >> add a > &

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Sergey Kozlov
k or >> add a >> >>> new >> >>>>> one then he/she needs to follow existed Yardstick guidance. So, no >> >> need >> >>> to >> >>>>> release benchmarks’s sources as a part of Ignite release. >> >>>>&g

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Sergey Kozlov
t;>>> release benchmarks’s sources as a part of Ignite release. > >>>>> > >>>>> — > >>>>> Denis > >>>>> > >>>>>> On Dec 18, 2016, at 7:08 AM, Dmitriy Setrakyan < > >> dsetrak...@apache.o

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Denis Magda
; wrote: >>>>>> >>>>>> On Sun, Dec 18, 2016 at 2:53 AM, Oleg Ostanin <oosta...@gridgain.com >>> >>>>> wrote: >>>>>> >>>>>>> Dmitriy, ignite-yardstick allows user to run plenty of useful >>

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Denis Magda
;>>>>> >>>>>>> On Dec 18, 2016, at 7:08 AM, Dmitriy Setrakyan < >> dsetrak...@apache.org> >>>>>> wrote: >>>>>>> >>>>>>> On Sun, Dec 18, 2016 at 2:53 AM, Oleg Ostanin <oosta...@gridgain.com &g

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Sergey Kozlov
6 at 2:53 AM, Oleg Ostanin <oosta...@gridgain.com > > > > >> wrote: > > >>> > > >>>> Dmitriy, ignite-yardstick allows user to run plenty of useful > > Yardstick > > >>>> benchmarks, which can be used to check Ignite performance

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Dmitriy Setrakyan
;>>> wrote: > >>>>> > >>>>>> Dmitriy, ignite-yardstick allows user to run plenty of useful > >> Yardstick > >>>>>> benchmarks, which can be used to check Ignite performance. > >>>>>> > >>>&g

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Denis Magda
enty of useful >> Yardstick >>>>>> benchmarks, which can be used to check Ignite performance. >>>>>> >>>>> >>>>> In that case, why would it be under the "libs" folder at all? Do we >>>> really >>

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Dmitriy Setrakyan
s, which can be used to check Ignite performance. > >>>> > >>> > >>> In that case, why would it be under the "libs" folder at all? Do we > >> really > >>> need to include benchmarks into Ignite? If yes, then I would create a > >>&g

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-19 Thread Denis Magda
uot;libs" folder at all? Do we >> really >>> need to include benchmarks into Ignite? If yes, then I would create a >>> benchmarks folder under "examples" and add all the benchmarks there. >>> >>> >>>> >>>> On Fri, Dec 16,

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-18 Thread Denis Magda
.org >>> >> wrote: >> >>> Oleg, what does ignite-yardstick module do? >>> >>> On Fri, Dec 16, 2016 at 12:37 AM, Oleg Ostanin <oosta...@gridgain.com> >>> wrote: >>> >>>> Hello Igniters! >>>> I'm working

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-18 Thread Sergey Kozlov
> > > > > wrote: > > > > > Oleg, what does ignite-yardstick module do? > > > > > > On Fri, Dec 16, 2016 at 12:37 AM, Oleg Ostanin <oosta...@gridgain.com> > > > wrote: > > > > > > > Hello Igniters! > > > &

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-18 Thread Dmitriy Setrakyan
, what does ignite-yardstick module do? > > > > On Fri, Dec 16, 2016 at 12:37 AM, Oleg Ostanin <oosta...@gridgain.com> > > wrote: > > > > > Hello Igniters! > > > I'm working on ticket IGNITE-4212 "Ignite Benchmarking Simplification > a

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-18 Thread Oleg Ostanin
016 at 12:37 AM, Oleg Ostanin <oosta...@gridgain.com> > wrote: > > > Hello Igniters! > > I'm working on ticket IGNITE-4212 "Ignite Benchmarking Simplification and > > Automation" and I'd like to ask your opinion about ignite-yardstick: > where > &

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-16 Thread Dmitriy Setrakyan
Oleg, what does ignite-yardstick module do? On Fri, Dec 16, 2016 at 12:37 AM, Oleg Ostanin <oosta...@gridgain.com> wrote: > Hello Igniters! > I'm working on ticket IGNITE-4212 "Ignite Benchmarking Simplification and > Automation" and I'd like to ask your opinion abou

Re: IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-16 Thread Denis Magda
to the script and script will launch it. — Denis > On Dec 16, 2016, at 12:37 AM, Oleg Ostanin <oosta...@gridgain.com> wrote: > > Hello Igniters! > I'm working on ticket IGNITE-4212 "Ignite Benchmarking Simplification and > Automation" and I'd like to ask your opinion about i

IGNITE-4212 (Ignite Benchmarking Simplification and Automation)

2016-12-16 Thread Oleg Ostanin
Hello Igniters! I'm working on ticket IGNITE-4212 "Ignite Benchmarking Simplification and Automation" and I'd like to ask your opinion about ignite-yardstick: where do you think is the most appropriate place to put a compiled ignite-yardstick module in the apache-ignite binary assembly?

[jira] [Created] (IGNITE-4212) Ignite Benchmarking Simplification and Automation

2016-11-10 Thread Denis Magda (JIRA)
Denis Magda created IGNITE-4212: --- Summary: Ignite Benchmarking Simplification and Automation Key: IGNITE-4212 URL: https://issues.apache.org/jira/browse/IGNITE-4212 Project: Ignite Issue Type

[GitHub] ignite pull request: GG-10988 benchmarking

2016-04-05 Thread ilantukh
Github user ilantukh closed the pull request at: https://github.com/apache/ignite/pull/592 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] ignite pull request: GG-10988 benchmarking

2016-03-31 Thread ilantukh
GitHub user ilantukh opened a pull request: https://github.com/apache/ignite/pull/592 GG-10988 benchmarking This version uses CHM8 instead of JDK CHM. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ilantukh/ignite ignite-gg