Atri, one area of benchmarking is in the area of scalability of libprocess in terms of number of actors. The Mesos master currently creates tens of thousands of actors (1 for each slave in the cluster). However, in the future we may double or triple this number (either from supporting larger and larger clusters, or by refactoring the master in a manner that uses more than 1 actor per slave). We'd like to be able to cope with such changes without running into performance issues in production.
On Mon, Feb 23, 2015 at 1:49 PM, Benjamin Mahler <[email protected]> wrote: > Joris, are you planning to follow up on the cleanups? I'd love to land > that first: > https://reviews.apache.org/r/27113/ > > On Sat, Feb 21, 2015 at 8:48 PM, Adam Bordelon <[email protected]> wrote: > >> This patch was already merged in, so you could start exploring what Joris >> did there, and what more can be done. >> Joris may have more thoughts on the matter. >> >> On Sat, Feb 21, 2015 at 5:23 AM, Atri Sharma <[email protected]> wrote: >> >> > Thanks. >> > >> > Do you advice building on this patch? >> > On 21 Feb 2015 14:18, "Adam Bordelon" <[email protected]> wrote: >> > >> > > Looks like https://reviews.apache.org/r/26150/ was submitted with a >> > basic >> > > libprocess benchmark. >> > > See the source and tests (and `make bench` target) under >> > > https://github.com/apache/mesos/tree/master/3rdparty/libprocess >> > > >> > > On Fri, Feb 20, 2015 at 7:16 AM, Atri Sharma <[email protected]> >> > wrote: >> > > >> > > > Looks super interesting. Can I get more information here and >> guidance >> > > > please? How to start, which code areas to look into et al... >> > > > >> > > > On Fri, Feb 20, 2015 at 11:46 AM, Benjamin Mahler < >> > > > [email protected]> wrote: >> > > > >> > > > > On second thought, we had a GSOC project for benchmarking >> libprocess >> > > (our >> > > > > C++ actor runtime / asynchronous library), but we ultimately chose >> > > > another >> > > > > project for the student. >> > > > > >> > > > > Contributions there would be greatly appreciated as well: >> > > > > https://issues.apache.org/jira/browse/MESOS-1018 >> > > > > >> > > > > On Thu, Feb 19, 2015 at 8:59 PM, Atri Sharma <[email protected] >> > >> > > > wrote: >> > > > > >> > > > > > Thanks guys. >> > > > > > >> > > > > > Can anyone also suggest two things: >> > > > > > >> > > > > > 1) Code pointers to start with. >> > > > > > 2) Any area that needs love right now and that I can pick up as >> a >> > > > longer >> > > > > > project after fixing some smalll newbies to get started. >> > > > > > >> > > > > > On Wed, Feb 18, 2015 at 2:40 PM, Timothy Chen < >> [email protected]> >> > > > wrote: >> > > > > > >> > > > > > > I suggest you can also search for JIRA tickets on Mesos with >> the >> > > > label >> > > > > > > "newbie" to start out with. >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > >> https://issues.apache.org/jira/browse/MESOS-2314?jql=project%20%3D%20MESOS%20AND%20labels%20%3D%20newbie >> > > > > > > >> > > > > > > Tim >> > > > > > > >> > > > > > > On Wed, Feb 18, 2015 at 1:07 AM, Atri Sharma < >> > [email protected]> >> > > > > > wrote: >> > > > > > > > Hi Ben, >> > > > > > > > >> > > > > > > > Thanks for your email. >> > > > > > > > >> > > > > > > > If not performance, is there any other area where I could >> focus >> > > on? >> > > > > > > > >> > > > > > > > On Wed, Feb 18, 2015 at 2:33 PM, Benjamin Mahler < >> > > > > > > [email protected]> >> > > > > > > > wrote: >> > > > > > > > >> > > > > > > >> We generally don't have a lot of performance improvement >> work, >> > > but >> > > > > one >> > > > > > > >> thing that came up recently for large clusters was: >> > > > > > > >> https://issues.apache.org/jira/browse/MESOS-2353 >> > > > > > > >> >> > > > > > > >> On Tue, Feb 17, 2015 at 11:10 PM, Atri Sharma < >> > > > [email protected]> >> > > > > > > wrote: >> > > > > > > >> >> > > > > > > >> > Hi all, >> > > > > > > >> > >> > > > > > > >> > I am looking into starting hacking Mesos and >> concentrating >> > on >> > > > the >> > > > > > > >> > performance improvement areas of Mesos for the same. >> > > > > > > >> > >> > > > > > > >> > Can anyone please guide me a bit into the code base and >> how >> > to >> > > > > start >> > > > > > > in >> > > > > > > >> the >> > > > > > > >> > performance code base and Mesos architecture, along with >> > some >> > > > > > projects >> > > > > > > >> that >> > > > > > > >> > I can pick up in performance? That will be great. >> > > > > > > >> > >> > > > > > > >> > Regards, >> > > > > > > >> > >> > > > > > > >> > Atri >> > > > > > > >> > >> > > > > > > >> >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > -- >> > > > > > > > Regards, >> > > > > > > > >> > > > > > > > Atri >> > > > > > > > *l'apprenant* >> > > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > -- >> > > > > > Regards, >> > > > > > >> > > > > > Atri >> > > > > > *l'apprenant* >> > > > > > >> > > > > >> > > > >> > > > >> > > > >> > > > -- >> > > > Regards, >> > > > >> > > > Atri >> > > > *l'apprenant* >> > > > >> > > >> > >> > >
