Martin, On Tue, May 17, 2011 at 4:34 PM, Martin Alderete <malder...@gmail.com> wrote: > Guys, > How are you doing? > The idea proposed by Andres and Javier sounds great :)! > > On 13 May 2011 09:10, Andres Riancho <andres.rian...@gmail.com> wrote: >> >> Guys, >> >> With Javier we've been thinking about using the multiprocessing >> [1] module in order to exploit all the hardware power current >> computers currently have. In the current state, w3af consumes >> (usually) 90% of one CPU, while 3 other cores (given that you are >> lucky enough to have a quad core) are at 0% usage. This gives us >> errors similar to [0], which we would love to fix. In the future, if >> you find a bug that you think relates to this issue, please set the >> "multiprocessing" tag to it. > > That's because of the GIL implementation and how python handle threads and > IO interrupts and other CPython internals...
Yep, exactly! >> >> Also related... someone has experience with this module? Any >> comments? Hints? Should we spawn 1 process per processor? More? Less? > > Multiprocessing is really good and has an API similar to the threading > module(not trivial), also is easy to share data, objects or whatever you > want between process using the Queue module. I think that concurrency using > multiprocessing is "painless" because you dont use many LOCKS in your code. > > I hope this mail help you! Have you used this module? Which aspects of it did you find annoying? What do we need to know before even starting to use it? > Regards, > > -- > Alderete, Martin Nicolas > Senior Python Developer > ------------------------------------------------------------------------------ > Achieve unprecedented app performance and reliability > What every C/C++ and Fortran developer should know. > Learn how Intel has extended the reach of its next-generation tools > to help boost performance applications - inlcuding clusters. > http://p.sf.net/sfu/intel-dev2devmay > _______________________________________________ > W3af-develop mailing list > W3af-develop@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/w3af-develop > > -- Andrés Riancho Director of Web Security at Rapid7 LLC Founder at Bonsai Information Security Project Leader at w3af ------------------------------------------------------------------------------ What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay _______________________________________________ W3af-develop mailing list W3af-develop@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/w3af-develop