Martin,

On Tue, May 17, 2011 at 4:34 PM, Martin Alderete <malder...@gmail.com> wrote:
> Guys,
> How are you doing?
> The idea proposed by Andres and Javier sounds great :)!
>
> On 13 May 2011 09:10, Andres Riancho <andres.rian...@gmail.com> wrote:
>>
>> Guys,
>>
>>    With Javier we've been thinking about using the multiprocessing
>> [1] module in order to exploit all the hardware power current
>> computers currently have. In the current state, w3af consumes
>> (usually) 90% of one CPU, while 3 other cores (given that you are
>> lucky enough to have a quad core) are at 0% usage. This gives us
>> errors similar to [0], which we would love to fix. In the future, if
>> you find a bug that you think relates to this issue, please set the
>> "multiprocessing" tag to it.
>
> That's because of the GIL implementation and how python handle threads and
> IO interrupts and other CPython internals...

Yep, exactly!

>>
>>    Also related... someone has experience with this module? Any
>> comments? Hints? Should we spawn 1 process per processor? More? Less?
>
> Multiprocessing is really good and has an API similar to the threading
> module(not trivial), also is easy to share data, objects or whatever you
> want between process using the Queue module. I think that concurrency using
> multiprocessing is "painless" because you dont use many LOCKS in your code.
>
> I hope this mail help you!

Have you used this module? Which aspects of it did you find annoying?
What do we need to know before even starting to use it?

> Regards,
>
> --
> Alderete, Martin Nicolas
> Senior Python Developer
> ------------------------------------------------------------------------------
> Achieve unprecedented app performance and reliability
> What every C/C++ and Fortran developer should know.
> Learn how Intel has extended the reach of its next-generation tools
> to help boost performance applications - inlcuding clusters.
> http://p.sf.net/sfu/intel-dev2devmay
> _______________________________________________
> W3af-develop mailing list
> W3af-develop@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/w3af-develop
>
>



-- 
Andrés Riancho
Director of Web Security at Rapid7 LLC
Founder at Bonsai Information Security
Project Leader at w3af

------------------------------------------------------------------------------
What Every C/C++ and Fortran developer Should Know!
Read this article and learn how Intel has extended the reach of its 
next-generation tools to help Windows* and Linux* C/C++ and Fortran 
developers boost performance applications - including clusters. 
http://p.sf.net/sfu/intel-dev2devmay
_______________________________________________
W3af-develop mailing list
W3af-develop@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/w3af-develop

Reply via email to