Andres,
The web_spider alone works well, but if you use it with dir_bruter
something strange happens because web_spider does not crawl all directories
...
dir_bruter works well for me with this fix ;)
Index: dir_bruter.py
===================================================================
--- dir_bruter.py (revisión: 5824)
+++ dir_bruter.py (copia de trabajo)
@@ -73,12 +73,12 @@
base_url = fuzzable_request.getURL().baseUrl()
if base_url not in self._already_tested:
+ self._already_tested.add( base_url )
self._bruteforce_directories( base_url )
- self._already_tested.add( base_url )
if self._be_recursive and domain_path not in
self._already_tested:
+ self._already_tested.add( domain_path )
self._bruteforce_directories( domain_path )
- self._already_tested.add( domain_path )
def _dir_name_generator(self, base_path):
'''
On Fri, Sep 28, 2012 at 9:09 PM, Tomas Velazquez <tomas.velazqu...@gmail.com
> wrote:
> Andres,
>
> I'm sorry, redundancy also exist at threading2 branch.
>
> I explain the test:
> - Exist directory listing in all directories except /.
> - oneword.txt wordlist has hide_folder.
>
> Problems found:
> - dir_bruter brute force same directory:
> http://localhost/ 4 times
> http://localhost/test/ 2 times
> http://localhost/test/hide_folder/ 2 times
> http://localhost/test/hide_folder/another/ 1 time
> all directories inside another/ are not brute forced at any depth.
> - web_spider does not crawl to maximum directory depth.
>
> Result:
> Found 6 URLs and 6 different points of injection.
> The list of URLs is:
> - http://localhost/test/hide_folder/another/1/
> - http://localhost/test/hide_folder/test.txt
> - http://localhost/
> - http://localhost/test/hide_folder/another/
> - http://localhost/test/hide_folder/
> - http://localhost/test/
>
> Test script:
> plugins
> crawl web_spider dir_bruter
> crawl config dir_bruter
> set wordlist /tmp/oneword.txt
> back
> back
> target
> set target http://localhost/test/
> back
> start
>
> I hope you can reproduce it, thanks a lot for your work!
>
> PD: I like the new plugin filename homogenization ;)
>
>
>
> On Fri, Sep 28, 2012 at 1:56 AM, Andres Riancho
> <andres.rian...@gmail.com>wrote:
>
>> Tomas,
>>
>> Thanks for the patch! I've been working on improvements in my
>> threading2 branch, where I think this was fixed [0], could you please
>> verify?
>>
>> [0]
>> http://sourceforge.net/apps/trac/w3af/browser/branches/threading2/plugins/crawl/dir_bruter.py
>>
>> On Tue, Sep 25, 2012 at 9:27 PM, Tomas Velazquez
>> <tomas.velazqu...@gmail.com> wrote:
>> > Hi list,
>> >
>> > I see that dir_bruter brute force the same folder more than once. This
>> > redundancy increases if you add other plugins like webSpider.
>> >
>> > Regards,
>> >
>> >
>> > Possible patch:
>> >
>> > Index: dir_bruter.py
>> > ===================================================================
>> > --- dir_bruter.py (revision 5824)
>> > +++ dir_bruter.py (working copy)
>> > @@ -53,6 +53,7 @@
>> > # Internal variables
>> > self._fuzzable_requests = []
>> > self._tested_base_url = False
>> > + self._already_done = []
>> >
>> > def discover(self, fuzzableRequest ):
>> > '''
>> > @@ -82,6 +83,9 @@
>> > to_test.append( domain_path )
>> >
>> > for base_path in to_test:
>> > + # Check if the url is a folder and if the url already
>> been
>> > bruteforced
>> > + if base_path.url_string.endswith('/') and filter(lambda
>> x:
>> > x.url_string==base_path.url_string,self._already_done) == []:
>> > + self._already_done.append(base_path)
>> > # Send the requests using threads:
>> > self._run_async(
>> > meth=self._bruteforce_directories,
>> >
>> >
>> >
>> ------------------------------------------------------------------------------
>> > Live Security Virtual Conference
>> > Exclusive live event will cover all the ways today's security and
>> > threat landscape has changed and how IT managers can respond.
>> Discussions
>> > will include endpoint security, mobile security and the latest in
>> malware
>> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>> > _______________________________________________
>> > W3af-develop mailing list
>> > W3af-develop@lists.sourceforge.net
>> > https://lists.sourceforge.net/lists/listinfo/w3af-develop
>> >
>>
>>
>>
>> --
>> Andrés Riancho
>> Project Leader at w3af - http://w3af.org/
>> Web Application Attack and Audit Framework
>> Twitter: @w3af
>> GPG: 0x93C344F3
>>
>
>
------------------------------------------------------------------------------
How fast is your code?
3 out of 4 devs don\\\'t know how their code performs in production.
Find out how slow your code is with AppDynamics Lite.
http://ad.doubleclick.net/clk;262219672;13503038;z?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
_______________________________________________
W3af-develop mailing list
W3af-develop@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/w3af-develop
