One possible way is if you have a search feature built into your site.
Internal search engines index files not by URL but by directory/file and
would therefore find "hidden" documents.  If the spider can somehow access a
search results page (submit a blank form maybe?) those files might show up.

Regardless, never assume that a file is safely hidden on your website simply
because it is not linked to.  There have been several high profile "finds"
of "hidden" files ranging from obituaries for people who were not dead to
sensitive internal documents.  As a rule, don't put anything on a web server
unless you're willing to let people see it.

--
Mosh Teitelbaum
evoch, LLC
Tel: (301) 942-5378
Fax: (301) 933-3651
Email: [EMAIL PROTECTED]
WWW: http://www.evoch.com/

-----Original Message-----
From: Mark W. Breneman [mailto:[EMAIL PROTECTED]
Sent: Wednesday, October 08, 2003 12:42 PM
To: CF-Talk
Subject: OT:Bots / spiders finding unlinked pages... How?

One of our clients' IS department just got NetTracker/6.0 Enterprise and
has set it loose on the site.  It has found several pages that are not
linked from any where.  I do not have directory browsing turned on and I
know these pages are not linked from any page..

How is it possible that it found these unlinked pages?

Can other Bots / spiders also find unlinked pages?

Thanks

Mark W. Breneman
-Cold Fusion Developer
-Network Administrator
  Vivid Media
  [EMAIL PROTECTED]
  www.vividmedia.com
  608.270.9770


[Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]

Reply via email to