It looks to me as if autoindexing is not turned on in Apache. Htdig
follows links, it doesn't just look at files in folders. Links either
need to be provided by the website itself (e.g., via an index page
(which it didn't seem to find) or by using autoindexing, which is
fairly straightforward to turn on in Apache.
On Oct 15, 2004, at 10:52 AM, Lahiri, Pallab (Cognizant) wrote:
I'm newbie to htdig. I would like the be able to just specify a
directory and have it recurse through looking
at every valid file type and index it.
I'm trying to dig local files using a start_url and local_url.
relevant attrbs. in my htdig.conf are :
start_url: http://10.xx.xx.xx/
local_urls_only: true
local_urls: http://10.xx.xx.xx/=/opt/nwa/pallab/
local_user_urls: http://10.xx.xx.xx/=/opt/nwa/pallab/
limit_urls_to: ${start_url} /opt/nwa/pallab/
When I do
# ./htdig -vvv
1:1:http://10.xx.xx.xx/
New server: 10.xx.xx.xx, 80
Trying local files
tried local file /opt/nwa/pallab/robots.txt
pushed
pick: 10.xx.xx.xx, # servers = 1
0:1:0:http://10.xx.xx.xx/: Trying local files
tried local file /opt/nwa/pallab/index.html
not found
pick: 10.xx.xx.xx, 36.# servers = 1
Please help.
Thanks,
pallab
This e-mail and any files transmitted with it are for the sole use of
the intended recipient(s) and may contain confidential and privileged
information.
If you are not the intended recipient, please contact the sender by
reply e-mail and destroy all copies of the original message.
Any unauthorised review, use, disclosure, dissemination, forwarding,
printing or copying of this email or any action taken in reliance on
this e-mail is strictly
prohibited and may be unlawful.
Visit us at http://www.cognizant.com
-------------------------------------------------------
This SF.net email is sponsored by: IT Product Guide on
ITManagersJournal
Use IT products in your business? Tell us what you think of them. Give
us
Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out
more
http://productguide.itmanagersjournal.com/guidepromo.tmpl
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
Tim Cleary
Manager
Dean & Company
(703) 760-4375
[EMAIL PROTECTED]
-------------------------------------------------------
This SF.net email is sponsored by: IT Product Guide on ITManagersJournal
Use IT products in your business? Tell us what you think of them. Give us
Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more
http://productguide.itmanagersjournal.com/guidepromo.tmpl
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
