Author: Kevin
Email: [EMAIL PROTECTED]
Message:
Alex,
Thank you for the information. I do have one concern, with my first question. We would
only want to index Handheld/PDA web sites. These sites fortunately have either one of
2 meta tags:
meta name="PalmComputingPlatform" content="true"
META
Author: Alexander Barkov
Email: [EMAIL PROTECTED]
Message:
> 1.) Is it possible to ONLY index sites that have a specific meta tag, such as
>
> I would assume this can be done with some type of filter?
It supports robot exclusions, so pages with
WILL NOT
Author: Kevin
Email: [EMAIL PROTECTED]
Message:
Ok, I have a few questions about your program: (I am assuming you can crawl outside
your domain to external sites.)
1.) Is it possible to ONLY index sites that have a specific meta tag, such as
I would assume this can be done with some type of fi
