hi all
I have a little question for you
I want index sites hosted freely, generaly the url is something like
this
www.xoom.com/yourname/
Why in the database the site is www.xoom.com and not
www.xoom.com/yourname/.
Does it can be a problem for the option follow and followoutside.
In my case sometimes i find urls from site I don't index; the first
part of the
url is allways a part of url I ask to index before.
example
I want to index www.xoom.com/yourname/
I can find sometimes an url like www.xoom.com/anothername/
I have a config file with option
follow yes
followoutside no
when I index a site I do
server www.foo.com/
Disallow .*
Allow www.foo.com/
