Re-direct in Nutch 1.0 does not seem to work.. If I point to a url that is "re-directed to" (the result of a re-direction, everything works great, if I point to the page that is re-directing me to the working one, I get a corrupted index. Can nutch handle re-direction and if so what magic is required?
ray
