Re: robots.txt 404 errors are not ignored, even though I put it in my settings file

2014-10-21 Thread Sabine Maennel
Thank you very much for your help Collin! Am Dienstag, 21. Oktober 2014 03:29:38 UTC+2 schrieb Collin Anderson: > > Hi Sabine, > > IGNORABLE_404_URLS = ( > re.compile(r'^/apple-touch-icon.*\.png$'), > re.compile(r'^/favicon\.ico$'), > re.compile(r'^/robots\.txt$'), > ) > remove the sla

Re: robots.txt 404 errors are not ignored, even though I put it in my settings file

2014-10-20 Thread Collin Anderson
Hi Sabine, IGNORABLE_404_URLS = ( re.compile(r'^/apple-touch-icon.*\.png$'), re.compile(r'^/favicon\.ico$'), re.compile(r'^/robots\.txt$'), ) remove the slash at the beginning: IGNORABLE_404_URLS = ( re.compile(r'^apple-touch-icon.*\.png$'), re.compile(r'^favicon\.ico$'), r

robots.txt 404 errors are not ignored, even though I put it in my settings file

2014-10-20 Thread Sabine Maennel
*Please can anybody help me with 404 errors?* *I put this in my settingsfile: * import re IGNORABLE_404_URLS = ( re.compile(r'^/apple-touch-icon.*\.png$'), re.compile(r'^/favicon\.ico$'), re.compile(r'^/robots\.txt$'), ) *but I still get 404 errors reported for robots.txt: What am