Re: robots.txt 404 errors are not ignored, even though I put it in my settings file

2014-10-21 Thread Sabine Maennel
Thank you very much for your help Collin! Am Dienstag, 21. Oktober 2014 03:29:38 UTC+2 schrieb Collin Anderson: > > Hi Sabine, > > IGNORABLE_404_URLS = ( > re.compile(r'^/apple-touch-icon.*\.png$'), > re.compile(r'^/favicon\.ico$'), > re.compile(r'^/robots\.txt$'), > ) > remove the sla

Re: robots.txt 404 errors are not ignored, even though I put it in my settings file

2014-10-20 Thread Collin Anderson
Hi Sabine, IGNORABLE_404_URLS = ( re.compile(r'^/apple-touch-icon.*\.png$'), re.compile(r'^/favicon\.ico$'), re.compile(r'^/robots\.txt$'), ) remove the slash at the beginning: IGNORABLE_404_URLS = ( re.compile(r'^apple-touch-icon.*\.png$'), re.compile(r'^favicon\.ico$'), r

robots.txt 404 errors are not ignored, even though I put it in my settings file

2014-10-20 Thread Sabine Maennel
*Please can anybody help me with 404 errors?* *I put this in my settingsfile: * import re IGNORABLE_404_URLS = ( re.compile(r'^/apple-touch-icon.*\.png$'), re.compile(r'^/favicon\.ico$'), re.compile(r'^/robots\.txt$'), ) *but I still get 404 errors

django 1.5 robots.txt

2013-05-28 Thread Wade Williams
http://stackoverflow.com/questions/16802176/django-1-5-robots-txt -- You received this message because you are subscribed to the Google Groups "Django users" group. To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscr...@googlegroups.com. To p

Re: Help with robots.txt

2013-05-24 Thread frocco
Thank you On Friday, May 24, 2013 9:16:35 AM UTC-4, Mike Dewhirst wrote: > > On 24/05/2013 10:04pm, frocco wrote: > > Hello, > > > > Can someone give me an example of configuring robots.txt? > > > > I want to block the admin site. > > > > and

Re: Help with robots.txt

2013-05-24 Thread Mike Dewhirst
On 24/05/2013 10:04pm, frocco wrote: Hello, Can someone give me an example of configuring robots.txt? I want to block the admin site. and anything else? I needed this info recently and googled robots.txt. This was the second item ... http://www.robotstxt.org/robotstxt.html -- You

Help with robots.txt

2013-05-24 Thread frocco
Hello, Can someone give me an example of configuring robots.txt? I want to block the admin site. and anything else? -- You received this message because you are subscribed to the Google Groups "Django users" group. To unsubscribe from this group and stop receiving emails from i

Re: How to serve robots.txt for Django?

2008-02-15 Thread Derek Hoy
It's not as efficient as the methods already described, but you can do this in Django if it's easier. Just set up a redirect (django.contrib.redirects) for robots.txt pointing to a flatpage (django.contrib.flatpages). for example, /robots-t

Re: How to serve robots.txt for Django?

2008-02-14 Thread Dave Dash
RewriteEngine On RewriteRule ^robots\.txt$ /static/robots.txt [L] I think that should work if you have a web served folder of /static I forget if DH supports Alias because Alias robots.txt /path/to/robots.txt will also work. On Feb 14, 1:24 pm, "[EMAIL PROTECTED]" <[EMAIL PROT

Re: How to serve robots.txt for Django?

2008-02-14 Thread [EMAIL PROTECTED]
his somewhere, does anyone know the URL? > > On Feb 14, 2:35 pm, Alex Koshelev <[EMAIL PROTECTED]> wrote: > > > I use something like this: > > > (r'^robots.txt$', 'django.views.static.serve', { 'path' : "/ > > txt/robot

Re: How to serve robots.txt for Django?

2008-02-14 Thread [EMAIL PROTECTED]
doing it by directory), there is a guide to doing this somewhere, does anyone know the URL? On Feb 14, 2:35 pm, Alex Koshelev <[EMAIL PROTECTED]> wrote: > I use something like this: > >   (r'^robots.txt$',         'django.views.static.serve', { 'path

Re: How to serve robots.txt for Django?

2008-02-14 Thread Alex Koshelev
I use something like this: (r'^robots.txt$', 'django.views.static.serve', { 'path' : "/ txt/robots.txt", 'document_root': settings.MEDIA_ROOT, 'show_indexes': False } ), On Feb 14, 10:53 pm, "[EMAIL PROTECTED]&qu

Re: How to serve robots.txt for Django?

2008-02-14 Thread [EMAIL PROTECTED]
On Feb 14, 1:53 pm, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: > I built a Django site for my blog and want to serve a robots.txt file > for it. But I can't figure out how to go about doing this since it's a > static file. > > Here is what I have in m

How to serve robots.txt for Django?

2008-02-14 Thread [EMAIL PROTECTED]
I built a Django site for my blog and want to serve a robots.txt file for it. But I can't figure out how to go about doing this since it's a static file. Here is what I have in my urls: from patrickbeeson.views import robots ... (r'^robots.txt$', robots), >From the v

Re: robots.txt?

2007-06-06 Thread Rob Hudson
Great. Thanks for all the help everyone. -Rob On Jun 5, 9:56 am, "Joseph Heck" <[EMAIL PROTECTED]> wrote: > Yes, you'd set in something like: > > >SetHandler None > > > (which is exactly what I've done) > > -joe > --~--~-~--~~~---~--~~ You received this

Re: robots.txt?

2007-06-05 Thread Joseph Heck
nother solution? > > I have my static media folder set in Apache with: > > > SetHandler None > > > Can you do the same for single files? > > Thanks, > Rob > > On Jun 4, 8:12 am, KpoH <[EMAIL PROTECTED]> wro

Re: robots.txt?

2007-06-05 Thread orestis
You can always put a urlconf that will match "robots.txt" and return a simple http response... On Jun 5, 6:24 pm, "Deryck Hodge" <[EMAIL PROTECTED]> wrote: > On 6/5/07, Rob Hudson <[EMAIL PROTECTED]> wrote: > > > > > SetHandler None

Re: robots.txt?

2007-06-05 Thread Deryck Hodge
On 6/5/07, Rob Hudson <[EMAIL PROTECTED]> wrote: > > SetHandler None > > > Can you do the same for single files? > You can, and probably would be better than the mod_rewrite overhead in this case. Cheers, deryck --~--~-~--~~~---~--~~ You received this m

Re: robots.txt?

2007-06-05 Thread Rob Hudson
ROTECTED]> wrote: > You can "mod_rewrite" /robots.txt to /static/robots.txt for example > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send e

robots.txt?

2007-06-04 Thread Rob Hudson
What do most people do for a robots.txt file in Django? I set up my website to email me errors and 404s, and I often get a 404 email for the robots.txt. Thanks, Rob --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups

Re: robots.txt?

2007-06-04 Thread Artiom Diomin
I mean /static/ is your static files location (images, CSS, JS, etc...) KpoH пишет: > You can "mod_rewrite" /robots.txt to /static/robots.txt for example > > Rob Hudson пишет: > >> What do most people do for a robots.txt file in Django? >> >> I set u

Re: robots.txt?

2007-06-04 Thread KpoH
You can "mod_rewrite" /robots.txt to /static/robots.txt for example Rob Hudson пишет: > What do most people do for a robots.txt file in Django? > > I set up my website to email me errors and 404s, and I often get a 404 > email for the robots.txt. > > Thanks, &