I'm using urllib2 to pull pages for a custom version of a web proxy and am having issues with 404 errors. Urllib2 does a great job of letting me know that a 404 happened with the following code.
import urllib2 url = 'http://cnn.com/asfsdafsadfasdf/' try: page = urllib2.urlopen( url ) except urllib2.URLError, e: print e returns: HTTP Error 404: Not Found However, upon finding the error I would like to load the domain's custom 404 message instead of returning my own. I've checked the error information and searched for some sort of web standard but cannot find anything. Does anyone know if it is possible to retrieve a url or the page information for the custom 404 page like this? http://cnn.com/asdfasdfadsf -- http://mail.python.org/mailman/listinfo/python-list
