have you tried adding a non-existent downloader middleware in your settings.py and checked if it fails? maybe you're adding it to the wrong settings.py? otherwise, can you share your settings.py?
On Monday, December 5, 2016 at 12:23:13 PM UTC+1, Ramzay Ak wrote: > > crawler, i created *my_project/middlewares.py which contain your > *TorMiddleware > class and add *DOWNLOADER_MIDDLEWARES in my settings.py. But when i start > my scrapy i do not see **my_project.middlewares.TorMiddleware in list of > *Enabled > downloader middlewares. > > 2016-12-04 22:13:59 [scrapy] INFO: Enabled downloader middlewares: > ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', > 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', > 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', > 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', > 'scrapy.downloadermiddlewares.retry.RetryMiddleware', > 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', > 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', > 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', > 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', > 'scrapy.downloadermiddlewares.chunked.ChunkedTransferMiddleware', > 'scrapy.downloadermiddlewares.stats.DownloaderStats'] > > > понедельник, 18 июля 2011 г., 18:13:45 UTC+3 пользователь crawler написал: >> >> *This works:* >> >> class TorMiddleware(object): >> def process_request(self, request, spider): >> request.meta["proxy"] = "http://localhost:8118"; >> >> >> *DOWNLOADER_MIDDLEWARES = { 'my_project.middlewares.TorMiddleware': >> 740,} * >> > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
