Thanks Paul,
problem solved!
>>>
yield scrapy.Request(full_url, callback=self.parse, meta={'dont_cache':
True},)
<<<
Op zondag 20 maart 2016 23:17:38 UTC+1 schreef Paul Tremberth:
>
> Hi Markus,
> Assuming you have HTTPCACHE_ENABLED set to True, (thus activating caching,
> which is not on by default,)
> you can set "dont_cache" to True in Request's meta dict to not cache some
> http pages
> See
>
> http://doc.scrapy.org/en/latest/topics/downloader-middleware.html?#module-scrapy.downloadermiddlewares.httpcache
>
> http://doc.scrapy.org/en/latest/topics/request-response.html?highlight=dont_cache#request-meta-special-keys
>
> Hope this helps
>
> Paul.
> Hi,
>
> is there a way that I can make Scrapy cache only certain pages? Let's say
> I do not want to cache index pages, but only details pages (pages that
> won't change), is that possible? If yes, how?
>
> Thanks,
>
> Markus
>
> --
> You received this message because you are subscribed to the Google Groups
> "scrapy-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected] <javascript:>.
> To post to this group, send email to [email protected]
> <javascript:>.
> Visit this group at https://groups.google.com/group/scrapy-users.
> For more options, visit https://groups.google.com/d/optout.
>
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
