I need help with Cookie management for authentication for a php app called Zencart.
On sending a GET req for the login page, the server sends a Set-Cookie header in the response. While sending a POST request with authentication credentials, I include the cookie sent by the server. The server in response sends another Set-Cookie and also there is a redirect to the login page. For a successful login, the server expects the second cookie to be sent in the header of the redirected GET request, however scrapy's cookie middleware sends the first cookie and so I cannot login. I have confirmed with a proxy (charles) this observation is true. I tried overloading scrapy's Cookie middleware. But I only have access to the request object and have lost the object corresponding to the referer. How can I access the object corresponding to the referrer of the request? Please let me know if you need more information for helping me out? Thanks! -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
