Hi all, I'm trying to scrape a site. Spider successfully logins and gets access to profile page. However after following to the page with data to extract it gets redirected by IIS server with status 302 to the landing page. When I follow these steps with browser I do get 200 and see page with data.
I worked a lot to make requests identical (using Firebug and scrapy tuning), now headers and cookies are almost identical, IP should be same also (spider on vagrant on the same machine as browser) Any Ideas why do I get redirected by server? Thanks! Evgeny -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
