Wow this looks great. I wish I found this a month ago! What barriers are there in getting this into the main scrapy code base?
Additionally, I would say a common case with OAuth is that the user has access to a pool of tokens to use and cycle through them because APIs usually restrict the number of call that can be made per token. I have written code that deals with this usecase (although not very gracefully). Would you be interested in incorporating this logic into the OAuth middleware? On Wednesday, August 19, 2015 at 3:23:37 PM UTC+1, Juan Riaza wrote: > > Hi Josh, > > Nice to hear about that middleware. I worked some time ago on a draft > implementation here: > https://github.com/juanriaza/scrapy/commits/oauth-draft It would be > awesome to check your middleware and give this a final push. > > On Wednesday, August 19, 2015 at 3:42:43 PM UTC+2, Josh Levy-Kramer wrote: >> >> Hi All, >> >> I have written an OAuth middleware module so Scrapy can access website or >> APIs which require OAuth authentication. Parts of the module are quite >> specific with the sites I have been working with (namely Twitter). Would >> anyone be interested in such a module? My knowledge of the OAuth protocol >> is rather limited and I would be interested in generalising the module for >> other websites that use the OAuth protocol. Does anyone have the expertise >> to this? >> > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
