It needs some proper tests plus docs. Hopefully I'll get time to do so early next month. I would like to check that code to cycle through a pool of tokens it seems like a proper use case.
On Wednesday, August 19, 2015 at 5:03:43 PM UTC+2, Josh Levy-Kramer wrote: > > Wow this looks great. I wish I found this a month ago! What barriers are > there in getting this into the main scrapy code base? > > Additionally, I would say a common case with OAuth is that the user has > access to a pool of tokens to use and cycle through them because APIs > usually restrict the number of call that can be made per token. I have > written code that deals with this usecase (although not very gracefully). > Would you be interested in incorporating this logic into the OAuth > middleware? > > On Wednesday, August 19, 2015 at 3:23:37 PM UTC+1, Juan Riaza wrote: >> >> Hi Josh, >> >> Nice to hear about that middleware. I worked some time ago on a draft >> implementation here: >> https://github.com/juanriaza/scrapy/commits/oauth-draft It would be >> awesome to check your middleware and give this a final push. >> >> On Wednesday, August 19, 2015 at 3:42:43 PM UTC+2, Josh Levy-Kramer wrote: >>> >>> Hi All, >>> >>> I have written an OAuth middleware module so Scrapy can access website >>> or APIs which require OAuth authentication. Parts of the module are quite >>> specific with the sites I have been working with (namely Twitter). Would >>> anyone be interested in such a module? My knowledge of the OAuth protocol >>> is rather limited and I would be interested in generalising the module for >>> other websites that use the OAuth protocol. Does anyone have the expertise >>> to this? >>> >> -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
