I’ve not checked in the v3+ version but there used to be a preload page generator that batch retrieved stuff from the API. Then pass the preloaded page object on to the parallel processing part.
On Mon, Mar 27, 2023 at 3:58 PM Roy Smith <r...@panix.com> wrote: > I need to issue a bunch of Page.get() requests in parallel. My > understanding is that pywikibot uses the requests library which is > incompatible with async_io, so that's out. So what do people use? > Threading <https://docs.python.org/3.9/library/threading.html>? Or, I > see there's an async_io friendly requests port > <https://github.com/rdbhost/yieldfromRequests>. Is there a way to make > pywikibot use that? > > _______________________________________________ > pywikibot mailing list -- pywikibot@lists.wikimedia.org > Public archives at > https://lists.wikimedia.org/hyperkitty/list/pywikibot@lists.wikimedia.org/message/QDE2AHAX4O6G5YTHLGGKWK5LLKKRYUST/ > To unsubscribe send an email to pywikibot-le...@lists.wikimedia.org >
_______________________________________________ pywikibot mailing list -- pywikibot@lists.wikimedia.org Public archives at https://lists.wikimedia.org/hyperkitty/list/pywikibot@lists.wikimedia.org/message/AKLSJR5CSLB2RQMT5N2DZ7DYENW4JIXZ/ To unsubscribe send an email to pywikibot-le...@lists.wikimedia.org
