On 2022-09-26, Stefan Ram <r...@zedat.fu-berlin.de> wrote: > So, I wanted to try to download all pages in parallel with > processes to avoid any GIL effect, while I don't understand > what the GIL actuall is. But processes didn't work here, so > I tried threads. This worked and now the total run time is > down to about 50 seconds.
Downloading things from the network is *extremely* I/O-bound. So, as you have discovered, the GIL is going to make essentially no difference whatsoever. -- https://mail.python.org/mailman/listinfo/python-list