On 5/23/2019 2:39 PM, Bob van der Poel wrote:
I've got a short script that loops though a number of files and processes
them one at a time. I had a bit of time today and figured I'd rewrite the
script to process the files 4 at a time by using 4 different instances of
python.

As others have said, you give no evidence that you are doing that.

The python test suite runner has an argument to use multiple cores. For me, 'python -m test -j0' runs about 6 times faster than 'python -m test'. The speedup would be faster except than there is one test file that takes over two minutes, and may run at least a minute after all other processes have quit. (I have suggested than long running files be split to even out the load, but that has not gained favor yet.) For this use, more CPUs *does* equal more speed.

--
Terry Jan Reedy

--
https://mail.python.org/mailman/listinfo/python-list

Reply via email to