I'm using urllib
lib in a fairly intensive spider/load test application. After some time,
though, my script just seems to hang, and I've traced it to waiting on the
read() call on the file handle returned from urlopen(). It doesn't matter
whether I attempt to read in small chunks, or reall all bytes. Although
the program was designed multithreaded, I also built a single-thread version to
see if it made a difference - it did not.
Anyone have a
similar experience with urllib? Is urllib2 better?
Thanks,
Rick