I'm using urllib lib in a fairly intensive spider/load test application.  After some time, though, my script just seems to hang, and I've traced it to waiting on the read() call on the file handle returned from urlopen().  It doesn't matter whether I attempt to read in small chunks, or reall all bytes.  Although the program was designed multithreaded, I also built a single-thread version to see if it made a difference - it did not.
 
Anyone have a similar experience with urllib?  Is urllib2 better?
 
Thanks,
    Rick
 

Reply via email to