jkn, > I think a combination of hashing the URL,
I hope you're not thinking of saving the hash (into the "done" list) instead if the URL itself. While hash collisions do not happen often (especially not in a small list), you cannot rule them out. And when that happens that would mean you would be skipping downloads ... Regards, Rudy Wieser -- https://mail.python.org/mailman/listinfo/python-list
