> You have to build several arrays > which construct silos to fetch and parse from. You should have a "seen" > "dead" or "down", "fetch", "duplicate" and "completed" arrays (or however > Python keeps it straight).
Yes, that sounds like a good design. Bill