I just wanted to make sure my understanding is correct:
Suppose I am doing a recursive fetch with a high depth, and many of
those pages are interlinked or contain, e.g., references to the same
graphics files (logos etc.). Will wwwoffle be so smart to skip the
pages it already downloaded in this batch, or will it simply continue
following links until the depth is exceeded?
My assumption is that wwwoffle is smart enough not to fetch the same
file more than once during a single run.
On a related note[*]: Is there any defined relation between the order
of the output of `wwwoffle-ls outgoing' and the order in which pages
are fetched?
Thanks in advance for any light you may shed,
Albert.
[*] The relatedness stemming from the fact that the same graphics file
URL kept appearing and vanishing again from the top position of
the list of outgoing URLs, i.e., `wwwoffle-ls outgoing | head -1'.
