Let's say I have 50 items in outgoing to fetch, and 10 minutes of
modem time to do it.
I would like wwwoffle to just first fetch exactly those items, and
only after that, start getting images contained, if time remains.
I would rather have 50 pages without images, than just 10 with images,
as only a few pages perk my interest so I want to see them in full.
Yes, there are the depth=0 options, but I'm just talking about
priorities here. If I remain on the line, I'd like the images too --
why not -- my phone bill is measured in 10 minute chunks, not by bytes
downloaded.
Anyway, this just points to an important TODO issue: some way of
controlling the order of items fetched, beyond the mere luck of the
Unix filesystem or whatever.
Prioritizing all throughout the fetch? Not necessarily, but at least
allowing working on an initial start list of fetch items.
Of course any new requests coming in from the browser while online
should get worked on right away too.
Of course any new behaviour should be made a configuration option.
OK, I'll try this first
wwwoffle-ls outgoing|awk '{print $NF}'> tmp
rm /var/cache/wwwoffle/outgoing/*
xargs wwwoffle -g < tmp
wwwoffle -fetch
