On 9/27/2015 6:55 AM, Daniel Koć wrote:
Even if this is not 6 days long, it may still make sense to use
differential dumps for example.
I don't know how much additional resources we would need to create
them and how faster would it be to import the data, but after one big
import at - let's say - the beginning of a month (full copy) you just
update it with small "patches" (daily diffs) and you're done for some
time. Weekly diffs may be also of some use, but it needs some testing
to know, of course.
If this would cause disc space shortage, we could drop creating full
dumps weekly and make them only once a month.
This could make importing much easier for established services at the
cost of more trouble to start the new ones (they should probably wait
for next month to be in sync if we need to drop full weekly dumps),
but I think it's worth considering.
planet.osm.org has been providing weekly dumps and daily, hourly, and
minutely diffs of data for a few years.
_______________________________________________
talk mailing list
talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk
