Re: [Talk-us] Changes for USA data on Geofabrik Download Server

2020-02-22 Thread Martijn van Exel
Fantastic news! Thanks for the update, Frederik.
-- 
  Martijn van Exel
  m...@rtijn.org

On Sat, Feb 22, 2020, at 04:06, Frederik Ramm wrote:
> Dear US OSMers,
> 
> for historical reasons, the layout of data for the USA on the Geofabrik
> download server has always been a bit peculiar: There wasn't a file for
> "all of the US" - there was a file for North America (including Canada
> and Mexico), and then there were files for the "Census Regions" (US
> Midwest, US Norhteast and so on, and for individual states.
> 
> (The concrete historical reason is that there used to be a time when due
> to TIGER imports the US extract would have been about 95% of the North
> America file anyway, and not much would be gained by clipping Canada.
> And Mexico was initially not even part of North America on the download
> server, due to my own lack of geographic competence.)
> 
> I'm in the process of straightening that out, so that there will be the
> standard structure (one file for North America, below that a file for
> USA and its neighbours, and below that the different states) in the future.
> 
> In detail, this will mean the following changes:
> 
> (a) for download links (pbf, bz2, diff directories etc)
> 
> * North America remains unchanged.
> * US states (and Norcal/Socal) remain unchanged.
> * new http://download.geofabrik.de/north-america/us-latest.osm.pbf and
> ancillary files
> * the five census regions (Midwest, Northeast, Pacific, South, West)
> will be demoted by one directory from currently
> /north-america/us-midwest-latest.osm.pbf to
> /north-america/us/us-midwest-latest.osm.pbf - but I will set up
> redirects so that the old locations still work for a while.
> 
> (b) for HTML pages
> 
> * http://download.geofabrik.de/north-america.html will drop the US
> states and Census regions and instead list just three sub regions
> (Canada, USA, Mexico)
> * new http://download.geofabrik.de/north-america/us.html to list US
> states and census regions.
> 
> I will make these changes incrementally over the coming days. On the
> whole, this should cause minimum disruption; the only thing that will
> stop working is when someone has written instructions somewhere that go
> like "open the North America download page and select Iowa from the
> list" but I hope that people would then be able to guess that maybe they
> need to click on USA first.
> 
> If this has any unintended consequences let me know and we'll find a way
> to fix it.
> 
> Bye
> Frederik
> 
> PS: Just like with other countries, the "all of US" file is cut out of
> its parent continent file (North America) which means that those bits of
> the USA that lie outside North America will not be included. This mainly
> affects Puerto Rico. I'll be making a standalone Puerto Rico file
> available in the Central America section.
> 
> -- 
> Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"
> 
> ___
> Talk-us mailing list
> Talk-us@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-us
>

___
Talk-us mailing list
Talk-us@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-us


[Talk-us] Changes for USA data on Geofabrik Download Server

2020-02-22 Thread Frederik Ramm
Dear US OSMers,

for historical reasons, the layout of data for the USA on the Geofabrik
download server has always been a bit peculiar: There wasn't a file for
"all of the US" - there was a file for North America (including Canada
and Mexico), and then there were files for the "Census Regions" (US
Midwest, US Norhteast and so on, and for individual states.

(The concrete historical reason is that there used to be a time when due
to TIGER imports the US extract would have been about 95% of the North
America file anyway, and not much would be gained by clipping Canada.
And Mexico was initially not even part of North America on the download
server, due to my own lack of geographic competence.)

I'm in the process of straightening that out, so that there will be the
standard structure (one file for North America, below that a file for
USA and its neighbours, and below that the different states) in the future.

In detail, this will mean the following changes:

(a) for download links (pbf, bz2, diff directories etc)

* North America remains unchanged.
* US states (and Norcal/Socal) remain unchanged.
* new http://download.geofabrik.de/north-america/us-latest.osm.pbf and
ancillary files
* the five census regions (Midwest, Northeast, Pacific, South, West)
will be demoted by one directory from currently
/north-america/us-midwest-latest.osm.pbf to
/north-america/us/us-midwest-latest.osm.pbf - but I will set up
redirects so that the old locations still work for a while.

(b) for HTML pages

* http://download.geofabrik.de/north-america.html will drop the US
states and Census regions and instead list just three sub regions
(Canada, USA, Mexico)
* new http://download.geofabrik.de/north-america/us.html to list US
states and census regions.

I will make these changes incrementally over the coming days. On the
whole, this should cause minimum disruption; the only thing that will
stop working is when someone has written instructions somewhere that go
like "open the North America download page and select Iowa from the
list" but I hope that people would then be able to guess that maybe they
need to click on USA first.

If this has any unintended consequences let me know and we'll find a way
to fix it.

Bye
Frederik

PS: Just like with other countries, the "all of US" file is cut out of
its parent continent file (North America) which means that those bits of
the USA that lie outside North America will not be included. This mainly
affects Puerto Rico. I'll be making a standalone Puerto Rico file
available in the Central America section.

-- 
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
Talk-us mailing list
Talk-us@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-us