Re: [Talk-GB] Hobbyist OSM Data Server?
For around £25 a month I get quite a decent server but even still, I am constrained to only offering data for selected areas of the UK (much of England away from the urban areas, and all of Wales). What sort of spec machine are we taking about for a GB extract? The main problem is less the osm2pgsql extraction (which can be run in slim mode to conserve memory) and more the speed of accessing the postgis database to grab the data. My current machine (Bytemark VM) has 1GB memory, 20GB disc space, 1 core. See: http://www.bytemark.co.uk/hosting/virtual_machines With caching the generated GeoJSON data and a cron job to re-render tiles, this can (only just!) cope with an extract covering part of England and all of Wales, see http://www.free-map.org.uk/0.6/about.html#village Not sure, without looking up, what percentage of the data is used by Freemap, but given London, Birmingham etc are missed out, as well as the whole of Scotland and most of the Midlands and East Anglia, I'm guessing abput 25% or so. I can check later though. Hello Andy, To follow up on this: the total size of all the PBF files I use to populate the Freemap database is 294MB, compared to 524MB for the complete OSM extracts for the whole of England and Wales. So a machine with perhaps 2-3x the RAM and disc space (for caching) of the above might do it for the UK. Thanks, Nick ___ Talk-GB mailing list Talk-GB@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-gb
Re: [Talk-GB] Hobbyist OSM Data Server?
For around £25 a month I get quite a decent server but even still, I am constrained to only offering data for selected areas of the UK (much of England away from the urban areas, and all of Wales). What sort of spec machine are we taking about for a GB extract? The main problem is less the osm2pgsql extraction (which can be run in slim mode to conserve memory) and more the speed of accessing the postgis database to grab the data. My current machine (Bytemark VM) has 1GB memory, 20GB disc space, 1 core. See: http://www.bytemark.co.uk/hosting/virtual_machines With caching the generated GeoJSON data and a cron job to re-render tiles, this can (only just!) cope with an extract covering part of England and all of Wales, see http://www.free-map.org.uk/0.6/about.html#village Not sure, without looking up, what percentage of the data is used by Freemap, but given London, Birmingham etc are missed out, as well as the whole of Scotland and most of the Midlands and East Anglia, I'm guessing abput 25% or so. I can check later though. Nick ___ Talk-GB mailing list Talk-GB@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-gb
Re: [Talk-GB] Hobbyist OSM Data Server?
Nick Whitelegg wrote: What sort of spec machine are we taking about for a GB extract? The main problem is less the osm2pgsql extraction (which can be run in slim mode to conserve memory) and more the speed of accessing the postgis database to grab the data. Very much 'work in progress' ... a new initial extract is running as we speak :) http://lsces.co.uk/wiki/OSM+Data+Mirror+on+SUSE13.1 I have OSRM running on that machine http://osrm.rdm2.co.uk/main.html and am planning to drop another machine over to Sheffield to do the rendering for my own tile set, but I've had this all running nicely on a local machine, only restricted by 'BT Broadband' so once it's all on a nice fast pipe everything should be a bit more accessible. While the crib sheets are freely accessible, they are mainly intended as my own guide to keeping everything running, and rebuilding machines if required. Any corrections or improvements are MOST welcome! -- Lester Caine - G8HFL - Contact - http://lsces.co.uk/wiki/?page=contact L.S.Caine Electronic Services - http://lsces.co.uk EnquirySolve - http://enquirysolve.com/ Model Engineers Digital Workshop - http://medw.co.uk Rainbow Digital Media - http://rainbowdigitalmedia.co.uk ___ Talk-GB mailing list Talk-GB@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-gb