Re: [Talk-GB] Hobbyist OSM Data Server?

2013-12-08 Thread Nick Whitelegg


 For around £25 a month I get quite a decent server but even still, I
 am constrained to only offering data for selected areas of the UK
 (much of England away from the urban areas, and all of Wales).

What sort of spec machine are we taking about for a GB extract?

The main problem is less the osm2pgsql extraction (which can be run in slim 
mode to conserve memory) and more the speed of accessing the postgis database 
to grab the data.

My current machine (Bytemark VM) has 1GB memory, 20GB disc space, 1 core.

See: http://www.bytemark.co.uk/hosting/virtual_machines

With caching the generated GeoJSON data and a cron job to re-render tiles, 
this can (only just!) cope with an extract covering part of England and all of 
Wales, see
http://www.free-map.org.uk/0.6/about.html#village

Not sure, without looking up, what percentage of the data is used by Freemap, 
but given London, Birmingham etc are missed out, as well as the whole of 
Scotland and most of the Midlands and East Anglia, I'm guessing abput 25% or 
so. I can check later though.

Hello Andy,

To follow up on this: the total size of all the PBF files I use to populate the 
Freemap database is 294MB, compared to 524MB for the complete OSM extracts for 
the whole of England and Wales. So a machine with perhaps 2-3x the RAM and disc 
space (for caching) of the above might do it for the UK.

Thanks,
Nick

 ___
Talk-GB mailing list
Talk-GB@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-gb


Re: [Talk-GB] Hobbyist OSM Data Server?

2013-12-06 Thread Nick Whitelegg
 For around £25 a month I get quite a decent server but even still, I
 am constrained to only offering data for selected areas of the UK
 (much of England away from the urban areas, and all of Wales).

What sort of spec machine are we taking about for a GB extract?

The main problem is less the osm2pgsql extraction (which can be run in slim 
mode to conserve memory) and more the speed of accessing the postgis database 
to grab the data.

My current machine (Bytemark VM) has 1GB memory, 20GB disc space, 1 core.

See: http://www.bytemark.co.uk/hosting/virtual_machines

With caching the generated GeoJSON data and a cron job to re-render tiles, this 
can (only just!) cope with an extract covering part of England and all of 
Wales, see

http://www.free-map.org.uk/0.6/about.html#village

Not sure, without looking up, what percentage of the data is used by Freemap, 
but given London, Birmingham etc are missed out, as well as the whole of 
Scotland and most of the Midlands and East Anglia, I'm guessing abput 25% or 
so. I can check later though.

Nick
___
Talk-GB mailing list
Talk-GB@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-gb


Re: [Talk-GB] Hobbyist OSM Data Server?

2013-12-06 Thread Lester Caine

Nick Whitelegg wrote:

 What sort of spec machine are we taking about for a GB extract?

The main problem is less the osm2pgsql extraction (which can be run in slim mode
to conserve memory) and more the speed of accessing the postgis database to grab
the data.


Very much 'work in progress' ... a new initial extract is running as we speak :)
http://lsces.co.uk/wiki/OSM+Data+Mirror+on+SUSE13.1

I have OSRM running on that machine http://osrm.rdm2.co.uk/main.html and am 
planning to drop another machine over to Sheffield to do the rendering for my 
own tile set, but I've had this all running nicely on a local machine, only 
restricted by 'BT Broadband' so once it's all on a nice fast pipe everything 
should be a bit more accessible.


While the crib sheets are freely accessible, they are mainly intended as my own 
guide to keeping everything running, and rebuilding machines if required. Any 
corrections or improvements are MOST welcome!


--
Lester Caine - G8HFL
-
Contact - http://lsces.co.uk/wiki/?page=contact
L.S.Caine Electronic Services - http://lsces.co.uk
EnquirySolve - http://enquirysolve.com/
Model Engineers Digital Workshop - http://medw.co.uk
Rainbow Digital Media - http://rainbowdigitalmedia.co.uk

___
Talk-GB mailing list
Talk-GB@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-gb