Re: [OSM-talk] 'wget'ing largish portion of planetOSM
>> Mick, >> >> On 10/20/11 08:22, Mick wrote: >> > I've downloaded all of UK from nick.dev.openstreetmap.org and >> > extracted the bit I want, its a bit old (28 Oct 2009) but mayhap I >> > can update it without massive downloads. I've got most of the area >> > current to last week. >> >> It's your decision entirely of course but I utterly fail to >> understand why you use 2-year-old data and batter all available APIs >> with tons of requests when you can easily get CURRENT data for ALL OF >> THE UK from downloads.cloudmade.com or download.geofabrik.de, both >> linked from the planet page that has been pointed out to you. >> >I hadn't thought of UK as being Northern Europe, I looked in Western >Europe. I would tend to agree there. I would only think of the UK as being Northern Europe as opposed to Southern Europe: we're clearly nearer the western edge of Europe (Ireland and Portugal) than the northern edge (extreme northern Norway and Finland). I always think of Northern Europe as being Scandinavia and the Baltic States. Nick ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
On Thu, 20 Oct 2011 13:50:14 +0100 Lester Caine wrote: > Mick wrote: > > I hadn't thought of UK as being Northern Europe, I looked in Western > > Europe. > That's where they hid it ;) > I'd found the Isle of Man ... > That really threw me, I'd seen several references to England/UK being on that site. I guess oldtimers disease is catching up with me :( ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
Mick wrote: I hadn't thought of UK as being Northern Europe, I looked in Western Europe. That's where they hid it ;) I'd found the Isle of Man ... -- Lester Caine - G8HFL - Contact - http://lsces.co.uk/wiki/?page=contact L.S.Caine Electronic Services - http://lsces.co.uk EnquirySolve - http://enquirysolve.com/ Model Engineers Digital Workshop - http://medw.co.uk// Firebird - http://www.firebirdsql.org/index.php ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
On Thu, 20 Oct 2011 10:37:22 +0200 Frederik Ramm wrote: > Mick, > > On 10/20/11 08:22, Mick wrote: > > I've downloaded all of UK from nick.dev.openstreetmap.org and > > extracted the bit I want, its a bit old (28 Oct 2009) but mayhap I > > can update it without massive downloads. I've got most of the area > > current to last week. > > It's your decision entirely of course but I utterly fail to > understand why you use 2-year-old data and batter all available APIs > with tons of requests when you can easily get CURRENT data for ALL OF > THE UK from downloads.cloudmade.com or download.geofabrik.de, both > linked from the planet page that has been pointed out to you. > I hadn't thought of UK as being Northern Europe, I looked in Western Europe. Found england.shapefiles.zip and am downloading it now. I guess I was preoccupied with finding closer to just the area I wanted and not thinking straight. mick ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
Frederik Ramm wrote: >>> I've downloaded all of UK from nick.dev.openstreetmap.org and >>> extracted the bit I want, its a bit old (28 Oct 2009) but mayhap I can >>> update it without massive downloads. I've got most of the area current >>> to last week. >> >> It's your decision entirely of course but I utterly fail to understand why >> you >> use 2-year-old data and batter all available APIs with tons of requests when >> you >> can easily get CURRENT data for ALL OF THE UK from downloads.cloudmade.com or >> download.geofabrik.de, both linked from the planet page that has been pointed >> out to you. >I think the problem here is that nick is listed as 'UK' area on the extract >list, and people don't think to look at other options :) Yes I have to admit I haven't been giving these a lot of attention for a while - mostly because geofabrik provides the service, so my motivation to sort out any problems with these downloads (obviously something stopped working correctly in Oct 2009) has not been there. I'd echo with what others say and go with geofabrik. Frederik has offered to provide extracts of specific counties. Some are there already. I'll fix the wiki to encourage people to use geofabrik. Nick - ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
Hello Mick, See my reply to you about this. Nick -Mick wrote: - To: "talk@openstreetmap.org" From: Mick Date: 20/10/2011 04:49AM Subject: Re: [OSM-talk] 'wget'ing largish portion of planetOSM On Wed, 19 Oct 2011 22:58:28 -0400 Richard Weait wrote: > On Wed, Oct 19, 2011 at 10:51 PM, Mick wrote: > > I have been struggling to get a largish chunk of open street map > > covering an area from the Isles of Scilly in the south west to > > Bristol [ ... ] > > The Planet page points to a number of planet extracts. Will one of > the UK-like extracts work for you? > Sadly, no, the area is split between southwest, south, swales & oxford extracts with 1 to 5 mile gaps between. I have tried to fill the gaps using the export to xml feature of the online map but that requires a (for me at least) mind bending array of inconsistently sized bits. mick ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
Frederik Ramm wrote: I've downloaded all of UK from nick.dev.openstreetmap.org and extracted the bit I want, its a bit old (28 Oct 2009) but mayhap I can update it without massive downloads. I've got most of the area current to last week. It's your decision entirely of course but I utterly fail to understand why you use 2-year-old data and batter all available APIs with tons of requests when you can easily get CURRENT data for ALL OF THE UK from downloads.cloudmade.com or download.geofabrik.de, both linked from the planet page that has been pointed out to you. I think the problem here is that nick is listed as 'UK' area on the extract list, and people don't think to look at other options :) -- Lester Caine - G8HFL - Contact - http://lsces.co.uk/wiki/?page=contact L.S.Caine Electronic Services - http://lsces.co.uk EnquirySolve - http://enquirysolve.com/ Model Engineers Digital Workshop - http://medw.co.uk// Firebird - http://www.firebirdsql.org/index.php ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
This is the way to go. I download the UK from download.geofabrik.de once a week or so. Then use osmosis to divide the UK extract up into the smaller regions as required. In my case I use poly files (derived from the UK region boundary relations) to tell osmosis which regions I want. Mark S On 20/10/2011 04:01, Toby Murray wrote: If you are needing that much data I would strongly recommend starting off with an extract of the whole country and then trim out what you need using osmosis. Extract providers can be found here: http://wiki.openstreetmap.org/wiki/Planet#Country_and_area_extracts And osmosis docs on trimming an extract are here: http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage#Area_Filtering_Tasks Toby On Wed, Oct 19, 2011 at 9:51 PM, Mick wrote: I have been struggling to get a largish chunk of open street map covering an area from the Isles of Scilly in the south west to Bristol in the north east using commands like: wget -t 0 http://xapi.openstreetmap.org/api/xapi?map[bbox=-6.41,49.85,-1.68,51.56] -O souwest.osm but all I can get is an error - 'connection reset by peer' or 'timeout' I also tried: wget -t 0 http://www.overpass-api.de/api/xapi?relation[bbox=-6,49.8,-1.0,51.6][natural=*] -O souwest-relation-natural.osm but this required dozens of individual transaction to get results osmosis refused to read. am I biting off more than the server can chew or using the wrong procedure? could some kind soul point me in the right direction mick ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
Mick, On 10/20/11 08:22, Mick wrote: I've downloaded all of UK from nick.dev.openstreetmap.org and extracted the bit I want, its a bit old (28 Oct 2009) but mayhap I can update it without massive downloads. I've got most of the area current to last week. It's your decision entirely of course but I utterly fail to understand why you use 2-year-old data and batter all available APIs with tons of requests when you can easily get CURRENT data for ALL OF THE UK from downloads.cloudmade.com or download.geofabrik.de, both linked from the planet page that has been pointed out to you. Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
On Wed, 19 Oct 2011 22:58:41 -0700 Paul Norman wrote: > > From: Mick [mailto:bare...@tpg.com.au] > > Subject: Re: [OSM-talk] 'wget'ing largish portion of planetOSM > > > > On Wed, 19 Oct 2011 22:58:28 -0400 > > Richard Weait wrote: > > > > > On Wed, Oct 19, 2011 at 10:51 PM, Mick wrote: > > > > I have been struggling to get a largish chunk of open street map > > > > covering an area from the Isles of Scilly in the south west to > > > > Bristol [ ... ] > > > > > > The Planet page points to a number of planet extracts. Will one > > > of the UK-like extracts work for you? > > > > > Sadly, no, the area is split between southwest, south, swales & > > oxford extracts with 1 to 5 mile gaps between. > > > > I have tried to fill the gaps using the export to xml feature of the > > online map but that requires a (for me at least) mind bending array > > of inconsistently sized bits. > > Would the united_kingdom extract at > http://downloads.cloudmade.com/europe/northern_europe/united_kingdom > work? > > If not, you could try the jxapi. It is more reliable than the old > xapi, although the osm.org hosted one is currently down for > maintenance. Mapquest runs one, the details are at > http://wiki.openstreetmap.org/wiki/Xapi#Java > I've downloaded all of UK from nick.dev.openstreetmap.org and extracted the bit I want, its a bit old (28 Oct 2009) but mayhap I can update it without massive downloads. I've got most of the area current to last week. Now for a couple of weeks 'normalizing' the tags and load it into postgis. Thanks to all who replied mick ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
> From: Mick [mailto:bare...@tpg.com.au] > Subject: Re: [OSM-talk] 'wget'ing largish portion of planetOSM > > On Wed, 19 Oct 2011 22:58:28 -0400 > Richard Weait wrote: > > > On Wed, Oct 19, 2011 at 10:51 PM, Mick wrote: > > > I have been struggling to get a largish chunk of open street map > > > covering an area from the Isles of Scilly in the south west to > > > Bristol [ ... ] > > > > The Planet page points to a number of planet extracts. Will one of > > the UK-like extracts work for you? > > > Sadly, no, the area is split between southwest, south, swales & oxford > extracts with 1 to 5 mile gaps between. > > I have tried to fill the gaps using the export to xml feature of the > online map but that requires a (for me at least) mind bending array of > inconsistently sized bits. Would the united_kingdom extract at http://downloads.cloudmade.com/europe/northern_europe/united_kingdom work? If not, you could try the jxapi. It is more reliable than the old xapi, although the osm.org hosted one is currently down for maintenance. Mapquest runs one, the details are at http://wiki.openstreetmap.org/wiki/Xapi#Java ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
On Wed, 19 Oct 2011 22:58:28 -0400 Richard Weait wrote: > On Wed, Oct 19, 2011 at 10:51 PM, Mick wrote: > > I have been struggling to get a largish chunk of open street map > > covering an area from the Isles of Scilly in the south west to > > Bristol [ ... ] > > The Planet page points to a number of planet extracts. Will one of > the UK-like extracts work for you? > Sadly, no, the area is split between southwest, south, swales & oxford extracts with 1 to 5 mile gaps between. I have tried to fill the gaps using the export to xml feature of the online map but that requires a (for me at least) mind bending array of inconsistently sized bits. mick ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
On 19 Oct 2011, at 19:58, Richard Weait wrote: > On Wed, Oct 19, 2011 at 10:51 PM, Mick wrote: >> I have been struggling to get a largish chunk of open street map >> covering an area from the Isles of Scilly in the south west to Bristol [ ... >> ] > > The Planet page points to a number of planet extracts. Will one of > the UK-like extracts work for you? http://wiki.openstreetmap.org/wiki/Extract If the UK is too large use Osmosis or another similar tool to extract a smaller bbox http://wiki.openstreetmap.org/wiki/Osmosis Shaun > > ___ > talk mailing list > talk@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
If you are needing that much data I would strongly recommend starting off with an extract of the whole country and then trim out what you need using osmosis. Extract providers can be found here: http://wiki.openstreetmap.org/wiki/Planet#Country_and_area_extracts And osmosis docs on trimming an extract are here: http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage#Area_Filtering_Tasks Toby On Wed, Oct 19, 2011 at 9:51 PM, Mick wrote: > I have been struggling to get a largish chunk of open street map > covering an area from the Isles of Scilly in the south west to Bristol > in the north east using commands like: > wget -t 0 > http://xapi.openstreetmap.org/api/xapi?map[bbox=-6.41,49.85,-1.68,51.56] > -O souwest.osm > > but all I can get is an error - 'connection reset by peer' or 'timeout' > > I also tried: > wget -t 0 > http://www.overpass-api.de/api/xapi?relation[bbox=-6,49.8,-1.0,51.6][natural=*] > -O souwest-relation-natural.osm > > but this required dozens of individual transaction to get results > osmosis refused to read. > > am I biting off more than the server can chew or using the wrong > procedure? > > could some kind soul point me in the right direction > > mick > > ___ > talk mailing list > talk@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk > ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] 'wget'ing largish portion of planetOSM
On Wed, Oct 19, 2011 at 10:51 PM, Mick wrote: > I have been struggling to get a largish chunk of open street map > covering an area from the Isles of Scilly in the south west to Bristol [ ... ] The Planet page points to a number of planet extracts. Will one of the UK-like extracts work for you? ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] 'wget'ing largish portion of planetOSM
I have been struggling to get a largish chunk of open street map covering an area from the Isles of Scilly in the south west to Bristol in the north east using commands like: wget -t 0 http://xapi.openstreetmap.org/api/xapi?map[bbox=-6.41,49.85,-1.68,51.56] -O souwest.osm but all I can get is an error - 'connection reset by peer' or 'timeout' I also tried: wget -t 0 http://www.overpass-api.de/api/xapi?relation[bbox=-6,49.8,-1.0,51.6][natural=*] -O souwest-relation-natural.osm but this required dozens of individual transaction to get results osmosis refused to read. am I biting off more than the server can chew or using the wrong procedure? could some kind soul point me in the right direction mick ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
