Re: [OSM-talk] Geofabrik Download Server Update
Am 19.05.2011 12:51, schrieb Frederik Ramm: Hi, by popular demand ;) http://download.geofabrik.de/clipbounds/ Please make sure to read the README file there. You write there that the cutting is done sequentially from large to small. Seeing as how the polygon complexity is one major factor in the cutting process, wouldn't it make sense to use more smaller, more precise polygons to cut out the small stuff first with better polygons and then assembling the larger parts from that? Or would the complexity of the necessary housekeeping outweigh the use of more accurate border polys? -- Dirk-Lüder Deelkar Kreie Bremen - 53.0901°N 8.7868°E signature.asc Description: OpenPGP digital signature ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hi, On 05/20/11 14:09, Dirk-Lüder Kreie wrote: You write there that the cutting is done sequentially from large to small. Seeing as how the polygon complexity is one major factor in the cutting process, wouldn't it make sense to use more smaller, more precise polygons to cut out the small stuff first with better polygons and then assembling the larger parts from that? Not with the current Osmosis implementation. If you had, say, 150 precise country polygons and were to cut them out of a 1.2 billion node planet file, then that would mean Osmosis does 180 billion point-in-precise-polygon tests, and that would take quite a while. The top-down approach I am using means fewer tests. Better algorithms for tiling a surface exist but haven't yet been put to use in Osmosis. Very fast tile splitters exist in the mkgmap and routing preprocessing arenas but they only do rectangles and don't do --complete-ways which I am increasingly using. Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hi, On 05/19/2011 06:44 AM, Hermann Peifer wrote: Are the boundary polygons that you use for clipping available somewhere? I do vaguely remember that I have seen them earlier, but I can't find them anymore. No, they aren't publicly available but I send them to people on request. There's really no reason to keep them secret, I just haven't set up a mechanism to automatically put them on the server because I didn't think people were all that interested. Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On 19/05/2011 08:10, Frederik Ramm wrote: No, they aren't publicly available but I send them to people on request. There's really no reason to keep them secret, I just haven't set up a mechanism to automatically put them on the server because I didn't think people were all that interested. I am about to make some (rough) overview statistics for European countries, about the length of OSM ways (with tagfilters highway=motorway, railway=rail, etc.). Your country files at http://download.geofabrik.de/osm/europe/ are very convenient in this context. Thanks for this great service! However, I wanted to see how much double-counting there might be, due to the simplified country borders and overlaps between neighbouring countries. I also wanted to know what your difference is between 'british_isles' and 'great_britain', etc. Other users of your files might have a similar interest. Hermann ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm frede...@remote.org schrieb: Hi, On 05/19/2011 06:44 AM, Hermann Peifer wrote: Are the boundary polygons that you use for clipping available somewhere? I do vaguely remember that I have seen them earlier, but I can't find them anymore. No, they aren't publicly available but I send them to people on request. There's really no reason to keep them secret, I just haven't set up a mechanism to automatically put them on the server because I didn't think people were all that interested. Are they so much in flux that simply putting them on a web server won't do as a mechanism? If you publish them you might get patches to eliminate those occasional spots of no-man's-land you were referring to in an earlier mail. One thing people might be interested in doing is to merge them and use the result for extracting where the geofabrik extracts are not mergeable. Matthias ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
2011/5/19 Frederik Ramm frede...@remote.org: On 05/19/2011 06:44 AM, Hermann Peifer wrote: Are the boundary polygons that you use for clipping available somewhere? I do vaguely remember that I have seen them earlier, but I can't find them anymore. No, they aren't publicly available but I send them to people on request. There's really no reason to keep them secret, I just haven't set up a mechanism to automatically put them on the server because I didn't think people were all that interested. It would be interesting for me if I could just review those polygons on a map. Don't know if and/or how this can be done. For instance, I want to use the Austria extract for the coming summer holiday, but we will stay near the border of Italy. So I would like to know how far does it go across borders. And I don't know how to see that from the polygons, if I could download them. Regards, Frank ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On 19/05/2011 11:09, Frank Fesevur wrote: It would be interesting for me if I could just review those polygons on a map. Indeed. Why not on an Open Street Map? For Denmark, it would expect the bounding polygon it to look like a simplified version of: http://www.openstreetmap.org/browse/relation/50046. Hermann ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hi, by popular demand ;) http://download.geofabrik.de/clipbounds/ Please make sure to read the README file there. Regarding boundaries, I prefer geographical over political grouping. The Azores are part of the Europe extract but they are not part of the Portugal extract; likewise, British/French/Dutch overseas territories are not included in the extract of the mother country and usually not even in the Europe extract. There are no hard and fast rules but I figured that if someone took the France extract and computed tiles for everything in that bounding box, they should not have a nasty surprise because I threw in Guadeloupe ;) Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm wrote on 04/05/2011 at 17:26:27 +1100 subject [OSM-talk] Geofabrik Download Server Update : I have added a New Caledonia extract, and it should be there daily from tomorrow. Thank you for adding New Caledonia! It has appeared on http://download.geofabrik.de/osm/australia-oceania/ but the bounding box seems to be wrong. The new-caledonia.osm.pbf should not be bigger than 3M but on the server it has 154M. Just like the whole australia-oceania.osm.pbf . New Caledonia fits nice in the atached OSM file surrounding some small islands belonging to it. Attach: 1) NC.osm -- Sincerely Hendrik Oesterlin - New Caledonia NC.osm Description: Binary data ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Would it be too much to ask that the osmosis.bat file tried some of the more obvious places that java might have put itself, rather than just falling over. Checking in C:\Program Files (x86)\Java\jre6\bin might not be a bad idea and giving an error message telling you what to do about it (if it couldn't find Java) wouldn't hurt either Richard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hendrik, On 05/04/11 00:44, Hendrik Oesterlin wrote: It is included, but ADSL in New Caledonia is expensive and therefor quite slow (256kb downstream). I have added a New Caledonia extract, and it should be there daily from tomorrow. Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm frede...@remote.org schrieb: Hi, Matthias Julius wrote: One option would be to run osmosis with clipIncompleteEntities=false (the default). That would not increase the burden on your box and still allow the extracts to be merged. Of course, this would leave it up to the data consumer to deal with the incomplete ways and relations. Yes. I somewhat fear the number of i am getting a strange error in my program emails that this would cause. Yes, that is why there would need to be a tool that can trim incomplete ways. Maybe as an osmosis task. Merging extracts is a niche operation and not the main purpose of what I am doing. Is it that small of a niche? There are probably plenty of reasons why someone might be interested in an area that crosses an extract boundary. You might save a lot of bandwidth if people who for example want to produce a Garmin map for BeNeLux do not ha e to download the whole of Europe. ;-) Of course, this all speculation. Maybe I am the only one that cares for mergeable extracts. For someone who wants to mix and merge at will, it would be much better to simply divide the world in lots of squares and select from those. The expensive polygon cutting could be dropped completely. It is possible that a process for doing that can be derived from those who do regular Garmin maps. If done properly, it would even be possible to have a web interface where you can select your area of interest, and a matching extract is then merged live from pre-made squares... In some ways this is even preferable because it would preserve the boundary of the extract. Otherewise you get a fuzzy boundary and the consuming tools have no way of knowing the original boundary. Yes but if you start looking at this closely then the only thing you know is that the boundary must be somewhere between nodes X and Y so that doesn't get you far. It is more a cosmetic thing. If for example someone wants to render a map for a certain extract they will have some long ways sticking out here and there, which is ugly. Matthias ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hi, On 05/03/11 07:07, Hendrik Oesterlin wrote: Would it be possible to add New Caledonia in .pbf to http://download.geofabrik.de/osm/australia-oceania/ I'd love to but before I start making smaller files for Australia I think I'll do something in the US. I suggest that for the time being you download the 160 MB full Australia file and cut out New Caledonia yourself with Osmosis. That may be a small waste of bandwidth, but someone in the southern US currently has to download 1.5 GB if they want to use one of my extracts! Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
New Caledonia is not part of Australia. It is approx 2000km east of the closest point in Australia, about the same distance as New Zealand is. Does the Australia file (which doesnt seem to be on that linked page at the moment) cover the entire oceania region? Maybe its worth looking at putting up smaller filtered extracts (ie. only highway tagged ways or only amenity tagged features for the US users, this would reduce the extract size for those who only wish to use it for navigation or who simply want to keep their POI db up-to-date. David On Tue, 2011-05-03 at 10:11 +0200, Frederik Ramm wrote: Hi, On 05/03/11 07:07, Hendrik Oesterlin wrote: Would it be possible to add New Caledonia in .pbf to http://download.geofabrik.de/osm/australia-oceania/ I'd love to but before I start making smaller files for Australia I think I'll do something in the US. I suggest that for the time being you download the 160 MB full Australia file and cut out New Caledonia yourself with Osmosis. That may be a small waste of bandwidth, but someone in the southern US currently has to download 1.5 GB if they want to use one of my extracts! Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Thank you for improving the IMHO most important additional service in OSM! bye Nop -- View this message in context: http://gis.638310.n2.nabble.com/Geofabrik-Download-Server-Update-tp6264407p6326736.html Sent from the General Discussion mailing list archive at Nabble.com. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On Tue, May 3, 2011 at 9:11 AM, Frederik Ramm frede...@remote.org wrote:
I suggest that for the time being you download
the 160 MB full Australia file and cut out New Caledonia yourself with
Osmosis.
Is there a guide somewhere to using osmosis on Windows. Maybe just a
simple bounding-box extraction to get us started?
All I find by Googling is I've {done lots of unspecified stuff and}
got this horrible error message... which is hardly encouraging.
Richard
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On Tue, May 3, 2011 at 11:56 AM, Richard Mann
richard.mann.westoxf...@gmail.com wrote:
On Tue, May 3, 2011 at 9:11 AM, Frederik Ramm frede...@remote.org wrote:
I suggest that for the time being you download
the 160 MB full Australia file and cut out New Caledonia yourself with
Osmosis.
Is there a guide somewhere to using osmosis on Windows. Maybe just a
simple bounding-box extraction to get us started?
All I find by Googling is I've {done lots of unspecified stuff and}
got this horrible error message... which is hardly encouraging.
Richard:
You can consider using osmembrane[1] which is a GUI on top of osmosis. I
haven't tested it on Windows but I guess there's no reason it shouldn't
work. It makes working with osmosis a much gentler experience ;).
[1] http://osmembrane.de/
--
Martijn van Exel
http://about.me/mvexel
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hi, On 05/03/11 10:48, David Murn wrote: New Caledonia is not part of Australia. Bummer. I must have mixed it up with New South Wales or whatever the place is called. I'll check but I think that the NC area should be in the australia+oceania extract. Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On Tue, May 3, 2011 at 11:55 AM, Martijn van Exel m...@rtijn.org wrote: Richard: You can consider using osmembrane[1] which is a GUI on top of osmosis. I haven't tested it on Windows but I guess there's no reason it shouldn't work. It makes working with osmosis a much gentler experience ;). [1] http://osmembrane.de/ I'm not sure if downloading a second package is really what I have in mind: just a simple howto which uses dos file paths rather than linux ones, and tells me which bits are programs (which need to be obtained), and which bits are commands to those programs. I'm sure it's not that difficult to puzzle out, but a few clues would make it easier. Richard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On Tue, May 3, 2011 at 7:19 AM, Richard Mann richard.mann.westoxf...@gmail.com wrote: On Tue, May 3, 2011 at 11:55 AM, Martijn van Exel m...@rtijn.org wrote: Richard: You can consider using osmembrane[1] which is a GUI on top of osmosis. I haven't tested it on Windows but I guess there's no reason it shouldn't work. It makes working with osmosis a much gentler experience ;). [1] http://osmembrane.de/ I'm not sure if downloading a second package is really what I have in mind: just a simple howto which uses dos file paths rather than linux ones, and tells me which bits are programs (which need to be obtained), and which bits are commands to those programs. I'm sure it's not that difficult to puzzle out, but a few clues would make it easier. This older tutorial includes using osmosis to extract a bounding box. http://weait.com/content/make-your-first-map In the example, the heavy lifting is done here. ./bin/osmosis --read-xml /home/username/planet-090311.osm.gz --bounding-box left=-94 bottom=38 right=-71.5 top=50 --write-xml /home/username/GreatLakes.osm.gz simplifying that by removing paths leaves: osmosis --read-xml planet-090311.osm.gz --bounding-box left=-94 bottom=38 right=-71.5 top=50 --write-xml GreatLakes.osm.gz Which is one command with three arguments. osmosis command. This is the only program. --read-xml use an xml-file for input with filename planet-090311.osm.gz --bounding-box take to portion of the data that is within the bounding box in the four sub-arguments left=-94 bottom=38 right=-71.5 top=50 --write-xml ... and write it as an xml-file with filename GreatLakes.osm.gz With the filepaths removed from the filenames, I expect that your operating system will only look for, or save, the files in the present working directory. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On Tue, May 3, 2011 at 1:19 PM, Richard Mann richard.mann.westoxf...@gmail.com wrote: On Tue, May 3, 2011 at 11:55 AM, Martijn van Exel m...@rtijn.org wrote: Richard: You can consider using osmembrane[1] which is a GUI on top of osmosis. I haven't tested it on Windows but I guess there's no reason it shouldn't work. It makes working with osmosis a much gentler experience ;). [1] http://osmembrane.de/ I'm not sure if downloading a second package is really what I have in mind: just a simple howto which uses dos file paths rather than linux ones, and tells me which bits are programs (which need to be obtained), and which bits are commands to those programs. I'm sure it's not that difficult to puzzle out, but a few clues would make it easier. Richard If getting the job done and learning about how osmosis works in the process are among your goals, I guess osmembrane would still be a useful path to follow. cutting a bounding box of Port-Au-Prince from a PBF planet file and writing it out as xml on Windows would be: C:\osm\osmosis-0.39bin\osmosis.bat --rb \osm\planet-haiti-latest.osm.pbf --bb left=-72.36 bottom=18.51 right=-72.26 top=18.65 --wx \osm\planet-portauprince.osm The only executable you're calling is bin\osmosis.bat (a shell script wrapper). The rest is described in the wiki: http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage Be sure to get 0.39 if you're on windows as per Brett's warning on the main Osmosis wiki page. Martijn -- Martijn van Exel http://about.me/mvexel ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm wrote: I'd love to but before I start making smaller files for Australia I think I'll do something in the US. That would be great! Currently, I think only Cloudmade are offering state level extracts (much more managable than the larger extracts) for the US and unfortunately they are updated very infrequently. The last update being 15th of March. Also they don't offer the much more efficient osm.pbf format. Both make the Cloudmade extracts much less useful to work with, so imho it would be a great help if you could offer the daily extracts for the US as well. Altogether, I think those daily country extracts are one of the most useful tools for working with OSM data, so I'd like to send a great thanks to Geofabrik for providing the resource to offer this valuable service. Kai -- View this message in context: http://gis.638310.n2.nabble.com/Geofabrik-Download-Server-Update-tp6264407p6327659.html Sent from the General Discussion mailing list archive at Nabble.com. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Kai Krueger kakrue...@gmail.com schrieb: Altogether, I think those daily country extracts are one of the most useful tools for working with OSM data, so I'd like to send a great thanks to Geofabrik for providing the resource to offer this valuable service. I agree. But, I need to point out again that theese extracts are not quite as useful as they could be, IMHO. Unless something has been changed, ways that cross the bounding polygon are trunkated at the last node inside the polygon. When two neighboring extracts are merged there will be a gap at the border (or worse). This makes the extracts unusable if one needs a little bit more than one. Merging of two extracts is much easier and resource friendlier than downloading the bigger extract and extracting the data from that. I know it has been stated before that the Geofabrik extracts are as they are to maintain backwards compatibility. One could provide a little tool or osmosis filter (if that doesn't exist, yet) that trunkates incomplete ways for tools that cannot cope with those on their own. Matthias ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Matthias, Matthias Julius wrote: But, I need to point out again that theese extracts are not quite as useful as they could be, IMHO. Unless something has been changed, ways that cross the bounding polygon are trunkated at the last node inside the polygon. I have started to slowly introduce extracts built with the --complete-ways option, but not all extracts have that yet. In Europe, all sub-country extracts have it but countries don't, so you should be able to join two German Laender or two French regions, but you will encounter problems when joining a part of Germany with a part of France. I'm working on that but even a box with 90 GB of RAM disk has a hard time splitting Europe into countries with --complete-ways. Note that two other preconditions exist for a successful join of neighbouring regions. First, the polygons I use for cutting must actually overlap. They usually do but every now and then I encounter a little bit of no man's land due to polygon simplification. Second, you have to use software that properly eliminates the double elements; I'm not sure if Osmosis does that. Bye Frederik -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09 E008°23'33 ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm frede...@remote.org writes: Matthias, Matthias Julius wrote: But, I need to point out again that theese extracts are not quite as useful as they could be, IMHO. Unless something has been changed, ways that cross the bounding polygon are trunkated at the last node inside the polygon. I have started to slowly introduce extracts built with the --complete-ways option, but not all extracts have that yet. In Europe, all sub-country extracts have it but countries don't, so you should be able to join two German Laender or two French regions, but you will encounter problems when joining a part of Germany with a part of France. I'm working on that but even a box with 90 GB of RAM disk has a hard time splitting Europe into countries with --complete-ways. One option would be to run osmosis with clipIncompleteEntities=false (the default). That would not increase the burden on your box and still allow the extracts to be merged. Of course, this would leave it up to the data consumer to deal with the incomplete ways and relations. In some ways this is even preferable because it would preserve the boundary of the extract. Otherewise you get a fuzzy boundary and the consuming tools have no way of knowing the original boundary. Alternatively, the boundary polygon could be stored in the file. Unfortunately, so far the file formats only support rectangular bounding boxes. Note that two other preconditions exist for a successful join of neighbouring regions. First, the polygons I use for cutting must actually overlap. They usually do but every now and then I encounter a little bit of no man's land due to polygon simplification. Second, you have to use software that properly eliminates the double elements; I'm not sure if Osmosis does that. If it doesn't than this is the chance to fix it. Do your polygons really overlap? I think it would be ideal if the shared the nodes. Matthias ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hi, Matthias Julius wrote: One option would be to run osmosis with clipIncompleteEntities=false (the default). That would not increase the burden on your box and still allow the extracts to be merged. Of course, this would leave it up to the data consumer to deal with the incomplete ways and relations. Yes. I somewhat fear the number of i am getting a strange error in my program emails that this would cause. Merging extracts is a niche operation and not the main purpose of what I am doing. For someone who wants to mix and merge at will, it would be much better to simply divide the world in lots of squares and select from those. The expensive polygon cutting could be dropped completely. It is possible that a process for doing that can be derived from those who do regular Garmin maps. If done properly, it would even be possible to have a web interface where you can select your area of interest, and a matching extract is then merged live from pre-made squares... In some ways this is even preferable because it would preserve the boundary of the extract. Otherewise you get a fuzzy boundary and the consuming tools have no way of knowing the original boundary. Yes but if you start looking at this closely then the only thing you know is that the boundary must be somewhere between nodes X and Y so that doesn't get you far. Do your polygons really overlap? I think it would be ideal if the shared the nodes. No, that would kill the process. I need to use simplified polygons; cutting out a country with a 15k node polygon would take forever. And it is impossible to simplify the polygons and still make sure that each boundary is contained completely in the respective country file, so they have to overlap. Bye Frederik -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09 E008°23'33 ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm wrote on 03/05/2011 at 21:59:45 +1100 subject [OSM-talk] Geofabrik Download Server Update : I'll check but I think that the NC area should be in the australia+oceania extract. It is included, but ADSL in New Caledonia is expensive and therefor quite slow (256kb downstream). I downloaded it yesterday to update both my New Zealand and New Caledonia map. Maybe you could make one Oceania extract for the hole pacific ocean, just excluding Australia an New Zealand. I guess that 95% of data volume is located in this two island and the rest of Oceania will be fast to download even if I get the Easter Island, Samoa, Hawaii en Tahiti if I only need New Caledonia. Cutting the extract with osmosis is not a problem and very fast. -- Sincerely Hendrik Oesterlin - New Caledonia ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Hi Frederik, Excuse me for jumping in here without knowing much of the background, but: Frederik Ramm wrote: I need to use simplified polygons; cutting out a country with a 15k node polygon would take forever. Is your point-in-polygon test O(N) in the size of the polygon? You can do much better than that. Regards, Phil. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Phil, On 05/04/11 01:48, Phil Endecott wrote: I need to use simplified polygons; cutting out a country with a 15k node polygon would take forever. Is your point-in-polygon test O(N) in the size of the polygon? You can do much better than that. I use Osmosis, which in turn uses whatever Java offers in its Area.contains() method. If you have interesting improvements to offer, why not discuss on the osmosis mailing list, or even hack them into svn.openstreetmap.org/applications/utils/osmosis/trunk/areafilter/src/org/openstreetmap/osmosis/areafilter/v0_6/PolygonFilter.java directly ;) Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm frede...@remote.org wrote on 12/04/2011 at 20:17:37 +1100 subject [OSM-talk] Geofabrik Download Server Update : Together with the added disk space on the download server this means that I can continue supporting the bz2 format indefinitely, although I expect it gradually to fall behind in currency (currently, the bz2 will show up a few hours after the .pbf; in the future this might increase to half a day or so). The .pbf format is definietly the preferred format. Would it be possible to add New Caledonia in .pbf to http://download.geofabrik.de/osm/australia-oceania/ I was used to to get the data using wget -O ncxapi.osm http://xapi.openstreetmap.org/api/0.6/map?bbox=163.5,-23.0,168.5,-19.5; in order to compile the Garmin Map for New Caledonia www.oesterlin.ile.nc/gpsbut the xapi is not reliable enough since some time. The MapQuest xapi supports not an as large area, even if there is not (yet ?) so much data there. -- Sincerely Hendrik Oesterlin - email hendrikmail2...@yahoo.de ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
On Tue, 2011-04-12 at 11:17 +0200, Frederik Ramm wrote: Before, the .pbf and .bz2 and .shp files were all created on a machine in the Geofabrik office and uploaded to the download server for distribution, and with the office only having 10 MBit upstream connectivity, there was a limit to how much could be transferred every night. I'm now slowly changing to a setup where the .bz2 and perhaps eventually even the .shp files will be created directly on the download server, giving me more room to create additional extracts (think US states) and upload them in the time we've saved. congratulations, thanks and may you live long -- regards KG http://lawgon.livejournal.com Coimbatore LUG rox http://ilugcbe.techstud.org/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Geofabrik Download Server Update
Frederik Ramm (frede...@remote.org) wrote: Hi, for a few years now, the Geofabrik download server (download.geofabrik.de) has been serving various, daily updated, regional OSM extracts, in XML and shape file form, and for the last half year also in PBF form. After a few hiccups in the past weeks, I have moved the server to new infrastructure with more of everything so that you shouldn't see any more 503 service unavailable messages (except when you're really trying very hard to abuse the machine). Before, the .pbf and .bz2 and .shp files were all created on a machine in the Geofabrik office and uploaded to the download server for distribution, and with the office only having 10 MBit upstream connectivity, there was a limit to how much could be transferred every night. I'm now slowly changing to a setup where the .bz2 and perhaps eventually even the .shp files will be created directly on the download server, giving me more room to create additional extracts (think US states) and upload them in the time we've saved. Together with the added disk space on the download server this means that I can continue supporting the bz2 format indefinitely, although I expect it gradually to fall behind in currency (currently, the bz2 will show up a few hours after the .pbf; in the future this might increase to half a day or so). The .pbf format is definietly the preferred format. I would like to thank GWDG who are hosting a mirror for the Europe and Germany extract, by far the most popular files on the download server. The server will redirect you to their mirror if and only if it is clear from the log files that the mirror has the complete latest version of a file. (This is new, too - before, it was possible that the server would redirect you to a stale copy on the mirror.) You're welcome to continue using the server - but even though all is new and shiny now, please act responsibly and download only what you need. Hoarding doesn't make sense - who wants yesterday's geodata anyway? Bye Frederik Do you publish any stats on your downloads (top 50 extracts, location of downloaders, frequency of re-visit etc). Would be interesting to see. -- Charlie ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
