Re: [OSM-talk] Bulk Uploading
On Sun, Jul 19, 2009 at 06:58, Andrew Ayre wrote: > I am converting public domain data into OSM files for bulk upload. This > is data that currently is not in OSM. > > JOSM is a nightmare for uploading large amounts of data. I have a OSM > file with 30k nodes (5Mb) and JOSM tells me it will take 15 hours... > > I tried bulk_upload.py and it fails with error 404 - no further information. > > I tried bulk_upload.php and it also failed with an error - can't > remember the details now. Recently I've used the following in order to upload some converted data to osm... Data were generated from State's SHP using: http://svn.openstreetmap.org/applications/utils/import/shp2osm/polyshp2osm.py then: http://svn.openstreetmap.org/applications/utils/import/bulk_upload_06 Used a wrap-around to do directory traverse. -S ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] keepright! goes global
...well, almost. From now on, the site http://keepright.ipax.at will provide data consistency checks not only for Europe but also for Africa, Asia and South America. Australia is already covered by the keepright partner site at http://keepright.x10hosting.com/ What's still missing in the list is North America. Volunteers who want to donate computing power are welcome to join. All you need is a medium-sized PC running Linux and a little bit of time to manage running the program. Have a nice weekend! Harald ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Bulk Uploading
Hey, (just noticed your mail on the list) 2009/7/19 Andrew Ayre : > JOSM is a nightmare for uploading large amounts of data. I have a OSM > file with 30k nodes (5Mb) and JOSM tells me it will take 15 hours... > > I tried bulk_upload.py and it fails with error 404 - no further information. > > I tried bulk_upload.php and it also failed with an error - can't > remember the details now. > > I'm now trying the scripts at > http://www.openstreetmap.pl/balrog/bulkupload/. However I don't want to > upload incorrect or partial data to the public server. So I tried > uploading to api06.dev.openstreetmap.org and > mysql.dev.openstreetmap.org. Both servers returned the following error: > > 500: Internal Server Error (Application errorRails application > failed to start properly) > > All I want is a (moderately) fast and reliable way of uploading data. I > have plenty of it ready to go. Can anyone help? I'm afraid the scripts won't be any faster than JOSM, all the scripts as well as JOSM use the same API and there's likely not going to be much difference in speed or in reliability. The 15h was probably a little pessimistic, though (depending on your connectivity, but it definitely should be less than that for 30k nodes). And reliability is assured by the API too. Cheers ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
On Sun, Jul 19, 2009 at 5:53 AM, Harald Kleiner wrote: > ...well, almost. > > From now on, the site > http://keepright.ipax.at > will provide data consistency checks not only for Europe but also for > Africa, Asia and South America. > Australia is already covered by the keepright partner site at > http://keepright.x10hosting.com/ > > What's still missing in the list is North America. Volunteers who want > to donate computing power are welcome to join. All you need is a > medium-sized PC running Linux and a little bit of time to manage running > the program. I'd love to run it for North America. Are there fairly comprehensive instructions somewhere? ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
On Sun, Jul 19, 2009 at 6:53 PM, Harald Kleiner wrote: > ...well, almost. > > From now on, the site > http://keepright.ipax.at > will provide data consistency checks not only for Europe but also for > Africa, Asia and South America. > Sweet! I've been waiting for this. This will help a lot in the QA effort. Thanks! :-) ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
Am 19.07.2009 12:53, Harald Kleiner: > ...well, almost. > > From now on, the site > http://keepright.ipax.at > will provide data consistency checks not only for Europe but also for > Africa, Asia and South America. > Australia is already covered by the keepright partner site at > http://keepright.x10hosting.com/ > > What's still missing in the list is North America. Volunteers who want > to donate computing power are welcome to join. All you need is a > medium-sized PC running Linux and a little bit of time to manage running > the program. > > Have a nice weekend! > > Harald Awesome. Really appreciated for mapping in Asia. Thanks a lot to all involved. Claudius ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] [tagging] Feature Proposal - RFC - (natural=rock)
Hi all, I want to propose the tag natural=rock for tagging mountain areas made only by rocks, where there isn't vegetation or it's minimal. The wiki's page is here [1]. Bye. [1] http://wiki.openstreetmap.org/wiki/Proposed_features/rock -- Cadenelli Nicola The information contained in this message and/or attachments is intended solely for the attention of the named addressee and it may include confidential data or documents. Pursuant to D.Lgs. 196/2003 any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is forbidden, except previous formal approval of the named addressee. If you have received this e-mail in error, please contact the sender, by answering to this e-mail and delete this information from your system. The holder is not liable for the proper and complete transmission of the information contained in this message. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
Great stuff! I've been using keepright in London for a while now. The most common form of error is an almost-junction. It seems that many of these could be fixed automatically, subject to manual confirmation. Is there any tool that can do this? -- Ed Avis ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
Hi Ian, Welcome! There's a README file in the sources. Check them out of subversion using this command: svn co https://keepright.svn.sourceforge.net/svnroot/keepright keepright The README explains the steps to take. Of course I'll try to help if you get stuck, best regards, Harald > > > I'd love to run it for North America. Are there fairly comprehensive > instructions somewhere? ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
On Sun, Jul 19, 2009 at 9:04 PM, Ed Avis wrote: > Great stuff! I've been using keepright in London for a while now. > The most common form of error is an almost-junction. It seems that many of > these could be fixed automatically, subject to manual confirmation. Is > there > any tool that can do this? Or an easy shortcut in Potlatch? - Gustav ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] [tagging] Feature Proposal - RFC - (natural=rock)
On Sunday 19 Jul 2009 18:38:04 Nicola Cadenelli wrote: > I want to propose the tag natural=rock for tagging mountain areas made only > by rocks, where there isn't vegetation or it's minimal. The wiki's page is > here [1]. > > Bye. > > > [1] http://wiki.openstreetmap.org/wiki/Proposed_features/rock How does this relate to natural=rocks ? http://wiki.openstreetmap.org/wiki/Tag:natural%3Drocks I've just been trying to map some rocky coastline and a mountain walk in south west Scotland, there are lots of proposals in the wiki that overlap and there's no clear documentation on how to consistently and usefully tag countryside features. Or have I missed it? Regards, Tom ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
How much processing power are we talking of?[1] I could get my PC to run the report for where ever the need arises to run a report. Only problem is that I don't have the hosting capabilities to put in online. Is it possible to setup some sort of cname re-direct thinggy so people could just go to keepright.osm.org or such like. That way it can be found much easier. Jack Stringer [1] should run it on a laptop I have spare. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
Hi Jack, > How much processing power are we talking of?[1] I could get my PC to > run the report for where ever the need arises to run a report. I don't know your laptop but I don't think it would work well. The North America dump and the Europe dump are equal in size (1.9GB), so you can compare the two. On my PC one run takes four days. That's why there's only one update per week. My machine is a cheap dual core AMD CPU with 6GB of RAM and a RAID0 built of two new hard disks. Critical components (bottlenecks) are the disks. The database as a whole needs 70GB on disk. And you have to take into account downloading the 1.9GB planet dump once a week. Your traffic policy should allow that. > Only > problem is that I don't have the hosting capabilities to put in > online. You could just upload the results to my existing site. You need not set up your own webspace > > Is it possible to setup some sort of cname re-direct thinggy so people > could just go to keepright.osm.org or such like. That way it can be > found much easier. > There is discussion going on on the mailing list about including openstreetbugs into the main OSM site and enabling other services to upload their bug reports into that database tables and thus make them appear on the main site Harald > > Jack Stringer > [1] should run it on a laptop I have spare. > ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] keepright! goes global
--- On Sun, 19/7/09, Harald Kleiner wrote: > And you have to take into account downloading the 1.9GB > planet dump once > a week. Your traffic policy should allow that. Or just download the change file (about 20M/day) and combine it with the previous day to spit out the new day. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Speaking of daily change files...
In the last week or so there has been dumps that osm2pgsql fails to parse due to garbage characters, I even tried the -u switch for kicks, but unless I manually intervene and clean things up osm2pgsql refuses to deal with it. Pretty sure I'm using the latest version, or near to it, was downloaded about the 1st. # osm2pgsql -a -b 110,-50,179,-10 -s 20090718-20090719.osc.gz osm2pgsql SVN version 0.66-16258 Using projection SRS 900913 (Spherical Mercator) Applying Bounding box: 110.00,-50.00 to 179.00,-10.00 Setting up table: planet_osm_point Setting up table: planet_osm_line Setting up table: planet_osm_polygon Setting up table: planet_osm_roads Mid: pgsql, scale=100, cache=800MB, maxblocks=102401*8192 Setting up table: planet_osm_nodes Setting up table: planet_osm_ways Setting up table: planet_osm_rels Reading in file: 20090718-20090719.osc.gz Processing: Node(513k) Way(49k) Relation(0k)Entity: line 1883470: parser error : invalid character in attribute value ^ Entity: line 1883470: parser error : attributes construct error ^ Entity: line 1883470: parser error : Couldn't find end of Start Tag tag ^ 20090718-20090719.osc.gz : failed to parse Error occurred, cleaning up ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] "Campus", medical center, commercial?
Not finding definitive info on these questions in the wiki or mail archives, at least so far. I have questions about how to draw two types of "campuses" or "sites". The first example is a medical center, which may have one or more primary Hospital buildings and a number of smaller office buildings and facilities. The other would be a large company campus (think Cisco, IBM, etc.) Would these both best be done with an outer "landuse=commercial" area? ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] "Campus", medical center, commercial?
On Sun, Jul 19, 2009 at 09:54:30PM -0700, David Carmean wrote: > > Not finding definitive info on these questions in the wiki or mail archives, > at least > so far. I have questions about how to draw two types of "campuses" or > "sites". The > first example is a medical center, which may have one or more primary > Hospital buildings > and a number of smaller office buildings and facilities. The other would be > a > large company campus (think Cisco, IBM, etc.) > > Would these both best be done with an outer "landuse=commercial" area? Ugh, Osmarender renders the campus and the parking areas with the same yellow. Don't have a way to check mapnik, locally. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Undo request button for changesets
On 16 Jul 2009, at 13:48, Sam Vekemans wrote: Hi all, +1 for having a revert button only for your own (personal) changsets. With no button requesting a change revert. .. just message that person, in a friendly way. Most of the time it's a newbie who is just learning. :-) Umm.. Not everyone is that friendly and we need more powerful medicine for those occasions. We have a persistent and very destructive mapper in the UK. We have reverted most of his edits from June by hand. I messaged him politely in June without a response. He reappeared in July and is now breaking roads, rivers and railways and adding stray bits of visible rubbish most days. All of this stuff is majorly destructive:- http://www.openstreetmap.org/user/liam123/edits I think we need a number of things pretty fast. 1) A way to view quickly determine the nature of any change-set - did the change set add any new ways/nodes? did it add tags to ways/nodes? change values in tags? delete ways/node? delete tags? - that sort of stuff. I would like to see all the changes textually and also as a map and be able to see the history of each feature with similar information available. 2) A way to for people to patrol for edits by new contributors in an area on a real-time basis and a way for experienced mappers to indicate that a newbie's changesets has been checked and are ok or not. 3) An RSS feed to monitor a users edits to watch for new activity. Got it, we have that one - thanks 4) A way to revert a change-sets quickly before people put stuff on top or try to repair (I would also like to opportunities to complete the revert even if work has subsequently been done on some of the touched features) 5) A way to see which change-sets have been reverted recently within an area and by whom 6) A way to revert the revert etc 7) A way for people spot revert wars (ie users doing many reverts or areas with many reverts) 8) Community guidelines on only using revert for blatant vandalism rather than just because you preferred it as is was - (assume food intentions and build if in doubt) 9) A way to request a block on the IP address for a short period if vandalism is coming from unique static IP address 10) I would also like a publicly available talk page for a user where people can leave public messages for the user and for other people to read. This would need to be a wiki page so problems could be removed, but it would allow a place to talk in semi-public about issues which is sometimes useful. I think all of the above is the what we need to have to make it work from a community perspective as well as from a technical perspective. Do be aware that a vandal is very unlikely to sign the new license so at present it is important that we remove the edits rather than repair on top of edits. Regards, Peter Miller (If we had a "revert" button next to a changeset, and I agree with the cautious voices who said that this is quite unlikely to work once a few hours or days have passed, then I would probably enable that button only for the user who committed the original change, and anyone else who clicks the button would just send a message to that user saying "please revert your change".) Bye Frederik From my experience, the user who did the upload. .. ie, if i uploaded something that i realize that more nodes were added than needed. Having an easy way for me to fix that is helpful. I found that once i notified users of what was done, they (themselves) would probably appreciate the ability for them to revert their mistake (since now becoming aware of it). ie. in the case of copyright maps. For example, im now fixing up some of the stuff i added for my sample area. My changesets are in a logical order. So i'd like the ability to be able to 'undo', something i did last week. So if other edits where made ontop of some of the changes, a list can be made available of those conflicts. But all the other stuff (breadcrumbs) can be reverted. (some of my polygons might have extra nodes, that i dont know of yet) Cheers, Sam ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
