[OSM-talk] Deleted Place names in the Philippines
Hi, I think I have just deleted a load of place names In the Philippines. I may have also deleted a load of other data as well. Could someone check out the map of the Philippines area ( I think only the area north of Manila has been affected), and put the data back if it's missing. The time frame of the deletions is from about 3 hours ago until now. I think that's 9pm 14th Jan to midnight GMT. Cheers, Ian - Sent from Yahoo! - a smarter inbox.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
I'm afraid there's more: [http://www.openstreetmap.org/index.html?mlat=14.550859217239761&mlon=121.04870772458753&zoom=14] [http://www.openstreetmap.org/index.html?mlat=14.558977716301913&mlon=121.0841830236886&zoom=14] [http://www.openstreetmap.org/index.html?mlat=14.650792267628056&mlon=121.07140653390742&zoom=14] [http://www.openstreetmap.org/index.html?mlat=14.661455707705189&mlon=121.05404332743633&zoom=14] [http://www.openstreetmap.org/index.html?mlat=14.698512880048776&mlon=121.12088122612128&zoom=14] [http://www.openstreetmap.org/index.html?mlat=14.556818832369347&mlon=121.12429083089091&zoom=12] maning On Tue, 2008-01-15 at 14:30 +0800, Maning Sambale wrote: > Ian, > > Is this the area? > [http://www.openstreetmap.org/index.html?mlat=14.637254788010372&mlon=120.96460629211329&zoom=14] > > Help please to revert deleted ways. > > cheers, > > maning > > On Tue, 2008-01-15 at 00:34 +, Ian Haylock wrote: > > Hi, > > > > I think I have just deleted a load of place names In the Philippines. > > I may have also deleted a load of other data as well. > > > > Could someone check out the map of the Philippines area ( I think only > > the area north of Manila has been affected), and put the data back if > > it's missing. > > > > The time frame of the deletions is from about 3 hours ago until now. I > > think that's 9pm 14th Jan to midnight GMT. > > > > > > > > > > Cheers, Ian > > > > > > __ > > Sent from Yahoo! - a smarter inbox. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Ian, Is this the area? [http://www.openstreetmap.org/index.html?mlat=14.637254788010372&mlon=120.96460629211329&zoom=14] Help please to revert deleted ways. cheers, maning On Tue, 2008-01-15 at 00:34 +, Ian Haylock wrote: > Hi, > > I think I have just deleted a load of place names In the Philippines. > I may have also deleted a load of other data as well. > > Could someone check out the map of the Philippines area ( I think only > the area north of Manila has been affected), and put the data back if > it's missing. > > The time frame of the deletions is from about 3 hours ago until now. I > think that's 9pm 14th Jan to midnight GMT. > > > > > Cheers, Ian > > > __ > Sent from Yahoo! - a smarter inbox. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Maning Sambale wrote: > Ian, > Is this the area? > [http://www.openstreetmap.org/index.html > mlat=14.637254788010372&mlon=120.96460629211329&zoom=14] > > Help please to revert deleted ways. 1. Open Potlatch 2. Go to the area you want 3. Press 'U' (for undelete) 4. Select a red line denoting a deleted way 5. Click the little padlock in the bottom left to unlock it 6. Deselect to upload Repeat steps 4-6 for every way. If all the nodes from the way are still there, but the way itself has been deleted, Potlatch won't pick it up in step 3. Instead you'll need to delete one of the nodes yourself first, then press 'U'. You can't undelete POI nodes yet. If svn remains stable enough that I can spend some time coding rather than repeatedly upgrading my Rails install then I'll fix that. ;) cheers Richard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
On Jan 15, 2008 1:34 AM, Ian Haylock <[EMAIL PROTECTED]> wrote: > Hi, > > I think I have just deleted a load of place names In the Philippines. I may > have also deleted a load of other data as well. The easiest way to fix this is to cut the phillipines out of the last planet dump and load it into JOSM, pick all the deleted objects and add and remove a dummy tag and hit upload. I've consider setting up a server deliberatly a week out of date to make this easier, but you should be able to do this by hand. You can also try extracting them out of the planet diffs but that's harder... Hope this helps, -- Martijn van Oosterhout <[EMAIL PROTECTED]> http://svana.org/kleptog/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, Still no reply from this message ? Surely someone with osm database access can just roll back the edits in the time frame jan 14th 2008 9pm-12am (3 hours) The area in question should be covered by these lats' / lon's top left : lat 19.9325 lon 115.6431 bottom right : lat 5.3102 lon 127.9038 I have trashed parts of Manila as well so there is far too much to put back manually. I don't know how it happened. I was using the latest version of josm, and had loaded the above coordinates. Then I was fixing errors and uploading them to the database. I finished some fixes, then went out leaving josm uploading. Only to come back home to find out it had deleted LOADS and I mean LOADS of data in the Philippines. I also have an osm file of the philippines that I saved before the error. If someone can tell me how to use that to fix the mistake I will do so myself. Cheers, Ian - Yahoo! Answers - Get better answers from someone who knows. Tryit now.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
In message <[EMAIL PROTECTED]> Ian Haylock <[EMAIL PROTECTED]> wrote: > Still no reply from this message ? I can see two replies from people suggesting different ways of dealing with the problem. > Surely someone with osm database access can just roll back the edits > in the time frame jan 14th 2008 9pm-12am (3 hours) Not easily, no. We don't have any tools to do such things. > I also have an osm file of the philippines that I saved before the > error. If someone can tell me how to use that to fix the mistake I > will do so myself. In that case you want to look at Martijn's advice - he was basing it on using a planet dump, but if you have an osm file then you should be able to use that instead. Tom -- Tom Hughes ([EMAIL PROTECTED]) http://www.compton.nu/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Ian, There were a number of replies to this since you posted. Here is the thread http://lists.openstreetmap.org/pipermail/talk/2008-January/thread.html#22071 If the volume of deletion is great then for sure the simplest way to recover is going to be to delete the remaining data for the relevant bbox and reload it all from last week's planet or your own OSM file. Bear in mind though that doing that will remove a) all the history data for objects and b) (if you use planet) the details of the original contributors. There is currently no way to revert a specific area for a given time span at the server end. Would need new tools developing to do that. Cheers Andy >-Original Message- >From: [EMAIL PROTECTED] [mailto:talk- >[EMAIL PROTECTED] On Behalf Of Ian Haylock >Sent: 16 January 2008 5:15 AM >To: Ian Haylock; OSM Talk Archive >Subject: Re: [OSM-talk] Deleted Place names in the Philippines > >Hi, > >Still no reply from this message ? > >Surely someone with osm database access can just roll back the edits in the >time frame jan 14th 2008 9pm-12am (3 hours) > >The area in question should be covered by these lats' / lon's > >top left : lat 19.9325 lon 115.6431 > >bottom right : lat 5.3102 lon 127.9038 > >I have trashed parts of Manila as well so there is far too much to put back >manually. > >I don't know how it happened. I was using the latest version of josm, and >had loaded the above coordinates. Then I was fixing errors and uploading >them to the database. I finished some fixes, then went out leaving josm >uploading. Only to come back home to find out it had deleted LOADS and I >mean LOADS of data in the Philippines. > >I also have an osm file of the philippines that I saved before the error. >If someone can tell me how to use that to fix the mistake I will do so >myself. > > > >Cheers, Ian > > > >Yahoo! Answers - Get better answers from someone who knows. Try it now ><http://uk.answers.yahoo.com/;_ylc=X3oDMTEydmViNG02BF9TAzIxMTQ3MTcxOTAEc2Vj >A21haWwEc2xrA3RhZ2xpbmU> . ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
On Jan 16, 2008 8:41 AM, Andy Robinson (blackadder) < [EMAIL PROTECTED]> wrote: > Ian, > > There were a number of replies to this since you posted. Here is the > thread > > http://lists.openstreetmap.org/pipermail/talk/2008-January/thread.html#22071 > > If the volume of deletion is great then for sure the simplest way to > recover > is going to be to delete the remaining data for the relevant bbox and > reload > it all from last week's planet or your own OSM file. Bear in mind though > that doing that will remove a) all the history data for objects and b) (if > you use planet) the details of the original contributors. > a) and b) aren't true if you keep the OSM IDs intact though... just load the area into JOSM then convince it to upload the data by making it think it's changed -- to do this add then remove a dummy tag as Martijn said. The API will then resurrect the objects, with the edit history (including the deletion) as JOSM uploads them. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
> > > a) and b) aren't true if you keep the OSM IDs intact though... just > load the area into JOSM then convince it to upload the data by making > it think it's changed -- to do this add then remove a dummy tag as > Martijn said. The API will then resurrect the objects, with the edit > history (including the deletion) as JOSM uploads them. This one work like a charm! Thanks! Let's start then! maning > ___ > talk mailing list > talk@openstreetmap.org > http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, I can see two replies from people suggesting different ways of dealing with the problem. What I was after was a quick practical way to fix my mistake. I thought that as osm was on a sql database someone who new sql magic could just enter some commands to reverse the edits. Martijn's method would be great if only certain types of data had been removed, or in a certain area, but this could be anything in the whole of the Philippines. I could just select everything in the Philippines.osm file I have and add/remove the dummy tags, but I'd probably still be uploading the corrections this time next year And I still don't know why JOSM did this :( I dread to think what would happen if some map vandals decided to delete large chunks of different parts of the world. How can I ruin openstreetmap ? I know I'll go to their website and just delete whatever I feel like using potlatch. Cheers, Ian - Yahoo! Answers - Get better answers from someone who knows. Tryit now.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Ian Haylock wrote: > How can I ruin openstreetmap ? I know I'll go to their website and > just delete whatever I feel like using potlatch. Fortunately, Potlatch has undelete. :) cheers Richard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, Ok I'm trying Martijn's method, but I'm just starting with Manila, as that's the most mapped part of the Philippines. So if Maning, and anyone else helping to fix this could just sit back and wait I'll let you know when the upload finishes. Hopefully no brown-outs or ISP disconnections for a while (crosses fingers) Cheers, Ian - Sent from Yahoo! - a smarter inbox.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
On Jan 16, 2008 3:17 PM, Ian Haylock <[EMAIL PROTECTED]> wrote: > And I still don't know why JOSM did this :( You mean you don't know how oyu managed to delete so much, or you don't know how you managed to upload it even though it showed you a list of all the things that were going to be deleted? > I dread to think what would happen if some map vandals decided to delete > large chunks of different parts of the world. Undelete it the same way you did. The planet dumps and daily diff show what was deleted so you can easily undo it. > How can I ruin openstreetmap ? I know I'll go to their website and just > delete whatever I feel like using potlatch. This is hardly news... Have a nice day, -- Martijn van Oosterhout <[EMAIL PROTECTED]> http://svana.org/kleptog/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, Richard Fairhurst <[EMAIL PROTECTED]> wrote:Fortunately, Potlatch has undelete. :) Maybe there could be an option added to JOSM to allow editing history to be saved, instead of just deleting it when uploading is finished, that would have saved my bacon. Also, the potlatch undelete would only work if you knew what needed fixing. If a vandle was to just jump all over the map deleting random objects, where would you start, when fixing the damage. It's not such a small world after all :-) Maybe if the database also logged the ip address of the uploader (waits for the uproar from the privacy people to subside), then all the edits could be found merely by searching the database using ip address and time frame. Cheers, Ian - Sent from Yahoo! - a smarter inbox.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
> Maybe if the database also logged the ip address > of the uploader (waits for the uproar from the > privacy people to subside), then all the edits could > be found merely by searching the database using ip > address and time frame. The mediawiki software logs ip addresses behind every edit and I haven't heard massive outcry in the tubes over that practice. I would imagine most people would expect the server to log such information. Cheers, Charles ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, Martijn van Oosterhout <[EMAIL PROTECTED]> wrote:You mean you don't know how oyu managed to delete so much, or you don't know how you managed to upload it even though it showed you a list of all the things that were going to be deleted? No, I don't check everything in the upload dialog box, before I upload. I have never done something so stupid before when uploading data, so I have always assumed whatever JOSM says is ok. Yes my fault for just assuming. > delete whatever I feel like using potlatch. This is hardly news... And what has / is being done about it ? P.S. Thanks for the suggestion for fixing the mistake. Not the first time you've helped me out. Cheers, Ian - Sent from Yahoo! - a smarter inbox.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
In message <[EMAIL PROTECTED]> Ian Haylock <[EMAIL PROTECTED]> wrote: > Maybe if the database also logged the ip address of the uploader (waits > for the uproar from the privacy people to subside), then all the edits > could be found merely by searching the database using ip address and time > frame. All edits are logged against the user id of the uploader anyway, so that doesn't gain you anything (wikipedia does it because it allows anonymous edits). Tom -- Tom Hughes ([EMAIL PROTECTED]) http://www.compton.nu/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
In message <[EMAIL PROTECTED]> Ian Haylock <[EMAIL PROTECTED]> wrote: > And what has / is being done about it ? We're waiting for somebody to write code to group edits into changesets and allow them to be rolled back. Tom -- Tom Hughes ([EMAIL PROTECTED]) http://www.compton.nu/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
On Wed, 16 Jan 2008 17:49:31 -0600 (CST) <[EMAIL PROTECTED]> wrote: > > Maybe if the database also logged the ip address > > of the uploader (waits for the uproar from the > > privacy people to subside), then all the edits could > > be found merely by searching the database using ip > > address and time frame. > > The mediawiki software logs ip addresses behind every edit and I > haven't heard massive outcry in the tubes over that practice. I would > imagine most people would expect the server to log such information. Mediawiki logs IP adresses because it (can) allow(s) anonymouse edits. Neither Potlatch nor JOSM allow anonymouse edits. Maybe you forgot you had to setup a password and username when you started using JOSM? So storing IP-adresses won't help you more than simply looking at the username: ergo it would be just wasted bits in the database. Cartinus ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, Tom Hughes <[EMAIL PROTECTED]> wrote:All edits are logged against the user id of the uploader anyway, so that doesn't gain you anything Is this true with potatch as well ? Just curious, but what would be involved in undoing someones edits in the database ? i.e. suppose I deleted a way, then uploaded the edit to the database. Does sql delete all the data for the way in the database ? Or just mark the data as deleted ? Cheers, Ian - Sent from Yahoo! - a smarter inbox.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, Tom Hughes <[EMAIL PROTECTED]> wrote: We're waiting for somebody to write code to group edits into changesets and allow them to be rolled back. How I wish that had already been done :-) Cheers, Ian - Yahoo! Answers - Get better answers from someone who knows. Tryit now.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Ian Haylock wrote: >> All edits are logged against the user id of the uploader anyway, so >> that doesn't gain you anything > > Is this true with potatch as well ? Yes, Potlatch treats the database in just the same way that JOSM and other tools do, even though the code and user interface are very different. In one way Potlatch is actually stricter in that it won't let you edit the map unless you've set your edits to be public (i.e. publically attributed to your user name). > Just curious, but what would be involved in undoing someones edits > in the database ? > i.e. suppose I deleted a way, then uploaded the edit to the database. > Does sql delete all the data for the way in the database ? Or > just mark the data as deleted ? It marks it as deleted. We store "history" for each way and node, just as Wikipedia does for articles. It's just that it's more complex to retrieve the history in a map than it is in a textual website. When you select "undelete" in Potlatch, it looks for all the deleted ways that have deleted nodes in your current map view, and presents them all to you for recovery. cheers Richard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
Hi, > The easiest way to fix this is to cut the phillipines out of the last > planet dump and load it into JOSM, pick all the deleted objects and > add and remove a dummy tag and hit upload. I always considered this (meaning: uploading of objects that have not chnaged) a bug in JOSM that I should fix sooner or later but then again, maybe just leave that behaviour in ;-) Bye Frederik -- Frederik Ramm ## eMail [EMAIL PROTECTED] ## N49°00.09' E008°23.33' ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Deleted Place names in the Philippines
In message <[EMAIL PROTECTED]> Ian Haylock <[EMAIL PROTECTED]> wrote: > Tom Hughes <[EMAIL PROTECTED]> wrote: > > > All edits are logged against the user id of the uploader anyway, so > > that doesn't gain you anything > > Is this true with potatch as well ? Yes. > Just curious, but what would be involved in undoing someones edits > in the database ? Well the first problem is finding them - there are a lot of objects in the database and there are no indexes on the user so finding edits by a given user is hard to start with. > i.e. suppose I deleted a way, then uploaded the edit to the database. > Does sql delete all the data for the way in the database ? Or > just mark the data as deleted ? In the case of a delete the object is marked as deleted in the live table and a new record is added to the history table marking the object as deleted. To answer your question more generally, all edits are recorded in a set of history tables so no data is lost as such. It's just not very easy to find and restore. Tom -- Tom Hughes ([EMAIL PROTECTED]) http://www.compton.nu/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
