On Thu, Jun 9, 2011 at 12:27 PM, Ben Supnik <bsup...@xsquawkbox.net> wrote:
> Hi Y'all, > > I apologize for going NORDO for a while there. :-( I have integrated > James' latest NHD conversion rules. > > Test data: > > http://dev.x-plane.com/download/01090001.zip > > The entire process is running now...not sure how long it will take to > complete - it looks like it could take up to a week to convert all of HUCs. > > If anyone has feedback on that converted set of XML files, please let me > know, otherwise I'll let it keep running. > > Based on the threads about broken imports that took place over the last few > weeks, it looks like there is still an additional problem: even given > pre-converted data, users who want to do a import may get killed when their > import fails, leaving a splattering of broken nodes all over the place. :-( > > There isn't a whole lot we can do to outright *prevent* this, but there is some mitigation: 1) The XML converter should split up the data so that ways and their nodes are in the same XML file. I *think* my shp-to-osm tries to do this. If you end up with a bunch of XML files that have 50k node elements in them then you're doing it wrong [0]. 2) Each XML file should contain fewer than the absolute maximum number of changes allowed by the API and should be uploaded using the diff upload API endpoint. 3) The upload script should keep track of the response information to see what nodes actually get uploaded. If I remember correctly there's no way to know which elements in a diff upload were successful and which weren't if you receive an error in the reply from the server. [0] This is how a lot of the original NHD imports got screwed up and left behind thousands of orphaned nodes.
_______________________________________________ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
