Re: [OSM-talk] bulk merge of duplicate points

2010-04-29 Thread Frank Sautter
Robin Paulson wrote:
> On 28 April 2010 18:33, Vincent Pottier  wrote:
>>> we have a situation as part of the LINZ import where some nodes
>>> need to be merged - specifically cattle stops, gates, etc. with
>>> roads. there are lots of these, so we would like to do it
>>> programmatically.
>>> 
>>> is there a tool to do this en masse? either a josm plugin
>> The validator plugin...
> can this be made to run in a bulk fashion? i was under the impression
>  after running the check, it required each set of duplicate nodes to
> be accepted for merging. we will potentially have tens of thousands
> of duplicates, so this isn't really on

afair this could be done by clicking on the folder containing all these 
types of errors.

frank


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] bulk merge of duplicate points

2010-04-29 Thread Elizabeth Dodd
On Thu, 29 Apr 2010, Robin Paulson wrote:
> On 29 April 2010 21:29, Liz  wrote:
> > It would help if you thought a little more about duplicate things on the
> > one position.
> > E.g. Service Station
> > could have 5 or 6 types of fuel, an address, a phone number, notes about
> > ancillary services - car wash, groceries, telephone, atm machine,
> > A number of these are "amenity=xxx" and if you merge the nodes you will
> > have data loss, or difficulty in post-processing data if you string it
> > all together.
> > The next category are things that are at different heights in the same
> > location - a multistorey building with basement parking, ground level
> > shops, upper levels offices and on the roof various aerials.
> > How will you merge all of those and not lose information?
> 
> yes, we've thought about that, and realise that some of them should
> stay unmerged. the specific example we have from the import so far
> (there will be more) are fences round the edge of golf courses. the
> fence and the golf course edge do coincide, but the import scripts
> we're using have created duplicate nodes, as the two imports are from
> two different shape files within the same data set
> 

In particular, where roads in Australia overlie imported admin_boundary nodes 
and ways, we do not want them merged. Editing the relations of the 
admin_boundaries often breaks the relations. Secondly, the roads move (in 
terms of the passage of years) in rural areas, while the boundaries do not.

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] bulk merge of duplicate points

2010-04-29 Thread Robin Paulson
On 29 April 2010 21:29, Liz  wrote:
> It would help if you thought a little more about duplicate things on the one
> position.
> E.g. Service Station
> could have 5 or 6 types of fuel, an address, a phone number, notes about
> ancillary services - car wash, groceries, telephone, atm machine,
> A number of these are "amenity=xxx" and if you merge the nodes you will have
> data loss, or difficulty in post-processing data if you string it all
> together.
> The next category are things that are at different heights in the same
> location - a multistorey building with basement parking, ground level shops,
> upper levels offices and on the roof various aerials.
> How will you merge all of those and not lose information?

yes, we've thought about that, and realise that some of them should
stay unmerged. the specific example we have from the import so far
(there will be more) are fences round the edge of golf courses. the
fence and the golf course edge do coincide, but the import scripts
we're using have created duplicate nodes, as the two imports are from
two different shape files within the same data set

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] bulk merge of duplicate points

2010-04-29 Thread Liz
On Thu, 29 Apr 2010, Robin Paulson wrote:
> can this be made to run in a bulk fashion? i was under the impression
> after running the check, it required each set of duplicate nodes to be
> accepted for merging. we will potentially have tens of thousands of
> duplicates, so this isn't really on
> 
It would help if you thought a little more about duplicate things on the one 
position.
E.g. Service Station
could have 5 or 6 types of fuel, an address, a phone number, notes about 
ancillary services - car wash, groceries, telephone, atm machine, 
A number of these are "amenity=xxx" and if you merge the nodes you will have 
data loss, or difficulty in post-processing data if you string it all 
together.
The next category are things that are at different heights in the same 
location - a multistorey building with basement parking, ground level shops, 
upper levels offices and on the roof various aerials.
How will you merge all of those and not lose information?


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] bulk merge of duplicate points

2010-04-28 Thread andrzej zaborowski
On 28 April 2010 01:43, Robin Paulson  wrote:
> we have a situation as part of the LINZ import where some nodes need
> to be merged - specifically cattle stops, gates, etc. with roads.
> there are lots of these, so we would like to do it programmatically.

I'd try to do it as a part of whatever conversion script is used.
It's a simple feature if the language the script is in has
dictionaries, then you can just use the coordinates pair as key (or a
string version of them to avoid floating point comparison).

Cheers

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] bulk merge of duplicate points

2010-04-28 Thread Ian Dees
On Wed, Apr 28, 2010 at 4:25 PM, Robin Paulson wrote:

> On 28 April 2010 18:33, Vincent Pottier  wrote:
> >> we have a situation as part of the LINZ import where some nodes need
> >> to be merged - specifically cattle stops, gates, etc. with roads.
> >> there are lots of these, so we would like to do it programmatically.
> >>
> >> is there a tool to do this en masse? either a josm plugin
> >
> > The validator plugin...
>
> can this be made to run in a bulk fashion? i was under the impression
> after running the check, it required each set of duplicate nodes to be
> accepted for merging. we will potentially have tens of thousands of
> duplicates, so this isn't really on
>

How were you planning on automatically handling the merge? How are you going
to handle the case where two things are actually occupying the exact same
location but don't belong on the same node?
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] bulk merge of duplicate points

2010-04-28 Thread Robin Paulson
On 28 April 2010 18:33, Vincent Pottier  wrote:
>> we have a situation as part of the LINZ import where some nodes need
>> to be merged - specifically cattle stops, gates, etc. with roads.
>> there are lots of these, so we would like to do it programmatically.
>>
>> is there a tool to do this en masse? either a josm plugin
>
> The validator plugin...

can this be made to run in a bulk fashion? i was under the impression
after running the check, it required each set of duplicate nodes to be
accepted for merging. we will potentially have tens of thousands of
duplicates, so this isn't really on

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] bulk merge of duplicate points

2010-04-28 Thread Frank Sautter
Robin Paulson wrote:
> is there a josm plugin?

i think the josm validator plugin should do the job.

frank

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk


[OSM-talk] bulk merge of duplicate points

2010-04-27 Thread Robin Paulson
we have a situation as part of the LINZ import where some nodes need
to be merged - specifically cattle stops, gates, etc. with roads.
there are lots of these, so we would like to do it programmatically.

is there a tool to do this en masse? either a josm plugin, or some
command-line tool?

cheers

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk