Re: [OSM-talk-be] Blackspots
On Fri, Oct 14, 2011 at 16:10, Ben Abelshausen wrote: > Hello, > > I have this data I would like to share with the Belgian mappers: > http://www.14k.be/node/179 ! > Hi Ben, Fascinating idea. If I understand correctly, you have a (confidential) list of addresses and are checking if they can be found in OSM? I assume you already have GPS coordinates for these addresses and place a black spot there if the street is not found? You can't share the addresses, but you can share rendered heatmaps? How large is the collection of images? Is it at one fixed zoom level? I think they would be useful for active mappers, who can then check if there are any areas in their territory they may have missed. Few people will want the whole data set, so we should find some way of making it available by region. I know I'd be interested to see if there are any black spots near my home. Cheers, Jw ___ Talk-be mailing list Talk-be@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-be
Re: [OSM-talk-be] Blackspots
It's nog exactly as you are describing it. I have a dataset of addresses (geocoded with lat/lon) covering almost all of Flanders. Then we use our software to find the closest street with the same name. If no street with the same name can be found the closest street is taken. This all returns a distance and then we filter all these that have distances higher than let's say 50m. This gives us a good estimate of where roads are missing! I can share lat/lon/distance records that we use to generate the 'heat'maps. I think there are about 5 with a distance > 50m. The records will have no address data (postalcode, street, housenumber), that is the part i am not supposed to share. I hope you can understand my chaotic explanation! :-) On Fri, Oct 14, 2011 at 5:28 PM, Jan-willem De Bleser wrote: > On Fri, Oct 14, 2011 at 16:10, Ben Abelshausen > wrote: > > Hello, > > > > I have this data I would like to share with the Belgian mappers: > > http://www.14k.be/node/179 ! > > > > Hi Ben, > > Fascinating idea. If I understand correctly, you have a (confidential) > list of addresses and are checking if they can be found in OSM? I > assume you already have GPS coordinates for these addresses and place > a black spot there if the street is not found? > > You can't share the addresses, but you can share rendered heatmaps? > How large is the collection of images? Is it at one fixed zoom level? > > I think they would be useful for active mappers, who can then check if > there are any areas in their territory they may have missed. Few > people will want the whole data set, so we should find some way of > making it available by region. I know I'd be interested to see if > there are any black spots near my home. > > Cheers, > Jw > > ___ > Talk-be mailing list > Talk-be@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk-be > ___ Talk-be mailing list Talk-be@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-be
Re: [OSM-talk-be] Blackspots
I think I understand :) On Fri, Oct 14, 2011 at 18:16, Ben Abelshausen wrote: > ...If no street with > the same name can be found the closest street is taken. > > This all returns a distance and then we filter all these that have distances > higher than let's say 50m. This gives us a good estimate of where roads are > missing! > This'll help avoid spelling mismatches, but doesn't it mean that a missing address won't show up in the heat map if it's within 50m of any other street, even the wrong one? Any idea if this is a significant problem? Say, for example, addresses on a city alley missing from OSM but near another street? > I can share lat/lon/distance records that we use to generate the 'heat'maps. > I think there are about 5 with a distance > 50m. The records will have > no address data (postalcode, street, housenumber), that is the part i am not > supposed to share. So, a table of lat/lon/dist values where you know of an address but no street is nearby, from which we can generate heatmaps. It should be small enough to throw up on a website somewhere, and then we just need a script to do the rendering. I'd be interested in working that out (probably possible with GDAL or similar) but I'm away next week so it won't be for right away. Cheers, Jw ___ Talk-be mailing list Talk-be@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-be
Re: [OSM-talk-be] Blackspots
We use a matching algorithm that still recognizes streets with small spelling errors and takes into account derivations like st. and straat. Spelling shouldn't be a problem. I'll see if I can prepare the data in a good format for you. Also an update mechanism would be nice. After updating osm blackspots should dissappear! :-) The updates will be max daily. If you can do all this that would be great! It's not that urgent so take your time! Regards, Ben On Fri, Oct 14, 2011 at 6:39 PM, Jan-willem De Bleser wrote: > I think I understand :) > > On Fri, Oct 14, 2011 at 18:16, Ben Abelshausen > wrote: > > ...If no street with > > the same name can be found the closest street is taken. > > > > This all returns a distance and then we filter all these that have > distances > > higher than let's say 50m. This gives us a good estimate of where roads > are > > missing! > > > > This'll help avoid spelling mismatches, but doesn't it mean that a > missing address won't show up in the heat map if it's within 50m of > any other street, even the wrong one? Any idea if this is a > significant problem? Say, for example, addresses on a city alley > missing from OSM but near another street? > > > I can share lat/lon/distance records that we use to generate the > 'heat'maps. > > I think there are about 5 with a distance > 50m. The records will > have > > no address data (postalcode, street, housenumber), that is the part i am > not > > supposed to share. > > So, a table of lat/lon/dist values where you know of an address but no > street is nearby, from which we can generate heatmaps. It should be > small enough to throw up on a website somewhere, and then we just need > a script to do the rendering. I'd be interested in working that out > (probably possible with GDAL or similar) but I'm away next week so it > won't be for right away. > > Cheers, > Jw > > ___ > Talk-be mailing list > Talk-be@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk-be > ___ Talk-be mailing list Talk-be@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-be
Re: [OSM-talk-be] Blackspots
On Fri, Oct 14, 2011 at 18:48, Ben Abelshausen wrote: > We use a matching algorithm that still recognizes streets with small > spelling errors and takes into account derivations like st. and straat. > Spelling shouldn't be a problem. Ah, ok. But you also said earlier that: > If no street with the same name can be found the closest street is taken. ...which I understood to mean that if you have an address, say 123 Fake St, and Fake St is missing but this address happens to be within 50m of Main St, it will not be marked with a black spot? > > I'll see if I can prepare the data in a good format for you. Also an update > mechanism would be nice. After updating osm blackspots should dissappear! > :-) > > The updates will be max daily. > > If you can do all this that would be great! It's not that urgent so take > your time! I'll do my best. I don't have anywhere to run a full slippy map, but if we make it easy for people to generate the heatmaps themselves it should already be helpful. Cheers, Jw ___ Talk-be mailing list Talk-be@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-be
Re: [OSM-talk-be] Blackspots
Op 14-10-11 18:16, Ben Abelshausen schreef: It's nog exactly as you are describing it. I have a dataset of addresses (geocoded with lat/lon) covering almost all of Flanders. Then we use our software to find the closest street with the same name. If no street with the same name can be found the closest street is taken. like I see it, it might come from Belgian kADASTER INFO? Marc -- The "Penguin" has arrived - and he's not going away - ever. What's on Shortwave guide: choose an hour, go! http://shortwave.tk 700+ Radio Stations on SW http://swstations.tk 300+ languages on SW http://radiolanguages.tk ___ Talk-be mailing list Talk-be@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-be
Re: [OSM-talk-be] Blackspots
We have purchased this data and yes I believe it is goverment data. We will never be allowed to anything more with it then this quality check however so let's not even go there. Let there not be any doubt that we are NOT using this data to import stuff into osm!! On Fri, Oct 14, 2011 at 7:03 PM, Marc Coevoet wrote: > Op 14-10-11 18:16, Ben Abelshausen schreef: > > It's nog exactly as you are describing it. I have a dataset of addresses >> (geocoded with lat/lon) covering almost all of Flanders. Then we use our >> software to find the closest street with the same name. If no street >> with the same name can be found the closest street is taken. >> >> > like I see it, it might come from Belgian kADASTER INFO? > > Marc > -- > The "Penguin" has arrived - and he's not going away - ever. > What's on Shortwave guide: choose an hour, go! > http://shortwave.tk > 700+ Radio Stations on SW http://swstations.tk > 300+ languages on SW http://radiolanguages.tk > ___ Talk-be mailing list Talk-be@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-be