Re: [OSM-talk-be] Blackspots

2011-10-14 Thread Jan-willem De Bleser
On Fri, Oct 14, 2011 at 16:10, Ben Abelshausen
 wrote:
> Hello,
>
> I have this data I would like to share with the Belgian mappers:
> http://www.14k.be/node/179 !
>

Hi Ben,

Fascinating idea. If I understand correctly, you have a (confidential)
list of addresses and are checking if they can be found in OSM? I
assume you already have GPS coordinates for these addresses and place
a black spot there if the street is not found?

You can't share the addresses, but you can share rendered heatmaps?
How large is the collection of images? Is it at one fixed zoom level?

I think they would be useful for active mappers, who can then check if
there are any areas in their territory they may have missed. Few
people will want the whole data set, so we should find some way of
making it available by region. I know I'd be interested to see if
there are any black spots near my home.

Cheers,
Jw

___
Talk-be mailing list
Talk-be@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk-be


Re: [OSM-talk-be] Blackspots

2011-10-14 Thread Ben Abelshausen
It's nog exactly as you are describing it. I have a dataset of addresses
(geocoded with lat/lon) covering almost all of Flanders. Then we use our
software to find the closest street with the same name. If no street with
the same name can be found the closest street is taken.

This all returns a distance and then we filter all these that have distances
higher than let's say 50m. This gives us a good estimate of where roads are
missing!

I can share lat/lon/distance records that we use to generate the 'heat'maps.
I think there are about 5 with a distance > 50m. The records will have
no address data (postalcode, street, housenumber), that is the part i am not
supposed to share.

I hope you can understand my chaotic explanation! :-)


On Fri, Oct 14, 2011 at 5:28 PM, Jan-willem De Bleser
wrote:

> On Fri, Oct 14, 2011 at 16:10, Ben Abelshausen
>  wrote:
> > Hello,
> >
> > I have this data I would like to share with the Belgian mappers:
> > http://www.14k.be/node/179 !
> >
>
> Hi Ben,
>
> Fascinating idea. If I understand correctly, you have a (confidential)
> list of addresses and are checking if they can be found in OSM? I
> assume you already have GPS coordinates for these addresses and place
> a black spot there if the street is not found?
>
> You can't share the addresses, but you can share rendered heatmaps?
> How large is the collection of images? Is it at one fixed zoom level?
>
> I think they would be useful for active mappers, who can then check if
> there are any areas in their territory they may have missed. Few
> people will want the whole data set, so we should find some way of
> making it available by region. I know I'd be interested to see if
> there are any black spots near my home.
>
> Cheers,
> Jw
>
> ___
> Talk-be mailing list
> Talk-be@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/talk-be
>
___
Talk-be mailing list
Talk-be@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk-be


Re: [OSM-talk-be] Blackspots

2011-10-14 Thread Jan-willem De Bleser
I think I understand :)

On Fri, Oct 14, 2011 at 18:16, Ben Abelshausen
 wrote:
> ...If no street with
> the same name can be found the closest street is taken.
>
> This all returns a distance and then we filter all these that have distances
> higher than let's say 50m. This gives us a good estimate of where roads are
> missing!
>

This'll help avoid spelling mismatches, but doesn't it mean that a
missing address won't show up in the heat map if it's within 50m of
any other street, even the wrong one? Any idea if this is a
significant problem? Say, for example, addresses on a city alley
missing from OSM but near another street?

> I can share lat/lon/distance records that we use to generate the 'heat'maps.
> I think there are about 5 with a distance > 50m. The records will have
> no address data (postalcode, street, housenumber), that is the part i am not
> supposed to share.

So, a table of lat/lon/dist values where you know of an address but no
street is nearby, from which we can generate heatmaps. It should be
small enough to throw up on a website somewhere, and then we just need
a script to do the rendering. I'd be interested in working that out
(probably possible with GDAL or similar) but I'm away next week so it
won't be for right away.

Cheers,
Jw

___
Talk-be mailing list
Talk-be@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk-be


Re: [OSM-talk-be] Blackspots

2011-10-14 Thread Ben Abelshausen
We use a matching algorithm that still recognizes streets with small
spelling errors and takes into account derivations like st. and straat.
Spelling shouldn't be a problem.

I'll see if I can prepare the data in a good format for you. Also an update
mechanism would be nice. After updating osm blackspots should dissappear!
:-)

The updates will be max daily.

If you can do all this that would be great! It's not that urgent so take
your time!

Regards,


Ben


On Fri, Oct 14, 2011 at 6:39 PM, Jan-willem De Bleser
wrote:

> I think I understand :)
>
> On Fri, Oct 14, 2011 at 18:16, Ben Abelshausen
>  wrote:
> > ...If no street with
> > the same name can be found the closest street is taken.
> >
> > This all returns a distance and then we filter all these that have
> distances
> > higher than let's say 50m. This gives us a good estimate of where roads
> are
> > missing!
> >
>
> This'll help avoid spelling mismatches, but doesn't it mean that a
> missing address won't show up in the heat map if it's within 50m of
> any other street, even the wrong one? Any idea if this is a
> significant problem? Say, for example, addresses on a city alley
> missing from OSM but near another street?
>
> > I can share lat/lon/distance records that we use to generate the
> 'heat'maps.
> > I think there are about 5 with a distance > 50m. The records will
> have
> > no address data (postalcode, street, housenumber), that is the part i am
> not
> > supposed to share.
>
> So, a table of lat/lon/dist values where you know of an address but no
> street is nearby, from which we can generate heatmaps. It should be
> small enough to throw up on a website somewhere, and then we just need
> a script to do the rendering. I'd be interested in working that out
> (probably possible with GDAL or similar) but I'm away next week so it
> won't be for right away.
>
> Cheers,
> Jw
>
> ___
> Talk-be mailing list
> Talk-be@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/talk-be
>
___
Talk-be mailing list
Talk-be@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk-be


Re: [OSM-talk-be] Blackspots

2011-10-14 Thread Jan-willem De Bleser
On Fri, Oct 14, 2011 at 18:48, Ben Abelshausen
 wrote:
> We use a matching algorithm that still recognizes streets with small
> spelling errors and takes into account derivations like st. and straat.
> Spelling shouldn't be a problem.

Ah, ok. But you also said earlier that:

> If no street with the same name can be found the closest street is taken.

...which I understood to mean that if  you have an address, say 123
Fake St, and Fake St is missing but this address happens to be within
50m of Main St, it will not be marked with a black spot?

>
> I'll see if I can prepare the data in a good format for you. Also an update
> mechanism would be nice. After updating osm blackspots should dissappear!
> :-)
>
> The updates will be max daily.
>
> If you can do all this that would be great! It's not that urgent so take
> your time!

I'll do my best. I don't have anywhere to run a full slippy map, but
if we make it easy for people to generate the heatmaps themselves it
should already be helpful.

Cheers,
Jw

___
Talk-be mailing list
Talk-be@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk-be


Re: [OSM-talk-be] Blackspots

2011-10-17 Thread Marc Coevoet

Op 14-10-11 18:16, Ben Abelshausen schreef:

It's nog exactly as you are describing it. I have a dataset of addresses
(geocoded with lat/lon) covering almost all of Flanders. Then we use our
software to find the closest street with the same name. If no street
with the same name can be found the closest street is taken.



like I see it, it might come from Belgian kADASTER INFO?

Marc
--
The "Penguin" has arrived - and he's not going away - ever.
What's on Shortwave guide: choose an hour, go!
http://shortwave.tk
700+ Radio Stations on SW http://swstations.tk
300+ languages on SW http://radiolanguages.tk

___
Talk-be mailing list
Talk-be@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk-be


Re: [OSM-talk-be] Blackspots

2011-10-18 Thread Ben Abelshausen
We have purchased this data and yes I believe it is goverment data. We will
never be allowed to anything more with it then this quality check however so
let's not even go there. Let there not be any doubt that we are NOT using
this data to import stuff into osm!!


On Fri, Oct 14, 2011 at 7:03 PM, Marc Coevoet  wrote:

> Op 14-10-11 18:16, Ben Abelshausen schreef:
>
>  It's nog exactly as you are describing it. I have a dataset of addresses
>> (geocoded with lat/lon) covering almost all of Flanders. Then we use our
>> software to find the closest street with the same name. If no street
>> with the same name can be found the closest street is taken.
>>
>>
> like I see it, it might come from Belgian kADASTER INFO?
>
> Marc
> --
> The "Penguin" has arrived - and he's not going away - ever.
> What's on Shortwave guide: choose an hour, go!
> http://shortwave.tk
> 700+ Radio Stations on SW http://swstations.tk
> 300+ languages on SW http://radiolanguages.tk
>
___
Talk-be mailing list
Talk-be@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk-be