Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source
[resending as my original reply was inadvertently off-list] On 31 August 2012 12:12, Andrew Mackenzie wrote: > there is another approach, which is to download the data for all companies > in the UK from Companies House. There may be other (open-) databases which include address-postcode pairs; for example NHS pharmacies, GP surgeries and dentists; police stations; schools; licenced premises (alcohol, gambling, sex shops) restaurants and takeaways assessed for health issues; listed buildings; etc. -- Andy Mabbett @pigsonthewing http://pigsonthewing.org.uk ___ Talk-gb-westmidlands mailing list Talk-gb-westmidlands@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands
Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source
I’ve just downloaded this. It looks like it contains Registered Office address which isn’t necessarily the same as the business (trading) address – for example where I used to work in Pattingham used to have a registered office in Dudley (the accountants address, I understand), and having just checked their entry this is still the case (the business address is now in Bridgnorth, but the registered office is still in Dudley). It doesn’t stop the source being used for checking postcodes to addresses, but I’d be careful about extracting any other information from it. Ed From: Andrew Mackenzie [mailto:a.macken...@bethere.co.uk] Sent: 31 August 2012 11:13 To: Andy Robinson Cc: talk-gb-westmidlands@openstreetmap.org Subject: Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source Hi all there is another approach, which is to download the data for all companies in the UK from Companies House. This became available as free public data in July. The full address and postcode is there along with a URI (not the same as the company number). I prefer this approach to private house sales because - companies want to be found - there isn't a privacy issue from address being matched to other data to identify individuals (although that will happen) - OSM has less complete business listings than Google maps. For SMEs the company address and business premises will often be the same. - connecting OSM location data with Open Corporates http://opencorporates.com/ would enhance both services. The data is listed alphabetically. Would be useful to group them geographically and extract the West Midlands addresses. It's not difficult to extract the column for URIs, which gives the link to the Companies House web page for the company. Download the data from http://download.companieshouse.gov.uk/en_output.html Andrew On 31 Aug 2012, at 10:48, Andy Robinson wrote: http://www.landregistry.gov.uk/public/information/public-data/price- paid-dat a -Original Message- From: Big Fat Frog [mailto:bigfatfro...@gmail.com] Sent: 31 August 2012 10:11 To: talk-gb-westmidlands@openstreetmap.org Subject: Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source Have I missed something? What datasource are you referring to here? Jonathan On 31/08/2012 09:44, Andy Robinson wrote: In the meantime I'm just downloading the files and filtering in spreadsheet for my patch (Sutton Coldfield) and then checking/adding postcode data for the handful of addresses it contains for each month. Though this only really works if you have the majority of your building addressing done for an area. As I'm now adding some postcode data from this source I've added the required attribution to http://wiki.openstreetmap.org/wiki/Contributors#United_Kingdom Incidentally, what do folks feel about adding any of the other data from the dataset?: .the full address of the property (Primary addressable object name (PAON), Secondary addressable object name (SAON), street, postcode, locality (if available), town, district, county) .the price paid for the property .the date of transfer .the property type (Detached, Semi, Terraced, Flat/Maisonette) .whether the property is new build or not .whether the property is freehold or leasehold. Cheers Andy *From:*Brian Prangle [mailto:bpran...@gmail.com] *Sent:* 31 August 2012 08:27 *To:* Rob Nickerson; talk-gb-westmidlands *Subject:* Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source I'd agree with Rob's logic and extend it to show one of three results: postcode missing or postcode incomplete or postcode incorrect. We have loads of addresses with only the first group in place e.g B27 and I'm sure when we were using codepoint( before we knew it was dodgy in licensing terms) we chose the wrong break point in address runs. We currently have 61272 addresses in the W Mids and 44164 have postcodes. regards Brian On 30 August 2012 18:35, Rob Nickerson mailto:rob.j.nicker...@gmail.com>> wrote: == Matt wrote == This does indeed seem like a very useful data source. Great find! However, I'm struggling to think of a nice way of visualising it to make it useful. What I've got so far in my mind is: - Take an entry from the list - Take its postcode - Search for the postcode (I've got a curated list of postcodes as part of my PostCodeFinder [1]) - Get the location of the nearest match (hopefully, we'll find at least a CV4-type segment match) - Search for roads within an x mile radius with a matching name - Associate that entry with that road == End Message == Hi Matt, I was actually thinking the other way round. That is: Pull in a list of building with addresses but no postcode in OSM (with their way IDs) a
Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source
Hi all there is another approach, which is to download the data for all companies in the UK from Companies House. This became available as free public data in July. The full address and postcode is there along with a URI (not the same as the company number). I prefer this approach to private house sales because - companies want to be found - there isn't a privacy issue from address being matched to other data to identify individuals (although that will happen) - OSM has less complete business listings than Google maps. For SMEs the company address and business premises will often be the same. - connecting OSM location data with Open Corporates http://opencorporates.com/ would enhance both services. The data is listed alphabetically. Would be useful to group them geographically and extract the West Midlands addresses. It's not difficult to extract the column for URIs, which gives the link to the Companies House web page for the company. Download the data from http://download.companieshouse.gov.uk/en_output.html Andrew On 31 Aug 2012, at 10:48, Andy Robinson wrote: > http://www.landregistry.gov.uk/public/information/public-data/price-paid-dat > a > > >> -Original Message- >> From: Big Fat Frog [mailto:bigfatfro...@gmail.com] >> Sent: 31 August 2012 10:11 >> To: talk-gb-westmidlands@openstreetmap.org >> Subject: Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential > data >> source >> >> Have I missed something? What datasource are you referring to here? >> >> Jonathan >> >> On 31/08/2012 09:44, Andy Robinson wrote: >>> In the meantime I'm just downloading the files and filtering in >>> spreadsheet for my patch (Sutton Coldfield) and then checking/adding >>> postcode data for the handful of addresses it contains for each month. >>> Though this only really works if you have the majority of your >>> building addressing done for an area. >>> >>> As I'm now adding some postcode data from this source I've added the >>> required attribution to >>> http://wiki.openstreetmap.org/wiki/Contributors#United_Kingdom >>> >>> Incidentally, what do folks feel about adding any of the other data >>> from the dataset?: >>> >>> .the full address of the property (Primary addressable object name >>> (PAON), Secondary addressable object name (SAON), street, postcode, >>> locality (if available), town, district, county) >>> >>> .the price paid for the property >>> >>> .the date of transfer >>> >>> .the property type (Detached, Semi, Terraced, Flat/Maisonette) >>> >>> .whether the property is new build or not >>> >>> .whether the property is freehold or leasehold. >>> >>> Cheers >>> >>> Andy >>> >>> *From:*Brian Prangle [mailto:bpran...@gmail.com] >>> *Sent:* 31 August 2012 08:27 >>> *To:* Rob Nickerson; talk-gb-westmidlands >>> *Subject:* Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - >>> Potential data source >>> >>> I'd agree with Rob's logic and extend it to show one of three results: >>> postcode missing or postcode incomplete or postcode incorrect. We have >>> loads of addresses with only the first group in place e.g B27 and I'm >>> sure when we were using codepoint( before we knew it was dodgy in >>> licensing terms) we chose the wrong break point in address runs. We >>> currently have 61272 addresses in the W Mids and 44164 have postcodes. >>> >>> regards >>> >>> Brian >>> >>> On 30 August 2012 18:35, Rob Nickerson >> <mailto:rob.j.nicker...@gmail.com>> wrote: >>> >>> >>> == Matt wrote == >>> >>> This does indeed seem like a very useful data source. Great find! >>> >>> >>> >>> However, I'm struggling to think of a nice way of visualising it to >>> >>> make it useful. What I've got so far in my mind is: >>> >>> - Take an entry from the list >>> >>> - Take its postcode >>> >>> - Search for the postcode (I've got a curated list of postcodes as >>> >>> part of my PostCodeFinder [1]) >>> >>> - Get the location of the nearest match (hopefully, we'll find at >>> >>> least a CV4-type segment match) >>> >>> - Search for roads within an x mile radius with a matching name >>> >>> - Associate that entry with that road >>&
Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source
http://www.landregistry.gov.uk/public/information/public-data/price-paid-dat a > -Original Message- > From: Big Fat Frog [mailto:bigfatfro...@gmail.com] > Sent: 31 August 2012 10:11 > To: talk-gb-westmidlands@openstreetmap.org > Subject: Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data > source > > Have I missed something? What datasource are you referring to here? > > Jonathan > > On 31/08/2012 09:44, Andy Robinson wrote: > > In the meantime I'm just downloading the files and filtering in > > spreadsheet for my patch (Sutton Coldfield) and then checking/adding > > postcode data for the handful of addresses it contains for each month. > > Though this only really works if you have the majority of your > > building addressing done for an area. > > > > As I'm now adding some postcode data from this source I've added the > > required attribution to > > http://wiki.openstreetmap.org/wiki/Contributors#United_Kingdom > > > > Incidentally, what do folks feel about adding any of the other data > > from the dataset?: > > > > .the full address of the property (Primary addressable object name > > (PAON), Secondary addressable object name (SAON), street, postcode, > > locality (if available), town, district, county) > > > > .the price paid for the property > > > > .the date of transfer > > > > .the property type (Detached, Semi, Terraced, Flat/Maisonette) > > > > .whether the property is new build or not > > > > .whether the property is freehold or leasehold. > > > > Cheers > > > > Andy > > > > *From:*Brian Prangle [mailto:bpran...@gmail.com] > > *Sent:* 31 August 2012 08:27 > > *To:* Rob Nickerson; talk-gb-westmidlands > > *Subject:* Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - > > Potential data source > > > > I'd agree with Rob's logic and extend it to show one of three results: > > postcode missing or postcode incomplete or postcode incorrect. We have > > loads of addresses with only the first group in place e.g B27 and I'm > > sure when we were using codepoint( before we knew it was dodgy in > > licensing terms) we chose the wrong break point in address runs. We > > currently have 61272 addresses in the W Mids and 44164 have postcodes. > > > > regards > > > > Brian > > > > On 30 August 2012 18:35, Rob Nickerson > <mailto:rob.j.nicker...@gmail.com>> wrote: > > > > > > == Matt wrote == > > > > This does indeed seem like a very useful data source. Great find! > > > > > > > > However, I'm struggling to think of a nice way of visualising it to > > > > make it useful. What I've got so far in my mind is: > > > > - Take an entry from the list > > > > - Take its postcode > > > > - Search for the postcode (I've got a curated list of postcodes as > > > > part of my PostCodeFinder [1]) > > > > - Get the location of the nearest match (hopefully, we'll find at > > > > least a CV4-type segment match) > > > > - Search for roads within an x mile radius with a matching name > > > > - Associate that entry with that road > > > > == End Message == > > > > Hi Matt, > > I was actually thinking the other way round. That is: > > > > Pull in a list of building with addresses but no postcode in OSM (with their > way IDs) and see if any match up with the Land Registry addresses. This way > we can add postcode to buildings rather than just to the roads. > > > > > > > > > > Not sure if this is any easier/harder to do. > > > > Regards, > > Rob > > > > > > > > ___ > > Talk-GB mailing list > > talk...@openstreetmap.org <mailto:talk...@openstreetmap.org> > > http://lists.openstreetmap.org/listinfo/talk-gb > > > > > > > > ___ > > Talk-gb-westmidlands mailing list > > Talk-gb-westmidlands@openstreetmap.org > > http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands > > > > ___ > Talk-gb-westmidlands mailing list > Talk-gb-westmidlands@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands ___ Talk-gb-westmidlands mailing list Talk-gb-westmidlands@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands
Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source
Have I missed something? What datasource are you referring to here? Jonathan On 31/08/2012 09:44, Andy Robinson wrote: In the meantime I’m just downloading the files and filtering in spreadsheet for my patch (Sutton Coldfield) and then checking/adding postcode data for the handful of addresses it contains for each month. Though this only really works if you have the majority of your building addressing done for an area. As I’m now adding some postcode data from this source I’ve added the required attribution to http://wiki.openstreetmap.org/wiki/Contributors#United_Kingdom Incidentally, what do folks feel about adding any of the other data from the dataset?: ·the full address of the property (Primary addressable object name (PAON), Secondary addressable object name (SAON), street, postcode, locality (if available), town, district, county) ·the price paid for the property ·the date of transfer ·the property type (Detached, Semi, Terraced, Flat/Maisonette) ·whether the property is new build or not ·whether the property is freehold or leasehold. Cheers Andy *From:*Brian Prangle [mailto:bpran...@gmail.com] *Sent:* 31 August 2012 08:27 *To:* Rob Nickerson; talk-gb-westmidlands *Subject:* Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source I'd agree with Rob's logic and extend it to show one of three results: postcode missing or postcode incomplete or postcode incorrect. We have loads of addresses with only the first group in place e.g B27 and I'm sure when we were using codepoint( before we knew it was dodgy in licensing terms) we chose the wrong break point in address runs. We currently have 61272 addresses in the W Mids and 44164 have postcodes. regards Brian On 30 August 2012 18:35, Rob Nickerson mailto:rob.j.nicker...@gmail.com>> wrote: == Matt wrote == This does indeed seem like a very useful data source. Great find! However, I'm struggling to think of a nice way of visualising it to make it useful. What I've got so far in my mind is: - Take an entry from the list - Take its postcode - Search for the postcode (I've got a curated list of postcodes as part of my PostCodeFinder [1]) - Get the location of the nearest match (hopefully, we'll find at least a CV4-type segment match) - Search for roads within an x mile radius with a matching name - Associate that entry with that road == End Message == Hi Matt, I was actually thinking the other way round. That is: Pull in a list of building with addresses but no postcode in OSM (with their way IDs) and see if any match up with the Land Registry addresses. This way we can add postcode to buildings rather than just to the roads. Not sure if this is any easier/harder to do. Regards, Rob ___ Talk-GB mailing list talk...@openstreetmap.org <mailto:talk...@openstreetmap.org> http://lists.openstreetmap.org/listinfo/talk-gb ___ Talk-gb-westmidlands mailing list Talk-gb-westmidlands@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands ___ Talk-gb-westmidlands mailing list Talk-gb-westmidlands@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands
Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source
In the meantime I'm just downloading the files and filtering in spreadsheet for my patch (Sutton Coldfield) and then checking/adding postcode data for the handful of addresses it contains for each month. Though this only really works if you have the majority of your building addressing done for an area. As I'm now adding some postcode data from this source I've added the required attribution to http://wiki.openstreetmap.org/wiki/Contributors#United_Kingdom Incidentally, what do folks feel about adding any of the other data from the dataset?: . the full address of the property (Primary addressable object name (PAON), Secondary addressable object name (SAON), street, postcode, locality (if available), town, district, county) . the price paid for the property . the date of transfer . the property type (Detached, Semi, Terraced, Flat/Maisonette) . whether the property is new build or not . whether the property is freehold or leasehold. Cheers Andy From: Brian Prangle [mailto:bpran...@gmail.com] Sent: 31 August 2012 08:27 To: Rob Nickerson; talk-gb-westmidlands Subject: Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source I'd agree with Rob's logic and extend it to show one of three results: postcode missing or postcode incomplete or postcode incorrect. We have loads of addresses with only the first group in place e.g B27 and I'm sure when we were using codepoint( before we knew it was dodgy in licensing terms) we chose the wrong break point in address runs. We currently have 61272 addresses in the W Mids and 44164 have postcodes. regards Brian On 30 August 2012 18:35, Rob Nickerson wrote: == Matt wrote == This does indeed seem like a very useful data source. Great find! However, I'm struggling to think of a nice way of visualising it to make it useful. What I've got so far in my mind is: - Take an entry from the list - Take its postcode - Search for the postcode (I've got a curated list of postcodes as part of my PostCodeFinder [1]) - Get the location of the nearest match (hopefully, we'll find at least a CV4-type segment match) - Search for roads within an x mile radius with a matching name - Associate that entry with that road == End Message == Hi Matt, I was actually thinking the other way round. That is: Pull in a list of building with addresses but no postcode in OSM (with their way IDs) and see if any match up with the Land Registry addresses. This way we can add postcode to buildings rather than just to the roads. Not sure if this is any easier/harder to do. Regards, Rob ___ Talk-GB mailing list talk...@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-gb ___ Talk-gb-westmidlands mailing list Talk-gb-westmidlands@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands
Re: [Talk-gb-westmidlands] [Talk-GB] UK Postcodes - Potential data source
I'd agree with Rob's logic and extend it to show one of three results: postcode missing or postcode incomplete or postcode incorrect. We have loads of addresses with only the first group in place e.g B27 and I'm sure when we were using codepoint( before we knew it was dodgy in licensing terms) we chose the wrong break point in address runs. We currently have 61272 addresses in the W Mids and 44164 have postcodes. regards Brian On 30 August 2012 18:35, Rob Nickerson wrote: > > == Matt wrote == > > This does indeed seem like a very useful data source. Great find! > > However, I'm struggling to think of a nice way of visualising it to > make it useful. What I've got so far in my mind is: > - Take an entry from the list > - Take its postcode > - Search for the postcode (I've got a curated list of postcodes as > part of my PostCodeFinder [1]) > - Get the location of the nearest match (hopefully, we'll find at > least a CV4-type segment match) > - Search for roads within an x mile radius with a matching name > - Associate that entry with that road > > == End Message == > > Hi Matt, > I was actually thinking the other way round. That is: > > Pull in a list of building with addresses but no postcode in OSM (with their > way IDs) and see if any match up with the Land Registry addresses. This way > we can add postcode to buildings rather than just to the roads. > > Not sure if this is any easier/harder to do. > > Regards, > Rob > > > > ___ > Talk-GB mailing list > talk...@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk-gb > > ___ Talk-gb-westmidlands mailing list Talk-gb-westmidlands@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-gb-westmidlands
