Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Paul Gillard
Being a lone mapper up to now it's been interesting to read everyone's comments, a good wide range of views. Brian, to answer your question about priorities, I don't particularly have any. My thoughts were to choose a selection of different types of company and if see we can't work out where the l

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Andy Mabbett
On 21 December 2017 at 10:28, Frederik Ramm wrote: > Your approach will ultimately lead to every last > large-chain pub in England being nicely mapped from afar, whereas the > independent pub next door has to wait until a mapper comes around. Did we not have a data set supplied by a trade body,

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Andy Townsend
On 21/12/2017 09:15, Ilya Zverev wrote: ... Or do you think the map does not need imports and that every shop and amenity will be mapped without them before they are out of business? Maybe it's worth having a look at an example. http://www.openstreetmap.org/way/245390956 is a petrol station

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Colin Smale
This discussion brings a couple of similar sayings to mind (and there are many more in the same vein): _To Sacrifice The Good On The Altar Of The Perfect_ = and = _Perfect is the enemy of good_ [1] A dataset will never be perfect. Resisting an import because a small proportion of the data is

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Mark Goodge
On 21/12/2017 15:49, Frederik Ramm wrote: Hi, On 21.12.2017 16:13, Mark Goodge wrote: My vision of OSM is a movement which places its users first, by providing the maximum utility possible for those who look at the maps. That means maximising the quantity, accuracy, relevance and timeliness o

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Frederik Ramm
Hi, On 21.12.2017 16:13, Mark Goodge wrote: > My vision of OSM is a movement which places its users first, by > providing the maximum utility possible for those who look at the maps. > That means maximising the quantity, accuracy, relevance and timeliness > of the data. That is certainly a valid

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Mark Goodge
On 21/12/2017 10:28, Frederik Ramm wrote: My vision of OSM is that of a grassroots movement that makes its own decisions about the data. We decide what the fuel station around the corner is called - not the marketing department of the fuel station chain. Corporate interests already dictate eno

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Brian Prangle
Eloquently put as ever Frederick. I share your lament about the seemingly unattainable vision, which I happen to share. I would dearly love there to be 10 times the number of consistently active mappers in the UK, but it seems to be an order of magnitude more difficult ot persuade people to maintai

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Warin
On 21-Dec-17 09:28 PM, Frederik Ramm wrote: Hi, A lot is wrong with capitalism; large chains are one of those things. Small independent shops, booksellers, or pubs *already* face difficulties against the marketing and purchasing power of big corporations. Your approach will ultimately lead to e

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Frederik Ramm
Hi, On 21.12.2017 10:15, Ilya Zverev wrote: > Frederik and Tom, please explain what has been wrong with the last import, > and why osm_conflate + cf_audit tools used for it (conflation + community > validation) still do not attain the required quality for OSM contributions? Your tools are certa

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread David Woolley
On 21/12/17 09:33, Tom Hughes wrote: People often imagine these things as perfectly curated and fully normalised and standardised when the reality is often that they're maintained as an excel spreadsheet by this weeks intern. Also, web sites are maintained by advertising team in the marketin

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Tom Hughes
On 21/12/17 09:15, Ilya Zverev wrote: Frederik and Tom, please explain what has been wrong with the last import, and why osm_conflate + cf_audit tools used for it (conflation + community validation) still do not attain the required quality for OSM contributions? I wasn't commenting on any pa

Re: [Talk-GB] Importing Website Data

2017-12-21 Thread Ilya Zverev
Again, with sarcasm. Frederik and Tom, please explain what has been wrong with the last import, and why osm_conflate + cf_audit tools used for it (conflation + community validation) still do not attain the required quality for OSM contributions? How would you build a process for importing large

Re: [Talk-GB] Importing Website Data

2017-12-20 Thread Frederik Ramm
Hi, On 19.12.2017 16:20, Tom Hughes wrote: > Which is exactly what everybody said about OSM when it started - that it > couldn't possibly work and there'd never be enough people. > Pretty sure we proved them wrong. Perhaps that's what people mean when they say "OSM has to grow up" - that we need

Re: [Talk-GB] Importing Website Data

2017-12-19 Thread Ian Caldwell
On 19 December 2017 at 15:20, Tom Hughes wrote: > > > The fundamental problem of imports that conflate with existing data is > that you have way of knowing whether or not you are actually improving > anything - you are making an assumption that an "official" source will be > up to date and accura

Re: [Talk-GB] Importing Website Data

2017-12-19 Thread Tom Hughes
On 19/12/17 14:46, Brian Prangle wrote: For those who decry the approach of using third party data, preferring instead the personally surveyed approach, I echo Ilya's and Warin's sentiments: Lloyds TSB demerged in 2013 and we still have 200 instances of Lloyds TSB, TA Centres became Army Reser

Re: [Talk-GB] Importing Website Data

2017-12-19 Thread Brian Prangle
Paul thank you for suggesting this, it's certainly something as a UK community (and I guess more widely)we need to deal with. Unfortunately website data can be problematic, as others have already indicated, for us to use, but instead we should ask the organisations concerned to provide the data in

Re: [Talk-GB] Importing Website Data

2017-12-18 Thread Warin
On 19-Dec-17 05:42 AM, Ilya Zverev wrote: 18.12.2017 19:14, Frederik Ramm пишет: Hi, On 12/18/2017 03:09 PM, SK53 wrote: Personally, I'd also be chary of turning OSM into a repository of scraped data rather than one of surveyed geodata. And more: the more imports you do, the more OpenStreetM

Re: [Talk-GB] Importing Website Data

2017-12-18 Thread Ilya Zverev
18.12.2017 19:14, Frederik Ramm пишет: Hi, On 12/18/2017 03:09 PM, SK53 wrote: Personally, I'd also be chary of turning OSM into a repository of scraped data rather than one of surveyed geodata. And more: the more imports you do, the more OpenStreetMap becomes an IT project where computer ner

Re: [Talk-GB] Importing Website Data

2017-12-18 Thread Frederik Ramm
Hi, On 12/18/2017 03:09 PM, SK53 wrote: > Personally, I'd also be chary of turning OSM into a repository of > scraped data rather than one of surveyed geodata. And more: the more imports you do, the more OpenStreetMap becomes an IT project where computer nerds script, collect, convert, conflate,

Re: [Talk-GB] Importing Website Data

2017-12-18 Thread Gregrs
Hi Paul, On Mon, Dec 18, 2017 at 01:15:08PM +, paulmgill...@gmail.com wrote: If store data can be pulled from directly from a company's public facing website ('store finder' page) is there any reason we can't do such imports without discussion with/permission from the company concerned?

Re: [Talk-GB] Importing Website Data

2017-12-18 Thread SK53
Because it is nearly always copyright, we don't have permission, and it's against OSM's T&Cs. Additionally, not every organisation keeps up-to-date, or even validated data on their websites. Personally, I'd also be chary of turning OSM into a repository of scraped data rather than one of surveyed

Re: [Talk-GB] Importing Website Data

2017-12-18 Thread Tom Hughes
On 18/12/17 13:15, paulmgill...@gmail.com wrote: Reading all the talk of Walmart and Shell imports recently got me to wondering why we can't be doing more of this kind of thing. If store data can be pulled from directly from a company's public facing website ('store finder' page) is there any

Re: [Talk-GB] Importing Website Data

2017-12-18 Thread Dan S
Hi, People have mentioned this before. The conversation usually then goes to copyright (and the question of whether simple facts (such as addresses, opening hours etc) can be copyrighted), then in fact it's database rights that are probably the main barrier.* I'm not central to all of this, nor a

[Talk-GB] Importing Website Data

2017-12-18 Thread paulmgillard
Hi, Reading all the talk of Walmart and Shell imports recently got me to wondering why we can't be doing more of this kind of thing. If store data can be pulled from directly from a company's public facing website ('store finder' page) is there any reason we can't do such imports without discu