Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-28 Thread Michael Reichert
Hi OSM @ Facebook, Am 2017-03-27 um 20:22 schrieb OSM @ Facebook: > Why are there are no relations in those files? > > Yes, currently we skip relations as we map in more rural areas. What is your definition of "rural areas"? Rural areas might have lots of relations and damaging one of them by i

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-27 Thread Christoph Hormann
Thanks for the additional details, this clarifies quite a few things. > How do you deal with clouds in imagery? > > Our ML algorithm has been trained on images with no cloud cover only. That is what i feared. This means the AI is unaware of the phenomenon of clouds in images. If you run it on

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-27 Thread OSM @ Facebook
Hello, Thank for your feedback. Here are more answers to clarify the questions you have raised. How do you deal with clouds in imagery? Our ML algorithm has been trained on images with no cloud cover only. So, for areas that have cloud cover, our ML model will not output any data. After m

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-22 Thread Martin Koppenhoefer
sent from a phone > On 22 Mar 2017, at 15:30, Rory McCann wrote: > > JOSM validator won't detect this sort of thing (since it's not > always an error). it's important to keep in mind that Josm validator detections are not necessarily actual problems. They help finding suspiciously looking s

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-22 Thread Rory McCann
Hi Drishtie, Thanks for replying. If you don't want to release lots of source code, that's your call, but then you should show the data that you plan to import, like all the other imports for OSM. Some further thoughts: On 21.03.2017 22:02, osm wrote: *Who are your editors?* Our team consists

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-22 Thread James
+∞ Wojciech Myrda On Mar 22, 2017 6:34 AM, "Wojciech Myrda" wrote: > On 2017-03-22 09:59, Martin Koppenhoefer wrote: > >> Are the human mappers in your team "on the ground " in Thailand? Do they >> know the country, have they been/do they live there? It's clear that a >> small team of 14 people

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-22 Thread Wojciech Myrda
On 2017-03-22 09:59, Martin Koppenhoefer wrote: Are the human mappers in your team "on the ground " in Thailand? Do they know the country, have they been/do they live there? It's clear that a small team of 14 people will not know all the country in detail, but knowing the general conditions/set

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-22 Thread Martin Koppenhoefer
Are the human mappers in your team "on the ground " in Thailand? Do they know the country, have they been/do they live there? It's clear that a small team of 14 people will not know all the country in detail, but knowing the general conditions/setting still is helping a lot when judging the outc

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-21 Thread Richard Welty
On 3/21/17 7:30 PM, Christoph Hormann wrote: > >> 3. Road masks are processed to remove low confidence >> predictions and add connections between short breaks. > So you say you automatically connect roads in close proximity even if > you have no observable information in your source data tha

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-21 Thread Christoph Hormann
Thanks for the additional information. Just a quick reply on the most important things - i don't have much time right now. > Is the Imagery free of Cloud Cover? > The intended output of +Vivid is cloud free, and in most cases, DG > meets this. There are some highly cloudy parts of the world whe

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-21 Thread Johan C
Hi Drishtie, thanks for your extensive reply. In general it looks good to me. One point however. Earlier in this thread I mentioned: ' I would be more interested to know whether community buy-in is okay. I haven't seen a response from the Thai community on this posting. I think they should be resp

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread Christoph Hormann
On Saturday 18 March 2017, James wrote: > That Drishtie is a missing maps coordinator for missing maps at the > american red cross. Maybe its the same person, maybe not. The point > of these emails is not to start a witch hunt. I think Michael's point here is to illustrate that just knowing a firs

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread James
That Drishtie is a missing maps coordinator for missing maps at the american red cross. Maybe its the same person, maybe not. The point of these emails is not to start a witch hunt. On Mar 18, 2017 8:55 AM, "Michael Reichert" wrote: Hi James, Am 2017-03-18 um 11:54 schrieb James: > Well if I r

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread Michael Reichert
Hi James, Am 2017-03-18 um 11:54 schrieb James: > Well if I remember correctly Stats Canada did the samething by trying to > address the "OSM board". People don't know off the bat we are a comunity > and not an organization. Hasn't Drishtie been member of OSM US board? Or do I confuse her with so

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread Andy Townsend
On 18/03/2017 10:54, James wrote: ... Just to be able to keep everyone in the loop without a bunch of FW: .She might have said "us" because there's a team behind the email(see prevous explanation of avoiding FW) or because its the version "corporate" approved. Just to be clear - are you answe

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread James
Well if I remember correctly Stats Canada did the samething by trying to address the "OSM board". People don't know off the bat we are a comunity and not an organization. Creating an email for a project is not uncommon for a company. There is probably a few people that have access to that account(

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread Andy Townsend
On 18/03/2017 10:40, James wrote: Andy did you read the first email or skim it? I quote: Best, Drishtie on behalf of the OSM at Facebook Team Indeed, but frankly the content looks like it was written by a committee. Also https://forum.openstreetmap.org/viewtopic.php?pid=632670#p632670 say

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread James
Andy did you read the first email or skim it? I quote: Best, Drishtie on behalf of the OSM at Facebook Team On Mar 18, 2017 6:38 AM, "Andy Townsend" wrote: > On 15/03/2017 02:39, osm wrote: > > Dear OSM Community, ... > > > Actually one other thing - may we know who we're actually dealing wi

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-18 Thread Andy Townsend
On 15/03/2017 02:39, osm wrote: Dear OSM Community, ... Actually one other thing - may we know who we're actually dealing with here? OSM is a community of real people. Sometimes they go by their real name, sometimes by some other one, but (except for very rare exceptions such as "wheelma

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-17 Thread James
Funny never specifically says to provide source code(Revision as of 12:27, 29 May 2015 just before the "disappearance"): https://wiki.openstreetmap.org/w/index.php?title=Automated_Edits_code_of_conduct&oldid=1185196 also https://wiki.openstreetmap.org/wiki/Automated_Edits_code_of_conduct Just says

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-17 Thread Johan C
2017-03-17 14:28 GMT+01:00 Rory McCann : > Hi, > > Yes, we must treat Facebook the same as all others. We ask importers to > show all the data. FB have shown part of the data. If they want to import > lots of data for Thailand, then they could show all of that data for review. > > The Automated Ed

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-17 Thread James
I agree with Kate, we are NOT an academic institution, so why are we requiring proof of the method when the results should be the thing that matters. It would be like if we required to provide the mathematical method every time we want to do long division: 1200 | 10 -10 120

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-17 Thread Kate Chapman
Hi Rory, I'm not in disagreement that providing the code could improve it, though I don't think it is required to provide the code that made the data. If we are handling this as any other import than providing the entire data source should be sufficient. We don't require governments that provide o

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-17 Thread Eric Ladner
On Fri, Mar 17, 2017 at 8:30 AM Rory McCann wrote: > P.S.: I suggested sharing the imagery because OSM has 2 main global > imagery source (Mapbox & Bing). It would be great to have a third. :) > > It'd be nice, but DG isn't going to publicly release the thing their entire business is built upon.

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-17 Thread Rory McCann
Hi, Yes, we must treat Facebook the same as all others. We ask importers to show all the data. FB have shown part of the data. If they want to import lots of data for Thailand, then they could show all of that data for review. The Automated Edits & Imports guidelines do call for documentatio

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Robert Banick
Very cool Kevin, I’m looking forward to the +Vivid release! On Fri, Mar 17, 2017 at 6:40 AM Kevin Bullock wrote: > Hi Everyone, it's Kevin representing DigitalGlobe. I do understand the > situation and I think some good points have been made in this thread. If > you've seen my SOTM presentations

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Kevin Bullock
Hi Everyone, it's Kevin representing DigitalGlobe. I do understand the situation and I think some good points have been made in this thread. If you've seen my SOTM presentations from last year, I have spoken at length about the DG business model of licensing data. In short, we do this to sustain ou

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Andy Townsend
On 16/03/2017 21:46, Kate Chapman wrote: 1. We can't demand more of Facebook than others doing imports. When a government releases data under an open license we don't demand to see the imagery they used to make it. I purchase the same imagery Facebook does for my job and our license also ensure

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Christoph Hormann
On Thursday 16 March 2017, Kate Chapman wrote: > > 2. There is not a requirement to share all the source code used to > create data either. Nor for the imports. Previously people have used > all kinds of scripts to perform imports. Some people use ArcGIS to > perform imports. We haven't required th

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Kate Chapman
Thanks for sharing this information. In reading through the comments so far I think we need to keep a few things in mind. 1. We can't demand more of Facebook than others doing imports. When a government releases data under an open license we don't demand to see the imagery they used to make it. I

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Rory McCann
Hi, It's great to see Facebook interested in OSM. FB is a large, wealthy and influential company, and could definitely use some of that strength to help the OSM community. I looked at the sample data, the data quality is comparable to what is mapped in that area already. There are few taggin

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Rory McCann
On 16.03.2017 13:15, Elliott Plack wrote: Lots of negativity here. I'm all for this import. I like the fact a major American tech company is willing to pour resources into an open source project. All this data benefits FB but rather than hoarding it in their own map, they're opting to put it on O

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Elliott Plack
Lots of negativity here. I'm all for this import. I like the fact a major American tech company is willing to pour resources into an open source project. All this data benefits FB but rather than hoarding it in their own map, they're opting to put it on OSM. On Thu, Mar 16, 2017 at 07:38 Christoph

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread James
Having the complete data set for analysis would be a must, as all imports go through this to validate the quality of the data. What I'm saying about the processing part: you feed it a bunch of drawing of dirt roads/paved roads. It will start to see what is similar and what is different (kind of li

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Christoph Hormann
On Thursday 16 March 2017, James wrote: > > Seeing as facebooks computational power will rival that of super > computers, even if you wanted to recreate it, it would probably take > you 1000 years of home computing power to "train" the neural network > to recognise roads, at which point we will all

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Christoph Hormann
On Thursday 16 March 2017, Michael Reichert wrote: > > By reading your license > (https://wiki.openstreetmap.org/w/images/c/cf/FacebookRoadMaskLicense >.pdf) some questions arose. The whole agreement is really difficult to > read and I ask myself why you choose to use it instead of a > well-establi

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Robert Banick
I agree with James that releasing the source code won’t happen (trade secrets) and isn’t really useful to the casual OSMer anyways. Of course we’d love to have more companies and institutions creating and releasing similar data — but that just suggests what a potentially great gift this is to OSM.

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread James
Micheal, facebook is not going to publish their source code. It doesnt make finacial sense. Also maybe you should look up machine learning/neural networks. There is no code persay. You feed a bunch of data into the neural net and train it for xyz(takes up a lot of disk space) to recognise what is

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-16 Thread Michael Reichert
Hi osm, Am 2017-03-15 um 03:39 schrieb osm: > This email is to share the Facebook process and sample data for review by the > OSM community. We welcome feedback. Almost one month ago, on 18. February 2017, Paul Norman asked you to use better changeset tags than comment="#nsroadimport #country".

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-15 Thread Sérgio V .
Hi, I'm new here. About the licence, sorry, I just couldn't understand very well what is stated for derivative works (as think it would be the natural evolvement of mapping in OSM in any region) at: https://wiki.openstreetmap.org/w/images/c/cf/FacebookRoadMaskLicense.pdf (https://wiki.openstre

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-15 Thread Christoph Hormann
On Wednesday 15 March 2017, Denis Carriere wrote: > > Have you even looked at the sample dataset provided before speaking? What makes you think i have not? I did not discuss the sample data set because - quoting myself: > Because the data is not available in full at the moment i > will refrain f

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-15 Thread Frederik Ramm
Denis, On 15.03.2017 16:35, Denis Carriere wrote: > The imagery that DigitalGlobe provides is used for computational > purposes and won't be distributed for free, the imagery data used to > create this data isn't usable for viewing purposes (it's for computers > to do machine learning). Do you wo

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-15 Thread Denis Carriere
Christoph, Have you even looked at the sample dataset provided before speaking? Yes it is very clear which roads would be added (add a filter source=digitalglobe) and the roads without an OSM history are the new roads. The imagery that DigitalGlobe provides is used for computational purposes and

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-15 Thread Christoph Hormann
First of all thanks for finally starting discussion of this in the proper channels now. Here my initial questions and comments in rough order of priority with the most important ones first: * Where is the data to be imported? The OpenStreetMap project is founded on the idea of openness and f

Re: [Imports] Facebook's AI-Assisted Road Tracing for OSM

2017-03-14 Thread Eric Jiang
On Tue, Mar 14, 2017 at 7:39 PM, osm wrote: > What Imagery are you using? > We are using DigitalGlobe's Vivid+ which is high-resolution (50cm / pixel, or > zoom 18) color-corrected and cloud-free. > > Can we share DG imagery? > While our license does not currently permit this. DG as noted in this