[OSM-dev] Area DataType
Hi, Newbie to OSM here, I'd like to contribute to the project, so I'm reading the ten priorities. Concerning the Data Type Area, I'd like to read any discussion about tools and structures in any languages especially about Boolean Set Operators (Union, Intersect, Difference, Xor), elementary way of building an area and use of Clipper Algorithm http://jsclipper.sourceforge.net/6.4.2.2/main_demo.html ... Do you guys have any memory of that kind of subject? Should I look for it in dev Mailing list or elsewhere? ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Area DataType
Thank you Andy, I had a look at iD, I managed to build a polygon and will try to go further. I already had read the Area DataType problem description, but thanks. What I think is that we may need to invent a DataType that takes a definition from Boolean Set operators and polygons ( at least broken lines drawn by hand or curves converted to broken lines ). For example a Coastline : - can be seen as intersection between a ground polygon and a sea polygon - can also be seen as a difference between a country border and its ground border An Object class taking two attributes : #include_polygons #exclude_polygons May be able to represent itself from those informations. It would make its persistence easier, in all Programming Languages. Clipper algorithm has been written in many languages. I guess Java, Python and C++ have libs to check if a way, a point, a node, belongs to such an area or to its border. I'd like to check if this problem has already been studied and is a dead end or if it has never been discussed or if it's a work in progress. I agree with you when you say it's not an algorithm problem, but will it be always the case? Either from persistence point of view or user interaction point of view. I also read the SVG explaining multi-polygon question and there's a polygon describing a hole in the area, so I wonder how we can avoid talking about Boolean operators here... Seems to me that it would help us not reinventing the wheel in geometry and building a versatile object class in any language that handle geometry libs. 2018-03-20 15:13 GMT+01:00 Andy Townsend : > On 20/03/2018 12:57, Julien Cochennec wrote: > >> Hi, >> Newbie to OSM here, I'd like to contribute to the project, so I'm reading >> the ten priorities. >> Concerning the Data Type Area, I'd like to read any discussion about >> tools and structures in any languages especially about Boolean Set >> Operators (Union, Intersect, Difference, Xor), elementary way of building >> an area and use of Clipper Algorithm http://jsclipper.sourceforge.n >> et/6.4.2.2/main_demo.html ... >> > > The best description of the problem is probably the one at > https://wiki.openstreetmap.org/wiki/Top_Ten_Tasks#Area_datatype . It's > not really an "algorithm" problem (at least not initially). > > What I'd suggest doing first is to become a bit more familiar with OSM, > and mapping your local area using the default "iD" editor is a great way to > start, because iD actually _does_ have a concept of areas, and interprets > OSM data as "area" or "non-area" as it goes along. > https://wiki.openstreetmap.org/wiki/Elements is also a good place to > start to see where OSM is now. > > Best Regards, > > Andy > > > ___ > dev mailing list > dev@openstreetmap.org > https://lists.openstreetmap.org/listinfo/dev > ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Bulk batch address search
Hi, I work for a big stats institute that have millions of addresses stored in a Oracle database. Data interacts with a SQL/JAVA search engine that is almost impossible to port. We can't afford to pay this system anymore and only have a few months, maybe more than a year, to switch to a different system. Our software takes addresses in big files from external providers, add geocoding data and stats to each address and return the extended data to providers as bigger files. We need to switch to PostGreSQL, so I was thinking about : - turning our adresses data into OSM format - turning our non geo data (administrative confidential data) in tags related to geo addresses data - putting all this on our own nominatim instance server with only french addresses - developing a web interface based on existing OSM tools - developing scripts that would make the match evaluation between provider address and nominatim address database So I need to know if it's possible to make millions of search in a bulk process, via nominatim, in command line, from a big input file (let's say csv) in a few hours, less than a whole night, searching through only french addresses. And how do I do that? I saw things about GeoPy but I don't want to slow the process with web API, just terminal. I guess there are less than 100 millions of addresses in our database. But providers sometime give 3millions addresses in a file. It would be a win/win as we could become a great contributor to OSM having all our data in OSM format and also use almost all tools OSM has already provided. We already give some info like city administrative borders/shapes via OpenData program. Thanks all for your help. ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
[OSM-dev] My own iD editor - OSM in a nutshell
Hi, I'd like to have my own iD editor on a server, to develop additional features or plugins. I'd like to connect it to different virtual servers "emulating" the whole OSM architecture, not to interfere with contributors. I would also like the result to be "exportable" to OSM real infrastructure so that the whole system would be OSM in a nutshell but whitout losing data that can be handled as contribution. - Do you think it's possible? - If it's possible, which servers do I need to emulate? - Which file in iD source would I have to change so the APIs are local and not worldwide? Thanks. ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] My own iD editor - OSM in a nutshell
Ok, very good info here. So I understood the "tricky" part. Another solution would be an application that would connect to OSM webservices to identify OSM objects. Then create new Data linked to OSM by their IDS. Then export data in one or many OSM export format. Le jeu. 28 mars 2019 à 18:11, mmd a écrit : > On 3/28/19 4:14 PM, Julien Cochennec wrote: > > Hi, I'd like to have my own iD editor on a server, to develop additional > > features or plugins. > > I'd like to connect it to different virtual servers "emulating" the > > whole OSM architecture, not to interfere with contributors. > > You can always use the dev instance for your tests > (master.apis.dev.openstreetmap.org), which is what I recommend to get up > to speed quickly. iD editor comes with quite comprehensive documentation > on how to set up your local development environment and deploy your code > to a server. > > In general, setting up your own OSM backend infrastructure is nothing > for the faint hearted. Be prepared to spend at least several weeks on > this topic. > > > I would also like the result to be "exportable" to OSM real > > infrastructure so that the whole system would be OSM in a nutshell but > > whitout losing data that can be handled as contribution. > > That's quite tricky. OSM object ids and versions need to match exactly, > you need to be prepared to handle conflicts, set up proper user names in > your local database etc. There's a whole lot more issue on a > non-technical level as well, which I'm not going to jump into here. If > you have no prior experience in this area, I would try to skip this part > for the time being, as it could be a major time sink. > > > > > - Do you think it's possible? > > Depends on how much time you want to invest. > > > - If it's possible, which servers do I need to emulate? > > As said, you could always set up your own Rails port. If your primary > goal is iD development, that's probably overkill, though. > > > - Which file in iD source would I have to change so the APIs are local > > and not worldwide? > > On http://preview.ideditor.com/master you can simply switch between live > and dev environment by clicking on the "live" button on the bottom > toolbar. IIRC, your local deployment should have the same button. Be > sure to use the "dev" server, and check your results on > https://master.apis.dev.openstreetmap.org after uploading. > > -- > > > ___ > dev mailing list > dev@openstreetmap.org > https://lists.openstreetmap.org/listinfo/dev > ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Any problem with Debian tile servers?
Hi, BTW we intend to build our own tiles server, for API calls in LeafLet or OpenLayers, what is the simplest way to do that? I saw that many Docker Instances exists on Docker Run, some have the possibility to serve tiles for a region only, and it's perfect for our use. Did you guys tried one of those? https://hub.docker.com/search?q=tile osm&type=image I tried this one : https://github.com/Overv/openstreetmap-tile-server But it failed during the import, using a Docker Volume, maybe because of the low RAM? (2 Go for France-latest PBF only). Thanks for your feedback, sorry if I should have open a new thread. Le jeu. 11 avr. 2019 à 10:24, Sven Geggus a écrit : > Tom Browder wrote: > > > I want to run my own tile server but I run Debian 9 on the server I plan > to > > use. All the docs I have seen so far target Ubuntu. Is there any problem > > with using other Linux distros? > > tile.openstreetmap.de is running Debian from day one. So yes, this is > working fine. > > Sven > > -- > "Thinking of using NT for your critical apps? > Isn't there enough suffering in the > world?" >(Advertisement of Sun Microsystems in Wall Street > Journal) > /me is giggls@ircnet, http://sven.gegg.us/ on the Web > > ___ > dev mailing list > dev@openstreetmap.org > https://lists.openstreetmap.org/listinfo/dev > ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
