Re: [Taginfo-dev] Tag synonyms
Hi Bryce I strongly agree that there is a need that users can search for tags via a specialized API (in topical or vertical search engine API). Unfortunately I know no answer yet within OSM which does that. Taginfo is definitely a good starting point. And yes, it's a challenge to extract synonyms (or related terms). But just to complete what Jochen wrote: There is already a proposal of putting synonyms (and more) into the Wiki text! See Related Terms at bottom e.g. of forest [1]. Everyone can contribute by adding such related terms right now. Based on Tagfinder db and API we implemented a prototype called TagFinder which gives you an idea how nice such a function would be: If you enter Wald into TagFinder [2] you get landuse=forest in a ranked result page. This prototype reads out the synonyms from the Wiki pages mentioned above and includes a thesaurus. For more background of TagFinder see slide 8 at [3]. Yours, Stefan [1] http://wiki.openstreetmap.org/wiki/Tag:landuse%3Dforest [2] http://openpoimap.ch/tagfinder/search?q=Wald [3] http://www.fossgis.de/konferenz/2012/programm/attachments/328_FOSSGIS%202012%20-%20OpenPOIMap%20-%20en.pdf 2013/1/26 Bryce Cogswell bryc...@yahoo.com: On Jan 26, 2013, at 12:12 PM, Jochen Topf joc...@remote.org wrote: On Sat, Jan 26, 2013 at 10:52:06AM -0800, Bryce Cogswell wrote: I have an editor that consumes TagInfo data from the wiki, allowing users to search for the tag they want. I search both the tag name and the description text. I'd like the search to include common synonyms for tags because newbies (and I) don't always know what to search for, so: drugstore - amenity=pharmacy, salon - shop=beauty, curb - kerb, etc. What is the correct place to put this information? Should it be a new tag metadata field on the wiki, or stuffed into the description field, or something else? This mailing list is about the taginfo application/service. From your question it sounds that you are not actually doing anything with taginfo, but parsing the Wiki directly. Is that correct? In that case you might want to raise this issue on the general dev or talk lists. That being said, I do think that the taginfo program is the right place to collect this information and bring it to other parts of the OSM ecosystem. I think framing the issue as being about synonyms is too simplistic. It is about finding the right tags. Just having a list of synonyms is not going to be enough. Say for instance forest and woods. Those are synonyms by some definitions. But there are actually different tags for these two things, because in the OSM context they mean different things. So you'd have to read the description on the wiki to find out which to use. I am sure there are many words you can't easily associate with just one tag. The other problem is maintainance. People actually have to maintain the lists of synonyms. And there is the internationalization issue of course. So I think the approach has to be different. I suggest a mixture of full-text search in wiki pages plus thesaurus plus maybe some kind of word-stemming plus maybe dictionaries. It is a bit of work to get that going, but I think it can be done. We'll get a lot of synonyms for free that way and where we don't get them, somebody just has to make sure they appear in the wiki text somewhere. There is already a very simple full-text search for the wiki integrated into taginfo that I whipped up in a few hours. Just use the search field and then choose the Full text tab. Your first two examples will find the right tags: http://taginfo.openstreetmap.org/search?q=drugstore#fulltext http://taginfo.openstreetmap.org/search?q=salon#fulltext That could be the basis of something better. Jochen -- Jochen Topf joc...@remote.org http://www.remote.org/jochen/ +49-721-388298 I currently pull the info from taginfo-wiki-db.bz2 at build time but long term I would prefer to get it via an API (or periodically download the bz2 to the client automatically). My editor is for a mobile device so for performance I don't want to hit the server doing a search on every keystroke. I expect iD is going to want similar functionality so it would be nice to have it centrally located rather than implemented in each client. I see that Nominatim has similar functionality already: http://wiki.openstreetmap.org/wiki/Nominatim/Special_Phrases/EN That may be sufficient for me and gives me a place to submit patches (they include shop=drugstore, unfortunately). Thanks for your feedback and suggestions. Bryce ___ Taginfo-dev mailing list Taginfo-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/taginfo-dev ___ Taginfo-dev mailing list Taginfo-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/taginfo-dev
Re: [osmosis-dev] 32-bit limit in IdTrackers
Hi IZ, On 6 February 2013 20:05, Ilya Zverev zve...@textual.ru wrote: Hi! As some of you have read (http://lists.openstreetmap.** org/pipermail/dev/2013-**February/026495.htmlhttp://lists.openstreetmap.org/pipermail/dev/2013-February/026495.html), in three days node ids are expected to surpass 2147483647, and this method https://github.com/**openstreetmap/osmosis/blob/** master/core/src/main/java/org/**openstreetmap/osmosis/core/** util/LongAsInt.java#L30https://github.com/openstreetmap/osmosis/blob/master/core/src/main/java/org/openstreetmap/osmosis/core/util/LongAsInt.java#L30will throw an exception Cannot represent + value + as an integer. It is used in every IdTracker implementation, so id trackers will become unusable. This will affect tag and area filters. Regional extracts that are made with osmosis will break. There is a comment at the start of each IdTracker class: The current implementation only supports 31 bit numbers, but will be enhanced if and when required. I guess, now is the time. Can anybody fix that? There must be a reason why this hasn't done sooner. Thanks for the heads up. I could be wrong but I don't think this is an issue. It is used by ListIdTracker and BitSetIdTracker so those implementations will soon fail if you try to use them. However, the default implementation is now DynamicIdTracker which doesn't suffer from this issue (I hope ;-). DynamicIdTracker breaks the id range into chunks of 1024 and internally uses either ListIdTracker or BitSetIdTracker for each of those chunks depending on which is more efficient. As a result, the largest number either of those id trackers ever sees is 1023, the DynamicIdTracker adds a base offset to those numbers to get the final number and it stores the base number as a 64-bit long. The idTrackerType arguments could probably be removed from the --bounding-box and --bounding-polygon tasks now because the default implementation should be better than specifying one in the vast majority of cases. I've checked the rest of the codebase for use of the LongToInt class. It is used internally by the Entity class to store a changeset id as a 32-bit number instead of a 64-bit number. That should be safe for a while yet. Brett ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev
Re: [OSM-dev] Reminder: Node 32-bit exhaustion
Stephan Knauss wrote: could you give details about a use case where mapnik needs the osm_id? The official styles do not contain a reference to osm_id, it's an internal thing in the database. Or is it going into using osm directly as a datasource instead of postrgres? While it is possible to feed osm files to mapnik directly, as far as I understand, osm_id can be fetched even from postgresql database as a feature id. Judging by a relevant issue https://github.com/mapnik/mapnik/issues/1662 before December it was 32-bit. Latest commits dealing with this problem were uploaded in January, including an option to turn off BIGINT support (it will be on by default) and some tests. IZ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Is there any API to get data from OSM as geoJson?
Hi everyone I am currently working with different technologies for showing OSM data in slippy maps and I noticed that some of those maps would work better with GeoJSON data format. I use Overpass API for downloading data but it doesn't export in GeoJSON format. The nearest approach would be to ask for it as OSM-JSON, store all the nodes ids and locations, store all the ways ids and node refs and then build the relations geometries but it's quite a big pain for browsers. I've been looking for some info in OSM wiki but I haven't been able to find nothing. Does anyone know if there exists something? Thank you very much. -- Ander Pijoan Lamas Research Assistant, Deustotech Computer Science Engineer University of Deusto E-mail: ander.pij...@deusto.es Phone: +34 664471228 in: http://www.linkedin.com/profile/view?id=162888312 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Is there any API to get data from OSM as geoJson?
On Thu, Feb 7, 2013 at 11:58 AM, Ander Pijoan ander.pij...@deusto.es wrote: I use Overpass API for downloading data but it doesn't export in GeoJSON format. The nearest approach would be to ask for it as OSM-JSON, store all the nodes ids and locations, store all the ways ids and node refs and then build the relations geometries but it's quite a big pain for browsers. You could build your own server and then server the data however you like. Since you're already doing all this conversion, and you seem to be doing a lot of work with the OSM data, this is probably the right approach for your application. - Serge ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Is there any API to get data from OSM as geoJson?
Hello Ander, I have an API for generating OSM data as geojson from a PostGIS database. The live api is part of the UK-orientated Freemap site and currently works with selected areas of the UK only, see http://www.free-map.org.uk/0.6/about.html However the code is open source and should in theory work with any OSM-derived PostGIS database. Look at https://github.com/nickw1/Freemap (look inside 0.6/ws. There are two services, tsvr.php which takes an xyz tile definition and bsvr.php which takes a bbox and projection/SRID). Nick -Ander Pijoan ander.pij...@deusto.es wrote: - To: dev@openstreetmap.org From: Ander Pijoan ander.pij...@deusto.es Date: 07/02/2013 04:59PM Subject: [OSM-dev] Is there any API to get data from OSM as geoJson? Hi everyone I am currently working with different technologies for showing OSM data in slippy maps and I noticed that some of those maps would work better with GeoJSON data format. I use Overpass API for downloading data but it doesn't export in GeoJSON format. The nearest approach would be to ask for it as OSM-JSON, store all the nodes ids and locations, store all the ways ids and node refs and then build the relations geometries but it's quite a big pain for browsers. I've been looking for some info in OSM wiki but I haven't been able to find nothing. Does anyone know if there exists something? Thank you very much. -- Ander Pijoan Lamas Research Assistant, Deustotech Computer Science Engineer University of Deusto E-mail: ander.pij...@deusto.es Phone: +34 664471228 in: http://www.linkedin.com/profile/view?id=162888312 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Is there any API to get data from OSM as geoJson?
Hi Not really an answer to your question, but anyway: For overpass turbo [1] I have implemented a converter on client side (as a Leaflet-Plugin [2]). It supports multipolygons and has some polygon-detection-magic. As far as I can tell, this client side conversion is not really a substantial big pain for browsers (when compared to rendering the same data). Bye Martin [1] http://overpass-turbo.eu [2] https://github.com/tyrasd/overpass-ide/blob/master/libs/OSM4Leaflet.js Am 07.02.2013, 17:58 Uhr, schrieb Ander Pijoan ander.pij...@deusto.es: Hi everyone I am currently working with different technologies for showing OSM data in slippy maps and I noticed that some of those maps would work better with GeoJSON data format. I use Overpass API for downloading data but it doesn't export in GeoJSON format. The nearest approach would be to ask for it as OSM-JSON, store all the nodes ids and locations, store all the ways ids and node refs and then build the relations geometries but it's quite a big pain for browsers. I've been looking for some info in OSM wiki but I haven't been able to find nothing. Does anyone know if there exists something? Thank you very much. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Reminder: Node 32-bit exhaustion
Stephan Knauss o...@stephans-server.de writes: On 06.02.2013 21:25, Andrew M. Bishop wrote: Does anybody know if there is a released version of Mapnik that supports ids up to (2^32)-1 rather than requiring an unreleased 64-bit version? could you give details about a use case where mapnik needs the osm_id? The official styles do not contain a reference to osm_id, it's an internal thing in the database. Might be worth being clarified on the wiki page. Currently it reads as mapnik is broken in general. I asked the question based on the new wiki page which says that the unreleased Mapnik version 2.2 is required for 64-bit ids. My question could have been more accurately stated as: If using the standard toolchain of osm2psql, postgresql and mapnik what is the minimum software versions that are needed to continue creating maps after ids reach 2^31-1? The wiki page says that osm2psql version 0.81.1 is required but the version that I have reports itself as osm2pgsql SVN version 0.80.0 (32bit id space). This suggests to me that it will work up until id 2^32-1 appears but this may be wishful thinking on my part. -- Andrew. -- Andrew M. Bishop a...@gedanken.demon.co.uk http://www.gedanken.org.uk/mapping/ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Reminder: Node 32-bit exhaustion
Andrew M. Bishop wrote: If using the standard toolchain of osm2psql, postgresql and mapnik what is the minimum software versions that are needed to continue creating maps after ids reach 2^31-1? I doubt that mapnik's handling of 32bit ids would in any way affect OSM rendering. So you can still use older versions of it without worrying that something will break. The wiki page says that osm2psql version 0.81.1 is required but the version that I have reports itself as osm2pgsql SVN version 0.80.0 (32bit id space). This suggests to me that it will work up until id 2^32-1 appears but this may be wishful thinking on my part. Well, you've got less than 24 hours to update your osm2pgsql. http://textual.ru/64/ shows that there are 1.3 million nodes left, and for the last two days nearly 1.5 million nodes were added daily. Though I fail to understand what would be broken if you continue to use 32-bit osm2pgsql. Indices, maybe. IZ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Reminder: Node 32-bit exhaustion
FYI, I have dubbed this the N2B (Node 2 Billion(ish)) problem :) Just think what would happen if we could get 1/1000th the media coverage of Y2K... Toby ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Reminder: Node 32-bit exhaustion
From: Ilya Zverev [mailto:zve...@textual.ru] Subject: Re: [OSM-dev] Reminder: Node 32-bit exhaustion Well, you've got less than 24 hours to update your osm2pgsql. http://textual.ru/64/ shows that there are 1.3 million nodes left, and for the last two days nearly 1.5 million nodes were added daily. Though I fail to understand what would be broken if you continue to use 32-bit osm2pgsql. Indices, maybe. Any tables which have node IDs in them will need to be using bigint, not int. You'll also have issues with anything that keeps track of node IDs for geometry building, etc. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Is there any API to get data from OSM as geoJson?
Thank you very much to all. I suppose I will create my own server in order to get geoJson, sounds good. Thanks =) -- Ander Pijoan Lamas Research Assistant, Deustotech Computer Science Engineer University of Deusto E-mail: ander.pij...@deusto.es Phone: +34 664471228 in: http://www.linkedin.com/profile/view?id=162888312 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] dev Digest, Vol 95, Issue 5
Please guide me how can i fetch User Database from OSM repositories by using API or any other method. Thanks On Fri, Feb 8, 2013 at 12:06 PM, dev-requ...@openstreetmap.org wrote: Send dev mailing list submissions to dev@openstreetmap.org To subscribe or unsubscribe via the World Wide Web, visit http://lists.openstreetmap.org/listinfo/dev or, via email, send a message with subject or body 'help' to dev-requ...@openstreetmap.org You can reach the person managing the list at dev-ow...@openstreetmap.org When replying, please edit your Subject line so it is more specific than Re: Contents of dev digest... Today's Topics: 1. Is there any API to get data from OSM as geoJson? (Ander Pijoan) 2. Re: Is there any API to get data from OSM as geoJson? (Serge Wroclawski) 3. Re: Is there any API to get data from OSM as geoJson? (Nick Whitelegg) 4. Re: Is there any API to get data from OSM as geoJson? (Martin Raifer) 5. Re: Reminder: Node 32-bit exhaustion (Andrew M. Bishop) 6. Re: Is there any API to get data from OSM as geoJson? (Jukka Rahkonen) 7. Re: Reminder: Node 32-bit exhaustion (Ilya Zverev) 8. Re: Reminder: Node 32-bit exhaustion (Toby Murray) -- Message: 1 Date: Thu, 7 Feb 2013 17:58:27 +0100 From: Ander Pijoan ander.pij...@deusto.es To: dev@openstreetmap.org Subject: [OSM-dev] Is there any API to get data from OSM as geoJson? Message-ID: CAMo0bbr54jhFX7= cxkqmc4ss3ovs-ojuuryjpitsfajdkyt...@mail.gmail.com Content-Type: text/plain; charset=iso-8859-1 Hi everyone I am currently working with different technologies for showing OSM data in slippy maps and I noticed that some of those maps would work better with GeoJSON data format. I use Overpass API for downloading data but it doesn't export in GeoJSON format. The nearest approach would be to ask for it as OSM-JSON, store all the nodes ids and locations, store all the ways ids and node refs and then build the relations geometries but it's quite a big pain for browsers. I've been looking for some info in OSM wiki but I haven't been able to find nothing. Does anyone know if there exists something? Thank you very much. -- Ander Pijoan Lamas Research Assistant, Deustotech Computer Science Engineer University of Deusto E-mail: ander.pij...@deusto.es Phone: +34 664471228 in: http://www.linkedin.com/profile/view?id=162888312 -- next part -- An HTML attachment was scrubbed... URL: http://lists.openstreetmap.org/pipermail/dev/attachments/20130207/5f4dc485/attachment-0001.html -- Message: 2 Date: Thu, 7 Feb 2013 12:12:00 -0500 From: Serge Wroclawski emac...@gmail.com To: Ander Pijoan ander.pij...@deusto.es Cc: dev@openstreetmap.org Subject: Re: [OSM-dev] Is there any API to get data from OSM as geoJson? Message-ID: CADbCdJg737iuR+jNw8bX32f2HAvvU7Mkva= mt5_-q2j4a7y...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 On Thu, Feb 7, 2013 at 11:58 AM, Ander Pijoan ander.pij...@deusto.es wrote: I use Overpass API for downloading data but it doesn't export in GeoJSON format. The nearest approach would be to ask for it as OSM-JSON, store all the nodes ids and locations, store all the ways ids and node refs and then build the relations geometries but it's quite a big pain for browsers. You could build your own server and then server the data however you like. Since you're already doing all this conversion, and you seem to be doing a lot of work with the OSM data, this is probably the right approach for your application. - Serge -- Message: 3 Date: Thu, 7 Feb 2013 17:27:21 + From: Nick Whitelegg nick.whitel...@solent.ac.uk To: Ander Pijoan ander.pij...@deusto.es Cc: dev@openstreetmap.org Subject: Re: [OSM-dev] Is there any API to get data from OSM as geoJson? Message-ID: of27288083.666076d1-on80257b0b.005fe393-80257b0b.005fe...@solent.ac.uk Content-Type: text/plain; charset=utf-8 Hello Ander, I have an API for generating OSM data as geojson from a PostGIS database. The live api is part of the UK-orientated Freemap site and currently works with selected areas of the UK only, see http://www.free-map.org.uk/0.6/about.html However the code is open source and should in theory work with any OSM-derived PostGIS database. Look at https://github.com/nickw1/Freemap (look inside 0.6/ws. There are two services, tsvr.php which takes an xyz tile definition and bsvr.php which takes a bbox and projection/SRID). Nick -Ander Pijoan ander.pij...@deusto.es wrote: - To: dev@openstreetmap.org From: Ander Pijoan ander.pij...@deusto.es Date: 07/02/2013 04:59PM Subject: [OSM-dev] Is there any API to get data from OSM as geoJson? Hi everyone I am currently
[josm-dev] MapCSS magic needed
Hi! I'm in need of some magic for a JOSM style. Any hints regarding the following? * I have a tag key=a:b. I need to retrieve b. * I have a tag key=a,b,c,d. The value is comma-separated and I need to retrieve the x-th value. Any ideas? Thanks in advance, Martin ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
