[OSM-dev] Filtering out elements from a planet extract
Hi, I am trying to filter our the landuse=* ways and the corresponding nodes from a planet extract. I need this in order to import less data into a PostGIS database to speed up some processing going on after the import. I have tried osmosis but I did not find a decent way to remove all the nodes corresponding to the removed ways without removing other important data (like POIs). I tried to do it the other way around by keeping only the landuse data and the corresponding ways and it's about 50% of the original extract so I would expect some improvement on the final processing if I manage to get this working. Unfortunately osmosis does not have a diff command (only merge) so I can't get the ways I am interested. I then tried with osmfilter but I don't think I found the right way to do it since the output file is only marginally smaller than the original. If anyone have done something similar (you can replace landuse with pretty much anything) I would appreciate any hint. Thanks, Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Filtering out elements from a planet extract
Hi Markus, The scope is to keep everything BUT the landuse ways and corresponding nodes. I've tried like this: osmfilter32 input.o5m --drop-ways=landuse= --out-o5m output.o5m Thanks, --Ciprian On Wed, Feb 8, 2012 at 10:19 PM, mar...@gmx.eu wrote: Hi, I then tried with osmfilter but I don't think I found the right way to do it since the output file is only marginally smaller than the original. how did your command line look like? This should work: osmfilter input_data.osm --keep=landuse= -o=output_data.osm If you do NOT want to include nodes and relations on the base of their own landuse tags, enter this: osmfilter input_data.osm --keep-ways=landuse= --keep-nodes-relations= -o=output_data.osm Markus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Filtering out elements from a planet extract
Hi Markus, I am OK with removing all the nodes that are part of a landuse way no matter if they have their own tags or not. At least for now that will be enough. Thanks, Ciprian On Wed, Feb 8, 2012 at 10:38 PM, mar...@gmx.eu wrote: Hi Ciprian, sorry, I got you wrong. Now it's clear which ways you want to exclude, but I'm still not sure which nodes you want have and which nodes you don't. You want to exclude landuse-ways with all their nodes? BUT you do NOT want to exclude that nodes of landuse-ways which have at least one node-owned tag? Markus Original-Nachricht Datum: Wed, 8 Feb 2012 22:25:19 +0200 Von: Ciprian Talaba cipriantal...@gmail.com An: mar...@gmx.eu CC: dev@openstreetmap.org Betreff: Re: [OSM-dev] Filtering out elements from a planet extract Hi Markus, The scope is to keep everything BUT the landuse ways and corresponding nodes. I've tried like this: osmfilter32 input.o5m --drop-ways=landuse= --out-o5m output.o5m Thanks, --Ciprian On Wed, Feb 8, 2012 at 10:19 PM, mar...@gmx.eu wrote: Hi, I then tried with osmfilter but I don't think I found the right way to do it since the output file is only marginally smaller than the original. how did your command line look like? This should work: osmfilter input_data.osm --keep=landuse= -o=output_data.osm If you do NOT want to include nodes and relations on the base of their own landuse tags, enter this: osmfilter input_data.osm --keep-ways=landuse= --keep-nodes-relations= -o=output_data.osm Markus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Filtering out elements from a planet extract
Hi Flo, C++ programming is not an issue, and I will definitely give Osmium a try. Thanks, Ciprian On Wed, Feb 8, 2012 at 10:00 PM, Flo Ledermann lederm...@ims.tuwien.ac.at wrote: Hi Ciprian, On 02/08/2012 08:39 PM, Ciprian Talaba wrote: Hi, I am trying to filter our the landuse=* ways and the corresponding nodes from a planet extract. I recently created similar extracts for railways and motorways using Osmium [1]. It's C++ based, so you need to know how to run a compiler and basic programming knowledge, but when you get it running it's orders of magnitude faster than Osmosis and allows for complete customization of the filtering by writing your own filtering code. I've written about it on my blog at http://www.floledermann.com/blog/tech/filtering-and-conversion-osm-files-osmium/ (I mostly discuss issues of processing a whole planet dump on low-end machines there, but there is some source code to get you started.) Hope it helps, Flo [1] http://wiki.openstreetmap.org/wiki/Osmium ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Rendering transparent OSM maps using Mapnik
Hi, I have a working installation of Mod_tile + Tirex + Mapnik rendering a small region. The next step was to create s simpler style without landuse and with transparent background in order to use this as an overlay. Currently osm.xml have a map background of #B5D0D0 (assuming that this is due to the fact that a lot of tiles contain water areas). The rendered tiles have instead a background of #F1EEE8 so somewhere this is set, but a search in the original style (and any includes) led me to nothing. Have anyone tried to generate transparent tiles with Mapnik. I am missing something here? Thanks, Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Rendering transparent OSM maps using Mapnik
Thanks Andre, commenting out the shapefiles layer seem to fix the problem. --Ciprian On Fri, Feb 3, 2012 at 10:22 AM, Andre Joost andre+jo...@nurfuerspam.de wrote: Am 03.02.2012 09:09, schrieb Andre Joost: The blue background is replaced by a white background along with the coastline rendering. To have transparent tiles, just leave out the background-color entry from your style. EDIT: And the shapefile-rendering! Greetings, ajoessen ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Latest daily diff (20100701-20100702)
As we are in read-only mode in order to upgrade the HW I wonder if there will be 20100701-20100702 daily diff available today? Thanks, Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] OSM - POI files?
I have some script I use to get the POIs from the Romanian extract and create a SQL query. Unfortunately the code needs some cleanup and most of the comments are in Romanian, but it might help you: http://github.com/cipt2001/OpenMap.ro/blob/master/update_scripts/generate-pois.py --Ciprian On Fri, Apr 16, 2010 at 2:35 PM, OJ W ojwli...@googlemail.com wrote: Is there some application that extracts a list of POIs from an OSM file, e.g. as GPX or whatever? It would need to collapse each polygon down into one central point, so that the output is just a list of points. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] GPX pollution (spam?)
Hi, I don't know if I have chosen the right list (dev instead of talk) but here is the problem: some Romanian users have discovered some sort of SPAM in form of GPX tracks: somebody is uploading artificial tracks that contains words, more likely names of different companies (see screenshot here: http://yfrog.com/59gpxspamp). I have a couple of questions: 1. Did anybody saw something similar until now? 2. Is there a way to find out who uploaded these tracks, even if I expect they are marked as anonymous? Should we contact the Admins (TomH?) for this, as is mentioned in the wiki for spam on diaries/wiki? Thanks, Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Any OpenStreetMap viewer for Android?
Hi Stefan, On Mon, Sep 28, 2009 at 2:39 AM, Stefan Keller sfkel...@gmail.com wrote: Am I right that there's no OpenStreetMap viewer software available for Android-based phones - at least no open source except AndNav2? -S. BTW: Just saw this: Google’s Android-based devices made by companies such as Motorola and HTC are about to hit the market in large numbers in 2010. ( http://gigaom.com/2009/09/24/iphone-nokias-troubles-by-the-numbers/ ) You can try to build OSM-Android from sources (we will provide an .apk and some sample data soon) by going here: http://code.google.com/p/osm-android/ Build instructions are in the Wiki: http://code.google.com/p/osm-android/wiki/BuildInstructions --Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] planet hourly diff generation stopped 20090627 19:00
Hello, On Mon, Jul 27, 2009 at 7:47 AM, Florian Lohoff f...@rfc822.org wrote: Hi, there are no newer diffs for the last 12 hours ... Flo And no daily diffs since July 25th. --Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] VM image
Andy Allan wrote: On Tue, Oct 14, 2008 at 3:37 PM, Simone Cortesi [EMAIL PROTECTED] wrote: hi, I remember some discussions from about one year ago about setting up a VM Ware image including all the software needed for a mini-OSM, a server able to do API, storing GPX, storing data in a MySQL server and as well being able to render them using mapnik, and maybe also a wiki engine. has anyone been working on something like this? I think this would be a valuable resource toward having a sandbox for testing purpose. I certainly use VMware for testing the rails_port, and in fact have been working on fixing up the installation instructions at http://wiki.openstreetmap.org/index.php/The_Rails_Port and the Ubuntu-specific installation notes. I've got mixed opinions on having a VMware image available - 95% of the download will just be the Operating System which I'd rather leave to the distribution to worry about! Also, I'm not going to commit to keeping it up to date, so I see more value in having a simple (and accurately documented) repeatable installation instructions that'll work on many distributions/releases. Whilst we're on the topic, I see most of the instructions at http://wiki.openstreetmap.org/index.php/The_Rails_Port#Platform-specific_instructions are out of date. So here's an offer - if anyone is considering helping with the api06 coding and would like the installation instructions updated for their distribution, let me know. I've done Ubuntu already but I'm happy to do the rest - and spend time blanking the VMs and checking the notes to get them right! Cheers, Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev How about providing a kickstart file for Ubuntu/Fedora, and then a script that will download/checkout/compile the other parts of the software. --Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Batch upload dilemma
Hi all, One fleet management company was kindly enough to give us right of usage to all their track logs, so now I am facing with the problem of using this HUGE track database (the history from 2007 to now is something like 40GB of data). One way I was thinking of using this information was to have a daily archive of tracks (all the tracks, from all the cars, from the previous day) and put them in an archive and upload it to OSM server. The problem is that OSM server is treating these logs as a single track and the timestamps from different cars are mixed, so it is not usable. The idea now is to upload each file generated daily by a car separated using a script. I will create a different user for this so I can have my own tracks separately. Do you have any other idea? Thanks, Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
[OSM-dev] New tool to convert from OSM to SHP
Hi everybody, I started the development on a tool that can convert from OSM format to Shapefile format, as the only tool available in SVN is a pain to use, and I haven't try to port it on Windows. For this I have created a project on GoogleCode: http://code.google.com/p/osm2shp/. It is based on .Net Framework 2.0 and uses a wrapper to connect to shapelib library. The application is in an early development stage and I have some ideas on how developped it further, but your inputs are welcomed anytime. --Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] New tool to convert from OSM to SHP
Let me try to answer this step by step: On Tue, Mar 11, 2008 at 1:92 PM, Milo van der Linden wrote: I would like to join your project on Google Code. I am a C# and vb.net professional and have good experience with data conversion. I would add you to the project first thing tomorrow. Your help will be welcome. On Tue, Mar 11, 2008 at 6:50 PM, Karl Newman wrote: Why don't you write it as a driver for ogr2ogr? (www.gdal.org) That's an oft-requested utility, which would open up a wide variety of export formats. You could start with read-only OSM access (which is effectively what you're doing now). I didn't know anything about ogr2ogr before reading this. I would like to proceed on this path as one of the things that is motivating me is that I have a chance to code in C# after more than a year, and I am missing that. If I have time I would have a look at ogr2ogr as C/C++ experience is not missing, as my regular job is embedded engineer. On Tue, Mar 11, 2008 at 8:14 PM, Frederik Ramm [EMAIL PROTECTED] wrote: Does Jochen's Ruby Lib (http://wiki.openstreetmap.org/index.php/OSMLib) not work on Windows? It's highly configurable and generally creates any type and number of shapefiles you want... I found this library while searching for a conversion tool but I thought that the it is now very simple to use, compared to an .Net application. Also I have no experience with Ruby :( ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] osmosis diffs revisited
Sebastian Spaeth wrote: I just chmod +x ~/app/osmosis/build/dist/bin as bretth (they were not). Hopefully this will fix the osmosis diff dumps. Sebastian Is it possible to re-run the process that should have happened tonight, to be sure that everything is fine? --Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] Daily planet diff only 14 bytes
Tom Hughes wrote: In message [EMAIL PROTECTED] Ciprian Talaba [EMAIL PROTECTED] wrote: Sebastian Spaeth wrote: Sigh, I do hope it's got nothing to do with the changes I did to osmosis as outlined by bretth. (the only thing I did is change version scheme from 10 to 11). Because if it is, then we are doomed to wait until he is back... I am afraid that this is related to your changes. After we had some problems with daily diff files from 23rd to 26th February, things were going fine until the 4th of March. You can try to undo the changes and see that will happened. David is (or so I assume) talking about the weekly diff that shows the differences between the main planet files. That is not generated by Osmosis, but by Jon's planetdiff tool. Tom My mistake. So probably they made some modifications on the planetdiff tool to be able to work with the former Osmosis version, and with the change from Sebastian (on Osmosis) the tool is not working. So probably the best choice is to check the tool again. --Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] Daily planet diff only 14 bytes
Tom Hughes wrote: David is (or so I assume) talking about the weekly diff that shows the differences between the main planet files. That is not generated by Osmosis, but by Jon's planetdiff tool. This is where the whole misunderstanding started. I think David is referring to the daily diff files in http://planet.openstreetmap.org/daily/ which are generated by Osmosis. Today (and yesterday) the diff file is only 14 bytes which is not good. --Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] Flash Player on Linux
Richard Fairhurst wrote: Could any Linux users out there confirm this? In particular, I'd be interested to know if: - it's still an issue with the latest Flash Player - copying and pasting the characters from another app fixes the issue Richard, This is still an issue with Fedore Core 6/Firefox 2.0/Flash Player 9.0.115.0 (my setup) when I try to use special characters from Romanian language. It is working fine if the characters are copy-pasted from another application. Hope that helps. Regards, Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] Special request for someone who has time [A clairon call.....]
On a Windows platform you can try to use Kosmos ( http://wiki.openstreetmap.org/index.php/Kosmos) as a rendering engine. For this you will need to have an OSM file corresponding to the area you want to render - use osmosis to get an extract from the big planet file if necessary. After this you can install Apache with OpenLayers to display the map. The process is quite simple, and if you get stuck I can give some simple examples. Hope this helps. Regards, Ciprian 2008/3/3 Fire Girl [EMAIL PROTECTED]: Hi, I am struggling with a problem. I have been trying for weeks... literally, to get a SQL database dump of the planet file. Something ready to generate maps from on a Windows platform. I have tried porting the .OSM file to a linux system. I actually ran a procedure on Fedora 7, PostGIS, Apache, etc. Some good instructions were out there... and I actually got the entire thing configured with some great pain.It was running for 2.2 days... and then it failed to pull up a map on the running Apache. All the stage by stage messages during the setup seemed to be OK... the huge file ran with tons of insertion messages I started up Apache, got to the default page... but blank hole no map. :( I am struggling just to get to point A with this data. I will take any age data,... but would be soo appreciative if someone out there would be willing to generate a big SQL dump of the planet file and all associated data needed to make maps and I'll break it down further and work with it. A Zip file? FTP? Anything. :) Here is my clairon call and hopefully someone can assist. Please send me a private message. Best wishes, %Fire-girl% -- Want an e-mail address like mine? Get a *free e-mail *account today at www.mail.comhttp://www.mail.com/Product.aspx ! ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
[OSM-dev] Osmosis broken
On Sun, Feb 24, 2008 at 9:44 AM, Tom Hughes tom at compton.nu http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev wrote: * In message 52ae42fa0802240831i1b2ac661jcc3598bd0f30e093 at mail.gmail.com http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev ** Karl Newman siliconfiend at gmail.com http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev wrote: ** ** On Sun, Feb 24, 2008 at 5:18 AM, Tom Hughes tom at compton.nu http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev wrote: ** ** That'll be when I updated the database to schema version 11 for ** Steve's ** changes. Unfortunately that breaks Osmosis... I think Brett's away at ** the ** moment, so this might not be very easy to fix. ** ** Actually, I think it's not too bad to fix. I don't think Osmosis cares ** about ** user preferences (assuming that was the major change), so all you have ** to do ** is bump the expected schema version to 11. It's in ** ** Osmosis/src/com/bretth/osmosis/core/mysql/v0_5/MySqlVersionConstants.java Of ** course, then you'd have to recompile and deploy the new version. ** ** The problem is not changing the code, it's that I have no idea how ** to go about building it or deploying the fixed version on dev. * I am running the Romania extract and I am not sure when this will be fixed are we gonna be able to fix the daily diffs starting with the 23rd, or just have to wait for a weekly drop for the whole database to be able to resume the process of extracting? Thanks, Ciprian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
