Re: [OSM-dev] [OSM-talk] Is there some lag in the backend data?

2013-07-23 Thread Paul Norman
From: Stephan Knauss [mailto:o...@stephans-server.de] Sent: Tuesday, July 23, 2013 5:30 AM Cc: t...@openstreetmap.org Subject: Re: [OSM-talk] Is there some lag in the backend data? For me this sounds more like a replication problem. Data is available immediately. It's not related to

Re: [osmosis-dev] Improving pgsnapshot

2013-07-21 Thread Paul Norman
From: Brett Henderson [mailto:br...@bretth.com] Sent: Sunday, July 21, 2013 3:38 AM To: Paul Norman Cc: osmosis-dev Subject: Re: [osmosis-dev] Improving pgsnapshot 2. Find all parent ways of those nodes and add them to a ways list (ways_from_nodes) If you have the linestring column

[OSM-dev] OSM cgimap GSOC 2013 report #5

2013-07-21 Thread Paul Norman
Note: A day late, due to odd schedules. What did I get done this week? This week I switched focus from cgimap coding to integration testing. To do this, I had to develop a way to test API responses. I spent awhile looking at different frameworks for testing that would work on a RESTful API and

Re: [osmosis-dev] osmosis loading, apidb and time zones

2013-07-20 Thread Paul Norman
From: Brett Henderson [mailto:br...@bretth.com] Sent: Friday, July 19, 2013 6:20 PM Subject: Re: [osmosis-dev] osmosis loading, apidb and time zones I'm not sure how to diagnose this one. Perhaps trace queries against the database server and see what Osmosis is passing in? Probably easiest.

Re: [osmosis-dev] Improving pgsnapshot

2013-07-19 Thread Paul Norman
From: Brett Henderson [mailto:br...@bretth.com] Subject: Re: [osmosis-dev] Improving pgsnapshot Schema details: I want to add a nodes.ways bigint[] column to the nodes table and use it for node-ways lookups, then use the existing ways.nodes bigint[] column for way-nodes What is the

[osmosis-dev] osmosis loading, apidb and time zones

2013-07-17 Thread Paul Norman
I've been working on some API tests, and ran into a case where the timestamps of objects in a file are not reproduced after loading the file into the database and fetching it with API calls. The file contains this node: node id=1001 version=1 changeset=1001 lat=1.001 lon=1.001 user=user_1001

Re: [OSM-dev] hourly-diffs broken

2013-07-15 Thread Paul Norman
From: Walter Nordmann [mailto:pil...@hotmail.com] Subject: Re: [OSM-dev] hourly-diffs broken Hi, i'm using minutely diffs. should i do something (reset state.txt to last evening) or is everything fine? My understanding is you're fine, although there was a brief interruption earlier for a

[OSM-dev] OSM cgimap GSOC 2013 report #4

2013-07-13 Thread Paul Norman
What did I get done this week? - pulled in the changeset cache refactor from upstream - lots of working with git merge - analyzed a set of logs from api.osm.org - 30% of map? calls return no results - This lead me to short-circuit map calls with no nodes, leading to a substantial

[osmosis-dev] Improving pgsnapshot

2013-07-09 Thread Paul Norman
I've been working on expanding cgimap to use pgsnapshot. In the process I've come across some changes to the schema I'd like to propose. The changes basically consist of removing the giant (237GB) way_nodes table. Would this be best to do within the existing pgsnapshot tasks and by incrementing

Re: [OSM-dev] osm2pgsql and timestamp as data in Postgres?

2013-07-09 Thread Paul Norman
From: Stefan Keller [mailto:sfkel...@gmail.com] Subject: [OSM-dev] osm2pgsql and timestamp as data in Postgres? Hi, Did anyone manage to configure osm2pgsql in order that it stores also the timestamp XML attribute in Postgres - either as separate field or as key/value in the hstore

[OSM-dev] OSM cgimap GSOC 2013 report #3

2013-07-06 Thread Paul Norman
What did I get done this week? http://pnorman.dev.openstreetmap.org/julnetwork.png I somehow managed to get everything done this week I had planned to, and am now significantly ahead of my schedule. I now have a version of cgimap that will respond to map? calls with data from a pgsnapshot

[OSM-dev] OSM cgimap GSOC 2013 report #2

2013-06-28 Thread Paul Norman
The theme of this week was refactoring and learning about boost 1) What have I completed this week? Aside from some assorted minor fixups, the bulk of the week was figuring out how to refactor part of cgimap. Cgimap has a changeset cache, which stores changeset information locally to reduce

Re: [OSM-dev] disk size for planet osm import into PostGIS (on an SSD)?

2013-06-27 Thread Paul Norman
From: Akos Maroy [mailto:a...@maroy.hu] Subject: [OSM-dev] disk size for planet osm import into PostGIS (on an SSD)? Hi, I'd like to inquire about the estimated disk size needed to import the planet osm file into PostGIS? For osm2pgsql about 240GB for the database plus 17GB for

[OSM-dev] Depreciation of changes API

2013-06-24 Thread Paul Norman
The changes API is an old API that was used by tiles@home. The rails devs and sysadmins are planning on depreciating this API and want to announce before doing so. Server logs indicate that there is one user of this API fetching it hourly.* Deprecating this API would allow the code for it to be

[josm-dev] Tag statistics

2013-06-24 Thread Paul Norman
Previously when I selected a bunch of objects in JOSM and selected their tags and copied them to a text editor, I got back various useful counts of tag usage. I no longer get this, I now get a list of tags but no way to get statistics. How can I restore the old behavior?

[osmosis-dev] Submitting patches

2013-06-22 Thread Paul Norman
I've made some local changes to some of the osmosis pgsnapshot loading scripts and wanted to contribute them back upstream. I've done a pull request to brettch/osmosis on github (https://github.com/brettch/osmosis/pull/2) but is this the right place? The dev guide isn't exactly clear to me.

[OSM-dev] GSoC Week 1-3

2013-06-22 Thread Paul Norman
This is my first report. Due to later scheduling conflicts I started coding early, so this report covers 3 weeks. Note: This was four calendar weeks, but one week was SOTM-US and due to visa restrictions I could do no GSOC work there at all. Accordingly I'll just divide up this 3 week period into

Re: [OSM-dev] Tile server

2013-06-22 Thread Paul Norman
:20 PM To: Jeffrey Ollie Cc: Paul Norman; OSM-Dev Openstreetmap Subject: Re: [OSM-dev] Tile server If you look here http://www.rackspace.com/cloud/block-storage/pricing/ you will see pricing for Rackspace SSD is $0.70 cents per GB per month. Its hard to compare apples to apples as they include

Re: [OSM-dev] Tile server

2013-06-21 Thread Paul Norman
Amazon EBS is extremely slow. Adding more space won't help. An EBS volume is about 100 iops, which is about the same as a single 7200 RPM drive. Within EBS your options for better performance are multiple EBS in RAID (complicated), provisioned iops EBS (expensive), ephemeral storage (reasonable

Re: [OSM-dev] Expiring Tiled OSM Data

2013-06-20 Thread Paul Norman
From: Andy Allan [mailto:gravityst...@gmail.com] Sent: Thursday, June 20, 2013 5:14 AM Subject: Re: [OSM-dev] Expiring Tiled OSM Data On 19 June 2013 20:58, Ian Dees ian.d...@gmail.com wrote: So we're talking potentially several billion (entity type)+(entity id) - [(tile x)+(tile y),

[osmosis-dev] Osmosis patches

2013-06-01 Thread Paul Norman
In connection with my GSoC work I'm submitting some of my local pgsnapshot optimizations upstream, but the development guide doesn't say where to do so. With what I have right now I've done a github pull request to brettch/osmosis at https://github.com/brettch/osmosis/pull/2, but is this the

Re: [OSM-dev] Querying Changeset Tags in OSM API

2013-05-31 Thread Paul Norman
query is one of the more expensive ones. There aren’t any great solutions yet for small-scale historical analysis. From: Pierre Béland [mailto:pierz...@yahoo.fr] Sent: Friday, May 31, 2013 8:38 PM To: Paul Norman; 'william skora'; dev@openstreetmap.org Subject: Re: [OSM-dev] Querying Changeset

Re: [josm-dev] Find superfluous nodes

2013-05-30 Thread Paul Norman
From: Jo [mailto:winfi...@gmail.com] Sent: Wednesday, May 29, 2013 10:42 PM To: josm-dev Subject: [josm-dev] Find superfluous nodes Hi, We got some data where there are extra nodes, which I'd like to get rid of before integrating it into OSM. Standard import cautions apply here of

Re: [osmosis-dev] Wrapper scripts for streaming replication

2013-05-24 Thread Paul Norman
From: Brett Henderson [mailto:br...@bretth.com] Sent: Friday, April 19, 2013 4:12 AM Subject: Re: [osmosis-dev] Wrapper scripts for streaming replication It'd be great to see the replication streaming getting some usage. It doesn't seem to be used at the moment. In fact it's been down

Re: [OSM-dev] Querying Changeset Tags in OSM API

2013-05-24 Thread Paul Norman
You could do this with pgsnapshot (or if just doing analysis, osm2pgsql) in the same database as changesetmd, and then do JOINs between the tables to get objects that were last modified in a changeset that had a particular tag. This may be hampered by two things - A lack of minutely

Re: [OSM-dev] Overpass DEV url?

2013-05-18 Thread Paul Norman
From: amrit karmacharya [mailto:amrit...@gmail.com] Sent: Friday, May 17, 2013 9:39 PM Subject: Re: [OSM-dev] Overpass DEV url? How can we enter a small bunch of data into dev server? Using josm didnot work, and there are no data in my area to test. I tried using the iD dev mode, but the

[OSM-dev] Identifying when a tag was added

2013-05-06 Thread Paul Norman
I have a list of a few hundred nodes with a particular tag, say foo=bar. All the nodes are version 2 or greater. I want to identify either the earliest version with that tag or which versions have that tag. For my case it is acceptable to call /history from the API because it is for editing.

[osmosis-dev] Wrapper scripts for streaming replication

2013-04-18 Thread Paul Norman
I'm considering making use of streaming replication to feed change data to a process, but I'm not quite sure how to script it to handle interruptions like power outages and such correctly without getting in advance of itself. Does anyone have any wrapper scripts that would help with this? I'd

[osmosis-dev] Bad PostgreSQL plans with pgsnapshot

2013-04-16 Thread Paul Norman
I ran across a PostgreSQL query planner bug today when benchmarking pgsnapshot. This may affect others so I'm documenting it. A common task is to extract a bounding box or polygon from the database, equivalent to a map? call. The way I was benchmarking was a multi-step process, but there's two

Re: [osmosis-dev] Problem with Windows 7

2013-04-07 Thread Paul Norman
I find no mention of a -mapfile-writer task in the usage page. Are you using a plugin? From: Malky [mailto:ma...@homersparadise.com] Sent: Sunday, April 07, 2013 5:48 AM To: osmosis-dev@openstreetmap.org Subject: [osmosis-dev] Problem with Windows 7 When I try to create a map, I get a

Re: [OSM-dev] mod_tile in other projections?

2013-03-24 Thread Paul Norman
From: Jason Lee [mailto:jaslee...@gmail.com] Sent: Thursday, March 07, 2013 7:36 AM To: dev@openstreetmap.org Subject: [OSM-dev] mod_tile in other projections? The only other thing I can think of is using MapProxy with Mapnik backend but I'm not sure the scalabilty/performance compared

Re: [josm-dev] JOSM Server

2013-03-19 Thread Paul Norman
From: Dirk Stöcker [mailto:openstreet...@dstoecker.de] Sent: Tuesday, March 19, 2013 12:31 PM To: josm-dev@openstreetmap.org Subject: Re: [josm-dev] JOSM Server On Mon, 18 Mar 2013, Simon Legner wrote: What about re-generating this file on modification and shipping as fast as possible

Re: [OSM-dev] Coastline changes Antarctica

2013-03-12 Thread Paul Norman
From: Jochen Topf [mailto:joc...@remote.org] Sent: Tuesday, March 12, 2013 1:25 AM Subject: Re: [OSM-dev] Coastline changes Antarctica On Mon, Mar 11, 2013 at 10:53:16AM -0700, Paul Norman wrote: From: Jochen Topf [mailto:joc...@remote.org] Sent: Monday, March 11, 2013 10:17 AM

Re: [OSM-dev] openstreetmapdata.com

2013-03-11 Thread Paul Norman
From: Jochen Topf [mailto:joc...@remote.org] Sent: Sunday, March 10, 2013 11:42 PM Subject: Re: [OSM-dev] openstreetmapdata.com This process is not and can not be perfect. If you wait for the coastline data to be perfect, you can wait for months. Every day errors are fixed but new errors

Re: [OSM-dev] Coastline changes Antarctica

2013-03-11 Thread Paul Norman
From: Jochen Topf [mailto:joc...@remote.org] Sent: Monday, March 11, 2013 9:27 AM Subject: [OSM-dev] Coastline changes Antarctica Hi! In the course of the Antarctica coastline update (see http://wiki.openstreetmap.org/wiki/Antarctica/Import_2013) we want to change how the coastline of

Re: [OSM-dev] Coastline changes Antarctica

2013-03-11 Thread Paul Norman
From: Jochen Topf [mailto:joc...@remote.org] Sent: Monday, March 11, 2013 10:17 AM Subject: Re: [OSM-dev] Coastline changes Antarctica If tile.osm.org has by now switched to using OSMCoastline and uses a current version there is no impact. If it still uses coastcheck it will break. I

Re: [OSM-dev] Coastline changes Antarctica

2013-03-11 Thread Paul Norman
From: Christoph Hormann [mailto:chris_horm...@gmx.de] Sent: Monday, March 11, 2013 10:50 AM Subject: Re: [OSM-dev] Coastline changes Antarctica On Monday 11 March 2013, Jochen Topf wrote: I have described the details in this blog post:

Re: [OSM-dev] openstreetmapdata.com

2013-03-10 Thread Paul Norman
It is potentially possible for the results of OSMCoastline to be absurd. In these cases, my understand is the new files might not be posted. There are a couple of coastline error displays. One is the coastline layer in OSMI at http://tools.geofabrik.de/osmi/?view=coastline which shows errors

[OSM-dev] OsmAnd data corruption bug

2013-03-08 Thread Paul Norman
. What user-agents do the bugged versions use, in case it becomes necessary to block them 3. Was this data corruption issue a known issue? If so, please advise the admins or dev@ in the future if it is necessary to block user- agents corrupting data Thanks, Paul Norman For the Data Working Group

Re: [Potlatch-dev] Status of potlatch2 development?

2013-02-15 Thread Paul Norman
From: Serge Wroclawski [mailto:emac...@gmail.com] Subject: Re: [Potlatch-dev] Status of potlatch2 development? On Sat, Feb 9, 2013 at 7:33 AM, Steve Bennett stevag...@gmail.com wrote: *crickets* No active devs left on this list? Did everyone move to iD? My impression (and I'm open

Re: [OSM-dev] Reminder: Node 32-bit exhaustion

2013-02-07 Thread Paul Norman
From: Ilya Zverev [mailto:zve...@textual.ru] Subject: Re: [OSM-dev] Reminder: Node 32-bit exhaustion Well, you've got less than 24 hours to update your osm2pgsql. http://textual.ru/64/ shows that there are 1.3 million nodes left, and for the last two days nearly 1.5 million nodes were added

[OSM-dev] Reminder: Node 32-bit exhaustion

2013-02-04 Thread Paul Norman
As of right now, we are 5.31 million nodes away from hitting our 2^31th node. This is likely to cause some software to break. Hopefully everything major has been tested, but if you haven't checked your software now would be a good time to do so. I think coastcheck will break in substantial

Re: [osmosis-dev] Non-standard pgsnapshot indexes

2013-01-28 Thread Paul Norman
This is all fairly pgsnapshot specific so I guess it depends on if you want that page to be about osmosis and postgis or osmosis and pgsnapshot. I’m really not much of a wiki editor myself. From: Brett Henderson [mailto:br...@bretth.com] Sent: Sunday, January 27, 2013 7:36 PM To: Paul

[OSM-dev] Dealing with conflicts

2013-01-24 Thread Paul Norman
I'm working on software which to be used with importing addresses. I expect to be able to identify cases where OSM data and remote data source data conflict. Obviously automatically overwriting OSM data with the remote source is a no-go, but the quality of the remote source is good enough I don't

Re: [OSM-dev] [josm-dev] Dealing with conflicts

2013-01-24 Thread Paul Norman
From: Simon Legner [mailto:simon.leg...@gmail.com] Sent: Thursday, January 24, 2013 2:04 AM Subject: Re: [josm-dev] Dealing with conflicts Hi! On 24/01/13 09:17, Paul Norman wrote: Is anyone aware of a better way to handle this? Did you take a look at Conflation, a plugin

[josm-dev] Dealing with conflicts

2013-01-24 Thread Paul Norman
I'm working on software which to be used with importing addresses. I expect to be able to identify cases where OSM data and remote data source data conflict. Obviously automatically overwriting OSM data with the remote source is a no-go, but the quality of the remote source is good enough I don't

Re: [josm-dev] Dealing with conflicts

2013-01-24 Thread Paul Norman
From: Simon Legner [mailto:simon.leg...@gmail.com] Sent: Thursday, January 24, 2013 2:04 AM Subject: Re: [josm-dev] Dealing with conflicts Hi! On 24/01/13 09:17, Paul Norman wrote: Is anyone aware of a better way to handle this? Did you take a look at Conflation, a plugin

[osmosis-dev] pgsnapshot composite index results

2013-01-22 Thread Paul Norman
I frequently use my pgsnapshot database for unusual purposes and end up running non-standard queries. The standard indexes for pgsnapshot nodes include a GiST index on geom. Another common index suggested by the jxapi installation instructions[1] is a GIN index on tags. These indexes work well

[osmosis-dev] Non-standard pgsnapshot indexes

2013-01-22 Thread Paul Norman
I've talked in other places about the non-standard indexes that I have on my pgsnapshot database, but I don't believe I've ever produced a full listing. I believe the following are all the non-standard indexes I have, with the size and applicable comments in [] On nodes: btree

Re: [OSM-dev] Snapshot Server

2013-01-08 Thread Paul Norman
On 2013-01-08, at 12:59 PM, Rob Nickerson rob.j.nicker...@gmail.com wrote: A web based loading screen would be a big plus for me. I had a quick look and found a 5mb shapefile. I would imagine 10mb is probably the largest I have. Not sure how that converts to .osm filesize. Rob It can

Re: [josm-dev] Is the should upload logic a little too eager?

2013-01-01 Thread Paul Norman
From: Toby Murray [mailto:toby.mur...@gmail.com] Subject: Re: [josm-dev] Is the should upload logic a little too eager? On Tue, Jan 1, 2013 at 8:18 AM, Greg Troxel g...@ir.bbn.com wrote: On exit, JOSM offers to save data to disk when it's modified, and this is of course totally fine.

Re: [OSM-dev] Snapshot Server

2012-12-27 Thread Paul Norman
Readme.md for snapshot-server is not quite accurate. I've got an updated readme at https://github.com/pnorman/snapshot-server/blob/patch-3/README.md that covers enabling PostGIS and hstore but Andy hasn't had time to update upstream. From: Rob Nickerson [mailto:rob.j.nicker...@gmail.com]

[OSM-dev] addressmerge 0.1 release

2012-12-09 Thread Paul Norman
For the last couple of weeks I've been working on addressmerge, a tool to post-process address data by comparing it with existing OSM data. I have pushed release 0.1 to https://github.com/pnorman/addressmerge Currently it will take a file in importable .osm format, compare it with existing OSM

Re: [OSM-dev] iD development updates

2012-12-06 Thread Paul Norman
From: Frederik Ramm [mailto:frede...@remote.org] Sent: Thursday, December 06, 2012 1:18 PM To: dev@openstreetmap.org Subject: Re: [OSM-dev] iD development updates Hi, On 06.12.2012 20:54, John Firebaugh wrote: And Saman Bemel-Benrud started on iD design work and gave us a quick

Re: [OSM-dev] [Talk-us] tools for analysis of road networks?

2012-12-05 Thread Paul Norman
] Sent: Wednesday, December 05, 2012 10:39 AM To: Martijn van Exel Cc: Paul Norman; Richard Welty; the Old Topo Depot; talk...@openstreetmap.org Openstreetmap Subject: Re: [Talk-us] tools for analysis of road networks? These are the sorts of queries that jxapi does all the time. hstore's

Re: [OSM-dev] Timestamp in PBF files

2012-11-23 Thread Paul Norman
From: Jochen Topf [mailto:joc...@remote.org] Sent: Thursday, November 22, 2012 8:19 AM Subject: Re: [OSM-dev] Timestamp in PBF files I don't know why there are no redacted nodes, Matt mentioned something that he hasn't implemented that yet. But that would mean we have non- ODbL-clean data

Re: [Potlatch-dev] P2, snapshot-server, imports, vector layers and more

2012-11-15 Thread Paul Norman
From: Andy Allan [mailto:gravityst...@gmail.com] Subject: Re: [Potlatch-dev] P2, snapshot-server, imports, vector layers and more On 15 November 2012 05:44, Paul Norman penor...@mac.com wrote: The additional attribute prevents the files from working in JOSM Oh, really? That sucks. I

[Potlatch-dev] P2, snapshot-server, imports, vector layers and more

2012-11-14 Thread Paul Norman
I've been working on methods of using external datasources as background vector layers in P2 and JOSM and have come up against a few issues. Background: P2 has excellent support for data layers but their full power is not exposed to the user by default. I am contemplating using snapshot-server

Re: [josm-dev] Adding your own imagery

2012-11-14 Thread Paul Norman
From: Russ Nelson [mailto:nel...@crynwr.com] Sent: Wednesday, November 14, 2012 6:32 PM To: kristy van putten Cc: josm-dev@openstreetmap.org Subject: Re: [josm-dev] Adding your own imagery kristy van putten writes: This is my first time on this list, so apologies if I am asking the

Re: [josm-dev] Missing keys/tags on JOSM

2012-11-08 Thread Paul Norman
From: Paul Hartmann [mailto:phaau...@googlemail.com] Sent: Thursday, November 08, 2012 12:20 PM To: josm-dev@openstreetmap.org Subject: Re: [josm-dev] Missing keys/tags on JOSM And another doubt: still using the restaurant example, we have in defaultpresets.xml: multiselect

[josm-dev] Building plugins

2012-11-08 Thread Paul Norman
I've been trying to compile the mirrored_download plugin so I can fix bugs http://josm.openstreetmap.de/ticket/7660 and http://josm.openstreetmap.de/ticket/7661 as well as add jxapi.openstreetmap.org to the list. I checked out the plugin environment as described at

Re: [osmosis-dev] Geometries for the relations table of pgsnapshot

2012-10-25 Thread Paul Norman
aggregate node and way geometries I get a MULTILINESTRING which is much more useful than GEOMETRYCOLLECTION. 2. What to do about hierarchical relations (that is, relations that have other relations as members)? Should they be resolved down to nodes/ways? Paweł On 10/25/2012 02:37 AM, Paul Norman

[osmosis-dev] Geometries for the relations table of pgsnapshot

2012-10-24 Thread Paul Norman
I keep a pgsnapshot database up to date on my home server for a local jxapi server and also for analysis. I have a linestring column built for the ways table, but there's no geometry for relations. I am wondering what would be involved with getting a geometry column built for the relations

Re: [OSM-dev] ODbL full history planet

2012-10-22 Thread Paul Norman
I’m dashing off to class, but I believe there’s one somewhere in the redaction bot codebase. No idea exactly where or how to run it, but hopefully that can get you started. From: kimaidou [mailto:kimai...@gmail.com] Sent: Monday, October 22, 2012 2:49 AM To: Peter Körner Cc: Martijn van

Re: [OSM-dev] Recapping wishlist + hello world + PDX Bof

2012-10-18 Thread Paul Norman
I'm just replying to a few points in the limited areas of my expertise. This isn't to say that other improvements aren't valuable, just that I'm not in a position to comment on them. From: Alex Barth [mailto:a...@mapbox.com] Subject: [OSM-dev] Recapping wishlist + hello world + PDX Bof ##

Re: [OSM-dev] Why are so many changeset so large?

2012-10-17 Thread Paul Norman
From: Alex Barth [mailto:a...@mapbox.com] Subject: Re: [OSM-dev] Why are so many changeset so large? BTW, I did some cursory digging in the changesets dump and found that actually only a relatively small percentage of changesets are geographically large. Trying to use the history tab they

Re: [OSM-dev] OSM Wishlist

2012-10-14 Thread Paul Norman
On 12-Oct-12, at 3:50 PM, Iván Sánchez Ortega wrote: Also. ogr3osm. I would love to have the time and resources (or paid time, nudgenudgewinkwink) to redo ogr2osm; adding a backtracking-like algorithm to minimise the amount of geometries' shared nodes (and their bounding boxes) in

Re: [OSM-dev] OSM Wishlist

2012-10-14 Thread Paul Norman
On 14-Oct-12, at 5:31 AM, Iván Sánchez Ortega wrote: On Sunday, 14 de October de 2012 10:05:31 Paul Norman escribió: I'm giving a talk tomorrow on ogr2osm [...] For a 600 MB .mdb (400 MB .shp) [...] it uses about 6-7 gigs of ram for that. I may be able to get that down substantially, I

Re: [OSM-dev] OSM Wishlist

2012-10-12 Thread Paul Norman
to see something new here too. It was up as a project for Google Summer of Code, but the project fell through. The idea was to create an engine that can flag suspicious changesets. There's some working code on this (which is actually in production I believe) by Paul Norman of the Data Working

Re: [OSM-dev] Multipolygons as members of a multipolygon

2012-10-08 Thread Paul Norman
I don’t believe anything supports nested multipolygons and I haven’t seen any in the database. As I read it, that page is only intended to apply to route relations. Personally, I’d regard any multipolygons containing non-ways as being in error. From: Igor Brejc

Re: [OSM-dev] osm mirror at spline (planet files)

2012-09-27 Thread Paul Norman
The easiest way to get a copy of the diffs going back to 2010 is get the hourly diffs with rsync from the heanet mirror. Didn't you ask this question a few times already? From: Mike Dupont [mailto:jamesmikedup...@googlemail.com] Sent: Thursday, September 27, 2012 2:48 AM To:

Re: [OSM-dev] osm mirror at spline (planet files)

2012-09-26 Thread Paul Norman
From: Philipp Borgers [mailto:borg...@mi.fu-berlin.de] Sent: Wednesday, September 26, 2012 12:41 PM To: dev Subject: [OSM-dev] osm mirror at spline (planet files) Hi everybody, for quite some time now we are mirroring the planet files at ftp.spline.de [1]. Finally I found some time to

[osmosis-dev] Odd rate numbers with write-pgsql-dump

2012-09-15 Thread Paul Norman
I am using the --write-pgsql-dump in preparation for importing the planet into a pgsnapshot database and have noticed some oddities with ways. I am reading from the latest .pbf and using enableBboxBuilder=no enableLinestringBuilder=yes nodeLocationStoreType=TempFile. I tried InMemory but 16G of

[OSM-dev] ODbL coastcheck coastlines

2012-09-15 Thread Paul Norman
New coastlines generated from the ODbL planet are available at http://pnorman.dev.openstreetmap.org/coastlines/ As these were not generated on my normal machine shapeindex was not run on the files so if you are using them for mapnik you will want to do so but that step is quick and easy. These

Re: [OSM-dev] Switch osm2pgsql to 64 bit mode

2012-09-13 Thread Paul Norman
Are there any other changes that will be made to the default config? (e.g. new .style, switching to hstore) -Original Message- From: Kai Krueger [mailto:kakrue...@gmail.com] Sent: Thursday, September 13, 2012 3:59 PM To: dev@openstreetmap.org Subject: [OSM-dev] Switch osm2pgsql to 64

Re: [OSM-dev] coastline shapefiles unprojected

2012-09-10 Thread Paul Norman
From: Yuan Bo [mailto:yuan.bo...@gmail.com] Sent: Monday, September 10, 2012 1:26 AM To: dev@openstreetmap.org Subject: [OSM-dev] coastline shapefiles unprojected Hi Paul, I just started to use OSM coastlines. I used to use GSHHS for land masking purposes. I've an issue here. I'd

[OSM-dev] New proposed directory layout for planet.openstreetmap.org

2012-09-05 Thread Paul Norman
I would like to propose changing the directory layout of planet.openstreetmap.org with the ODbL switch. The current directory layout has grown rather than being planned. With the new content being under a different license it is a good idea to re-arrange the files to make it clear where content is

Re: [OSM-dev] New proposed directory layout for planet.openstreetmap.org

2012-09-05 Thread Paul Norman
From: Martijn van Exel [mailto:m...@rtijn.org] Sent: Wednesday, September 05, 2012 12:57 PM Subject: Re: [OSM-dev] New proposed directory layout for planet.openstreetmap.org Agreed, but most of what you would want to do with grep is possible with other tools like osmosis, osmconvert and

[josm-dev] Imagery bounding polygons

2012-09-05 Thread Paul Norman
I've been thinking of cleaning up some of the shape entries for the sources in https://josm.openstreetmap.de/wiki/Maps so that I don't get US imagery suggested in areas without coverage. Is anyone aware of a tool that will convert from .osm, .poly or WKT to the XML used by JOSM? I could convert

Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping

2012-08-20 Thread Paul Norman
Are there installation instructions or a getting started guide? Also, I use photos taken every few seconds. Will this also work with them or would I need to convert them into a movie? With the last update to dev@ being about two months ago this project kind of fell off my radar of projects

Re: [OSM-dev] Anomaly Detection Engine

2012-08-18 Thread Paul Norman
Has the Anomaly Detection Engine project been abandoned? I never received a reply when I asked the student. -Original Message- From: Paul Norman [mailto:penor...@mac.com] Sent: Saturday, July 28, 2012 8:21 PM To: 'vel...@gmail.com' Cc: 'Derick Rethans' Subject: Anomaly Detection

Re: [OSM-dev] [GSoC] Improvements to Vespucci

2012-08-12 Thread Paul Norman
From: Jan Schejbal [mailto:jan.mailinglis...@googlemail.com] Sent: Sunday, August 12, 2012 12:17 PM To: osmeditor4andr...@googlegroups.com Cc: dev@openstreetmap.org Subject: Re: [OSM-dev] [GSoC] Improvements to Vespucci Am 2012-08-11 16:19, schrieb Jan Schejbal: Two things remain to be

Re: [OSM-dev] Older change files before sept 27 2011

2012-08-06 Thread Paul Norman
From: Mike Dupont [mailto:jamesmikedup...@googlemail.com] Sent: Monday, August 06, 2012 12:33 PM To: dev@openstreetmap.org Subject: [OSM-dev] Older change files before sept 27 2011 And the main site is blocking me from downloading, I guess I am over quota. Can someone please point me to a

Re: [osmosis-dev] APIDB replication stalled

2012-07-25 Thread Paul Norman
Thanks – working now. Few days to catch up on, I might catch up just in time to reload with ODbL data From: Brett Henderson [mailto:br...@bretth.com] Sent: Tuesday, July 24, 2012 9:19 AM To: Paul Norman Cc: osmosis-dev@openstreetmap.org Subject: Re: [osmosis-dev] APIDB replication stalled

Re: [OSM-dev] Useful post-bot visualisation?

2012-07-17 Thread Paul Norman
From: ikonor [mailto:iko...@gmx.de] Sent: Tuesday, July 17, 2012 2:31 PM To: dev@openstreetmap.org Subject: Re: [OSM-dev] Useful post-bot visualisation? Hi, I'm about to develop - amongst other things - an interactive local change file viewer. It consists of an Osmosis plugin to augment

[OSM-dev] New tools to help with reverts

2012-07-16 Thread Paul Norman
A problem with the revert tools is that they time out /download for large changesets I've written a tool that generates a .osc from the minutely diffs, only requiring one small API call. https://github.com/pnorman/make_changeset is the tool. Given a changeset ID it will query the API for the

[OSM-dev] Replication on dev API

2012-07-14 Thread Paul Norman
Would it be possible to turn on replication on the dev API? As we've seen recently with the changes to diffs it's useful to be able to test diff consuming software and sometimes you need to be able to generate changes that you shouldn't do on the live API

Re: [OSM-dev] (Multi)Polygon handling

2012-07-13 Thread Paul Norman
From: nimix [mailto:melchiorm...@gmail.com] Sent: Friday, July 13, 2012 12:58 AM To: dev@openstreetmap.org Subject: [OSM-dev] (Multi)Polygon handling Frederik Ramm wrote If we can't get everyone to use the same code base, then it would at least be great to reach some kind of

Re: [OSM-dev] (Multi)Polygon handling

2012-07-13 Thread Paul Norman
From: Jochen Topf [mailto:joc...@remote.org] Cc: dev@openstreetmap.org Subject: Re: [OSM-dev] (Multi)Polygon handling On Fri, Jul 13, 2012 at 12:57:33AM -0700, nimix wrote: Frederik Ramm wrote If we can't get everyone to use the same code base, then it would at least be great

Re: [OSM-dev] (Multi)Polygon handling

2012-07-13 Thread Paul Norman
From: Jochen Topf [mailto:joc...@remote.org] Sent: Friday, July 13, 2012 5:02 AM To: Paul Norman Cc: 'nimix'; dev@openstreetmap.org Subject: Re: [OSM-dev] (Multi)Polygon handling On Fri, Jul 13, 2012 at 03:11:40AM -0700, Paul Norman wrote: For a lot of the invalid cases there won't

Re: [josm-dev] Validator

2012-07-12 Thread Paul Norman
From: Maarten Deen [mailto:md...@xs4all.nl] Subject: Re: [josm-dev] Validator Is it possible to make an option for the validator so that you can choose between validating only touched objects and all objects? Then put it default on only touched objects for new installations so that newbies

Re: [OSM-dev] [OSM-talk] Licence redaction ready to begin

2012-07-10 Thread Paul Norman
From: Richard Fairhurst [mailto:rich...@systemed.net] Sent: Monday, July 09, 2012 1:47 PM Subject: [OSM-talk] Licence redaction ready to begin Test runs have shown that the bot is functioning as we want it to, but we will of course be monitoring its progress. We are currently expecting it

Re: [OSM-dev] Licence redaction ready to begin

2012-07-09 Thread Paul Norman
From: Richard Fairhurst [mailto:rich...@systemed.net] Subject: [OSM-dev] Licence redaction ready to begin Once it is complete, we will be ready to distribute data under the ODbL and we'll advise of that with a separate announcement. The final pre- redaction dataset available under CC-BY-SA

Re: [osmosis-dev] Specifying ports for replication

2012-07-07 Thread Paul Norman
So, the problem went away and I didn't bother debugging the cause, but it's intermittently back now. From: Igor Podolskiy [mailto:igor.podols...@vwi-stuttgart.de] Subject: Re: [osmosis-dev] Specifying ports for replication On 17.06.2012 06:46, Paul Norman wrote: I'm trying to get script

Re: [OSM-dev] Retina tiles - best way to support them?

2012-06-26 Thread Paul Norman
From: Frederik Ramm [mailto:frede...@remote.org] Subject: [OSM-dev] Retina tiles - best way to support them? Hi, I have had some people asking whether I could supply them with Retina map tiles. Retina is an Apple brand name for higher resolution displays, and these users tend to mean

Re: [OSM-dev] osm2pgsql failing with low cache size

2012-06-20 Thread Paul Norman
From: Frederik Ramm [mailto:frede...@remote.org] Subject: Re: [OSM-dev] osm2pgsql failing with low cache size Hi, On 06/20/2012 02:31 AM, Michael Corey wrote: I'm running this on an EC2 micro instance, which supposedly has up to 613 MB of RAM. That's not a lot, but the XML I'm trying

Re: [OSM-dev] osm2pgsql failing with low cache size

2012-06-20 Thread Paul Norman
From: Roland Olbricht [mailto:roland.olbri...@gmx.de] Subject: Re: [OSM-dev] osm2pgsql failing with low cache size Hi, Reading in file: ./data/latest.xml StartElement: Unknown element name: note Unknown node type 3 EndElement: Unknown element name: note StartElement: Unknown

[osmosis-dev] Specifying ports for replication

2012-06-16 Thread Paul Norman
I'm trying to get script to work to update my apidb, but I keep getting errors with trying to specify the location of the minutely replication diffs. I suspect it is related to the port in my change file URL My simplified command line is osmosis --rri --sc --wdc I have tried both

Re: [OSM-dev] Max nodes in a way?

2012-06-04 Thread Paul Norman
When splitting data in arbitrary positions (e.g. coastlines in remote areas) I like to go for a maximum of 1000-1500 nodes per way. If you upload ways with the maximum number of nodes and someone wants to refine the geometry by adding nodes they have to first split them. Also keep in

Re: [OSM-dev] [OSM-talk] Initial population of data in OSM

2012-06-04 Thread Paul Norman
I've cc'ed dev@ on this since it's more of an appropriate list. What seems the easiest way to me would be to convert the IDs to positive and add version and changeset information. You might be able to do this within the tool you use to convert FileGDB to OSM, or post-process. I have intended

<    1   2   3   4   >