[OSM-dev] Renderd / mapnik version alignment problems

2013-08-21 Thread Jeff Meyer
What's the proper way to get renderd to use mapnik 2.2?

I've nuked (or thought I nuked) all potential mapnik packages, python
libraries, etc. from my install, reinstalled mapnik from
ppa:mapnik/v.2.2.0, recompiled mod_tile from github, and when I run renderd
-f to test, I get this:

renderd[5581]: Renderd is using mapnik version 2.1.1

and, here's the package query:

$ dpkg-query -l | grep mapnik
ii  libmapnik
2.2.0+dev20121011.git.38d9163-1~precise1C++/Python toolkit for
developing GIS applications (libraries)
rc  libmapnik2-2.02.0.0+ds1-3build1
  C++/Python toolkit for developing GIS applications
(libraries)
ii  mapnik-utils
 2.2.0+dev20121011.git.38d9163-1~precise1C++/Python toolkit for
developing GIS applications (utilities)
rc  openstreetmap-mapnik-stylesheet-data  0.2-r29376~precise1
  Provides a stylesheet and costline data for rendering
OpenStreetMap with Mapnik
ii  python-mapnik
2.2.0+dev20121011.git.38d9163-1~precise1C++/Python toolkit for
developing GIS applications (Python)
rc  renderd   0.4-21~precise1
  Daemon that renders map tiles using mapnik

Thanks!
Jeff

-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347

OpenStreetMap: Mapping with a Human Touch
osm: Open Historical Map
(OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
 / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
t: @GWHAThistory https://twitter.com/GWHAThistory
f: GWHAThistory https://www.facebook.com/GWHAThistory
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] osmcoastline install question

2013-08-21 Thread Jeff Meyer
On Mon, Aug 19, 2013 at 1:30 AM, Jochen Topf joc...@remote.org wrote:

 On Sun, Aug 18, 2013 at 03:47:53PM -0700, Jeff Meyer wrote:
  I think I've cleared it up - standard Ubuntu packages won't work for the
  install, but ppa:ubuntugis/ubuntugis-unstable works well. This is also
 why
  I wasn't finding the libgeos++-dev in Ubuntu... it's not there without
 this
  ppa.
 
  I'd add these two items to the front of the install process and any
  spatialite or boost issues should go away:
 
  sudo add-apt-repository ppa:ubuntugis/ubuntugis-unstable

 The osmcoastline README mentions the ubuntugis repository. Yes, it could


Aha! RTFR! Mea culpa!
Lame excuse: I had skipped that part, as installing GDAL is a dependency
for Osmium, and the Osmium README doesn't include that.


 probably be made clearer how to install this, but then I'd have to explain
 it for each and every distribution. Adding extra repositories is a rather
 drastic step, it is done differently in different distributions and it is
 not necessary in all distributions. Unfortunately there is a minimum of
 expertise and experience involved in compiling your own software.

 Feel free to add your experiences and build instructions to the wiki.


Will do!
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] renderd exits... any ideas?

2013-08-19 Thread Jeff Meyer
Adding dev@ to a thread already in progress...

I think this may have been related to mucking around in the tile directory
and having some file and directory ownership change from www-data to root.

Sound plausible?

We'll keep our eyes open for other possible sources of failure.

On Sat, Aug 17, 2013 at 1:47 PM, Kai Krueger kakrue...@gmail.com wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA512

 Hi Jeff,

 This looks like there is some form of error / exception while trying
 to write a metatile to disk. Renderd is designed to shutdown in this case.

 I am not sure though what could throw that exception on a regular
 basis though. I have tried to increase the information it spits out
 about why this is happening and if it is a normal exception, it
 should now also no longer exit.

 Can you try out the latest code and see if this helps figure out what
 is going on?

 Kai

 On 08/13/2013 12:05 AM, Jeff Meyer wrote:
  Hi Kai -
 
  I'm seeing this on a fairly regular basis on a server I'm working
  with. Renderd works fine for a while and then mysteriously exits.
  I'm highly suspect that it's anything with renderd, but I wanted to
  check in to see if you've seen this one before...
 
  Aug 12 22:14:18 hackercoop renderd[26814]: Received error when
  writing metatile to disk, requesting exit. Aug 12 23:53:48
  hackercoop renderd[8859]: Received error when writing metatile to
  disk, requesting exit.
 
  Thanks, Jeff
 
 
 
 

 -


-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347

OpenStreetMap: Mapping with a Human Touch
osm: Open Historical Map
(OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
 / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
t: @GWHAThistory https://twitter.com/GWHAThistory
f: GWHAThistory https://www.facebook.com/GWHAThistory
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] osmcoastline install question

2013-08-18 Thread Jeff Meyer
Jochen -

I think I've cleared it up - standard Ubuntu packages won't work for the
install, but ppa:ubuntugis/ubuntugis-unstable works well. This is also why
I wasn't finding the libgeos++-dev in Ubuntu... it's not there without this
ppa.

I'd add these two items to the front of the install process and any
spatialite or boost issues should go away:

sudo add-apt-repository ppa:ubuntugis/ubuntugis-unstable
sudo add-apt-repository ppa:mapnik/v.2.2.0

The mapnik repo has a more up-to-date build of boost.

- Jeff




On Mon, Aug 12, 2013 at 8:38 AM, Jeff Meyer j...@gwhat.org wrote:

 Ah, ok... I think I had to use some non-Ubuntu flavors to make some other
 packages work (PostGIS 2.0 comes to mind, but I installed that a ways
 back...).

 I'll try on a different box  see what happens.

 Thanks!
 Jeff



 On Mon, Aug 12, 2013 at 8:27 AM, Jochen Topf joc...@remote.org wrote:

 Hi!

 it runs for me on a plain Ubuntu 12.04. Some library versions you have are
 different from what I have on that system. Did you install them yourself?
 Try using the versions supplied as Ubuntu packages. I think Osmium is the
 only library on that system that you need to install yourself, everything
 elseo should be okay out of the box.

 Jochen

 On Mon, Aug 12, 2013 at 08:18:47AM -0700, Jeff Meyer wrote:
  Date: Mon, 12 Aug 2013 08:18:47 -0700
  From: Jeff Meyer j...@gwhat.org
  To: Jochen Topf joc...@remote.org
  Cc: dev@openstreetmap.org dev@openstreetmap.org
  Subject: Re: [OSM-dev] osmcoastline install question
 
  I thought I was up to date, but perhaps some bindings or compile flags
  weren't set properly?
 
  Kernel 3.2.0-38-generic
  Ubuntu 12.04
  (uname -a:  Linux hackercoop 3.2.0-38-generic #61-Ubuntu SMP Tue Feb 19
  12:18:21 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
 
  gdal: 1.9.2
  Boost is 1.49
  Zlib is 1.28
 
  $ spatialite --version
  SpatiaLite version ..: 4.1.1 Supported Extensions:
  - 'VirtualShape' [direct Shapefile access]
  - 'VirtualDbf' [direct DBF access]
  - 'VirtualText' [direct CSV/TXT access]
  - 'VirtualNetwork' [Dijkstra shortest path]
  - 'RTree' [Spatial Index - R*Tree]
  - 'MbrCache' [Spatial Index - MBR cache]
  - 'VirtualSpatialIndex' [R*Tree metahandler]
  - 'VirtualFDO' [FDO-OGR interoperability]
  - 'SpatiaLite' [Spatial SQL - OGC]
  PROJ.4 version ..: Rel. 4.8.0, 6 March 2012
  GEOS version : 3.3.7-CAPI-1.7.7
  3.7.9 2011-11-01 00:52:41 c7c6050ef060877ebe77b41d959e9df13f8c9b5e
 
  What other libraries should I include?
 
  Thanks!
  Jeff
 
 
 
 
  On Mon, Aug 12, 2013 at 5:43 AM, Jochen Topf joc...@remote.org wrote:
 
   On Sun, Aug 11, 2013 at 01:25:47PM -0700, Jeff Meyer wrote:
Does anyone have any experience with osmcoastline installations
 (Jochen,
obviously!)?
   
I'm getting the following error from runtest.sh after setup:
   
$ ./runtest.sh
Enabled debug option
[ 0:00] Using SRS 4326 for output. (Change with the --srs/s option.)
[ 0:00] Writing to output database 'testdata.db'. (Was set with the
--output-database/-o option.)
[ 0:00] Removing database output file (if it exists) (because you
 told me
to with --overwrite/-f).
[ 0:00] Will create geometry index. (If you do not want an index use
--no-index/-i.)
[12:54] Reading from file 'testdata.osm'.
[12:54] Reading ways (1st pass through input file)...
[12:54]   There are 19 nodes where the coastline is not closed.
[12:54]   There are 36 coastline rings (16 from a single way and 20
 from
multiple ways).
[12:54] Memory used currently: 205 MB (Peak was: 205 MB).
[12:54] Reading nodes (2nd pass through input file)...
ERROR 1: In CreateFeature(): sqlite3_prepare(INSERT INTO
 'error_points'
(GEOMETRY,osm_id,error) VALUES (?,?,?)):
  table error_points has no column named GEOMETRY
Failed to create feature on layer 'error_points'.
$
   
spatialite .schema error_points
CREATE TABLE 'error_points' (   OGC_FID INTEGER PRIMARY KEY,
 'osm_id'
VARCHAR, 'error' VARCHAR);
spatialite
   
Not sure what's going on here, so thanks in advance for any help.
  
   Probably old spatialite and/or gdal lib. The spatialite format
 changed at
   some point and this leads to some confusion. You need GDAL 1.7 or
 later.
   If thats not the problem tell us something more about your setup (os
   version, lib versions etc.)
  
   Jochen
   --
   Jochen Topf  joc...@remote.org  http://www.jochentopf.com/
 +49-721-388298
  
 
 
 
  --
  Jeff Meyer
  Global World History Atlas
  www.gwhat.org
  j...@gwhat.org
  206-676-2347
 
  OpenStreetMap: Mapping with a Human Touch
  osm: Open Historical Map
  (OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
   / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
  t: @GWHAThistory https://twitter.com/GWHAThistory
  f: GWHAThistory https://www.facebook.com/GWHAThistory

 --
 Jochen Topf  joc...@remote.org  http://www.jochentopf.com/
 +49-721-388298




 --
 Jeff Meyer
 Global World

Re: [OSM-dev] osmcoastline install question

2013-08-12 Thread Jeff Meyer
I thought I was up to date, but perhaps some bindings or compile flags
weren't set properly?

Kernel 3.2.0-38-generic
Ubuntu 12.04
(uname -a:  Linux hackercoop 3.2.0-38-generic #61-Ubuntu SMP Tue Feb 19
12:18:21 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

gdal: 1.9.2
Boost is 1.49
Zlib is 1.28

$ spatialite --version
SpatiaLite version ..: 4.1.1 Supported Extensions:
- 'VirtualShape' [direct Shapefile access]
- 'VirtualDbf' [direct DBF access]
- 'VirtualText' [direct CSV/TXT access]
- 'VirtualNetwork' [Dijkstra shortest path]
- 'RTree' [Spatial Index - R*Tree]
- 'MbrCache' [Spatial Index - MBR cache]
- 'VirtualSpatialIndex' [R*Tree metahandler]
- 'VirtualFDO' [FDO-OGR interoperability]
- 'SpatiaLite' [Spatial SQL - OGC]
PROJ.4 version ..: Rel. 4.8.0, 6 March 2012
GEOS version : 3.3.7-CAPI-1.7.7
3.7.9 2011-11-01 00:52:41 c7c6050ef060877ebe77b41d959e9df13f8c9b5e

What other libraries should I include?

Thanks!
Jeff




On Mon, Aug 12, 2013 at 5:43 AM, Jochen Topf joc...@remote.org wrote:

 On Sun, Aug 11, 2013 at 01:25:47PM -0700, Jeff Meyer wrote:
  Does anyone have any experience with osmcoastline installations (Jochen,
  obviously!)?
 
  I'm getting the following error from runtest.sh after setup:
 
  $ ./runtest.sh
  Enabled debug option
  [ 0:00] Using SRS 4326 for output. (Change with the --srs/s option.)
  [ 0:00] Writing to output database 'testdata.db'. (Was set with the
  --output-database/-o option.)
  [ 0:00] Removing database output file (if it exists) (because you told me
  to with --overwrite/-f).
  [ 0:00] Will create geometry index. (If you do not want an index use
  --no-index/-i.)
  [12:54] Reading from file 'testdata.osm'.
  [12:54] Reading ways (1st pass through input file)...
  [12:54]   There are 19 nodes where the coastline is not closed.
  [12:54]   There are 36 coastline rings (16 from a single way and 20 from
  multiple ways).
  [12:54] Memory used currently: 205 MB (Peak was: 205 MB).
  [12:54] Reading nodes (2nd pass through input file)...
  ERROR 1: In CreateFeature(): sqlite3_prepare(INSERT INTO 'error_points'
  (GEOMETRY,osm_id,error) VALUES (?,?,?)):
table error_points has no column named GEOMETRY
  Failed to create feature on layer 'error_points'.
  $
 
  spatialite .schema error_points
  CREATE TABLE 'error_points' (   OGC_FID INTEGER PRIMARY KEY, 'osm_id'
  VARCHAR, 'error' VARCHAR);
  spatialite
 
  Not sure what's going on here, so thanks in advance for any help.

 Probably old spatialite and/or gdal lib. The spatialite format changed at
 some point and this leads to some confusion. You need GDAL 1.7 or later.
 If thats not the problem tell us something more about your setup (os
 version, lib versions etc.)

 Jochen
 --
 Jochen Topf  joc...@remote.org  http://www.jochentopf.com/  +49-721-388298




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347

OpenStreetMap: Mapping with a Human Touch
osm: Open Historical Map
(OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
 / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
t: @GWHAThistory https://twitter.com/GWHAThistory
f: GWHAThistory https://www.facebook.com/GWHAThistory
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] osmcoastline install question

2013-08-12 Thread Jeff Meyer
Ah, ok... I think I had to use some non-Ubuntu flavors to make some other
packages work (PostGIS 2.0 comes to mind, but I installed that a ways
back...).

I'll try on a different box  see what happens.

Thanks!
Jeff



On Mon, Aug 12, 2013 at 8:27 AM, Jochen Topf joc...@remote.org wrote:

 Hi!

 it runs for me on a plain Ubuntu 12.04. Some library versions you have are
 different from what I have on that system. Did you install them yourself?
 Try using the versions supplied as Ubuntu packages. I think Osmium is the
 only library on that system that you need to install yourself, everything
 elseo should be okay out of the box.

 Jochen

 On Mon, Aug 12, 2013 at 08:18:47AM -0700, Jeff Meyer wrote:
  Date: Mon, 12 Aug 2013 08:18:47 -0700
  From: Jeff Meyer j...@gwhat.org
  To: Jochen Topf joc...@remote.org
  Cc: dev@openstreetmap.org dev@openstreetmap.org
  Subject: Re: [OSM-dev] osmcoastline install question
 
  I thought I was up to date, but perhaps some bindings or compile flags
  weren't set properly?
 
  Kernel 3.2.0-38-generic
  Ubuntu 12.04
  (uname -a:  Linux hackercoop 3.2.0-38-generic #61-Ubuntu SMP Tue Feb 19
  12:18:21 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
 
  gdal: 1.9.2
  Boost is 1.49
  Zlib is 1.28
 
  $ spatialite --version
  SpatiaLite version ..: 4.1.1 Supported Extensions:
  - 'VirtualShape' [direct Shapefile access]
  - 'VirtualDbf' [direct DBF access]
  - 'VirtualText' [direct CSV/TXT access]
  - 'VirtualNetwork' [Dijkstra shortest path]
  - 'RTree' [Spatial Index - R*Tree]
  - 'MbrCache' [Spatial Index - MBR cache]
  - 'VirtualSpatialIndex' [R*Tree metahandler]
  - 'VirtualFDO' [FDO-OGR interoperability]
  - 'SpatiaLite' [Spatial SQL - OGC]
  PROJ.4 version ..: Rel. 4.8.0, 6 March 2012
  GEOS version : 3.3.7-CAPI-1.7.7
  3.7.9 2011-11-01 00:52:41 c7c6050ef060877ebe77b41d959e9df13f8c9b5e
 
  What other libraries should I include?
 
  Thanks!
  Jeff
 
 
 
 
  On Mon, Aug 12, 2013 at 5:43 AM, Jochen Topf joc...@remote.org wrote:
 
   On Sun, Aug 11, 2013 at 01:25:47PM -0700, Jeff Meyer wrote:
Does anyone have any experience with osmcoastline installations
 (Jochen,
obviously!)?
   
I'm getting the following error from runtest.sh after setup:
   
$ ./runtest.sh
Enabled debug option
[ 0:00] Using SRS 4326 for output. (Change with the --srs/s option.)
[ 0:00] Writing to output database 'testdata.db'. (Was set with the
--output-database/-o option.)
[ 0:00] Removing database output file (if it exists) (because you
 told me
to with --overwrite/-f).
[ 0:00] Will create geometry index. (If you do not want an index use
--no-index/-i.)
[12:54] Reading from file 'testdata.osm'.
[12:54] Reading ways (1st pass through input file)...
[12:54]   There are 19 nodes where the coastline is not closed.
[12:54]   There are 36 coastline rings (16 from a single way and 20
 from
multiple ways).
[12:54] Memory used currently: 205 MB (Peak was: 205 MB).
[12:54] Reading nodes (2nd pass through input file)...
ERROR 1: In CreateFeature(): sqlite3_prepare(INSERT INTO
 'error_points'
(GEOMETRY,osm_id,error) VALUES (?,?,?)):
  table error_points has no column named GEOMETRY
Failed to create feature on layer 'error_points'.
$
   
spatialite .schema error_points
CREATE TABLE 'error_points' (   OGC_FID INTEGER PRIMARY KEY, 'osm_id'
VARCHAR, 'error' VARCHAR);
spatialite
   
Not sure what's going on here, so thanks in advance for any help.
  
   Probably old spatialite and/or gdal lib. The spatialite format changed
 at
   some point and this leads to some confusion. You need GDAL 1.7 or
 later.
   If thats not the problem tell us something more about your setup (os
   version, lib versions etc.)
  
   Jochen
   --
   Jochen Topf  joc...@remote.org  http://www.jochentopf.com/
 +49-721-388298
  
 
 
 
  --
  Jeff Meyer
  Global World History Atlas
  www.gwhat.org
  j...@gwhat.org
  206-676-2347
 
  OpenStreetMap: Mapping with a Human Touch
  osm: Open Historical Map
  (OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
   / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
  t: @GWHAThistory https://twitter.com/GWHAThistory
  f: GWHAThistory https://www.facebook.com/GWHAThistory

 --
 Jochen Topf  joc...@remote.org  http://www.jochentopf.com/  +49-721-388298




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347

OpenStreetMap: Mapping with a Human Touch
osm: Open Historical Map
(OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
 / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
t: @GWHAThistory https://twitter.com/GWHAThistory
f: GWHAThistory https://www.facebook.com/GWHAThistory
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] osmcoastline install question

2013-08-11 Thread Jeff Meyer
Does anyone have any experience with osmcoastline installations (Jochen,
obviously!)?

I'm getting the following error from runtest.sh after setup:

$ ./runtest.sh
Enabled debug option
[ 0:00] Using SRS 4326 for output. (Change with the --srs/s option.)
[ 0:00] Writing to output database 'testdata.db'. (Was set with the
--output-database/-o option.)
[ 0:00] Removing database output file (if it exists) (because you told me
to with --overwrite/-f).
[ 0:00] Will create geometry index. (If you do not want an index use
--no-index/-i.)
[12:54] Reading from file 'testdata.osm'.
[12:54] Reading ways (1st pass through input file)...
[12:54]   There are 19 nodes where the coastline is not closed.
[12:54]   There are 36 coastline rings (16 from a single way and 20 from
multiple ways).
[12:54] Memory used currently: 205 MB (Peak was: 205 MB).
[12:54] Reading nodes (2nd pass through input file)...
ERROR 1: In CreateFeature(): sqlite3_prepare(INSERT INTO 'error_points'
(GEOMETRY,osm_id,error) VALUES (?,?,?)):
  table error_points has no column named GEOMETRY
Failed to create feature on layer 'error_points'.
$

spatialite .schema error_points
CREATE TABLE 'error_points' (   OGC_FID INTEGER PRIMARY KEY, 'osm_id'
VARCHAR, 'error' VARCHAR);
spatialite

Not sure what's going on here, so thanks in advance for any help.

Thanks!
Jeff

-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347

OpenStreetMap: Mapping with a Human Touch
osm: Open Historical Map
(OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
 / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
t: @GWHAThistory https://twitter.com/GWHAThistory
f: GWHAThistory https://www.facebook.com/GWHAThistory
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Generating local apidb diff files questions

2013-03-18 Thread Jeff Meyer
Hi -

Any advice on generating a local set of APIdb diffs to support minutely
editing feedback for a local rails instance? (www.openhistoricalmap.org)

I believe I've found what I need to get started at:
http://wiki.openstreetmap.org/wiki/Osmosis/Replication#Server-side_Replication
and
http://wiki.openstreetmap.org/wiki/Planet.osm/diffs

But... before I went off and started stubbing my toes, I wanted to check if
there was anywhere else I should be looking.

Any - _any_ - advice or questions (like, Why are you doing this?!?!?) are
most welcome.

Thanks,
Jeff

-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347

OpenStreetMap: Mapping with a Human Touch
http://www.openstreetmap.org/user/jeffmeyer osm: Open Historical Map
(OHM)http://wiki.openstreetmap.org/wiki/Open_Historical_Map
 / my OSM user page http://www.openstreetmap.org/user/jeffmeyer
 t: @GWHAThistory https://twitter.com/GWHAThistory
 f: GWHAThistory https://www.facebook.com/GWHAThistory
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Osmosis error - node not present in table current_nodes - no bbox

2013-01-04 Thread Jeff Meyer
Ok... still trying to solve this one. My primary machine is visiting the
Genius Saloon, so I'm a little dead in the water right now.

Couple of quick updates:
- The two.pbf file from above failed its import, as well... : /
  -- The diff.osc of the two files yielded about 8300 objects, ~8000
relations (lots of rivers) and ~300 ways
  -- The same node (25918312) broke the import of two.pbf, as well as
one.pbf, so it doesn't seem to have been disciplined appropriately. Bad
node, bad node.

- Comparing the output of my steps with osmfilter  convert, following
Markus's suggestions (thank you!) yielded the following:
  -- All steps, but without --drop-broken-refs = ~2GB
  -- All steps, without --drop-broken-refs = ~1.5GB
  -- Yikes! It seems that having ~25% broken refs means I'm doing something
horribly wrong to the data.

I'll keep hammering away to see what I can find out.

Thanks again for your help  patience!

Regards,
Jeff

On Thu, Jan 3, 2013 at 11:26 PM, mar...@gmx.eu wrote:

 Hi,

 Frederik is right:
  It seems that you somehow managed to drop a node that is referenced by
  something.

 I would suspect the --drop option of osmfilter to be responsible for this:

 --drop=natural=wood waterway=drain or waterway=ditch or waterway=stream
 or leisure=park

 Maybe replacing --drop by the --keep option will do the trick:

 --keep=natural!=wood and waterway!=drain and waterway!=ditch and
 waterway!=stream and leisure!=park

 Furthermore, you could exclude every broken reference by using this option
 in osmconvert:

 --drop-broken-refs

 Regards
 Markus




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
www.openstreetmap.org/user/jeffmeyer
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Osmosis error - node not present in table current_nodes - no bbox

2013-01-03 Thread Jeff Meyer
After executing:
$ osmosis --rb file=/home/historic/data/planet-natural.pbf --wd
user=openstreetmap password=openstreetmap database=osm
validateSchemaVersion=no

I'm running into the following error:
(full excerpt below)
Caused by: org.postgresql.util.PSQLException: ERROR: insert or update on
table current_way_nodes violates foreign key constraint
current_way_nodes_node_id_fkey
  Detail: Key (node_id)=(25918312) is not present in table current_nodes.

Most of what I can find about this on the intrawebs indicates that this is
typically a bbox-related issue, but I haven't used any bboxes to create my
planet-natural file. (see steps below)

Any guesses / suggestions / obvious things I'm missing?

Here's the sequence I've used to generate the planet-natural.pbf file - my
goal is to cut down the size of the file and retain only big waterways and
natural features - just ways and relations, no nodes. I believe osmfilter
should keep nodes required by ways and relations, but could be wrong there.

$ osmconvert planet-121226.osm.pbf -o=planet.o5m
$ ./osmfilter planet.o5m --drop-tags=created_by= nhd:*= yf:*= canvec:*=
gnis:*= NHD:*= KSJ2:*= massgis:*= --drop-author --drop=natural=wood
waterway=drain or waterway=ditch or waterway=stream or leisure=park
-o=planet-natural-temp1.o5m
$ ./osmfilter planet-natural-temp1.o5m --keep= --keep-ways=natural= or
waterway= --keep-relations=natural= or waterway=
-o=planet-natural-temp2.o5m
$ ./osmconvert planet-natural-temp2.o5m -o=planet-natural.pbf

Thanks, Jeff



Osmosis error:

SEVERE: Thread for task 1-rb failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to load
current way nodes.
at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.populateCurrentWays(ApidbWriter.java:980)
at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.populateCurrentTables(ApidbWriter.java:1031)
at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.complete(ApidbWriter.java:1064)
at
crosby.binary.osmosis.OsmosisBinaryParser.complete(OsmosisBinaryParser.java:35)
at crosby.binary.file.BlockInputStream.process(BlockInputStream.java:37)
at crosby.binary.osmosis.OsmosisReader.run(OsmosisReader.java:45)
at java.lang.Thread.run(Thread.java:679)
Caused by: org.postgresql.util.PSQLException: ERROR: insert or update on
table current_way_nodes violates foreign key constraint
current_way_nodes_node_id_fkey
  Detail: Key (node_id)=(25918312) is not present in table current_nodes.
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2102)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1835)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
at
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:500)
at
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
at
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:381)
at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.populateCurrentWays(ApidbWriter.java:977)
... 6 more
Jan 3, 2013 7:41:55 PM org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks
failed.
at
org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92)
at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
at org.codehaus.classworlds.Launcher.main(Launcher.java:47)

-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
www.openstreetmap.org/user/jeffmeyer
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Osmosis error - node not present in table current_nodes - no bbox

2013-01-03 Thread Jeff Meyer
Thanks - I really appreciate the help! : )

Unfortunately, I tried that  osmosis complained again. I'm going to try to
generate the data using strictly osmosis (instead of osmconvert 
osmfilter)  see what happens.

$ osmosis --read-pbf planet-natural.pbf --tee 2 --write-pbf one.pbf --bb
left=-180 right=180 top=90 bottom=-90 clipIncompleteEntities=true
--write-pbf two.pbf
Jan 3, 2013 6:06:22 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.40.1
Jan 3, 2013 6:06:22 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Jan 3, 2013 6:06:22 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Jan 3, 2013 6:06:22 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Jan 3, 2013 6:15:50 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
SEVERE: Thread for task 1-read-pbf failed
java.lang.NullPointerException
at java.util.ArrayList.init(ArrayList.java:131)
at org.openstreetmap.osmosis.core.domain.v0_6.Way.init(Way.java:166)
at
org.openstreetmap.osmosis.core.domain.v0_6.Way.getWriteableInstance(Way.java:361)
at
org.openstreetmap.osmosis.core.container.v0_6.WayContainer.getWriteableInstance(WayContainer.java:79)
at
org.openstreetmap.osmosis.areafilter.v0_6.AreaFilter.emitWay(AreaFilter.java:288)
at
org.openstreetmap.osmosis.areafilter.v0_6.AreaFilter.process(AreaFilter.java:203)
at
org.openstreetmap.osmosis.core.container.v0_6.WayContainer.process(WayContainer.java:60)
at
org.openstreetmap.osmosis.areafilter.v0_6.AreaFilter.process(AreaFilter.java:116)
at
org.openstreetmap.osmosis.core.tee.v0_6.EntityTee$ProxySinkSource.process(EntityTee.java:124)
at
org.openstreetmap.osmosis.core.tee.v0_6.EntityTee.process(EntityTee.java:70)
at
crosby.binary.osmosis.OsmosisBinaryParser.parseWays(OsmosisBinaryParser.java:172)
at crosby.binary.BinaryParser.parse(BinaryParser.java:121)
at crosby.binary.BinaryParser.handleBlock(BinaryParser.java:68)
at crosby.binary.file.FileBlock.process(FileBlock.java:135)
at crosby.binary.file.BlockInputStream.process(BlockInputStream.java:34)
at crosby.binary.osmosis.OsmosisReader.run(OsmosisReader.java:37)
at java.lang.Thread.run(Thread.java:680)
Jan 3, 2013 6:15:50 PM org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks
failed.
at
org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92)
at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
at org.codehaus.classworlds.Launcher.main(Launcher.java:47)
$



On Thu, Jan 3, 2013 at 1:58 PM, Frederik Ramm frede...@remote.org wrote:

 Hi,


 On 03.01.2013 21:02, Jeff Meyer wrote:

 Most of what I can find about this on the intrawebs indicates that this
 is typically a bbox-related issue, but I haven't used any bboxes to
 create my planet-natural file. (see steps below)


 It seems that you somehow managed to drop a node that is referenced by
 something.

 Try this:

 osmosis --read-pbf planet-natural.pbf --tee 2 --write-pbf one.pbf --bb
 left=-180 right=180 top=90 bottom=-90 clipIncompleteEntities=true
 --write-pbf two.pbf

 This will create two files which, if you have *no* dangling references,
 will be identical (and my hypothesis would then be wrong). If the files are
 not identical then the second will be minimally smaller, as objects in the
 second file that contained references to missing objects will have had
 those references deleted.

 The second file will then be safe to import.

 If the second file should turn out to be *much* smaller then it would make
 sense to make a diff (either write to xml and use unix diff, or use Osmosis
 --derive-changes) and find out what the problem is.

 My hunch is that you encountered something like a node tagged natural=wood
 (there are 25k of them) which was also a member of something you wanted to
 keep, and then you dropped that node or so.

 Bye
 Frederik

 --
 Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33

 __**_
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.**org/listinfo/devhttp://lists.openstreetmap.org/listinfo/dev




-- 
Jeff Meyer
Global World History Atlas

Re: [OSM-dev] production site disk use question

2013-01-01 Thread Jeff Meyer
Frederik, Sly -

Thanks for that help! I clearly need to do something differently. Upped my
VPS disk size  the same action filled up the disk after using ~86GB. 1.7GB
.pbf to 86GB+ apidb! Yikes! I've added some info  warnings to the Rails
Port page -
http://wiki.openstreetmap.org/wiki/The_Rails_Port#Populating_the_database

Frederik -

My guess is that I only need current tables - I'm setting up an instance of
the OSM Stack to see how useful it might be for creating a shared
environment for mapping cities and territories through history. (
http://wiki.openstreetmap.org/wiki/OSM-Historic) My plan was to take the
shorelines and natural features out of planet.osm, use that as a baseline,
and then let people add historical information from there, as well as
figuring out what tools need to be built to support this time-enabled
concept. So, it seems like I'll need both the history  the current tables.
In a non-history planet.osm extract, should those tables be the same in an
initial import?

Thanks!
Jeff



On Tue, Jan 1, 2013 at 3:42 AM, Frederik Ramm frede...@remote.org wrote:

 Hi,


 On 31.12.2012 18:25, Jeff Meyer wrote:

 For example, I just tried importing a 1.7GB planet-reduced.pbf into my
 rails port osm db and it failed after ~30 hrs because I ran out of disk
 space after it had eaten up 50GB of disk. Bad planning on my part, but
 how should I budget for this?


 In addition to Sly's data:

 A typical apidb setup has two sets of tables - current tables that
 have only the last version of each object, and history tables that
 contain every version (they don't have history in the name - the current
 nodes table is called current_nodes, and the history nodes table is called
 just nodes).

 This means that if you import data from a non-history planet into an apidb
 database, you'll have everyting twice.

 Depending on what you want to do with the data, you might really need that
 - or you might not. For example, if you wanted to run a read-only API that
 gives you data for a given bbox, only the current tables are required.
 For some other types of queries, only the history tables are be required.

 So it might be possible for you to take a shortcut by importing things
 only once. Osmosis has an option called populateCurrentTables which is on
 by default, but you can switch that off and it will only create history
 tables. If you have an use case that only needs current tables, then
 Osmosis doesn't offer that but you could actually achieve that by creating
 views on the history tables, instead of copies. This will save time and
 space; of course if you do that then you can't apply updates to your
 database without breaking the views.

 Bye
 Frederik

 --
 Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33


 __**_
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.**org/listinfo/devhttp://lists.openstreetmap.org/listinfo/dev




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] production site disk use question

2013-01-01 Thread Jeff Meyer
Mike, Frederik -

Muchas gracias  happy new year!

I'm going to need to go back to the drawing board a bit. I started this
experiment on AWS, then switched to Linode, but may need to go back to AWS.
It seems like running the OSM stack has some bursty processing dynamics
that might be better suited with flexible compute  disk capacity. I have a
feeling that the most effective tiling strategy might involve a hybrid of
some slower tiling for editors to see their changes and static tiles /
mbtiles type approach for general viewing, but that's probably fodder for a
different thread...

Thanks  more to follow,
Jeff


On Tue, Jan 1, 2013 at 12:37 PM, Frederik Ramm frede...@remote.org wrote:

 Hi,


 On 01.01.2013 18:52, Jeff Meyer wrote:

 So, it seems like I'll need both the history  the
 current tables. In a non-history planet.osm extract,


 Yes, if you want any kind of write access *and* read access through the
 API (instead of reading with specialised queries) then I guess you'll need
 both. The current tables always duplicate stuff that is in the history
 tables already, and in theory you could always make queries of the kind
 where version=(select max(version) ...) against the history tables to get
 the same you find in the current tables, but that would be too expensive.


  should those tables
 be the same in an initial import?


 Yes, with the exception that foreign keys contain the version number in
 the history tables but not in the current tables (since the current tables
 only contain ONE way ID #1234, the current_way_tags can afford to reference
 only the way ID, whereas in the history table it must reference way ID and
 version).


 Bye
 Frederik

 --
 Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[osmosis-dev] production site disk use question

2012-12-31 Thread Jeff Meyer
Are there any rules of thumb about Postgres disk requirements when
importing osm data?

For example, I just tried importing a 1.7GB planet-reduced.pbf into my
rails port osm db and it failed after ~30 hrs because I ran out of disk
space after it had eaten up 50GB of disk. Bad planning on my part, but how
should I budget for this?

e.g. a 30GB .osm file will probably take 2x that when the import is
finished?

Thanks,
Jeff


-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
osmosis-dev mailing list
osmosis-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/osmosis-dev


[OSM-dev] production site disk use question

2012-12-31 Thread Jeff Meyer
Are there any rules of thumb about Postgres disk requirements when
importing osm data?

For example, I just tried importing a 1.7GB planet-reduced.pbf into my
rails port osm db and it failed after ~30 hrs because I ran out of disk
space after it had eaten up 50GB of disk. Bad planning on my part, but how
should I budget for this?

e.g. a 30GB .osm file will probably take 2x that when the import is
finished?

Thanks,
Jeff


-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [osmosis-dev] Osmosis use q: points showing up in results after --used-node

2012-12-29 Thread Jeff Meyer
Aha... I believe I was missing this:

... --tf accept-relations natural=* ...

The spurious nodes appear to all have been part of relations that weren't
wiped out by the prior steps.

Please let me know if I've missed anything else obvious to the trained eye.

Thanks! Jeff

On Fri, Dec 28, 2012 at 3:12 PM, Jeff Meyer j...@gwhat.org wrote:

 Hi -

 I'm seeing individual nodes where I don't think I should be seeing any in
 this file: http://dl.dropbox.com/u/95199267/seattle-natural.osm

 It was generated by:

 $ osmosis --rb planet-120926.osm.pbf --bb left=-122.53 bottom=47.34
 right=-122.06 top=47.79 top=49.5138 --write-xml seattle.osm

 $ osmosis --rx seattle.osm --tf accept-ways natural=* --used-node --wx
 seattle-natural.osm

 There seem to be plenty of non-natural single nodes - bus stations,
 traffic lights, turn restrictions, etc.

 Am I doing something wrong?

 Thanks,
 Jeff


 --
 Jeff Meyer
 Global World History Atlas
 www.gwhat.org
 j...@gwhat.org
 206-676-2347




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
osmosis-dev mailing list
osmosis-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/osmosis-dev


[osmosis-dev] Osmosis use q: points showing up in results after --used-node

2012-12-28 Thread Jeff Meyer
Hi -

I'm seeing individual nodes where I don't think I should be seeing any in
this file: http://dl.dropbox.com/u/95199267/seattle-natural.osm

It was generated by:

$ osmosis --rb planet-120926.osm.pbf --bb left=-122.53 bottom=47.34
right=-122.06 top=47.79 top=49.5138 --write-xml seattle.osm

$ osmosis --rx seattle.osm --tf accept-ways natural=* --used-node --wx
seattle-natural.osm

There seem to be plenty of non-natural single nodes - bus stations, traffic
lights, turn restrictions, etc.

Am I doing something wrong?

Thanks,
Jeff


-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
osmosis-dev mailing list
osmosis-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/osmosis-dev


Re: [OSM-dev] iD alpha0

2012-12-21 Thread Jeff Meyer
W0-oo-0t!


On Fri, Dec 21, 2012 at 3:24 PM, Tom MacWright t...@macwright.org wrote:

 Saman, John, Alex, Richard, Martin




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Troubleshooting 500 errors

2012-12-19 Thread Jeff Meyer
Any tips on how to track down Rails Port configuration problems?

I've clearly horqued something up in trying to get a production server
going using Passenger (it was working in development, port:3000, etc.).

http://hosm.gwhat.org/

Related config files:
https://gist.github.com/3f5ab7ef348898d2e8bf

Thanks, Jeff

-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Troubleshooting 500 errors

2012-12-19 Thread Jeff Meyer
smacks forehead
Yes... logs/production.log. Clearly, I'm up too late. I'll chase this down
further. Thanks!


On Wed, Dec 19, 2012 at 1:16 AM, Tom Hughes t...@compton.nu wrote:

 On 19/12/12 08:40, Jeff Meyer wrote:

  Any tips on how to track down Rails Port configuration problems?


 Well looking at logs/production.log is your first point of call.

 If that shows nothing then try the Apache error log as it probably means
 Passenger failed to start rails.

 Tom

 --
 Tom Hughes (t...@compton.nu)
 http://compton.nu/




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Troubleshooting 500 errors

2012-12-19 Thread Jeff Meyer
Updated Passenger Installation instructions at:

http://wiki.openstreetmap.org/wiki/Rails_port/Ubuntu#Installing_Passenger

- Jeff


On Wed, Dec 19, 2012 at 1:43 AM, Jeff Meyer j...@gwhat.org wrote:

 smacks forehead
 Yes... logs/production.log. Clearly, I'm up too late. I'll chase this down
 further. Thanks!


 On Wed, Dec 19, 2012 at 1:16 AM, Tom Hughes t...@compton.nu wrote:

 On 19/12/12 08:40, Jeff Meyer wrote:

  Any tips on how to track down Rails Port configuration problems?


 Well looking at logs/production.log is your first point of call.

 If that shows nothing then try the Apache error log as it probably means
 Passenger failed to start rails.

 Tom

 --
 Tom Hughes (t...@compton.nu)
 http://compton.nu/




 --
 Jeff Meyer
 Global World History Atlas
 www.gwhat.org
 j...@gwhat.org
 206-676-2347





-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Rails Port hosting Qs

2012-12-14 Thread Jeff Meyer
Anyone have any advice on hosting the Rails Port?

I'm looking at setting up a sandbox for Historical OSM and am both
impressed and daunted by the range of hosting options available. I've
installed it on AWS, but it seems a little on the steep side ($$) for 24x7
operations.

I realize every option has strengths  weaknesses but am hoping to avoid
any mistakes that would be obvious to the adept.

I'm leaning toward a VPS type of setup on something like Linode (
www.linode.com - 1GB plan). VPS seems to provide flexibility that some of
the rails-specific hosting sites limit, as well as being generally cheaper.
I'm planning to seed the db with shoreline information  not much else.

Any lessons learned, experiences, etc. will be added to the wiki.

Thanks,
Jeff

-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Rails Port hosting Qs

2012-12-14 Thread Jeff Meyer
Ah, yes - good idea. Will do! : ) Thanks, Jeff


On Fri, Dec 14, 2012 at 4:16 PM, mick bare...@tpg.com.au wrote:

 On Fri, 14 Dec 2012 16:01:06 -0800
 Jeff Meyer j...@gwhat.org wrote:

  I'm planning to seed the db with shoreline information  not much else.
 
 I would add water courses as well, throughout history they have been used
 as boundaries, both physical and spiritual.

 mick

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] [Imports] addressmerge 0.1 release

2012-12-09 Thread Jeff Meyer
Paul -
Thanks for this - we'll take a look at it / test it with the Seattle Import
data  report back with lessons learned!
Thanks, Jeff



On Sun, Dec 9, 2012 at 1:36 AM, Paul Norman penor...@mac.com wrote:

 For the last couple of weeks I've been working on addressmerge, a tool to
 post-process address data by comparing it with existing OSM data. I have
 pushed release 0.1 to https://github.com/pnorman/addressmerge

 Currently it will take a file in importable .osm format, compare it with
 existing OSM data in an imposm database and create a resulting importable
 .osm file with address nodes that duplicate existing data removed.

 It will correctly handle addresses on building ways, multipolygons and
 anything else in the OSM data. It does not currently handle addresses on
 objects other than nodes in the import data.

 Requirements:

 An imposm database
 imposm.parser
 python-lxml
 psycopg2

 Limitations:
 It relies on imposm.parser which breaks on some XML files. To fix this try
 running xmllint --format original.osm  reformatted.osm

 It omits any ways or relations in the input file, relevant or not.

 The documentation is currently very minimal.

 I intend to make it handle other common address formats aside from
 addresses
 is a decent amount more complicated.


 ___
 Imports mailing list
 impo...@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/imports




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Available Languages on wiki. and real estate

2012-11-08 Thread Jeff Meyer
Not sure where to file tickets for the wiki / discuss changes to the wiki,
but I'm wondering if there's any way to make the Available Languages bar
at the top of many pages collapsed by default. It seems to eat a lot of
valuable screen real estate and is in the way of page content.

Here's what seems suboptimal to me...
https://www.evernote.com/shard/s266/sh/a9bcb911-39e3-477f-b4b4-7cbc27dfcc01/381b8c9e41fd5c08c8ead38bec0b4807

Here's the ticket I was going to file (but cannot figure out (a) where to
file it; and (b) where the code is underlying the wiki code below...):

-
Use of this code:

{{Languages|ns=|Main Page}}

at the top of many wiki pages ends up eating up a ton of valuable real
estate at the top of each page - see:
![wiki](
https://www.evernote.com/shard/s266/sh/a9bcb911-39e3-477f-b4b4-7cbc27dfcc01/381b8c9e41fd5c08c8ead38bec0b4807
)

Any alternative that reduces the amount of vertical screen space for this
information would be great. For example, why not collapse the list by
default, the same way Other Languages are currently collapsed by default.


Thanks,
Jeff


-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Available Languages on wiki. and real estate

2012-11-08 Thread Jeff Meyer
Done - thanks, Andy.
https://trac.openstreetmap.org/ticket/4675

Now... to figure out how to do this...


On Thu, Nov 8, 2012 at 9:54 AM, Andy Allan gravityst...@gmail.com wrote:

 On 8 November 2012 17:25, Jeff Meyer j...@gwhat.org wrote:

  Here's the ticket I was going to file (but cannot figure out (a) where to
  file it; and (b) where the code is underlying the wiki code below...):

 Tickets can be filed in trac.openstreetmap.org (component is 'wiki')

  Any alternative that reduces the amount of vertical screen space for this
  information would be great. For example, why not collapse the list by
  default, the same way Other Languages are currently collapsed by
 default.

 I like the way that wikipedia does it (by using the sidebar) but I'm
 not sure if there's any technical reasons why we're doing it
 differently.

 Cheers,
 Andy




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Available Languages on wiki. and real estate

2012-11-08 Thread Jeff Meyer
Hi Tobias -

Thanks for the background - it's very helpful!

Moving to MediaWiki looks like it'll be a step in the right direction.
However, it implements the language switcher in a way consistent with what
I'm suggesting - please see the upper-right corner of this page for an
example: http://translatewiki.net/wiki/Special:Translate

Perhaps users should be allowed to have it collapsed or expanded by default?

While I appreciate your suggestion, 100% of wiki users are currently
impacted by a control that eats up 5-6 lines (15-20% of the vertical screen
space on a 1400x900 display) but that could be solved with a
discretely-located 2 word toggle for some large % of the users who use
other languages. (e.g. English/Deutsch or
Italiano/中文(繁體)http://translatewiki.net/wiki/Special:Translate#)
I'm
guessing that there aren't a lot of people bouncing across more than 2
languages at a time.

So, my premise is not that this isn't important, just that the way it's
implemented is inefficient.

(Others would add that the current language bar is a bit messy  makes
things like the home page less friendly to newcomers, but I think those are
tightly coupled with efficiency...)

Thanks, Jeff


On Thu, Nov 8, 2012 at 1:39 PM, Tobias Knerr o...@tobias-knerr.de wrote:

 On 08.11.2012 19:03, Jeff Meyer wrote:
  https://trac.openstreetmap.org/ticket/4675
 
  Now... to figure out how to do this...

 As I've commented on the ticket, this might not be the best point in
 time for fine-tuning the visual aspect of the translations. There has
 been discussion about using the MediaWiki Translate extension for better
 handling of translations and installation of this extension is scheduled
 for the next software upgrade:
 http://wiki.osm.org/Talk:Wiki_Translation#Translate_extension

 More generally, though, I feel slightly uncomfortable with your
 suggestions to free valuable real estate or even collapse the list by
 default. Most of our wiki content is not available in all languages, and
 realistically will never be. (Many pages are not even expected to be
 translated, such as proposals.) So switching between languages will
 inevitably happen quite often for every user who wants to neither miss
 out on a lot of wiki content nor go English only.

 Yes, it makes sense to think about a language link redesign. However, it
 should not be based on the premise that these aren't important, and for
 practical reasons I would prefer to wait until the technical foundations
 of the translation system are in place.

 Tobias

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[osmosis-dev] Osmosis OSM wiki content

2012-10-21 Thread Jeff Meyer
Hi - n00b here.
There's a lot of good content on the wiki about Osmosis, but as a new guy
(fng), it seems like it could be organized a little more cleanly. I've put
together some suggestions at:
https://wiki.openstreetmap.org/wiki/Talk:Osmosis#Wiki_Osmosis_organization
The intent isn't to change things too much, and certainly not to delete
anything, but to consolidate similar information and reduce redundancy of
page purpose a little.
If there's support and/or suggestions of alternate approaches, I'd be glad
to take care of it.
If it's a bad idea, I'll sit tight.
Also... if this isn't the right way to propose wiki mods, please let me
know.
Thanks!
Jeff

-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
osmosis-dev mailing list
osmosis-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/osmosis-dev


Re: [osmosis-dev] Osmosis OSM wiki content

2012-10-21 Thread Jeff Meyer
Brett - good feedback. Yes, the detailed usage page is *hands off* - it's
in great shape. - Jeff

On Sun, Oct 21, 2012 at 2:50 PM, Brett Henderson br...@bretth.com wrote:

 Hi Jeff,

 On 22 October 2012 08:10, Jeff Meyer j...@gwhat.org wrote:

 Hi - n00b here.
 There's a lot of good content on the wiki about Osmosis, but as a new guy
 (fng), it seems like it could be organized a little more cleanly. I've put
 together some suggestions at:
 https://wiki.openstreetmap.org/wiki/Talk:Osmosis#Wiki_Osmosis_organization
 The intent isn't to change things too much, and certainly not to delete
 anything, but to consolidate similar information and reduce redundancy of
 page purpose a little.
 If there's support and/or suggestions of alternate approaches, I'd be
 glad to take care of it.
 If it's a bad idea, I'll sit tight.
 Also... if this isn't the right way to propose wiki mods, please let me
 know.


 There's no right way to propose anything, this seems like as good a way as
 any :-)

 Regarding the wiki structure, about the only page I really care about is
 the detailed usage page because it is the one page that I try to keep 100%
 accurate and up to date.  I'm very hesitant to split it up, re-arrange it,
 etc.  I take your point about the name detailed usage reading more like a
 man page than a usage page, it's just a name that seemed like a good idea
 at the time.  I like the content of the page, but I don't particularly care
 what it's called.

 As for the rest of the pages, I haven't been a great curator of the wiki
 so I won't get in the way of somebody trying to improve it.  I'm also not
 the best judge of what users need to know.  There is a bunch of stuff on
 there, some better organised than others.  The various examples are based
 on whatever people have found useful at the time so it's grown fairly
 organically.  In particular some of the older stuff like API 0.5 support,
 Java 1.5 support, Notes, etc are a bit distracting and could possibly move
 elsewhere.

 Brett




-- 
Jeff Meyer
Global World History Atlas
www.gwhat.org
j...@gwhat.org
206-676-2347
___
osmosis-dev mailing list
osmosis-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/osmosis-dev