Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Jon Burgess
On Sun, 2009-12-13 at 12:41 +, Shaun McDonald wrote: > There are some additional hints on the following wiki page: > http://wiki.openstreetmap.org/wiki/Mapnik#Loading_Data > > I'm sure other people on the list will be able to add more than me on tuning > postgres. You should expect it to take

Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Lars Francke
> Currently I need about four days for importing the whole planet file. Is > that a normal computing time? The bottleneck seems to be the database > (PostgreSQL). Are there any hints for the database configuration? For > conversion I use  a quadcore machine with 8GB RAM. Data files are > located on

Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Shaun McDonald
There are some additional hints on the following wiki page: http://wiki.openstreetmap.org/wiki/Mapnik#Loading_Data I'm sure other people on the list will be able to add more than me on tuning postgres. You should expect it to take a day or two to load if the disks are slow. There are a few discu

Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Frank Bielig
Many thanks for fast and valuable responses. One more open question I have. Currently I need about four days for importing the whole planet file. Is that a normal computing time? The bottleneck seems to be the database (PostgreSQL). Are there any hints for the database configuration? For conve

Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Frederik Ramm
Hi, Lennard wrote: > I thought that was fixed, and the dump now runs in a transaction? No; many seem to think it is fixed but simple inspection of the current planet file tells you that the highest node id therein is 583444559 (added 2009-12-09T01:19:27Z), whereas the highest *referenced* node

Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Shaun McDonald
On 13 Dec 2009, at 10:47, Lennard wrote: > Frederik Ramm wrote: > >> The planet files do not have referential integrity. Because the ways are >> dumped long after the nodes, if someone creates a new way plus new nodes >> some time during the planet dump creation, the new way will be in the >>

Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Lennard
Frederik Ramm wrote: > The planet files do not have referential integrity. Because the ways are > dumped long after the nodes, if someone creates a new way plus new nodes > some time during the planet dump creation, the new way will be in the > dump but the new nodes will not. I thought that w

Re: [OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Frederik Ramm
Hi, Frank Bielig wrote: > I want to setup up an own OSM server as a mirror. Therefore I downloaded > the planet file (2009/12/02) and used osmosis for import with following > command line: The planet files do not have referential integrity. Because the ways are dumped long after the nodes, if

[OSM-dev] Importing planet file with osmosis into PostgreSQL

2009-12-13 Thread Frank Bielig
Hallo, I want to setup up an own OSM server as a mirror. Therefore I downloaded the planet file (2009/12/02) and used osmosis for import with following command line: bzcat '/data/osm/all/20091202/planet-latest.osm.bz2' | osmosis --read-xml-0.6 file='-' --log-progress --write-apidb host=