[OSM-talk] Speaking of daily change files...

2009-07-19 Thread John Smith 

In the last week or so there has been dumps that osm2pgsql fails to parse due 
to garbage characters, I even tried the -u switch for kicks, but unless I 
manually intervene and clean things up osm2pgsql refuses to deal with it.

Pretty sure I'm using the latest version, or near to it, was downloaded about 
the 1st.

# osm2pgsql -a -b 110,-50,179,-10 -s 20090718-20090719.osc.gz 
osm2pgsql SVN version 0.66-16258

Using projection SRS 900913 (Spherical Mercator)
Applying Bounding box: 110.00,-50.00 to 179.00,-10.00
Setting up table: planet_osm_point
Setting up table: planet_osm_line
Setting up table: planet_osm_polygon
Setting up table: planet_osm_roads
Mid: pgsql, scale=100, cache=800MB, maxblocks=102401*8192
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels

Reading in file: 20090718-20090719.osc.gz
Processing: Node(513k) Way(49k) Relation(0k)Entity: line 1883470: parser error 
: invalid character in attribute value
  
   ^
Entity: line 1883470: parser error : attributes construct error
  
   ^
Entity: line 1883470: parser error : Couldn't find end of Start Tag tag
  
   ^
20090718-20090719.osc.gz : failed to parse
Error occurred, cleaning up



  

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] Speaking of daily change files...

2009-07-20 Thread Blaž Lorger 
On Monday 20 July 2009 00:49:32 John Smith wrote:
> In the last week or so there has been dumps that osm2pgsql fails to parse
> due to garbage characters, I even tried the -u switch for kicks, but unless
> I manually intervene and clean things up osm2pgsql refuses to deal with it.
>
> Pretty sure I'm using the latest version, or near to it, was downloaded
> about the 1st.
>

I have same problem. I guess it is advisable to quickly check planet change 
file with osmosis before you attempt to apply it.
Like so:
osmosis --read-xml-change 20090718-20090719.osc.gz --write-null-change

This way you at least get result (location of "bad" character) very quickly.


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] Speaking of daily change files...

2009-07-20 Thread John Smith 

--- On Mon, 20/7/09, Blaž Lorger  wrote:


> I have same problem. I guess it is advisable to quickly
> check planet change 

I switched to importing hourly change sets however I would have thought the API 
code would prevent garbage from getting into the database in the first place.


  

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk