[OSM-talk] Osmisis Uk Extracting
I'm trying to use Osmosis to extract the Uk data from the planet file, and ideally put it in a PostgreSQL database (but I have a serous lack of hard driver space currently. I want to use it for geocoding I really want a list of roads the there locations in the Uk. Could take someone else extract but I think its better to work from scratch. ie start from the original data. currently I've got as far as bzcat planet-latest.osm.bz2 | osmosis --read-xml-0.6 file=- --bounding-polygon-0.6 file=united_kingdom2pts.txt --write-xml-0.6 file=- | bzip2 uk.osm.bz2 osmisos is from SVN version 0.30.3 but I get an error of SEVERE: Thread for task 1-read-xml-0.6 failed java.lang.NumberFormatException: For input string: Way at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48) at java.lang.Long.parseLong(Long.java:403) at java.lang.Long.parseLong(Long.java:461) at org.openstreetmap.osmosis.core.xml.v0_6.impl.RelationMemberElementProcessor.begin(RelationMemberElementProcessor.java:52) at org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.startElement(OsmHandler.java:91) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:501) at com.sun.org.apache.xerces.internal.parsers.AbstractXMLDocumentParser.emptyElement(AbstractXMLDocumentParser.java:179) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanStartElement(XMLDocumentFragmentScannerImpl.java:1339) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2747) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:648) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522) at javax.xml.parsers.SAXParser.parse(SAXParser.java:395) at javax.xml.parsers.SAXParser.parse(SAXParser.java:198) at org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108) at java.lang.Thread.run(Thread.java:619) 28-Apr-2009 19:08:17 org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed. at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30) What If anything am I doing wrong, or is this a bug. Thanks Peter. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmisis Uk Extracting
Hi, Peter Childs wrote: bzcat planet-latest.osm.bz2 | osmosis --read-xml-0.6 file=- --bounding-polygon-0.6 file=united_kingdom2pts.txt --write-xml-0.6 file=- | bzip2 uk.osm.bz2 Using that united_kingdom2pts.txt is bound to be very slow because it cuts out the UK along the coastline which is much more complex than it needs to be; a polygon with 10 nodes is perfectly suitable, you don't need one with 10s of 1000s! Use something like this for your polygon: britain 1 -6.45E+00 4.98E+01 -2.00E+00 4.89E+01 -1.85E+00 4.925000E+01 -2.08E+00 4.973000E+01 1.35E+00 5.09E+01 2.25E+00 5.258000E+01 -5.00E-01 6.13E+01 -8.92E+00 5.785000E+01 -6.876876E+00 5.561885E+01 -5.412946E+00 5.507351E+01 -5.035438E+00 5.283576E+01 -6.45E+00 4.98E+01 END END but I get an error of SEVERE: Thread for task 1-read-xml-0.6 failed java.lang.NumberFormatException: For input string: Way Your planet file is broken. Get the latest one (090428) and it will work. Bye Frederik -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09 E008°23'33 ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmisis Uk Extracting
If this is planet-090421.osm.bz2 then it is a known problem. Please use planet-090429.osm.bz2 which should have that bug removed. Shaun On 1 May 2009, at 08:17, Peter Childs wrote: I'm trying to use Osmosis to extract the Uk data from the planet file, and ideally put it in a PostgreSQL database (but I have a serous lack of hard driver space currently. I want to use it for geocoding I really want a list of roads the there locations in the Uk. Could take someone else extract but I think its better to work from scratch. ie start from the original data. currently I've got as far as bzcat planet-latest.osm.bz2 | osmosis --read-xml-0.6 file=- --bounding-polygon-0.6 file=united_kingdom2pts.txt --write-xml-0.6 file=- | bzip2 uk.osm.bz2 osmisos is from SVN version 0.30.3 but I get an error of SEVERE: Thread for task 1-read-xml-0.6 failed java.lang.NumberFormatException: For input string: Way at java .lang .NumberFormatException.forInputString(NumberFormatException.java:48) at java.lang.Long.parseLong(Long.java:403) at java.lang.Long.parseLong(Long.java:461) at org .openstreetmap .osmosis .core .xml .v0_6 .impl .RelationMemberElementProcessor .begin(RelationMemberElementProcessor.java:52) at org .openstreetmap .osmosis.core.xml.v0_6.impl.OsmHandler.startElement(OsmHandler.java: 91) at com .sun .org .apache .xerces .internal .parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:501) at com .sun .org .apache .xerces .internal .parsers .AbstractXMLDocumentParser .emptyElement(AbstractXMLDocumentParser.java:179) at com .sun .org .apache .xerces .internal .impl .XMLDocumentFragmentScannerImpl .scanStartElement(XMLDocumentFragmentScannerImpl.java:1339) at com .sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl $FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2747) at com .sun .org .apache .xerces .internal .impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:648) at com .sun .org .apache .xerces .internal .impl .XMLDocumentFragmentScannerImpl .scanDocument(XMLDocumentFragmentScannerImpl.java:510) at com .sun .org .apache .xerces .internal.parsers.XML11Configuration.parse(XML11Configuration.java: 807) at com .sun .org .apache .xerces .internal.parsers.XML11Configuration.parse(XML11Configuration.java: 737) at com .sun .org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java: 107) at com .sun .org .apache .xerces .internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl $JAXPSAXParser.parse(SAXParserImpl.java:522) at javax.xml.parsers.SAXParser.parse(SAXParser.java:395) at javax.xml.parsers.SAXParser.parse(SAXParser.java:198) at org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java: 108) at java.lang.Thread.run(Thread.java:619) 28-Apr-2009 19:08:17 org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed. at org .openstreetmap .osmosis .core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30) What If anything am I doing wrong, or is this a bug. Thanks Peter. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmisis Uk Extracting
2009/5/1 Shaun McDonald sh...@shaunmcdonald.me.uk: If this is planet-090421.osm.bz2 then it is a known problem. Please use planet-090429.osm.bz2 which should have that bug removed. Hmm rsync -LP rsync://ftp.heanet.ie/mirrors/openstreetmap.org/planet-latest.osm.bz2 . But I might not have re-run it in a week... I might try the smaller bounding I was using that one as it was the the easiest to find... Peter. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmisis Uk Extracting
Hi, Peter Childs wrote: I might try the smaller bounding I was using that one as it was the the easiest to find... There are tools in SVN (applications/utils/osm-extract/polygons) for creating your own polygon from an .osm file, so you can draw an outline over a landsat WMS image in JOSM and then convert that to a polygon. Bye Frederik -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09 E008°23'33 ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
