Re: [osmosis-dev] Unable to write String to the store
Frederik, > > Nakor wrote: >> I was trying to extract a bounding box from planet-100519.osm.bz2 and >> after one hour or so osmosis stopped running with the error message >> at the end. > > You seem to have used one of the --complete-something options. These > are real performance killers because they have to cache the full > planet in a temp file. Don't use them unless you really have to. > > If the extract you are making is relatively small, then it can make > sense to first do an extract with --clip-incomplete-entities for > something that is slightly larger than the bit you want, and then make > an excerpt *from that* with the --complete option. Thanks for the advice. > >> I have 175 Gb free on the disk where the planet file resides. Is this >> not enough? Or is osmosis using another disk for its temporary files? > > 175 GB is enough because the temp files are gzipped. But it uses /tmp > unless you > > export JAVACMD_OPTIONS="-Djava.io.tmpdir=/my/pretty/little/tempdir" > > before you run it. > The drive with /tmp has only 5Gb left so that might explain the issue. Thanks, N. ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev
Re: [osmosis-dev] Unable to write String to the store
Hi, Nakor wrote: > I was trying to extract a bounding box from planet-100519.osm.bz2 and > after one hour or so osmosis stopped running with the error message at > the end. You seem to have used one of the --complete-something options. These are real performance killers because they have to cache the full planet in a temp file. Don't use them unless you really have to. If the extract you are making is relatively small, then it can make sense to first do an extract with --clip-incomplete-entities for something that is slightly larger than the bit you want, and then make an excerpt *from that* with the --complete option. > I have 175 Gb free on the disk where the planet file resides. Is this > not enough? Or is osmosis using another disk for its temporary files? 175 GB is enough because the temp files are gzipped. But it uses /tmp unless you export JAVACMD_OPTIONS="-Djava.io.tmpdir=/my/pretty/little/tempdir" before you run it. Bye Frederik -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09" E008°23'33" ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev
[osmosis-dev] Unable to write String to the store
Hello, I was trying to extract a bounding box from planet-100519.osm.bz2 and after one hour or so osmosis stopped running with the error message at the end. I have 175 Gb free on the disk where the planet file resides. Is this not enough? Or is osmosis using another disk for its temporary files? Thanks, N. May 22, 2010 7:06:24 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion SEVERE: Thread for task 1-read-xml failed org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to write String (Misoaen Dental Clinic) to the store. at org.openstreetmap.osmosis.core.store.DataOutputStoreWriter.writeString(DataOutputStoreWriter.java:110) at org.openstreetmap.osmosis.core.domain.v0_6.Tag.store(Tag.java:60) at org.openstreetmap.osmosis.core.domain.v0_6.TagCollectionImpl.store(TagCollectionImpl.java:70) at org.openstreetmap.osmosis.core.domain.v0_6.CommonEntityData.store(CommonEntityData.java:198) at org.openstreetmap.osmosis.core.domain.v0_6.Entity.store(Entity.java:138) at org.openstreetmap.osmosis.core.domain.v0_6.Node.store(Node.java:184) at org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.store(NodeContainer.java:49) at org.openstreetmap.osmosis.core.store.BaseObjectWriter.writeObject(BaseObjectWriter.java:63) at org.openstreetmap.osmosis.core.store.SimpleObjectStore.add(SimpleObjectStore.java:106) at org.openstreetmap.osmosis.core.filter.v0_6.AreaFilter.process(AreaFilter.java:136) at org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.process(NodeContainer.java:58) at org.openstreetmap.osmosis.core.filter.v0_6.AreaFilter.process(AreaFilter.java:104) at org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.end(NodeElementProcessor.java:117) at org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:107) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(Unknown Source) at org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108) at java.lang.Thread.run(Unknown Source) Caused by: java.io.IOException: No space left on device at java.io.FileOutputStream.writeBytes(Native Method) at java.io.FileOutputStream.write(Unknown Source) at java.util.zip.DeflaterOutputStream.deflate(Unknown Source) at java.util.zip.DeflaterOutputStream.write(Unknown Source) at java.util.zip.GZIPOutputStream.write(Unknown Source) at java.io.BufferedOutputStream.flushBuffer(Unknown Source) at java.io.BufferedOutputStream.write(Unknown Source) at java.io.DataOutputStream.write(Unknown Source) at java.io.DataOutputStream.writeUTF(Unknown Source) at java.io.DataOutputStream.writeUTF(Unknown Source) at org.openstreetmap.osmosis.core.store.DataOutputStoreWriter.writeString(DataOutputStoreWriter.java:108) ... 26 more May 22, 2010 7:06:24 PM org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed. at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) at org.codehaus.classworlds.Launcher.main(Launcher.java:31)
