[OSM-talk] Replication errors
Hi All! Since few days I have a replication errors using osmosis... Any ideas how to fix it? Is there anythink I can do or it's sth about a data? ---START Thu Apr 16 08:05:01 CEST 2020 No current.osc file found, downloading new one... Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Osmosis Version 0.46 Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Preparing pipeline. Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Launching pipeline execution. Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Pipeline executing, waiting for completion. Apr 16, 2020 8:05:03 AM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion SEVERE: Thread for task 1-read-replication-interval failed org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to parse xml file /tmp/change8964114732320454958.tmp. publicId=(null), systemId=(null), lineNumber=1775, columnNumber=22. at org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:100) at org.openstreetmap.osmosis.replication.v0_6.ReplicationDownloader.processChangeset(ReplicationDownloader.java:107) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.processReplicationFile(BaseReplicationDownloader.java:133) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.download(BaseReplicationDownloader.java:235) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:271) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:350) at java.lang.Thread.run(Thread.java:748) Caused by: org.xml.sax.SAXParseException; lineNumber: 1775; columnNumber: 22; Invalid byte 2 of 4-byte UTF-8 sequence. at org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source) at org.apache.xerces.util.ErrorHandlerWrapper.fatalError(Unknown Source) at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source) at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(SAXParser.java:195) at org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:90) ... 6 more Caused by: org.apache.xerces.impl.io.MalformedByteSequenceException: Invalid byte 2 of 4-byte UTF-8 sequence. at org.apache.xerces.impl.io.UTF8Reader.invalidByte(Unknown Source) at org.apache.xerces.impl.io.UTF8Reader.read(Unknown Source) at org.apache.xerces.impl.XMLEntityScanner.load(Unknown Source) at org.apache.xerces.impl.XMLEntityScanner.scanLiteral(Unknown Source) at org.apache.xerces.impl.XMLScanner.scanAttributeValue(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanAttribute(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown Source) ... 16 more Apr 16, 2020 8:05:03 AM org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed. at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) at org.codehaus.classworlds.Launcher.main(Launcher.java:47) -- Pozdraw
Re: [OSM-talk] Replication errors
If I had to guess, > On Apr 15, 2020, at 11:10 PM, Andrzej Kępys wrote: > ... > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Pipeline executing, waiting for completion. > Apr 16, 2020 8:05:03 AM > org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager > waitForCompletion > SEVERE: Thread for task 1-read-replication-interval failed > org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to parse xml > file this looks like a severely starved read-data pipeline, which is very often caused by overloaded servers not being able to keep up with serving data to too many read requests. Given how many people are overloading OSM's tile servers, other servers are also likely heavily-loaded or overloaded. Many, (billions) of us ARE, after all, in "COVID-19 lockdown" and find mapping on the 'net to be a soothing and worthwhile activity while cooped up. I had this happen earlier today on Lonvia's (?) Nominatim server(s), something I've never seen before. I'd "do your best" to discover a contact for the particular server (osmosis.openstreetmap.org is a guess, but it is a good start) and ask if it is experiencing overload conditions right now. It likely is, that likely explains the error(s) you see. However, I could be wrong. Check our "stats" page, https://wiki.osm.org/wiki/Stats which can offer helpful insights to user, database and server activity, or lead you to places where you might find what you're looking for. Good luck, have fun mapping, be as gentle as you can be on OSM's servers, SteveA California ___ talk mailing list talk@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Replication errors
Hi, this error has been fixed in the latest release of osmosis. You need to update your osmosis to a version >= 0.47.2. Sarah On Thu, Apr 16, 2020 at 08:10:45AM +0200, Andrzej Kępys wrote: > Hi All! > > Since few days I have a replication errors using osmosis... Any ideas how to > fix it? Is there anythink I can do or it's sth about a data? > > ---START > Thu Apr 16 08:05:01 CEST 2020 > No current.osc file found, downloading new one... > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Osmosis Version 0.46 > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Preparing pipeline. > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Launching pipeline execution. > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Pipeline executing, waiting for completion. > Apr 16, 2020 8:05:03 AM > org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager > waitForCompletion > SEVERE: Thread for task 1-read-replication-interval failed > org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to parse xml > file /tmp/change8964114732320454958.tmp. publicId=(null), systemId=(null), > lineNumber=1775, columnNumber=22. > at > org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:100) > at > org.openstreetmap.osmosis.replication.v0_6.ReplicationDownloader.processChangeset(ReplicationDownloader.java:107) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.processReplicationFile(BaseReplicationDownloader.java:133) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.download(BaseReplicationDownloader.java:235) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:271) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:350) > at java.lang.Thread.run(Thread.java:748) > Caused by: org.xml.sax.SAXParseException; lineNumber: 1775; columnNumber: 22; > Invalid byte 2 of 4-byte UTF-8 sequence. > at > org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown > Source) > at org.apache.xerces.util.ErrorHandlerWrapper.fatalError(Unknown Source) > at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source) > at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown > Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown > Source) > at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) > at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) > at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) > at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) > at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown > Source) > at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) > at javax.xml.parsers.SAXParser.parse(SAXParser.java:195) > at > org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:90) > ... 6 more > Caused by: org.apache.xerces.impl.io.MalformedByteSequenceException: Invalid > byte 2 of 4-byte UTF-8 sequence. > at org.apache.xerces.impl.io.UTF8Reader.invalidByte(Unknown Source) > at org.apache.xerces.impl.io.UTF8Reader.read(Unknown Source) > at org.apache.xerces.impl.XMLEntityScanner.load(Unknown Source) > at org.apache.xerces.impl.XMLEntityScanner.scanLiteral(Unknown Source) > at org.apache.xerces.impl.XMLScanner.scanAttributeValue(Unknown Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanAttribute(Unknown > Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown > Source) > ... 16 more > > Apr 16, 2020 8:05:03 AM org.openstreetmap.osmosis.core.Osmosis main > SEVERE: Execution aborted. > org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks > failed. > at > org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) > at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92) > at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330) > at > org.codehaus.plexus.classworlds.launcher.
Re: [OSM-talk] Replication errors
Sarah, thank you! You are really "on it!" SteveA ___ talk mailing list talk@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Replication errors
Sarah has already given the answer, but a small remark anyway: I would suggest following the operations twitter account https://twitter.com/OSM_Tech as that is the place you are most likely to see short term notices about these kind of things. Simon Am 16.04.2020 um 08:10 schrieb Andrzej Kępys: > Hi All! > > Since few days I have a replication errors using osmosis... Any ideas > how to fix it? Is there anythink I can do or it's sth about a data? > > ---START > Thu Apr 16 08:05:01 CEST 2020 > No current.osc file found, downloading new one... > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Osmosis Version 0.46 > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Preparing pipeline. > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Launching pipeline execution. > Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run > INFO: Pipeline executing, waiting for completion. > Apr 16, 2020 8:05:03 AM > org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager > waitForCompletion > SEVERE: Thread for task 1-read-replication-interval failed > org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to > parse xml file /tmp/change8964114732320454958.tmp. publicId=(null), > systemId=(null), lineNumber=1775, columnNumber=22. > at > org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:100) > at > org.openstreetmap.osmosis.replication.v0_6.ReplicationDownloader.processChangeset(ReplicationDownloader.java:107) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.processReplicationFile(BaseReplicationDownloader.java:133) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.download(BaseReplicationDownloader.java:235) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:271) > at > org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:350) > at java.lang.Thread.run(Thread.java:748) > Caused by: org.xml.sax.SAXParseException; lineNumber: 1775; > columnNumber: 22; Invalid byte 2 of 4-byte UTF-8 sequence. > at > org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown > Source) > at org.apache.xerces.util.ErrorHandlerWrapper.fatalError(Unknown > Source) > at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown > Source) > at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown > Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown > Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown > Source) > at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) > at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) > at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) > at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) > at > org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) > at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) > at javax.xml.parsers.SAXParser.parse(SAXParser.java:195) > at > org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:90) > ... 6 more > Caused by: org.apache.xerces.impl.io.MalformedByteSequenceException: > Invalid byte 2 of 4-byte UTF-8 sequence. > at org.apache.xerces.impl.io.UTF8Reader.invalidByte(Unknown Source) > at org.apache.xerces.impl.io.UTF8Reader.read(Unknown Source) > at org.apache.xerces.impl.XMLEntityScanner.load(Unknown Source) > at org.apache.xerces.impl.XMLEntityScanner.scanLiteral(Unknown > Source) > at org.apache.xerces.impl.XMLScanner.scanAttributeValue(Unknown > Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanAttribute(Unknown > Source) > at > org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown > Source) > ... 16 more > > Apr 16, 2020 8:05:03 AM org.openstreetmap.osmosis.core.Osmosis main > SEVERE: Execution aborted. > org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more > tasks failed. > at > org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) > at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92) > at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330) > at > org.codehaus.plexus.classworlds.laun
Re: [OSM-talk] Replication errors
Thanks for all answers - latest version of osmosis fixed problem. I've also following operations tweeter from now on :) Pozdrawiam Andrzej Kępys gg: 7918247 skype: jedrus305 tel: 605 997 440 W dniu 16.04.2020 o 10:35, Simon Poole pisze: Sarah has already given the answer, but a small remark anyway: I would suggest following the operations twitter account https://twitter.com/OSM_Tech as that is the place you are most likely to see short term notices about these kind of things. Simon Am 16.04.2020 um 08:10 schrieb Andrzej Kępys: Hi All! Since few days I have a replication errors using osmosis... Any ideas how to fix it? Is there anythink I can do or it's sth about a data? ---START Thu Apr 16 08:05:01 CEST 2020 No current.osc file found, downloading new one... Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Osmosis Version 0.46 Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Preparing pipeline. Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Launching pipeline execution. Apr 16, 2020 8:05:02 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Pipeline executing, waiting for completion. Apr 16, 2020 8:05:03 AM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion SEVERE: Thread for task 1-read-replication-interval failed org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to parse xml file /tmp/change8964114732320454958.tmp. publicId=(null), systemId=(null), lineNumber=1775, columnNumber=22. at org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:100) at org.openstreetmap.osmosis.replication.v0_6.ReplicationDownloader.processChangeset(ReplicationDownloader.java:107) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.processReplicationFile(BaseReplicationDownloader.java:133) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.download(BaseReplicationDownloader.java:235) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:271) at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:350) at java.lang.Thread.run(Thread.java:748) Caused by: org.xml.sax.SAXParseException; lineNumber: 1775; columnNumber: 22; Invalid byte 2 of 4-byte UTF-8 sequence. at org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source) at org.apache.xerces.util.ErrorHandlerWrapper.fatalError(Unknown Source) at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source) at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(SAXParser.java:195) at org.openstreetmap.osmosis.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:90) ... 6 more Caused by: org.apache.xerces.impl.io.MalformedByteSequenceException: Invalid byte 2 of 4-byte UTF-8 sequence. at org.apache.xerces.impl.io.UTF8Reader.invalidByte(Unknown Source) at org.apache.xerces.impl.io.UTF8Reader.read(Unknown Source) at org.apache.xerces.impl.XMLEntityScanner.load(Unknown Source) at org.apache.xerces.impl.XMLEntityScanner.scanLiteral(Unknown Source) at org.apache.xerces.impl.XMLScanner.scanAttributeValue(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanAttribute(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown Source) ... 16 more Apr 16, 2020 8:05:03 AM org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed. at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher
