the issue seems to happen when broker that is being stopped generated the
following exception.
Store getting corrupted due to the way the stop is handled?
2013-11-15 09:26:52,881 | WARN | Transport Connection to:
tcp://10.44.173.146:47163 failed: java.io.IOException: Connection reset by
peer | org.apache.activemq.broker.TransportConnection.Transport | ActiveMQ
NIO Worker 3
2013-11-15 09:27:04,959 | INFO | Apache ActiveMQ 5.10-SNAPSHOT (largeamq,
ID:dl360x2832-38143-1384525531423-0:1) is shutting down |
org.apache.activemq.broker.BrokerService | ActiveMQ ShutdownHook
2013-11-15 09:27:04,982 | INFO | Stopping BrokerService[largeamq] due to
exception, java.io.IOException: Store replication stopped |
org.apache.activemq.util.DefaultIOExceptionHandler | LevelDB IOException
handler.
java.io.IOException: Store replication stopped
at
org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
at
org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:554)
at
org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:1021)
at
org.apache.activemq.leveldb.LevelDBClient.store(LevelDBClient.scala:1352)
at
org.apache.activemq.leveldb.DBManager$$anonfun$drainFlushes$1.apply$mcV$sp(DBManager.scala:600)
at
org.fusesource.hawtdispatch.package$$anon$4.run(hawtdispatch.scala:357)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.IllegalStateException: Store replication stopped
at
org.apache.activemq.leveldb.replicated.MasterLevelDBStore.wal_sync_to(MasterLevelDBStore.scala:420)
at
org.apache.activemq.leveldb.replicated.MasterLevelDBClient$$anon$2$$anon$1.force(MasterLevelDBClient.scala:147)
at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1358)
at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1353)
at
org.apache.activemq.leveldb.RecordLog$$anonfun$appender$1.apply(RecordLog.scala:479)
at
org.apache.activemq.leveldb.util.TimeMetric.apply(TimeMetric.scala:43)
at
org.apache.activemq.leveldb.RecordLog.appender(RecordLog.scala:478)
at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply$mcV$sp(LevelDBClient.scala:1353)
at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1352)
at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1352)
at
org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:1015)
at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:1021)
at
org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:551)
... 7 more
2013-11-15 09:27:05,011 | INFO | Stopped LevelDB[/solidstate/ldb] |
org.apache.activemq.leveldb.LevelDBStore | LevelDB IOException handler.
2013-11-15 09:27:06,879 | INFO | Connector openwire stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
2013-11-15 09:27:07,768 | INFO | Connector amqp stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
--
View this message in context:
http://activemq.2283324.n4.nabble.com/replicatedLevelDB-errors-after-failover-tp4674550p4674556.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
