[
https://issues.apache.org/jira/browse/HDDS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17730368#comment-17730368
]
Dave Teng commented on HDDS-8786:
---------------------------------
{code:java}
2023-06-08 02:01:14,175 [Timer for 'OzoneManager' metrics system] ERROR
org.apache.hadoop.hdds.utils.RocksDBStoreMetrics: Failed to get property
mem-table-flush-pending from rocksdb
java.io.IOException: Rocks Database is closed
at
org.apache.hadoop.hdds.utils.db.RocksDatabase.assertClose(RocksDatabase.java:442)
at
org.apache.hadoop.hdds.utils.db.RocksDatabase.getProperty(RocksDatabase.java:779)
at
org.apache.hadoop.hdds.utils.RocksDBStoreMetrics.getDBPropertyData(RocksDBStoreMetrics.java:214)
at
org.apache.hadoop.hdds.utils.RocksDBStoreMetrics.getMetrics(RocksDBStoreMetrics.java:151)
at
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:200)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.snapshotMetrics(MetricsSystemImpl.java:419)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.sampleMetrics(MetricsSystemImpl.java:406)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.onTimerEvent(MetricsSystemImpl.java:381)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl$4.run(MetricsSystemImpl.java:368)
at java.util.TimerThread.mainLoop(Timer.java:555)
at java.util.TimerThread.run(Timer.java:505) {code}
> Encounter error of OzoneManagerDoubleBuffer Terminating during snapshot
> creation
> --------------------------------------------------------------------------------
>
> Key: HDDS-8786
> URL: https://issues.apache.org/jira/browse/HDDS-8786
> Project: Apache Ozone
> Issue Type: Bug
> Components: Ozone Manager
> Reporter: Dave Teng
> Priority: Major
> Labels: ozone-snapshot
>
> When creating snapshot, encountered following error in OM:
> {code:java}
> 2023-06-08 02:01:14,771 [OMDoubleBufferFlushThread] ERROR
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer: Terminating with
> exit statu
> s 1: During flush to DB encountered error in OMDoubleBuffer flush thread
> OMDoubleBufferFlushThread when handling OMRequest: cmdType: CreateSnaps
> hot
> traceID: ""
> success: true
> status: OK
> CreateSnapshotResponse {
> snapshotInfo {
> snapshotID: "3ce30204-da71-41ad-9e78-607c688e8c5c"
> name: "snap5670"
> volumeName: "vol2"
> bucketName: "bucket2"
> snapshotStatus: SNAPSHOT_ACTIVE
> creationTime: 1686189673557
> deletionTime: 18446744073709551615
> pathPreviousSnapshotID: "180bd9f4-a83e-4bfb-97b3-a19d0eef0450"
> globalPreviousSnapshotID: "180bd9f4-a83e-4bfb-97b3-a19d0eef0450"
> snapshotPath: "vol2/bucket2"
> checkpointDir: "-3ce30204-da71-41ad-9e78-607c688e8c5c"
> dbTxSequenceNumber: 3269138
> }
> }
> java.io.IOException: Rocks Database is closed
> at
> org.apache.hadoop.hdds.utils.db.RocksDatabase.assertClose(RocksDatabase.java:442)
> at
> org.apache.hadoop.hdds.utils.db.RocksDatabase.newIterator(RocksDatabase.java:827)
> at
> org.apache.hadoop.hdds.utils.db.RDBTable.iterator(RDBTable.java:194)
> at
> org.apache.hadoop.hdds.utils.db.TypedTable.iterator(TypedTable.java:361)
> at
> org.apache.hadoop.ozone.om.OmSnapshotManager.deleteKeysFromDelKeyTableInSnapshotScope(OmSnapshotManager.java:573)
> at
> org.apache.hadoop.ozone.om.OmSnapshotManager.createOmSnapshotCheckpoint(OmSnapshotManager.java:394)
> at
> org.apache.hadoop.ozone.om.response.snapshot.OMSnapshotCreateResponse.addToDBBatch(OMSnapshotCreateResponse.java:81)
> at
> org.apache.hadoop.ozone.om.response.OMClientResponse.checkAndUpdateDB(OMClientResponse.java:73)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.lambda$5(OzoneManagerDoubleBuffer.java:414)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.addToBatchWithTrace(OzoneManagerDoubleBuffer.java:237)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.addToBatch(OzoneManagerDoubleBuffer.java:412)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.flushBatch(OzoneManagerDoubleBuffer.java:333)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.flushCurrentBuffer(OzoneManagerDoubleBuffer.java:312)
> at
> org.apache.hadoop.ozone.om.ratis.OzoneManagerDoubleBuffer.flushTransactions(OzoneManagerDoubleBuffer.java:277)
> at java.lang.Thread.run(Thread.java:748) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
