jojochuang opened a new pull request, #7469: URL: https://github.com/apache/ozone/pull/7469
## What changes were proposed in this pull request? HDDS-11766. DataNode to cache blockDataTable and lastChunkInfoTable Please describe your PR in detail: * DataNode updating checksum of an open file is becoming the bottleneck for HBase/hsync workloads. * The main bottleneck is reading from rocksdb and deserialize it to the corresponding protobuf and further to the helper Java class. * To address this overhead, add a Guava cache in front of rocksdb operation so the deserialization is avoid. * Serialization cost when the rocksdb is updated, still exists and need to addressed seperately. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-11766 ## How was this patch tested? Ran on a small cluster with HBase YCSB workloads. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
