xichen01 opened a new pull request, #5358:
URL: https://github.com/apache/ozone/pull/5358
## What changes were proposed in this pull request?
Improving parsing speed of DB Scanner
### Test
```bash
ozone debug ldb --db=/tmp/metadata/om.db/ scan --column_family=keyTable -l
1000000 -o /dev/null
```
Before:
Take about 300s
After:
Take about 5s
Performance improvement of about 50 ~ 60 times
### Optimization method
- Multi-threaded Json parsing, separate thread to read RocksDB, separate
thread for output
- Replacing the Json parsing tool from Gson to Jackson
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-9348
## How was this patch tested?
Existing Test
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
