[ https://issues.apache.org/jira/browse/MINIFICPP-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gábor Gyimesi updated MINIFICPP-2401: ------------------------------------- Description: According to the profiling done by [~MZink] RocksDB takes most of its time while reading data with verifying checksums of the read data. There is an option in RocksDB ReadOptions::verify_checksums that could be set to false which would speed up the process if we do not need this feature. We should investigate if it's needed for our use case, check the possible benefits compared to the performance improvement we can get by disabling this feature and decide if we should turn it off or not, or maybe make this an optional feature in minifi.properties. (was: According to the profiling done by [~MZink] RocksDB takes most of it's time while reading data with verifying checksums of the read data. There is an option in RocksDB ReadOptions::verify_checksums that could be set to false which would speed up the process if we do not need this feature. We should investigate if it's needed for our use case, check the possible benefits compared to the performance improvement we can get by disabling this feature and decide if we should turn it off or not, or maybe make this an optional feature in minifi.properties.) > Investigate ReadOptions::verify_checksums flag and remove if unnecessary > ------------------------------------------------------------------------ > > Key: MINIFICPP-2401 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2401 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement > Reporter: Gábor Gyimesi > Priority: Minor > > According to the profiling done by [~MZink] RocksDB takes most of its time > while reading data with verifying checksums of the read data. There is an > option in RocksDB ReadOptions::verify_checksums that could be set to false > which would speed up the process if we do not need this feature. We should > investigate if it's needed for our use case, check the possible benefits > compared to the performance improvement we can get by disabling this feature > and decide if we should turn it off or not, or maybe make this an optional > feature in minifi.properties. -- This message was sent by Atlassian Jira (v8.20.10#820010)