[ 
https://issues.apache.org/jira/browse/MINIFICPP-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gábor Gyimesi updated MINIFICPP-2401:
-------------------------------------
    Description: According to the profiling done by [~MZink] RocksDB takes most 
of its time while reading data with verifying checksums of the read data. There 
is an option in RocksDB ReadOptions::verify_checksums that could be set to 
false which would speed up the process if we do not need this feature. We 
should investigate if it's needed for our use case, check the possible benefits 
compared to the performance improvement we can get by disabling this feature 
and decide if we should turn it off or not, or maybe make this an optional 
feature in minifi.properties.  (was: According to the profiling done by 
[~MZink] RocksDB takes most of it's time while reading data with verifying 
checksums of the read data. There is an option in RocksDB 
ReadOptions::verify_checksums that could be set to false which would speed up 
the process if we do not need this feature. We should investigate if it's 
needed for our use case, check the possible benefits compared to the 
performance improvement we can get by disabling this feature and decide if we 
should turn it off or not, or maybe make this an optional feature in 
minifi.properties.)

> Investigate ReadOptions::verify_checksums flag and remove if unnecessary
> ------------------------------------------------------------------------
>
>                 Key: MINIFICPP-2401
>                 URL: https://issues.apache.org/jira/browse/MINIFICPP-2401
>             Project: Apache NiFi MiNiFi C++
>          Issue Type: Improvement
>            Reporter: Gábor Gyimesi
>            Priority: Minor
>
> According to the profiling done by [~MZink] RocksDB takes most of its time 
> while reading data with verifying checksums of the read data. There is an 
> option in RocksDB ReadOptions::verify_checksums that could be set to false 
> which would speed up the process if we do not need this feature. We should 
> investigate if it's needed for our use case, check the possible benefits 
> compared to the performance improvement we can get by disabling this feature 
> and decide if we should turn it off or not, or maybe make this an optional 
> feature in minifi.properties.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to