[
https://issues.apache.org/jira/browse/OLIO-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shanti Subramanyam updated OLIO-20:
-----------------------------------
Description: The driver only checks whether the various metrics reported in
the summary report have passed the necessary criteria but does not check
whether the resulting throughput (ops/sec) is correct for the scale of the run
(number of concurrent users). Thus for example, it is possible to get 150
ops/sec for a run done with 1000 users and be reported as PASSED. (was: The
driver only checks whether the various metrics reported in the summary report
have passed the necessary criteria but does not check whether the resulting
throughput (ops/sec) is correct for the scale of the run (number of concurrent
users). Thus for example, it is possible to get 800 ops/sec for a run done with
200 users and be reported as PASSED.)
> Driver does not check for accuracy in throughput to determine pass/fail
> -----------------------------------------------------------------------
>
> Key: OLIO-20
> URL: https://issues.apache.org/jira/browse/OLIO-20
> Project: Olio
> Issue Type: Bug
> Components: generic
> Environment: generic
> Reporter: Shanti Subramanyam
> Assignee: Akara Sucharitakul
> Priority: Minor
>
> The driver only checks whether the various metrics reported in the summary
> report have passed the necessary criteria but does not check whether the
> resulting throughput (ops/sec) is correct for the scale of the run (number of
> concurrent users). Thus for example, it is possible to get 150 ops/sec for a
> run done with 1000 users and be reported as PASSED.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
