[
https://issues.apache.org/jira/browse/OLIO-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shanti Subramanyam updated OLIO-34:
-----------------------------------
Component/s: (was: php-driver)
rails-driver
Assignee: Mandy Waite (was: Akara Sucharitakul)
Description:
The driver only checks whether the various metrics reported in the summary
report have passed the necessary criteria but does not check whether the
resulting throughput (ops/sec) is correct for the scale of the run (number of
concurrent users). Thus for example, it is possible to get 150 ops/sec for a
run done with 1000 users and be reported as PASSED.
This issue has been fixed in the PHP driver - fix needs to be ported to rails
driver.
was:The driver only checks whether the various metrics reported in the
summary report have passed the necessary criteria but does not check whether
the resulting throughput (ops/sec) is correct for the scale of the run (number
of concurrent users). Thus for example, it is possible to get 150 ops/sec for a
run done with 1000 users and be reported as PASSED.
> Rails Driver does not check for accuracy in throughput to determine pass/fail
> -----------------------------------------------------------------------------
>
> Key: OLIO-34
> URL: https://issues.apache.org/jira/browse/OLIO-34
> Project: Olio
> Issue Type: Bug
> Components: rails-driver
> Environment: generic
> Reporter: Shanti Subramanyam
> Assignee: Mandy Waite
> Priority: Minor
>
> The driver only checks whether the various metrics reported in the summary
> report have passed the necessary criteria but does not check whether the
> resulting throughput (ops/sec) is correct for the scale of the run (number of
> concurrent users). Thus for example, it is possible to get 150 ops/sec for a
> run done with 1000 users and be reported as PASSED.
> This issue has been fixed in the PHP driver - fix needs to be ported to rails
> driver.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
