Implement automatic performance test
------------------------------------

                 Key: AMDATU-332
                 URL: http://jira.amdatu.org/jira/browse/AMDATU-332
             Project: Amdatu
          Issue Type: Task
          Components: Amdatu Core
    Affects Versions: 0.1.0
            Reporter: Ivo Ladage - van Doorn


In the /etc directory several JMeter plans are available. To run the plans and 
analyze the results a lot of manual effort is need:
- Start Amdatu version X
- Open JMeter
- Load and run all individual plans
- Stop Amdatu version X
- Repeat for version Y
- Copy/paste results to Excel, perform statistic analysis

This can be improved and automized. An initial simple implementation of this 
would support:

- Stand alone java tool
- Configurable with locations of Amdatu bin releases versions X and Y and 
location of JMeter plans
- Downloads and extracts X and Y
- Start X
- Runs all JMeter plans
- Stop X
- Repeat for version Y
- Collect JMeter test reports, create statistics (including μ(X-Y), σ(X-Y),  
μ(X-Y)/ μ(X) and goodness of fit against normal distribution (μ, σ)
- Validate null-hypothesis: 'Average response times of X and Y are the same' 
and 'Average throughput of X and Y is the same'
- Write results to HTML file

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

_______________________________________________
Amdatu-developers mailing list
[email protected]
http://lists.amdatu.org/mailman/listinfo/amdatu-developers

Reply via email to