Re: LoadRunner User simulation

2012-07-24 Thread Armen Avedisijan
But also be careful not to oversimplify your tests. If for example testing 
focuses on Incident Management, one transaction would normally be new incident 
creation and test would need to create a valid new incident regardless of the 
type of testing. Running concurrent ITSM transactions does not mean that 
sending static HTTP requests (hard coded data) will be sufficient as this would 
most likely generate a significant number of application level errors clouding 
the overall performance picture (to continue with the old fashioned use of the 
word :). Tests transactions also need to be valid for things like automatic 
ticket assignment or SLA (in my incident creation example) to be invoked 
correctly making test results more relevant.  

Choice of testing tool should not drive testing requirements and it is best to 
start with what is required outcome of the testing and only then look at the 
tooling. While it may be possible to use a generic HTTP testing tool to load 
test Mid Tier, data encoding and AR specific response validation complicate 
things quite significantly. Things are much better with one of the AR specific 
web testing tools that can handle ITSM Back Channel calls seamlessly and choice 
there is Scapa TPP or Silk.

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are


Re: LoadRunner User simulation

2012-07-23 Thread Armen Avedisijan
Rick,

I would just add that in the same way as using multiple user accounts may 
change performance that you are observing you also need to consider and handle 
data variability in your test transactions. Introducing variability (variable 
query parameters to start with and then correct storage and passing of the 
query results to subsequent queries) will have effect on the overall validity 
of the test and accuracy of the results. So if you need to generate accurate 
load and measure system performance you need to introduce variability to the 
test data.

Variability of the user names is in a way just a special case of the broader 
question of handling data variability. That of course if you assume that system 
can handle and manage well multiple authenticated user sessions from Mid Tier 
all the way to the database.

Armen 

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are


Re: LoadRunner User simulation

2012-07-23 Thread pritch
Just be careful not to mix functional testing with load testing.  LoadRunner is 
basically designed to test concurrent transactions.  WinRunenr can be used to 
validate functional testing (ie what happens under different scenarios).  Both 
are important, but you don't necessarily want one to cloud (old fashion use of 
the word - but then again I'm old) the other.

- Original Message -
From: Armen Avedisijan armen.avedisi...@scapatech.com
To: arslist@ARSLIST.ORG
Sent: Monday, July 23, 2012 11:02:46 AM
Subject: Re: LoadRunner User simulation

Rick,

I would just add that in the same way as using multiple user accounts may 
change performance that you are observing you also need to consider and handle 
data variability in your test transactions. Introducing variability (variable 
query parameters to start with and then correct storage and passing of the 
query results to subsequent queries) will have effect on the overall validity 
of the test and accuracy of the results. So if you need to generate accurate 
load and measure system performance you need to introduce variability to the 
test data.

Variability of the user names is in a way just a special case of the broader 
question of handling data variability. That of course if you assume that system 
can handle and manage well multiple authenticated user sessions from Mid Tier 
all the way to the database.

Armen 

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are


Re: LoadRunner User simulation

2012-07-18 Thread Longwing, LJ CTR MDA/IC
Rick,
The answer to your question is a resounding 'MAYBE' :)

As with all things Mid-Tier, it's all about the caching on the server.  As we 
all know, different things are cached for different users and depending on what 
your user base typically consists of, it makes a difference.  On top of that, 
the system doesn't allow non-admin's to be logged in simultaneously...which 
means that all of your 'few accounts' would need to be admin, which wouldn't 
give you true testing...but if all you are looking to do is 'put a load' on the 
server...that shouldn't matter much

-Original Message-
From: Action Request System discussion list(ARSList) 
[mailto:arslist@ARSLIST.ORG] On Behalf Of Rick Cook
Sent: Wednesday, July 18, 2012 1:05 PM
To: arslist@ARSLIST.ORG
Subject: LoadRunner User simulation

** 

ARS 7.5. For stress testing, is there any difference at the midtier layer 
between using a few users * multiple concurrent transactions vs. Lots of users 
running single tx?

Rick

_attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ 

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are


Re: LoadRunner User simulation

2012-07-18 Thread pritch
Does Loadrunner give you the ability to feed something like a spreadsheet into 
the script - basically to use a series of users concurrently?  Of course that 
will imply that the users are configured in Remedy (or guests) and the system 
is licensed accordingly.

- Original Message -
From: LJ CTR MDA Longwing/IC lj.longwing@mda.mil
To: arslist@ARSLIST.ORG
Sent: Wednesday, July 18, 2012 3:47:18 PM
Subject: Re: LoadRunner User simulation

Rick,
The answer to your question is a resounding 'MAYBE' :)

As with all things Mid-Tier, it's all about the caching on the server.  As we 
all know, different things are cached for different users and depending on what 
your user base typically consists of, it makes a difference.  On top of that, 
the system doesn't allow non-admin's to be logged in simultaneously...which 
means that all of your 'few accounts' would need to be admin, which wouldn't 
give you true testing...but if all you are looking to do is 'put a load' on the 
server...that shouldn't matter much

-Original Message-
From: Action Request System discussion list(ARSList) 
[mailto:arslist@ARSLIST.ORG] On Behalf Of Rick Cook
Sent: Wednesday, July 18, 2012 1:05 PM
To: arslist@ARSLIST.ORG
Subject: LoadRunner User simulation

** 

ARS 7.5. For stress testing, is there any difference at the midtier layer 
between using a few users * multiple concurrent transactions vs. Lots of users 
running single tx?

Rick

_attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ 

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are


Re: LoadRunner User simulation

2012-07-18 Thread Grooms, Frederick W
It has been forever since I looked at LR, but I thought it could script 
something like that

-Original Message-
From: Action Request System discussion list(ARSList) 
[mailto:arslist@ARSLIST.ORG] On Behalf Of pritch
Sent: Wednesday, July 18, 2012 3:01 PM
To: arslist@ARSLIST.ORG
Subject: Re: LoadRunner User simulation

Does Loadrunner give you the ability to feed something like a spreadsheet into 
the script - basically to use a series of users concurrently?  Of course that 
will imply that the users are configured in Remedy (or guests) and the system 
is licensed accordingly.

- Original Message -
From: LJ CTR MDA Longwing/IC lj.longwing@mda.mil
To: arslist@ARSLIST.ORG
Sent: Wednesday, July 18, 2012 3:47:18 PM
Subject: Re: LoadRunner User simulation

Rick,
The answer to your question is a resounding 'MAYBE' :)

As with all things Mid-Tier, it's all about the caching on the server.  As we 
all know, different things are cached for different users and depending on what 
your user base typically consists of, it makes a difference.  On top of that, 
the system doesn't allow non-admin's to be logged in simultaneously...which 
means that all of your 'few accounts' would need to be admin, which wouldn't 
give you true testing...but if all you are looking to do is 'put a load' on the 
server...that shouldn't matter much

-Original Message-
From: Action Request System discussion list(ARSList) 
[mailto:arslist@ARSLIST.ORG] On Behalf Of Rick Cook
Sent: Wednesday, July 18, 2012 1:05 PM
To: arslist@ARSLIST.ORG
Subject: LoadRunner User simulation

** 

ARS 7.5. For stress testing, is there any difference at the midtier layer 
between using a few users * multiple concurrent transactions vs. Lots of users 
running single tx?

Rick

___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are