Re: LoadRunner User simulation
But also be careful not to oversimplify your tests. If for example testing focuses on Incident Management, one transaction would normally be new incident creation and test would need to create a valid new incident regardless of the type of testing. Running concurrent ITSM transactions does not mean that sending static HTTP requests (hard coded data) will be sufficient as this would most likely generate a significant number of application level errors clouding the overall performance picture (to continue with the old fashioned use of the word :). Tests transactions also need to be valid for things like automatic ticket assignment or SLA (in my incident creation example) to be invoked correctly making test results more relevant. Choice of testing tool should not drive testing requirements and it is best to start with what is required outcome of the testing and only then look at the tooling. While it may be possible to use a generic HTTP testing tool to load test Mid Tier, data encoding and AR specific response validation complicate things quite significantly. Things are much better with one of the AR specific web testing tools that can handle ITSM Back Channel calls seamlessly and choice there is Scapa TPP or Silk. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: LoadRunner User simulation
Rick, I would just add that in the same way as using multiple user accounts may change performance that you are observing you also need to consider and handle data variability in your test transactions. Introducing variability (variable query parameters to start with and then correct storage and passing of the query results to subsequent queries) will have effect on the overall validity of the test and accuracy of the results. So if you need to generate accurate load and measure system performance you need to introduce variability to the test data. Variability of the user names is in a way just a special case of the broader question of handling data variability. That of course if you assume that system can handle and manage well multiple authenticated user sessions from Mid Tier all the way to the database. Armen ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: LoadRunner User simulation
Just be careful not to mix functional testing with load testing. LoadRunner is basically designed to test concurrent transactions. WinRunenr can be used to validate functional testing (ie what happens under different scenarios). Both are important, but you don't necessarily want one to cloud (old fashion use of the word - but then again I'm old) the other. - Original Message - From: Armen Avedisijan armen.avedisi...@scapatech.com To: arslist@ARSLIST.ORG Sent: Monday, July 23, 2012 11:02:46 AM Subject: Re: LoadRunner User simulation Rick, I would just add that in the same way as using multiple user accounts may change performance that you are observing you also need to consider and handle data variability in your test transactions. Introducing variability (variable query parameters to start with and then correct storage and passing of the query results to subsequent queries) will have effect on the overall validity of the test and accuracy of the results. So if you need to generate accurate load and measure system performance you need to introduce variability to the test data. Variability of the user names is in a way just a special case of the broader question of handling data variability. That of course if you assume that system can handle and manage well multiple authenticated user sessions from Mid Tier all the way to the database. Armen ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: LoadRunner User simulation
Rick, The answer to your question is a resounding 'MAYBE' :) As with all things Mid-Tier, it's all about the caching on the server. As we all know, different things are cached for different users and depending on what your user base typically consists of, it makes a difference. On top of that, the system doesn't allow non-admin's to be logged in simultaneously...which means that all of your 'few accounts' would need to be admin, which wouldn't give you true testing...but if all you are looking to do is 'put a load' on the server...that shouldn't matter much -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Rick Cook Sent: Wednesday, July 18, 2012 1:05 PM To: arslist@ARSLIST.ORG Subject: LoadRunner User simulation ** ARS 7.5. For stress testing, is there any difference at the midtier layer between using a few users * multiple concurrent transactions vs. Lots of users running single tx? Rick _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: LoadRunner User simulation
Does Loadrunner give you the ability to feed something like a spreadsheet into the script - basically to use a series of users concurrently? Of course that will imply that the users are configured in Remedy (or guests) and the system is licensed accordingly. - Original Message - From: LJ CTR MDA Longwing/IC lj.longwing@mda.mil To: arslist@ARSLIST.ORG Sent: Wednesday, July 18, 2012 3:47:18 PM Subject: Re: LoadRunner User simulation Rick, The answer to your question is a resounding 'MAYBE' :) As with all things Mid-Tier, it's all about the caching on the server. As we all know, different things are cached for different users and depending on what your user base typically consists of, it makes a difference. On top of that, the system doesn't allow non-admin's to be logged in simultaneously...which means that all of your 'few accounts' would need to be admin, which wouldn't give you true testing...but if all you are looking to do is 'put a load' on the server...that shouldn't matter much -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Rick Cook Sent: Wednesday, July 18, 2012 1:05 PM To: arslist@ARSLIST.ORG Subject: LoadRunner User simulation ** ARS 7.5. For stress testing, is there any difference at the midtier layer between using a few users * multiple concurrent transactions vs. Lots of users running single tx? Rick _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: LoadRunner User simulation
It has been forever since I looked at LR, but I thought it could script something like that -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of pritch Sent: Wednesday, July 18, 2012 3:01 PM To: arslist@ARSLIST.ORG Subject: Re: LoadRunner User simulation Does Loadrunner give you the ability to feed something like a spreadsheet into the script - basically to use a series of users concurrently? Of course that will imply that the users are configured in Remedy (or guests) and the system is licensed accordingly. - Original Message - From: LJ CTR MDA Longwing/IC lj.longwing@mda.mil To: arslist@ARSLIST.ORG Sent: Wednesday, July 18, 2012 3:47:18 PM Subject: Re: LoadRunner User simulation Rick, The answer to your question is a resounding 'MAYBE' :) As with all things Mid-Tier, it's all about the caching on the server. As we all know, different things are cached for different users and depending on what your user base typically consists of, it makes a difference. On top of that, the system doesn't allow non-admin's to be logged in simultaneously...which means that all of your 'few accounts' would need to be admin, which wouldn't give you true testing...but if all you are looking to do is 'put a load' on the server...that shouldn't matter much -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Rick Cook Sent: Wednesday, July 18, 2012 1:05 PM To: arslist@ARSLIST.ORG Subject: LoadRunner User simulation ** ARS 7.5. For stress testing, is there any difference at the midtier layer between using a few users * multiple concurrent transactions vs. Lots of users running single tx? Rick ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are