Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-03 Thread Erin Walsh
Doh! I should have said affinity diagram with clustered results of sites features and functions. I apologize for mistyping and causing confusion! We used Morae to perform the tests, so we initially spent time logging comments, observations and errors. Once complete we had a giant spread

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-02 Thread Guillermo Ermel
Could you explain further how you take those measures. e.g. how do you take time for tasks (whole tasks, parts...?), what other metrics you look into, how you measure success ("yes/no", "yes but...", etc. Thanks! Sarah Kampman escribió: Though I take notes, I rely more heavily on quantitative

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-02 Thread Chauncey Wilson
This is an excellent topic and a critical one for our profession. It would make for a good workshop or presentation at UPA, or CHI, or IxDA. There are some good issues with taking notes of usability sessions: 1. Many note taking sessions focus on point problems -- the person chooses the wrong m

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread Todd Zaki Warfel
On Jul 1, 2008, at 10:34 AM, Guillermo Ermel wrote: Now, how do YOU approach analyzing those notes? Reading and re- writing by heart? Putting all notes on a wall and eye-balling? Tagging the text with some piece of software? We use a custom framework we've developed that was inspired by ELI

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread Travis Stiles
Erin, your method "cluster analysis with comments on post-its" sounds effective, but I wasn't able to get a handle on the process as you described it. I think I have a 1/2 picture of it. Could you break it down a bit more for a newbie? Thanks for everyone's postings, such a valuable dialog! >t.

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread Sarah Kampman
I'd be happy to elaborate -- and I'd love feedback, as this is something I'm always trying to streamline and improve. I try to identify the items under investigation ahead of time, so that I can mark up a prewritten test script during the test. My usability tests are often short and target a sm

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread Sarah Kampman
Though I take notes, I rely more heavily on quantitative measures when assessing the results of a usability test. All of the tasks I have participants complete have degrees of success, and often a time component as well. These measures lend themselves to comparison and analysis in a way that quotes

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread chiwah liu
2008/7/1 Erin Walsh <[EMAIL PROTECTED]>: > The most effective method we have used has been a cluster analysis with > comments on post-its. You can color code by participant to keep things in > perspective. > Hello, I though cluster analysis was only for card sorting. How do you do cluster analy

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread Erin Walsh
The most effective method we have used has been a cluster analysis with comments on post-its. You can color code by participant to keep things in perspective. The last test we did was not only our site, but a competitive analysis as well. (It this case, we color coded post-its with site

Re: [IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread Patricia Garcia
One thing I started to do was create a chart using pen and paper. On the left side I list the numbers corresponding to the users. Across the top, I leave open. As I read my notes, I write issues encountered across the top of my chart and mark the user number with a a tic. As I review all my not

[IxDA Discuss] Analyzing usability testing notes

2008-07-01 Thread Guillermo Ermel
Hello folks! I'm trying to find a better way to do usability test analysis. My current approach is: after i finish a usability study, with 8 or 10 users, and collected my own and all observers' notes, I usually read all notes and then immediately write down the issues I feel area appearing more