>From James Page:
>Study after study has found massive variations
> in the Usability issues found by different evaluators.
> If you where right usability studies would be replicable,
> which current research shows they are not.
So what? I've never claimed that my beginner usability testers do br
On Mar 13, 2009, at 6:42 AM, James Page wrote:
@dana
I'd argue that in the small tests that most of us do percentages are
bogus).
Totally agree. Most of our tests are 30 plus, but for most
small studies they are meaningless.
30+? Wow. Sounds like huge amounts of wasted resources if you ne
@dana
>
> I'd argue that in the small tests that most of us do percentages are
> bogus).
>
Totally agree. Most of our tests are 30 plus, but for most
small studies they are meaningless.
You said
> Instead, they're [firms] asking, What do we want the user experience to be?
> What are the constrain
On Mar 12, 2009, at 3:09 PM, James Page wrote:
We believe very strongly in both qualitative and quantitative.
As do we. For certain measures, we'll want quantitative and for others
qualitative, but I'll take quality over quantity just about any day.
Cheers!
Todd Zaki Warfel
Principal De
James Page said:
> It depends on the design.
> You can have badly done qualitative studies,
> as well as poorly designed quantitative studies.
I replied:
> True, but it's so much *easier* to mess up on a survey.
James replied:
> Depends on if you create your own questions
> or use ones that hav
@caroline
>
> > It depends on the design.
> > You can have badly done qualitative studies,
> > as well as poorly designed quantitative studies.
>
> True, but it's so much *easier* to mess up on a survey.
Depends on if you create your own questions or use ones that have been
tested before. There i
>
> How do you work around that w/Webnographer?
>
> I didn't find a place on the website to try it out.
The self service module for Webnographer is coming soon.
I've always been a believer in quality over quantity myself,
We believe very strongly in both qualitative and quantitative. Just the l
On Mar 12, 2009, at 1:32 PM, Caroline Jarrett wrote:
True, but it's so much *easier* to mess up on a survey.
So true.
Cheers!
Todd Zaki Warfel
Principal Design Researcher
Messagefirst | Designing Information. Beautifully.
--
Contact Info
Voice: (215) 825-742
On Mar 12, 2009, at 11:36 AM, James Page wrote:
@todd
How do you work around that w/Webnographer?
I didn't find a place on the website to try it out.
Yes, you lose some ability to probe, but you gain by having a higher
number of participants.
I've always been a believer in quality over
James Page:
> It depends on the design.
> You can have badly done qualitative studies,
> as well as poorly designed quantitative studies.
True, but it's so much *easier* to mess up on a survey.
Designing a good quant study is hard, and any reputable book on survey
design will tell you that yo
@todd
How do you work around that w/Webnographer?
>
Try it and find out :)
Webnographer? With the absence of a moderator, you lose the richness of the
> conversation and ability to probe.
Yes, you lose some ability to probe, but you gain by having a higher number
of participants. We advice our
I agree absolutely that there comes a time to prioritize problems that
surface in user research.
In my experience, the teams that create the best experiences are not
concerned necessarily with the percentage of users that had the
problem (and I'd argue that in the small tests that most of
@dana
>
> Just get a mix of participants who do and are motivated to do what you're
> interested in observing.
>
agree.
If one or two participants in your mix have the issue, you want to fix that
> because you don't want *anyone* to have it.
>
Totally agree in the ideal world all issues should
On Mar 12, 2009, at 10:21 AM, James Page wrote:
Mac users are different, why - I don't know.
We've found the same over the years and contributed it to the
different environment of the MacOS to Windows OS.
And we get allot of behavioural differences by culture - (place of
birth vs reside
Ah, I meant with regard to age. If the sample is 8, say, in 99.9% of
cases, age won't matter. Just get a mix of participants who do and are
motivated to do what you're interested in observing.
If you're testing 30 or 50 or 100 participants, you might want to pay
attention to make sure you
On Mar 12, 2009, at 10:21 AM, James Page wrote:
Surely factors such as "margin of error", and "statistical power"
are important, or are they not?
They are not.
Jared
Welcome to the Interaction Design Association (IxDA)!
To
On Mar 12, 2009, at 10:07 AM, Todd Zaki Warfel wrote:
The key question is: How do you know that people older than 65 will
behave differently than people younger than 65?
My thoughts exactly. I don't see how you would know this until
you've actually done some research and testing on it. If
@dana
I am bit confused here by your question "What difference does it make how
many you're testing?"
Surely factors such as "margin of error", and "statistical power"
are important, or are they not?
The point of testing is to find out if your wrong, or right. How do you know
if your wrong or rig
On Mar 12, 2009, at 9:52 AM, Jared Spool wrote:
The key question is: How do you know that people older than 65 will
behave differently than people younger than 65?
My thoughts exactly. I don't see how you would know this until you've
actually done some research and testing on it. If you kn
On Mar 12, 2009, at 6:35 AM, Jen Giroux wrote:
Thanks everyone for your feedback. We are actually not limiting the
study to those under 65, as it may have indicated in the posting. We
do have an 'over 64' age group in the qualifying survey.
Another piece of unsolicited advice:
I don't like p
The key question is: How do you know that people older than 65 will
behave differently than people younger than 65?
Remember, there are three ways to build your participant schedule:
Screening, balancing, and analyzing.
By limiting the group to those under 65, you're *screening* out older
I wonder why the requirement is windows-based PC for US participants,
but both windows-based PCs and Macs for international participants?
Why not windows-based and Mac for both groups?
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Posted from the new ixda.org
http://www.ixda
What difference does it make how many you're testing? By breaking the
sample into groups, you're just creating extra work. Are you going to
compare the data by age group? Why would you do that? The only reason
I can think of is if you're creating different sites. You're not.
Dana
On Mar
Thanks everyone for your feedback. We are actually not limiting the
study to those under 65, as it may have indicated in the posting. We
do have an 'over 64' age group in the qualifying survey.
Thanks,
Jen
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Posted from the new ixd
Out of interest how many participants are you testing with? Could
you break the numbers down?
James
http://blog.feralabs.com
2009/3/12 Dana Chisnell
>
> Thanks for the prompt, Jared. There's no reason to limit the age range *at
> all.* As long as the behaviors are the same -- that is, the task
Thanks for the prompt, Jared. There's no reason to limit the age
range *at all.* As long as the behaviors are the same -- that is, the
task goals of the users -- across age ranges, then it doesn't matter a
bit how old the participants are.
As members of UPA, people over 65 would very l
If they don't have members over 65, then using them in research would
end up leading to false data, or untruth. If they have people over 65
and it's significant enough to warrant including them, then include
them.
For example, if they have 5 members out of 1000 who are 65, then
what's the
On Thu, Mar 12, 2009 at 1:20 PM, Todd Zaki Warfel wrote:
> Perhaps because the core audience isn't older than 65? Not to say that
> there aren't any, but I'd imagine, based on the meetings and conferences
> that I've been to, that the number of people over 65 are statistically quite
> small.
>
Yo
So? Why limit the age range? How does that benefit the research?
On Mar 11, 2009, at 10:20 PM, Todd Zaki Warfel wrote:
Perhaps because the core audience isn't older than 65? Not to say
that there aren't any, but I'd imagine, based on the meetings and
conferences that I've been to, that the n
Perhaps because the core audience isn't older than 65? Not to say that
there aren't any, but I'd imagine, based on the meetings and
conferences that I've been to, that the number of people over 65 are
statistically quite small.
On Mar 11, 2009, at 11:54 AM, Dana Chisnell wrote:
May I ask
May I ask why the age range limits to 65? Are there no members of UPA
who are older than that? I'm pretty sure there are.
Dana
:: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: :: ::
Dana Chisnell
desk: 415.392.0776
mobile: 415.519.1148
dana AT usabilityworks DOT net
The Usability Professionals Association (UPA) is currently working to
re-design its website, www.upassoc.org, and expect that the new site
will be launched by the end of 2009.
We are conducting a usability study of our new design and are
currently looking for representative users between the ages
32 matches
Mail list logo
