For what it's worth:

Telling the subjects to raise their hand when they noticed a change
wasn't necessarily "unblinding" the test, as long as there was a
possibility that no change would happen during the course of the test. 
Having multiple subjects in the same room, even with their eyes closed,
pretty much ruined the test, though.

If you ever want to re-do this test, isolate your subjects (test one at
a time), and perform multiple tests per subject (on the order of 12 or
more), including tests where no change occurs.  Come up with the
criteria for a "positive" BEFORE the trial starts, such as raising a
hand within 30 seconds of the tweak.  Then consider any other
hand-raising to be a false positive, even if it's at X+1 seconds. 
Otherwise you'll end up adjusting your criteria to fit your data, which
makes the whole process suspect.  Then at the end you'll have a nice big
pile of data to work with.

Then it will likely be a pretty good single-blind test.  It will not be
double-blind because you are in the room with the subjects, both to make
the tweak and to observe the hand-raising (and ninja-like as you may
believe yourself to be, your subjects may be able to sense you making
the tweak).  Invest in a one-way mirror if you want to try for
double-blind.


-- 
CatBus
------------------------------------------------------------------------
CatBus's Profile: http://forums.slimdevices.com/member.php?userid=7461
View this thread: http://forums.slimdevices.com/showthread.php?t=32466

_______________________________________________
audiophiles mailing list
audiophiles@lists.slimdevices.com
http://lists.slimdevices.com/lists/listinfo/audiophiles

Reply via email to