Our relatively new IRB has sent back a proposal from a colleague. The IRB refuses to evaluate the proposal without the author addressing issues of RELIABILITY and VALIDITY of measures. I find this to be a bit scary. While I feel that the IRB is properly charged with evaluating the risk to par
I am probably past my quota but now I am getting offended. Clearly you took my
statement completely out of context and used it add more fuel to a fire which
did not need it. Your question is absurd if the entire context of this
discussion was in place.
Annette
Quoting Bill Scott <[EMAIL PROTE
As a blanket statement without any context, I will say this: for many published
instruments there are reliability data available. In my experience when an IRB
asks for that kind of information, that is what they are asking for; if there
aren't any, then there aren't any, and a brief statement of
I took your words out of context? In what context is the word "abusing"
meant in the following quote?
> > " even in a minimum risk study you are abusing your participants if
you
> > are asking them to give up their time and energy on a useless task."
Certainly you do not mean abuse such as th
I may be too late to contribute anything helpful to this thread (I get
the digest version so I'm always a day behind or so).There is
obviously a concern about to what extent the IRB should be evaluating
the quality of the research, and intelligent people can have different
opinions on this. On
I suspect that the operating assumption boils down to the notion that
even in minimal risk research there always some risk. Thus, if
there is a possibility that the instrument is flawed, why waste Ss' time
and expose them to any degree of risk?
Miguel
At 09:10 AM 5/6/2004 -0400, you wrote:
Our
re
AIL PROTECTED]
[mailto:[EMAIL PROTECTED]Sent: Thursday, May 06, 2004 9:10
AMTo: Teaching in the Psychological SciencesSubject: IRB's
Gone Wild?
Our relatively new IRB has sent back a proposal from a
colleague. The IRB refuses to evaluate the proposal without the author
addressing issue
I've seen cases where this has happened. I agree that IRBs should not be in
the
business of evaluating research methods for minimal risk research. These IRBs
try to justify this micromanaging by appealing to the risk of "wasting the
participant's time" with a study that is unlikely to provide a mea
As chair of our IRB I have sometimes done the same thing, especially if the
measures send up a red flag somehow. If the measures are reliable and valid
then this is an extremely easy task. If they are not, then even in a minimum
risk study you are abusing your participants if you are asking them
Ok. I see your points.
Allow me to expand: This project involves a student developed survey on music preference and simple correlations with demographic info. The focus of the IRB is on the reliability and validity of this instrument. I see little risk in asking someone their music pref
Annette Taylor, Ph. D. wrote:
As chair of our IRB I have sometimes done the same thing, especially
if the measures send up a red flag somehow. If the measures are
reliable and valid then this is an extremely easy task. If they are
not, then even in a minimum risk study you are abusing your
part
I have to disagree with Annette (and others) on this one (I almost
always agree with Annette :-) ).
I was the chair of the IRB where I taught before and now I serve on the
college wide IRB.
I think this is exactly an example on an IRB gone wild. I think this is
an example that contributes to t
Yes, and now I see your point. I think that the student can respond to this
readily. First of all, obviously there are no reliabilty/validity 'data'. So
all the student has to note is that the instrument has face validity--can go
over the items individually if need be to satisfy the IRB and then
We will have to disagree here completely. It is the job of the IRB to decide on
the quality of research if the quality shifts the balance of cost/benefit to
cost. Participants do give up theri time and energy and are not often
compensated. Most subject pools use a genteel form of coercion that w
Annette Taylor, Ph. D. wrote:
We will have to disagree here completely. It is the job of the IRB to
decide on the quality of research if the quality shifts the balance of
cost/benefit to cost. Participants do give up theri time and energy
and are not often compensated. Most subject pools use a g
Hi
On Thu, 6 May 2004, Annette Taylor, Ph. D. wrote:
> We will have to disagree here completely. It is the job of
> the IRB to decide on the quality of research if the quality
> shifts the balance of cost/benefit to cost.
IRB members are not in a position to make this kind of judgment,
or at leas
On Thu, 6 May 2004, jim clark wrote:
>
> IRB members are not in a position to make this kind of judgment,
> or at least in this case they did not do a very good job. They
> would be better to focus on risk, and ONLY address methodological
> questions when the risk is elevated.
I agree.
> If we ta
On 6 May 2004 at 8:23, Annette Taylor wrote:
> On Thu, 6 May 2004, jim clark wrote:
> > With respect
> > to the last point, it would be interesting to see if
> > participating in bad studies harms or helps students'
> > understanding of science.
>
> Good study idea!
>
I agree, but getting that
IRBs should focus on assessing the potential risk for harm to
participants and should not address psychometric issues of the study. I
believe this for a few reasons.
First, an IRB cannot make an educated decision on psychometric issues if
they do not have expertise in that particular content area.
Hi
On Thu, 6 May 2004, Jeff Bartel wrote:
> On 6 May 2004 at 8:23, Annette Taylor wrote:
>
> > On Thu, 6 May 2004, jim clark wrote:
>
> > > With respect
> > > to the last point, it would be interesting to see if
> > > participating in bad studies harms or helps students'
> > > understanding of
I'm stumped. How do you know if a new measurement is reliable or valid before actually testing it by collecting data from participants?
Lenore Frigo
[EMAIL PROTECTED]
Do you Yahoo!?Win a $20,000 Career Makeover at Yahoo! HotJobs
---
You are currently subscribed to tips as: [EMAIL PROTECTED]
Title: Message
I'm stumped. How do you know if a new measurement is reliable or valid
before actually testing it by collecting data from participants?
Lenore Frigo
[EMAIL PROTECTED]
Or
alternatively, how do you know that an existing measure is going to produce
reliable/valid scores
I think we all agree that doing high quality research is important. We
should all design research without confounds, using valid and reliable
measures, add to the scientific literature in important ways, etc. My
point is that it is not the job of the IRB to make sure these
things happen. The jo
Just to add fuel to these flames . . . I once had a faculty member who was on
an IRB committee criticize my research proposal (on memory) on ethical grounds
because "students who could not remember would be embarrassed."
Sometimes it isn't politics, it is just mindless consideration for "risk."
Annette Taylor wrote:
" even in a minimum risk study you are abusing your participants if you
are asking them to give up their time and energy on a useless task."
--
Does this mean an IRB should not approve a replication of Martin Orne's
classic demonstration of experimental demand c
25 matches
Mail list logo