[IPAC-List] Item and Test writing

[Dennis Doverspike]

Thanks Mike

Hope you are staying safe and healthy

Dennis

On Mon, Aug 31, 2020 at 2:17 PM Blair, Michael <Michael.Blair2 at opm.gov>
wrote:

> Overall, I would agree with Lance regarding face validity. In the examples
> provided, I would suggest that the first example is measuring to different
> concepts (basic math versus reading comprehensive and simple problem
> solving). In the second example, I would argue that face validity is not
> lost with the simpler way of phrasing the question (i.e., What tool would
> you use to attach two pieces of wood?). In fact, from a laborers viewpoint,
> the simple version may be more face valid.
>
>
>
> *Michael D. Blair*
>
> *Lead Personnel Research Psychologist*
>
> *United States Office of Personnel Management*
>
>
>
> P: 202-957-5427 | M: 202-957-5427
>
> Michael.Blair2 at opm.gov | www.opm.gov/HRS
>
>
>
> *From:* IPAC-List <ipac-list-bounces at ipacweb.org> *On Behalf Of *Lance
> Seberhagen
> *Sent:* Sunday, August 30, 2020 3:27 PM
> *To:* 'Dennis Doverspike' <dennisdoverspike at gmail.com>; 'IPAC-List' <
> IPAC-List at ipacweb.org>
> *Subject:* Re: [IPAC-List] Item and Test writing
>
>
>
> Face validity does not necessarily increase reading level.  One picture is
> worth 1,000 words.  Use short paragraphs, short sentences, short words, &
> plain English.  Provide a generous time limit.  That said, face validity is
> not always needed to make a reliable, valid, & fair test when applicants
> are expected to have limited reading skills.
>
>
> Lance Seberhagen, Ph.D.
> Seberhagen & Associates
> 9021 Trailridge Ct
> Vienna, VA 22182
> Tel 703-790-0796
> www.seberhagen.com
>
>
>
> *From:* IPAC-List <ipac-list-bounces at ipacweb.org> *On Behalf Of *Dennis
> Doverspike
> *Sent:* Sunday, August 30, 2020 1:29 PM
> *To:* IPAC-List <IPAC-List at ipacweb.org>
> *Subject:* [IPAC-List] Item and Test writing
>
>
>
> IPAC list and others
>
>
>
> I am interested on people's opinion on this, and if you know of research
> on this all the better,
>
>
>
> For jobs where the applicants are expected to have limited reading ability
> skills.
>
>
>
> Would you be more likely to write items, go with items, or prefer items
> that
>
>
>
> 1) reduce the amount of face valid content and context and thus reading
> level
>
>
>
> 2) increase the amount of face valid content and context and thus increase
> reading level (and also follow strict item writing rules)
>
>
>
> For example for a test for a general laborer
>
>
>
> 1) Low content and low reading level
>
>
>
> 2 + 2 =
>
>
>
> 2) High content and high reading level for a test for general laborer
>
>
>
> A laborer has a piece of wood that is  two inches long and needs to attach
> it to another piece of wood that is two inches long. How long will the
> board be once the pieces of wood are attached?
>
>
>
> another one
>
>
>
> 1) What tool would you use to attach two pieces of wood?
>
>
>
> 2) A coworker is struggling to get two pieces of wood to stick together.
> The coworker asks a laborer how the coworker should attach the two pieces
> of wood. The laborer should indicate that the best tool to use to attach
> two pieces of wood would be:
>
>
>
> Dennis
>
>
>
>
>
> --
>
> Dennis Doverspike, PhD., ABPP
> dennisdoverspike at gmail.com
>
> *Principled Progress Through People Science*
>
>
>
> *Doverspike Consulting LLC:*
>
> HR Litehouse (DBA)
>
> Chief People Scientist
>
> Mailing:
>
> PO Box 1788
>
> Stow, OH 44224-0788
>
> 330-690-3534
>
> Email: dennisdoverspike at gmail.com
>
>
>
> *Personal:*
>
> Dennis Doverspike
>
> 3171 N. Dover Road
>
> Silver Lake, Ohio 44224
>
> 330-690-3534
>
> dennisdoverspike at gmail.com <dennis_doverspike at yahoo.com>
>
>
>
> The information is intended only for the person or entity to which it is
> addressed and may contain confidential, privileged and/or a work product
> for the sole use of the intended recipient. No confidentiality or privilege
> is waived or lost by any errant transmission. If you receive this message
> in error, please destroy all copies of it and notify the sender. If the
> reader of this message is not the intended recipient, you are hereby
> notified that any dissemination, distribution or copying of this
> communication is strictly prohibited. In the case of E-mail or electronic
> transmission, immediately delete it and all copies of it from your system
> and notify the sender. E-mail and fax transmission cannot be guaranteed to
> be secure or error-free as information could be intercepted, corrupted,
> lost, destroyed, arrive late or incomplete, or contain viruses.
>


-- 
Dennis Doverspike, PhD., ABPP
dennisdoverspike at gmail.com
*Principled Progress Through People Science*

*Doverspike Consulting LLC:*

HR Litehouse (DBA)

Chief People Scientist

Mailing:

PO Box 1788

Stow, OH 44224-0788

330-690-3534

Email: dennisdoverspike at gmail.com


*Personal:*

Dennis Doverspike

3171 N. Dover Road

Silver Lake, Ohio 44224

330-690-3534

dennisdoverspike at gmail.com <dennis_doverspike at yahoo.com>


The information is intended only for the person or entity to which it is
addressed and may contain confidential, privileged and/or a work product
for the sole use of the intended recipient. No confidentiality or privilege
is waived or lost by any errant transmission. If you receive this message
in error, please destroy all copies of it and notify the sender. If the
reader of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying of this
communication is strictly prohibited. In the case of E-mail or electronic
transmission, immediately delete it and all copies of it from your system
and notify the sender. E-mail and fax transmission cannot be guaranteed to
be secure or error-free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or contain viruses.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist9.pair.net/pipermail/ipac-list/attachments/20200904/b379d819/attachment-0001.html>