[IPAC-List] Appealed Items

[Blair, Michael]

Dennis – You’ll love this…it depends!


1.       If the original item went through a comprehensive review process with multiple SMEs to determine quality, job-relevance, answer, difficulty, etc., my preferred approach would be to score A & B as correct and award one point for each.  The assumption here being that there are indeed two best responses based on the initial SME input and the review committee input.

2.       If the original item did not go through a comprehensive review process, then I would toss the item out.  Of course, this poses other potential questions concerning other items and/or the test itself.

3.       If civil service rules or bargaining agreements are in place, then I would follow the rules/agreements.

4.       If employment lawyers are involved, then I would end up running a series of analysis based on the various scenarios for rescoring the item, present the outcomes to the lawyers along with my recommendation, and then step back and watch the debate.

[cid:image003.jpg at 01D0ADFD.95D32BC0]
Michael Blair | Manager HCM Technology
Office: 816-854-4312 | Cell: 913-832-6130
michael.blair at hrblock.com

From: IPAC-List [mailto:ipac-list-bounces at ipacweb.org] On Behalf Of Dennis Doverspike
Sent: Monday, October 17, 2016 11:44 AM
To: ipac-list at ipacweb.org
Subject: [IPAC-List] Appealed Items

This is an EXTERNAL EMAIL. Stop and think before clicking a link or opening attachments.
You are working for a city producing the final scoring key for a test. An item has been appealed where the original best answer was "A." The test review committee considers an appeal that "B" is the best answer, and agrees that "B" is the best answer. This was not simply a typo or miscoding, the original item writer believed that A was the best answer.
Do you:
1. Score A and B as correct; award one point for each.
2. Only score B as correct, counting A as being wrong.
3. Delete or throw out the item.
4. Give credit to all responses, A, B, C, and D.
5. Other
Does your jurisdiction have a stated or understood practice for handling such situations?
Do you have a rationale for your practice.
Please feel free to elaborate. Consultants, feel free to offer your usual practice.
Dennis

Dennis Doverspike, PhD., ABPP
Licensed Psychologist, #3539 (OHIO)
Independent Consultant
Professor of Psychology, University of Akron
dennisdoverspike at gmail.com<mailto:dennisdoverspike at gmail.com>

The information is intended only for the person or entity to which it is addressed and may contain confidential, privileged and/or a work product for the sole use of the intended recipient. No confidentiality or privilege is waived or lost by any errant transmission. If you receive this message in error, please destroy all copies of it and notify the sender. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. In the case of E-mail or electronic transmission, immediately delete it and all copies of it from your system and notify the sender. E-mail and fax transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist9.pair.net/pipermail/ipac-list/attachments/20161017/cdaff51a/attachment.html>