[IPAC-List] Appealed Items

[Deonda Scott]

Dennis,

Our Civil Service Code of Rules includes the following relevant sections:

7. Following the administration of any written test, a test review session
shall be conducted during which examinees will be allowed to review their
test results, all appropriate source material, and to submit written
challenges to any questions. A written challenge shall request relief in
one of three ways:

(1)   Acceptance of multiple answers;

(2)Acceptance of a different answer;

(3)Deletion of the item.



This rule is not applicable to the Assessment Center Testing Procedures.



8. A Challenge Board shall convene to rule on any written challenges that
are submitted. The identities of those individuals who have submitted the
challenges shall be concealed from the Challenge Board, which shall consist
of a minimum of three members of the Police Department whose grades are
equal to or greater than, that for which the examination was designed,
together with the Civil Service Administrator and another member of the
Human Resources Division. The Civil Service Administrator and the Human
Resources Division member shall be non‑voting members. The Challenge Board
shall, by majority vote, decide to reject or uphold each written challenge
that is made. When reviewing a challenge to a test item, the Challenge
Board may only respond to the challenge as written. That is, the Challenge
Board may not make a decision concerning an item which is outside of the
relief that is sought by the examinee. The Challenge Board has final
authority as to the content of test questions and the correct answers.



9. After all challenges have been ruled upon, final test scores shall be
based on the total number of test items that remain, rounded off to the
nearest hundredth of a percentage point (i.e., second decimal place).

However, the Police and Fire bargaining agreements (which supercedes) these
rules include language that indicates that if the challenge board
determines there are two correct answers to a question, the question will
be deleted (e.g., nobody is given credit.)

Hope that helps!
Deonda



On Mon, Oct 17, 2016 at 12:43 PM, Dennis Doverspike <
dennisdoverspike at gmail.com> wrote:

> You are working for a city producing the final scoring key for a test. An
> item has been appealed where the original best answer was "A." The test
> review committee considers an appeal that "B" is the best answer, and
> agrees that "B" is the best answer. This was not simply a typo or
> miscoding, the original item writer believed that A was the best answer.
>
> Do you:
>
> 1. Score A and B as correct; award one point for each.
> 2. Only score B as correct, counting A as being wrong.
> 3. Delete or throw out the item.
> 4. Give credit to all responses, A, B, C, and D.
> 5. Other
>
> Does your jurisdiction have a stated or understood practice for handling
> such situations?
>
> Do you have a rationale for your practice.
>
> Please feel free to elaborate. Consultants, feel free to offer your usual
> practice.
>
> Dennis
>
>
> Dennis Doverspike, PhD., ABPP
> Licensed Psychologist, #3539 (OHIO)
> Independent Consultant
> Professor of Psychology, University of Akron
> dennisdoverspike at gmail.com
>
> The information is intended only for the person or entity to which it is
> addressed and may contain confidential, privileged and/or a work product
> for the sole use of the intended recipient. No confidentiality or privilege
> is waived or lost by any errant transmission. If you receive this message
> in error, please destroy all copies of it and notify the sender. If the
> reader of this message is not the intended recipient, you are hereby
> notified that any dissemination, distribution or copying of this
> communication is strictly prohibited. In the case of E-mail or electronic
> transmission, immediately delete it and all copies of it from your system
> and notify the sender. E-mail and fax transmission cannot be guaranteed to
> be secure or error-free as information could be intercepted, corrupted,
> lost, destroyed, arrive late or incomplete, or contain viruses.
>
>
> _______________________________________________________
> IPAC-List
> IPAC-List at ipacweb.org
> https://pairlist9.pair.net/mailman/listinfo/ipac-list
>
>


-- 
Déonda Scott, Employment, Assessment & Development Manager
Human Resources Division
City of Orlando
400 South Orange Avenue
Orlando, FL, 32801
p. 407.246.2061
f. 407.246.2019
cityoforlando.net

Follow us!
@citybeautiful <http://goog_2047139281>
facebook.com/cityoforlando <http://goog_2047139281>
youtube.com/cityoforlando <http://goog_2047139281>
flickr.com/cityoforlando
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist9.pair.net/pipermail/ipac-list/attachments/20161017/e4463df8/attachment-0001.html>