[IPAC-List] Does the day you take an oral exam matter? -Killingthe Mess...

[Richard R. Carter]

If I might try to summarize:

1.  The original question concerned test-taking order of two types of
testing: a. situational role plays and b. structured interviews. My
assumption was that the question arose from questions of test security.
That is, earlier tested individuals may have the opportunity to share
information with those tested later in the process.  

2.  With structured interviews, the consensus seems to be that the more
information shared with the candidates, the better.  This strategy
eliminates this source of distrust among test-takers.  (I'm on-board
with that).  

3. With situational role plays designed to measure needed competencies,
including job knowledge, it seems that most would agree that providing
the test ahead of time is not recommended.  In this case, a candidate
orientation to explain what to expect while being tested, including the
competencies measured, should help with candidate acceptance.  (I'm good
with that one too).

4. When using situational role plays and not sharing the test with all
ahead of time, there is still no actual evidence of cheating when a test
is administered over a number of days.

5. This lack of evidence does not always translate into wide-spread
candidate acceptance in this specific situation.  Test takers are
distrustful, to some degree, of test makers, those making hiring
decisions, and others with whom they are competing.   

In the original example, I think that candidates are MOSTLY concerned
with those who have already taken the test - those with whom they are
competing for promotion.  There have been a few suggestions offered to
deal with this particular source of distrust.  

Perhaps, making more well-known to candidates the results of the studies
that Chris mentioned regarding the lack of evidence of a "day tested"
effect, would be another method of addressing this concern.  

There are likely more research opportunities in this are and definitive
guidance would be welcomed by all.  

Rick Carter

-----Original Message-----
From: ipac-list-bounces at ipacweb.org
[mailto:ipac-list-bounces at ipacweb.org] On Behalf Of Brull, Harry
Sent: Thursday, April 02, 2009 9:45 AM
To: Don Nott; RPClare at aol.com; dd1 at uakron.edu; ipac-list at ipacweb.org
Subject: Re: [IPAC-List] Does the day you take an oral exam matter?
-Killingthe Mess...

I support Don's observations about orientation. 
In my experience, "Tell them what you are going to do and do what you
told them" goes a long way.
I also make an audio or video tape of orientation for two purposes:
	-access to those who were unable to make the orientation session
	-documentation in case of later allegations
(I have never needed to use it for the later purpose)
Harry


Harry Brull
Senior Vice President
Personnel Decisions International-PDI Minneapolis
Expert Partners. Real Leadership Advantage.
Suite 4900
33 South sixth Street 
Minneapolis, Minnesota  55402
Direct :612-337-8233    fax: 612-337-3695
harry.brull at personneldecisions.com

www.personneldecisions.com


-----Original Message-----
From: ipac-list-bounces at ipacweb.org
[mailto:ipac-list-bounces at ipacweb.org] On Behalf Of Don Nott
Sent: Thursday, April 02, 2009 8:25 AM
To: RPClare at aol.com; dd1 at uakron.edu; ipac-list at ipacweb.org
Subject: Re: [IPAC-List] Does the day you take an oral exam matter?
-Killingthe Mess...

The interesting thing that I've found is that after we provide Candidate
orientation, some candidates express that they trust us (an outside
consulting firm) more than their own hierarchy!  Transparency and
understanding is big component in alleviating candidate skepticism of
testing.  

Perhaps it's basic psychology, but I'd love to see some data on
candidates' perceived testing experiences with, and without, candidate
orientation; my money is on that they would be significantly higher with
an orientation that helped the candidate's understanding of the process
and what to expect.  The bottom line would be reducing the likelihood
and cost of grievances.  The tricky part would be collecting the data
without social monitoring errors (i.e., I better say I liked it because
it might impact my results)

A couple more pennies to throw in the till. 


:Don


-----------------------------------------------------
Donald M. Nott
I/O Associate
  
Fields Consulting Group
7926 Jones Branch Drive
McLean, VA 22102
(703) 506-9400 

-----Original Message-----
From: ipac-list-bounces at ipacweb.org
[mailto:ipac-list-bounces at ipacweb.org] On Behalf Of RPClare at aol.com
Sent: Thursday, April 02, 2009 9:14 AM
To: dd1 at uakron.edu; ipac-list at ipacweb.org
Subject: Re: [IPAC-List] Does the day you take an oral exam matter?
-Killing the Mess...

I have some interesting anecdotes including small # data on folks who,  
through deception, took the same test twice and post test applicant
perception  
that I never followed up on. I do want to chip in with two observations:
First, while police are special, I've had similar experiences with
Social  
workers and accountant/auditors.
Second, while there is some distrust of testing, I believe it is more
about  
how the results are manipulated and used rather than the testing itself.
While 
 cops usually don't trust non-cops to have much to do with their  
selection/promotion, they also don't trust police command. That is a
major  reason for 
their drive (and Firefighters) to have contractual "rule of the  list". 
**************Feeling the pinch at the grocery store?  Make dinner for
$10 or 
less. (http://food.aol.com/frugal-feasts?ncid=emlcntusfood00000001)
_______________________________________________________
IPAC-List
IPAC-List at ipacweb.org
http://www.ipacweb.org/mailman/listinfo/ipac-list
_______________________________________________________
IPAC-List
IPAC-List at ipacweb.org
http://www.ipacweb.org/mailman/listinfo/ipac-list

Confidentiality Notice: All information in this communication, including
any files or attachments, is intended for the sole use of the individual
or entity to which it is addressed and may contain information that is
confidential, proprietary and/or trade secret information entitled to
protection and/or exempt from disclosure under applicable law. If you
are not the intended recipient, you are hereby notified that any
dissemination, distribution, or copying of this communication is
strictly prohibited. If you have received this communication in error,
please notify the sender by return email and delete this communication
from your system. Thank you for your cooperation.
_______________________________________________________
IPAC-List
IPAC-List at ipacweb.org
http://www.ipacweb.org/mailman/listinfo/ipac-list