Showing posts with label assessment validity. Show all posts
Showing posts with label assessment validity. Show all posts

Friday, November 29, 2013

Employment Testing: Hot Button Issue for EEOC and OFCCP

On October 30, 2013, the U.S. Department of Labor announced that federal construction contractor M.C. Dean Inc. had settled allegations that it failed to provide equal employment opportunity to 381 African American, Hispanic and Asian American workers who applied for jobs at the company's Dulles headquarters. A review by the department's Office of Federal Contract Compliance Programs determined that the contractor used a set of selection procedures, including invalid tests, which unfairly kept qualified minority candidates from securing jobs as apprentices and electricians.
"Our nation was built on the principles of fair play and equal opportunity, and artificial barriers that keep workers from securing good jobs violate those principles," said OFCCP Director Patricia A. Shiu. "I am pleased that this settlement will provide remedies to the affected workers and that M.C. Dean has agreed to invest significant resources to improve its hiring practices so that this never happens again."
Under the terms of the agreement, M.C. Dean will pay $875,000 in back wages and interest to 272 African American, 98 Hispanic and 11 Asian American job applicants who were denied employment in 2010. The contractor will also extend 39 job offers to the class members as opportunities become available. Additionally, M.C. Dean has agreed to undertake extensive self-monitoring measures and personnel training to ensure that all of its employment practices fully comply with Executive Order 11246, which prohibits federal contractors and subcontractors from discriminating in employment on the bases of race, color and national origin.
This settlement provides (at least) two lessons to all federal contractors.  First, the OFCCP is digging deeper than just the overall applicant-to-hire adverse impact analyses.  Where there is overall applicant-to-hire adverse impact in the hiring process, the Agency will analyze each stage (screen, test, interview, offer, etc.) in the hiring processes for adverse impact.  Second, where there is adverse impact at the testing stage, employers must evaluate the validity of their “tests.”  In these cases, OFCCP will request and send the validation materials to its Industrial-Organization Psychologist for review, so it must be able to withstand scrutiny, including whether the test has been (i) validated recently, (ii) validated for the employer’s specific position, and (iii) that there are not less discriminatory methods for achieving the same predictive results of job performance.   
In particular, employers who are using employment tests that have never been validated, have not been validated for the specific position for which they are being used, have not been validated for their specific company, have not been reviewed by someone other than the testing vendor who created the test, or have not been revalidated as the position changed over time may not realize they may be “at risk” in these audits. 
In short, own each step of your hiring process – even if a third-party testing vendor created and/or administers your test, the employer will be held accountable if the test causes adverse impact and is not properly validated.  Employers need to get in front of these testing issues by analyzing the test’s potential adverse impact and existing validation to minimize exposure during audits.  Notably, this has also become a “hot button” for EEOC, so taking a close look at your tests can help minimize exposure to both OFCCP and EEOC claims.

Saturday, July 20, 2013

Some Questions and Answers

What are pre-employment assessment tests?

There are a variety of pre-employment assessments, including intelligence tests, personality tests, job fit tests, interest inventories and work skills tests. Personality tests are designed to measure an individual’s emotional, motivational, interpersonal and attitudinal characteristics, as opposed to abilities. Although personality tests were originally designed for use by psychologists and psychiatrists in clinical settings to diagnose and treat mental illnesses, the increasing use of such tests by employers has spawned an entire industry focusing on developing job-specific personality testing.

Are pre-employment personality assessments effective?

According to a 2012 study by Oracle and Development Dimensions International (DDI), a global human resources consulting firm whose expertise includes designing and implementing selection systems, more than 250 staffing directors and over 2,000 new hires from 28 countries provided the following perspectives on their organization’s selection processes (the following are excerpts from the study):

  • [O]nly 41 percent of staffing directors report that their pre-employment assessments are able to predict better hires.
  • Only half of staffing directors rate their systems as effective, and even fewer view them as aligned, objective, flexible, efficient, or integrated. 
  • [T]he actual process for making a hiring decision is less effective than a coin toss.




In a 2007 article titled, “Reconsidering the Use of Personality Tests in Employment Contexts”, co-authored by six current or former editors of psychological journals, Dr. Kevin Murphy, Professor of Psychology at Pennsylvania State University and Editor of the Journal of Applied Psychology (1996-2002), states:

The problem with personality tests is … that the validity of personality measures as predictors of job performance is often disappointingly low. … The argument for using personality tests to predict performance does not strike me as convincing in the first place.

What are examples of test questions?

Set out below are examples of questions from an assessment test. Applicants are to respond to each statement with one of five choices: Strongly Disagree, Slightly Disagree, Not Sure/In Between, Slightly Agree, and Strongly Agree.

1. I don’t mind changes in my daily routine.
2. Others consider me a good teammate.
3. I hardly ever finish things on time.
4. Even if they are correct, I find criticism from others difficult to take.
5. I find unexpected changes to be frustrating.
6. It bothers me when people ask me to help them get their work done.
7. At work, I sometimes don’t finish things on time.
8. I prefer things to stay the same and not change.
9. I usually won’t go out of my way to help someone else.
10. Unexpected problems at work cause me great frustration.
11. I believe that others have good intentions.
12. I don’t always see things through.
13. I complete tasks before being told to do them.
14. I do not get emotional in stressful situations.
15. I can change course, if necessary.
16. I am willing to help other people, even if I am very busy.
17. I do everything I say I will do.
18. I jump into action before others.
19. I am not easily stressed.
20. I can handle criticism without getting upset.
21. I am put off by unexpected events.
22. I only help others if I have extra time at the end of the day.
23. I rarely finish doing things before they are actually due (such as paying bills, finishing work).
24. I am the first person to volunteer for new projects.
25. I am easily stressed.
26. I dislike the unknown.
27. I only offer my assistance to others if my own workload is complete.
28. I prefer to have the same structured schedule every day.
29. At work, you simply can’t help everyone and get your own job done.
30. I get frustrated at work when there are too many demands on my time.