Seriously? Just yesterday I did my research update, ending with a note that the December 2014 issue of the International Journal of Selection and Assessment should be out soon.
Guess what? It came out today.
So that means--you guessed it--another research update! :)
- First, a test of Spearman's hypothesis, which states that the magnitude of White-Black mean differences on tests of cognitive ability vary with the test's g loading. Using a large sample of GATB test-takers, these authors found support for Spearman's hypothesis, and that reducing g saturation lowered validity and increased prediction errors.
So does that mean practitioners have to choose between high-validity tests of ability or increasing the diversity of their candidate pool? Not so fast. Remember...there are other options.
- Next, international (Croatian) support for the Conditional Reasoning Test of Aggression, which can be used to predict counterproductive work behaviors. I can see this increasingly being something employers are interested in.
- Applicants that do well on tests have favorable impressions of them, while those that do poorly don't like them. Right? Not necessarily. These researchers found that above and beyond how people actually did on a test, certain individual differences predict applicant reactions, and suggest these be taken into account when designing assessments.
- Although personality testing continues to be one of the most popular topics, concerns remain about applicants "faking" their responses (i.e., trying to game the test by responding inaccurately but hopefully increase the chances of obtaining the job). This study investigates the use of blatant extreme responding, consistently selecting the highest or lowest response option, to detect faking, and looked at how this behavior correlated with cognitive ability, other measures of faking, and demographic factors (level of job, race, and gender).
- Next, a study of assessment center practices in Indonesia.
- Do individuals high in neuroticism have higher or lower job performance? Many would guess lower performance, but according to this research, the impact of neuroticism on job performance is moderated by job characteristics. This supports the more nuanced view that the relationship between personality traits and performance is in many cases non-linear and depends on how performance is conceptualized.
- ...which leads oh so nicely into the next article! In it, the authors studied air traffic controllers and found results consistent with previous studies--ability primarily predicted task performance while personality better predicted citizenship behavior. Which raises an interesting question: which version of "performance" are you interested in? My guess is for many employers the answer is both--which suggests of course using multiple methods when assessing candidates.
- Last but not least, an important study of using cognitive ability and personality to predict job performance in a three studies of Chilean organizations. Results were consistent with studies conducted elsewhere, namely ability and personality significantly predicted performance.
Okay, I think that's it for now!
Monday, October 27, 2014
Saturday, October 25, 2014
Research update
Okay, so it been a couple months, huh? Well, what say we do a research update then.
But before I dive in, I discovered something interesting and important. Longtime readers know that one of my biggest pet peeves is how difficult research articles are to get a hold of. And by difficult I mean expensive. Historically, unless you were affiliated with a research institution or were a subscriber, you had to pay exorbitant (IMHO) fees to see research articles. So imagine my pleasure when I discovered that at least one publisher--Wiley, who publishes several of the research journals in this area--now allows you to read-access for an article for as low as $6. Now that's only for 48 hours and you can't print it, but hey--that's a heck of a lot better than something like $30-40, which historically has been the case! So kudos.
Moving on.
Let's start with a bang with an article from the Autumn 2014 issue of Personnel Psych. A few years back several researchers argued that the assumption that performance is distributed normally was incorrect; and it got a bit of press. Not so fast, say new researchers, who show that when defined properly, performance is in fact more normally distributed.
For those of you wondering, "why do I care?" Whether we believe performance is normally distributed or not significantly impacts not only the statistical analyses performed on selection mechanisms but theories and practices surrounding HRM.
Moving to the July issue of the Journal of Applied Psychology:
- If you're going to use a cognitively-loaded selection mechanism (which in many cases has some of the highest predictive validity), be prepared to accept high levels of adverse impact. Right? Not to fast, say these researchers, who show that by weighting the subtests, you can increase diversity decisions without sacrifice validity.
- Here's another good one. As you probably know, the personality trait of conscientiousness has shown value in predicting performance in certain occupations. Many believe that conscientiousness may in fact have a curvilinear relationship with performance (meaning after a certain point, more conscientiousness may not help)--but this theory has not been consistently supported. According to these researchers, this may have to do with the assumption that higher scores equal more conscientiousness. In fact, when using an "ideal point" model, results were incredibly consistent in terms of supporting the curvilinear relationship between conscientiousness and performance.
- Range restriction is a common problem in applied selection research, since you only have performance data on a subset of the test-takers, requiring us to draw inferences. A few years back, Hunter, Schmidt, and Le proposed a new correction for range restriction that requires less information. But is it in fact superior? According to this research, the general answer appears to be: yes.
Let's move to the September issue of JAP:
- Within-person variance of performance is an important concept, both conceptually and practically. Historically short-term and long-term performance variance have been treated separately, but these researchers show the advantage of integrating the two together.
- Next, a fascinating study of the choice of (and persistence in) STEM fields as a career, the importance of both interest and ability, and how gender plays an important role. In a nutshell, as I understand it, interest and ability seem to play a more important role in predicting STEM career choices for men than for women, whereas ability is more important in the persistence in STEM careers for women.
Let's take a look at a couple from recent issue of Personnel Review:
- From volume 43(5), these researchers found support for ethics-based hiring decisions resulting in improved work attitudes, include organizational commitment.
- From 43(6), an expanded conceptual model of how hiring supervisors perceive "overqualification", which I would love to see more research on.
Last but not least, for you stats folks, what's new from PARE?
- What happens when you have missing data on multiple variables?
- Equivalence testing: samples matter!
- What sample size is needed when using regression models? Here's one suggestion on how to figure it out.
The December 2014 issue of IJSA should be out relatively soon, so look for a post on that soon!
But before I dive in, I discovered something interesting and important. Longtime readers know that one of my biggest pet peeves is how difficult research articles are to get a hold of. And by difficult I mean expensive. Historically, unless you were affiliated with a research institution or were a subscriber, you had to pay exorbitant (IMHO) fees to see research articles. So imagine my pleasure when I discovered that at least one publisher--Wiley, who publishes several of the research journals in this area--now allows you to read-access for an article for as low as $6. Now that's only for 48 hours and you can't print it, but hey--that's a heck of a lot better than something like $30-40, which historically has been the case! So kudos.
Moving on.
Let's start with a bang with an article from the Autumn 2014 issue of Personnel Psych. A few years back several researchers argued that the assumption that performance is distributed normally was incorrect; and it got a bit of press. Not so fast, say new researchers, who show that when defined properly, performance is in fact more normally distributed.
For those of you wondering, "why do I care?" Whether we believe performance is normally distributed or not significantly impacts not only the statistical analyses performed on selection mechanisms but theories and practices surrounding HRM.
Moving to the July issue of the Journal of Applied Psychology:
- If you're going to use a cognitively-loaded selection mechanism (which in many cases has some of the highest predictive validity), be prepared to accept high levels of adverse impact. Right? Not to fast, say these researchers, who show that by weighting the subtests, you can increase diversity decisions without sacrifice validity.
- Here's another good one. As you probably know, the personality trait of conscientiousness has shown value in predicting performance in certain occupations. Many believe that conscientiousness may in fact have a curvilinear relationship with performance (meaning after a certain point, more conscientiousness may not help)--but this theory has not been consistently supported. According to these researchers, this may have to do with the assumption that higher scores equal more conscientiousness. In fact, when using an "ideal point" model, results were incredibly consistent in terms of supporting the curvilinear relationship between conscientiousness and performance.
- Range restriction is a common problem in applied selection research, since you only have performance data on a subset of the test-takers, requiring us to draw inferences. A few years back, Hunter, Schmidt, and Le proposed a new correction for range restriction that requires less information. But is it in fact superior? According to this research, the general answer appears to be: yes.
Let's move to the September issue of JAP:
- Within-person variance of performance is an important concept, both conceptually and practically. Historically short-term and long-term performance variance have been treated separately, but these researchers show the advantage of integrating the two together.
- Next, a fascinating study of the choice of (and persistence in) STEM fields as a career, the importance of both interest and ability, and how gender plays an important role. In a nutshell, as I understand it, interest and ability seem to play a more important role in predicting STEM career choices for men than for women, whereas ability is more important in the persistence in STEM careers for women.
Let's take a look at a couple from recent issue of Personnel Review:
- From volume 43(5), these researchers found support for ethics-based hiring decisions resulting in improved work attitudes, include organizational commitment.
- From 43(6), an expanded conceptual model of how hiring supervisors perceive "overqualification", which I would love to see more research on.
Last but not least, for you stats folks, what's new from PARE?
- What happens when you have missing data on multiple variables?
- Equivalence testing: samples matter!
- What sample size is needed when using regression models? Here's one suggestion on how to figure it out.
The December 2014 issue of IJSA should be out relatively soon, so look for a post on that soon!
Subscribe to:
Posts (Atom)