Big research update

It's been a while since I provided a research update, so let's take a look at some recent highlights:

The March 2017 issue of the International Journal of Selection and Assessment (IJSA) (free right now!):

•  Some support for individual psychological assessment in a sample of middle- and senior-level civil service managers in the UK
• Concerns about personality measures that are non-contextualized (i.e., not tailored to the job)
• A study of the personality traits of high potentials (conscientiousness came out #1)
• Support for the equivalence of GMA tests on multiple devices, including mobile

The June IJSA:

• A fascinating twin study that found support for a strong relationship between counterproductive work behaviors in personal life and work.
• Applicants higher in conscientiousness and emotional stability may be more likely to re-test and improve their GMA scores
• A study of undergrads suggesting that Big 5 score results from internet-based tests and in-person tests are equivalent
• You may be able to decrease the number of candidates that withdraw from selection by engaging them more fully and ensuring your processes are fair
• Other-reports of personality appear to be fakable, but less so than self-reports

Vol 2(1) of Personnel Assessment and Decisions:

• Trusting, intelligent raters may be more able to pick up on impression management during interviews
• A study using the limited data available suggests applicants prefer in-person over technology-mediated interviews; interview ratings were also lower. Beware varying interview mode across applicants!
• A study of unproctored internet cognitive ability tests suggests cheating is common, and the researchers strongly suggest implementing technological precautions
• Hiring managers may resist standardized testing in part because they feel it reduces their usefulness/impact
• Free personality test items that can be used and mapped to the PPRF, a personality-based job analysis tool

April Psychological Bulletin:

• A meta-analysis showing that reaction time measures can be useful in detecting deception, but are themselves susceptible to counter-measures

March Journal of Applied Psychology:

•  A review of 100 years of selection and recruitment research in this journal

May Journal of Applied Psychology:

• A study of a large group of applicants suggests that recruiting candidates earlier (e.g., high school), and with more diagnostic methods, can influence their investment in their career and make them better candidates
• Using several computer simulations, researchers found that incumbent-based estimates of range restriction may be downwardly biasing criterion-related validity values, and can produce evidence of differential validity were none exists

March Journal of Organizational Behavior:

• The Big 5 factors of neuroticism, conscientiousness, and agreeableness may prevent supervisors from turning frustration into abusive supervision

May Journal of Organizational Behavior:

• Big age differences between subordinates and supervisors can negatively impact firm performance—if they're discussed

June Journal of Business and Psychology:

• Is the KSAO of communicating via computer just another version of face-to-face communication? According to this study, they are distinct.
• Do millennials have a worse work ethic than older employees? It appears not based on this meta-analysis

That's it for now!

Mega research update

I hope you like research, because there's a lot of it coming your way...and many are free as of this posting!

Without further ado...


Let's start with the Journal of Applied Psychology, January 2015 issue:

- We see a lot of research involving large candidate groups, but much less for individuals.  In this meta-analysis of individual assessments, the authors found support for their usefulness, but it varied significantly across studies.  Highest validity was found for managerial jobs and assessments that included a cognitive ability test.

- Being in the wrong job can be frustrating for both the employee and the employers.  In this study, the authors show a relationship between poor vocational fit and counterproductive work behaviors (CWBs).

- Speaking of CWB, there may be more of them going on than you would think based on the assessment literature...

- And even more on CWB!  These authors found support for both self- and acquaintance-reported personality ratings, specifically conscientiousness and agreeableness, in predicting "workplace deviance".

- Unfortunately, gender bias still exists in selection.  In this meta-analysis, the authors found this to be particularly the case in male-dominated jobs.  On a positive note, they do suggest ways of mitigating this: provide clear evidence of the competence of applicants, encourage careful decision making, and use experienced raters.

- The over-/under-prediction of cognitive ability tests debate for different ethnic groups continues.  In this study, the authors find support of overprediction for African Americans, suggesting the tests are not predictively biased.



Next, the March issue of J.A.P.:

- More support for the predictive validity of emotional intelligence, but more importantly, how the concept overlaps with other constructs such as the Big 5 and self-efficacy.

- All situational judgment tests (SJTs) are not equal, and according to these authors in a large number of instances the context that is presumably important?  Not so much.

- Speaking of SJTs, these researchers suggest that putting the "situational" back in SJTs--i.e., assessing how the situation is analyzed rather than the response options--is a useful method.

- A fascinating update of effect size benchmarks that can be used for a variety of purposes.

- Trying to predict safety-related behavior?  This research suggests that personality traits, particularly agreeableness, can usefully predict this behavior.


Moving on to the March issue of IJSA (free right now!):

- Some guidelines on preparing norms for personality inventories.

- Evidence that different cultures have different procedural justice perceptions of different selection mechanisms

- Some important findings on the equivalence and stability of job performance ratings over time

- Development of a new measure of subjective career success

- More evidence that both technical knowledge and prosocial knowledge are important factors in predicting medical student clinical performance

- This study found that CWBs are under-reported and organizational commitment increases the likelihood that peers will report them

- Evidence that forced-choice and Likert-type scales used in personality inventories have similar measurement properties


On to the Spring issue of Personnel Psych (also free right now!):

- This meta-analysis on narcissism showed that it is related to leadership emergence (through extraversion) and leadership effectiveness in a curvilinear fashion.

- More evidence of the importance of political skill--particularly the aspects of networking ability, interpersonal influence, and apparent sincerity--in predicting a range of important outcomes, including task performance beyond GMA and the Big 5.  It would be interesting to see how this is related to emotional intelligence (yes this is a foreshadowing).


Turning to the March issue of Psych Bulletin:

- More on narcissism: this time, researchers found that men consistently report higher levels of narcissism compared to women, which is interesting when taken in combination with the study above.


In the December issue of Industrial and Organizational Psychology:

- The first focal article calls out researchers for using incorrect assumptions about criterion reliabilities, thus impacting criterion validity values.  They make suggestions for how to improve meta-analyses moving forward.

- The second makes the important argument that utility analyses should consider measures of well-being when determining the effectiveness of interventions (such as an employment test).


Finally, in the January issue of JOB (also free right now):

- a proposal for improving the calculation and reporting of Cronbach's alpha

- a fascinating study showing that high conscientiousness may hinder performance during stressful situations

- in support of EI, this study found a link between emotion recognition ability and income (interestingly through political skill and interpersonal facilitation...remember the earlier study on political skill?).


That's all for now!

2014 Research of the Year (+ research update)

Happy New Year!  As I've done in previous years, I present below the research articles I ran across in this area that I think were the most impactful and/or important of 2014.  But first, let's catch up on two issues:

First, the Winter issue of Personnel Psychology:

- Situational judgment tests have been shown to be useful for measuring interpersonal skills, but beware: levels of "angry hostility" moderate that relationship.  (Is there a happy hostility?)

- When hiring leaders, should you look for those that have a busy home life, or be wary of them?  In this fascinating study, the authors found that leader family-to-work conflict negatively impacts followers in that it can increase their burnout. However, family-to-work enrichment increased follower engagement through leader engagement.  So the answer is, as usual, not simple: home/family life can be a good thing for followers if it makes the leader more engaged; but if the home/family life is increasing burnout, the leader may pass that along to others.  So it would seem it all depends on how the individual is handling their life outside of work!

Let's look at the November issue of the Journal of Applied Psychology:

- Are men or women perceived as better leaders?  According to this meta-analysis, it depends on how you ask the question.  If you limit the question to other-ratings, women are rated significantly higher.  But if you look at self-ratings, men rate themselves significantly higher.  Which leads to the next question: is it a biological perception or a gender perception, and if the latter, what traits are the most important?

- An intriguing study of how applicant confidence interacts with and can be altered by the recruitment experience, in this case among recruits for the U.S. military.

- Next, a study of employment and job search efficacy.  Not surprisingly, within-person frequency of job search behavior correlated with job offers; interestingly, the relationship between perceived job search progress and efficacy beliefs were moderated by beliefs of internal attribution.

- Last but not least, more evidence of the importance of defining the criteria when predicting job performance.  In this meta-analysis, the researchers found more support for personality traits out-predicting cognitive ability in predicting counterproductive work behavior, that the two predictors are approximately equal in predicting organizational citizenship behaviors, and that cognitive ability outperforms personality when predicting task and overall performance.  So do you want high task performance, OCBs, or do you want to avoid CWB?  :)  (of course the situation is even more complicated depending on whether you're looking at individual, team, leader performance, over what period of time, etc.)


Okay, on to the awards!  Without further ado, here are my nominations for Research of the Year for 2014:

1) Important advancements in our understanding of weight-based discrimination at work: Vanhove & Gordon.

2) A study of applicants posting faux pas on their social networking sites: Roulin.

3) Two important looks at assessments delivered remotely via mobile devices: Arthur, Doverspike, Munoz, Taylor, & Carr, and Morelli, Mahan, & Illingworth.

4) Two fascinating looks at personality at work: Judge, Simon, Hurst, & Kelley; and Wille & De Fruyt

5) An excellent study of how effective staffing and training practices impact firm-level flexibility and adaptability: Kim & Ployhart.

6) An important study of the movement of impactful I/O researchers to business schools: Aguinis, Bradley, & Brodersen.

7) The relationship between conscientiousness and job performance is more accurately described as curvilinear: Carter, Dalal, Boyce, O'Connell, Kung & Delgado

Finally, honorable mention to two great developments in 2014:  the change of some publishers to making access to articles more affordable, and the announcement of an additional journal, the Journal of Personnel Assessment and Decisions.


I'm continually amazed at the quality of thought and research in our area and the passion and practicality you exhibit.  Here's to an amazing 2014 and more in 2015!

Just kidding...more research update!

Seriously?  Just yesterday I did my research update, ending with a note that the December 2014 issue of the International Journal of Selection and Assessment should be out soon.

Guess what?  It came out today.

So that means--you guessed it--another research update!  :)

- First, a test of Spearman's hypothesis, which states that the magnitude of White-Black mean differences on tests of cognitive ability vary with the test's g loading.  Using a large sample of GATB test-takers, these authors found support for Spearman's hypothesis, and that reducing g saturation lowered validity and increased prediction errors.

So does that mean practitioners have to choose between high-validity tests of ability or increasing the diversity of their candidate pool?  Not so fast.  Remember...there are other options.

- Next, international (Croatian) support for the Conditional Reasoning Test of Aggression, which can be used to predict counterproductive work behaviors.  I can see this increasingly being something employers are interested in.

- Applicants that do well on tests have favorable impressions of them, while those that do poorly don't like them.  Right?  Not necessarily.  These researchers found that above and beyond how people actually did on a test, certain individual differences predict applicant reactions, and suggest these be taken into account when designing assessments.

- Although personality testing continues to be one of the most popular topics, concerns remain about applicants "faking" their responses (i.e., trying to game the test by responding inaccurately but hopefully increase the chances of obtaining the job).  This study investigates the use of blatant extreme responding, consistently selecting the highest or lowest response option, to detect faking, and looked at how this behavior correlated with cognitive ability, other measures of faking, and demographic factors (level of job, race, and gender).

- Next, a study of assessment center practices in Indonesia.

- Do individuals high in neuroticism have higher or lower job performance?  Many would guess lower performance, but according to this research, the impact of neuroticism on job performance is moderated by job characteristics.  This supports the more nuanced view that the relationship between personality traits and performance is in many cases non-linear and depends on how performance is conceptualized.

- ...which leads oh so nicely into the next article!  In it, the authors studied air traffic controllers and found results consistent with previous studies--ability primarily predicted task performance while personality better predicted citizenship behavior.  Which raises an interesting question: which version of "performance" are you interested in?  My guess is for many employers the answer is both--which suggests of course using multiple methods when assessing candidates.

- Last but not least, an important study of using cognitive ability and personality to predict job performance in a three studies of Chilean organizations.  Results were consistent with studies conducted elsewhere, namely ability and personality significantly predicted performance.

Okay, I think that's it for now!

Research update

I can't believe it's been three months since a research update.  I was waiting until I got critical mass, and with the release of the September issues of IJSA, I think I've hit it.

So let's start there:

- Experimenting with using different rating scales on SJTs (with "best and worst" response format doing the best of the traditional scales)

- Aspects of a semi-structured interview added incremental validity over cognitive ability in predicting training performance

- Studying the use of preselection methods (e.g., work experience) prior to assessment centers in German companies

- The proposed general factor of personality may be useful in selection contexts (this one was a military setting)

- Evidence that effective leaders show creativity and political skill

- Investigating the relationship (using survey data) between personality facets and CWBs (with emotional stability playing a key role)

- Corrections for indirect range restriction boosted the upper end of structured interview validity substantially

- A method of increasing the precision of simulations that analyze group mean differences and adverse impact

- A very useful study that looked at the prediction of voluntary turnover as well as performance using biodata and other applicant information, including recruitment source, among a sample of call center applicants.  Reuslts?  Individuals who had previously applied, chose to submit additional information, were employed, or were referrals had significantly less voluntary turnover.



Moving on...let's check out the May issue of JAP; there are only two articles but both worth looking at:

- First, a fascinating study of the firm-level impact of effective staffing and training, suggesting that the former allow organizations greater flexibility and adaptability (e.g., to changing financial conditions).

- Second, another study of SJT response formats.  The researchers found, using a very large sample, the "rate" format (e.g., "rate each of the following options in terms of effectiveness") to be superior in terms of validity, reliability, and group differences.


Next, the July issue of JOB, which is devoted to leadership:

- You might want to check out this overview/critique of the various leadership theories.

- This study suggests that newer models proposing morality as an important component of leadership success have methodological flaws.

- Last, a study of why Whites oppose affirmative action programs

Let's move to the September issue of Industrial and Organizational Psychology:

- The first focal article discusses the increasing movement of I/O psychology to business schools.  The authors found evidence that this is due in large part to some of the most active and influential I/O researchers moving to business schools.

- The second is about stereotype threat--specifically its importance as a psychological construct and the paucity of applied research about it.


Coming into the home stretch, the Summer issue of Personnel Psych:

- The distribution of individual performance may not be normal if, as these researchers suggest, "star performers" have emerged

- Executives with high levels of conscientiousness and who display transformational leadership behavior may directly contribute to organizational performance

Rounding out my review, check out a few recent articles from PARE:

- I'm not even gonna attempt to summarize this, so here's the title: Multiple-Group confirmatory factor analysis in R – A tutorial in measurement invariance with continuous and ordinal indicators

- Improving exploratory factor analysis for ordinal data

- Improving multidimensional adaptive testing


Last but not least, it's not related to recruitment or assessment, but check out this study that found productivity increases during bad weather :)

That's all folks!

Research update: September, 2013

Okay, it's mega research update time!

First off, the September IJSA; lots of good stuff, including:

- a constructed response multimedia test for entry-level police resulted in minor ethnic group differences

- panel interviews once again prove their superiority (also: more on interview reliability)

- further analysis of the Hogan Personality Inventory with a Spanish sample

- how to applicants form impressions of person-organization fit?  This study suggests contextual factors may be more important than interview content

- circumplex traits (combinations of personality factors) may predict counterproductive work behaviors better than simple FFM scores

- speaking of CWBs, conditional reasoning tests may not be the best predictor of them

- last but not least, what looks to be a good overview of competency modeling


Next up, the September JAP:

- an interesting, large study of the impact of candidate reactions on test scores, organizational perception, and criterion-related validity

- a study of the dynamics of the job search process and the impact of efficacy and focus

- highlighting certain factors during an interview may reduce discrimination toward pregnant applicants


Next, the Autumn 2013 Personnel Psychology:

- first, an important study of self-efficacy that suggests it is a product of past performance and not necessarily a predictor of future performance (free right now!)

- second, a study indirectly on selection that suggests that age diversity in work groups leads to more emotion regulation


Let's move on to the September JASP:

- okay, this may be a bit of a stretch, but if you're considering interviewing for a position as a dentist or a lawyer, make sure you suit up

- knowledge of service encounters predicts service effectiveness (and is related to conscientiousness)

- can use of biodata instruments result in adverse impact?  This study suggests so, but also suggests that removal of problematic items has no impact on validity


Starting to wrap up, let's move to the October JOB:

- perceptions of the fairness of promotion practices is one of those "bubbling beneath the surface" issues in most organizations.  This study found that perceptions are impacted by having been promoted in the past, organizational commitment, and ego defensiveness.  Good stuff.

- do more creative sales agents produce higher sales?  Perhaps only when there is a high quality of leader-member exchange.

- is validity generalization overgeneralized? (say that five times fast)  These folks seem to think so.


In the home stretch, from the September Psychological Science:

- older employees may have lower average cognitive performance, but it's more consistent

- spatial ability has a valuable role to play in the development of creativity, and can predict things like patents and publications


Second to last, for you stats geeks out there, a study that suggests that t-tests can be used reliably with small samples, thank you very much


Finally, something that has nothing to do with selection but is a nominee for the 2013 HR Tests Coolest Study Award, and something we all are very familiar with: time bandits (no, not the movie).

Research update

Okay, I'm just gonna say it.  There is an insane amount of research out there directly or indirectly related to our field.  I'll be honest, it's a little daunting thinking about reading and processing all of it.

Luckily, you have me to overly simplify it for you so you can incorrectly describe it to others.  So let's jump right in!

First up, the June issue of IJSA:

-  Fairness perceptions matter in web-based selection too!

-  The predictive validity of conscientiousness is moderated by self-enhancement

-  Speaking of conscientiousness, it's a better predictor of performance in routinized jobs than those with complex cognitive requirements

-  Psychological hardiness predicts adaptability in military leaders.  This study is awesome also for showing a negative relationship between SAT scores and West Point performance.

-  Recruiters, listen up: this study found that contingent workers converted to full-time status performed as well as referral and online hires, but not as well as those sourced internally (bookmark this one, there's a dearth of recruitment research)

- Scoring biodata: empirical keying reigns supreme over rational and quasi-rational approaches.  Quasi-rational?  Sounds like me most of the time.

- Personality and job performance: interactions are important beyond main effects


Okay, next, the May issue of JAP:

- Adaptive decision making in military leaders: both the brain and the mind are important (okay you monists out there, chill out)

- Are you a MANOVA (wo)man?  Then read this.

- Proactive leaders set more challenging goals and have higher sales performance--assuming they have the trust of their subordinates.


Next, the April issue of JOB.  Just one study, albeit interesting, in which female evaluators were less likely to recommend hiring or promoting Asian (versus White) applicants into jobs requiring social skills


Speaking of JOB, how about the May issue?

- Have you been calling for more research on calling?  Your wish is granted.

- Curious about the concept of curiosity? (okay, I'll stop)  Looks like it can be predictive of job performance above and beyond traditional cognitive and non-cognitive predictors.  I'm gonna assume it varies with job, but I think the authors are probably right that it will increase in importance over time.

- When selecting for teams that may experience crisis situations (e.g., nuclear power plant crews), consider homogeneity--not mean levels--of positive affect.

- Moderate levels of supervisory structure combined with high levels of consideration lead to lowest levels of CWB's

- The dark side of OCBs

- The light side of OCBs

- Dark side and light side working together in a picture that has nothing to do with selection


Okay, onwards and upwards: one from the April issue of JASP, on generalized self-efficacy, work-related self-efficacy, and job-related outcomes


And one from the May issue:  Sensation seeking and need for structure predict military field exercise performance


How about a little EI research?  Haven't had a lot of that lately.  Here's a piece from the May issue of Journal of Management that found emotion management ability to be a valid predictor of job performance.


Let's look in the May Psychological Science:

- Where we find a fascinating study that demonstrates assessment of profound cognitive abilities at a young age predicts outstanding contributions in many adults

- Another interesting study of how an individual responds to daily stressors (which I would posit are differentially found in various jobs) has long-term consequences for their mental health

- High schoolers with high math and verbal skills are less likely to choose STEM careers than those with math skills but moderate verbal skills

- Okay, check this one out: mindfulness training improved GRE reading comp scores as well as working memory.  Implications for personnel assessment??


Shifting to the May Psychological Bulletin:

- Rorschach, anyone?

- Believing that individuals are malleable, rather than fixed ("implicit theory") predicts goal achievement.  Implications for leaders?


Last but not least, let's hook up with our friends at PARE and see what they're up to:

- Into Excel?  Check out this article on forest plots

- Or maybe factor analysis is your thing.


That's all folks!  Hope your brain is spinning like mine!

May mega research update

It's time once again for the monthly research round-up.  So let's dive right in:

The June International Journal of Selection and Assessment doesn't disappoint; let's take a look:

- More evidence of the link between personality variables and CWBs; this time with concurrent data in China

- Dovetailing nicely with a post I've been working on regarding promotional testing, this research indicates some interesting characteristics of internal test takers

- Why are supervisors open to behavioral interviews but shun discussion of "structure"?  Looks like how we communicate about them plays a big role.

- More research on self-efficacy, this time teasing apart the concept a bit.

- Always a popular topic: applicant reactions to selection mechanisms.  This time with a sample from Saudi Arabia.

- Speaking of applicant reactions...how about another study?  This one comparing U.S. and Vietnamese college students.  By the way, not surprisingly work samples came out a winner in both of these studies.

- Next, a fascinating study of a hidden bonus to UIT: despite the cheating element, it likely increases your candidate pool and eventually performance outcomes

- Speaking of response distortion, here's another study, this time of military cadet selection using personality inventories

- Okay, one more on inflation.  This time a study of Chinese applicants--no difference compared to American samples.

- Back in March I wrote about a study Jeremy Bernerth published in J.A.P.  that got a lot of attention.  This time, Bernerth studied ethnic differences and found minority status was negatively related to credit scores.


Moving on to the summer issue of Personnel Psychology:

-  The "file drawer problem" is the theory that nonsignificant results are less likely to get published.  According to this study, that appears unlikely.  But IMHO looking at all correlations is different than looking at the correlations key to one's hypothesis(es)...

- Back to faking (that may be this post's theme!), can response elaboration reduce faking on biodata items?  This study suggests so.  Although I'm left wondering...what was the impact on validity?

- Speaking of biodata, there are various ways of keying these items.  This research suggests the best method depends on your sample size, although rational keying performed the worst.


How about the May issue of Journal of Applied Psychology?

-  Well this is interesting...Chad Van Iddekinge and his colleagues have provided an updated meta-analysis on the criterion-related validity of integrity tests.  What did they find? Well, the results appear to be less promising than those published previously (e.g., corrected r=.18 for job performance).  Much like SIOP's research journal, this time J.A.P. published several commentaries in response to the study that...well, let's just say a debate ensued about the analysis...

- The Dark Triad.  It sounds like something in a Dan Brown novel.  But in this meta-analysis the authors show that personality characteristics that make up this triad (Machiavellianism, narcissism, and psychopathy) explain some variance in CWBs.

- Why are some people more proactive in seeking career goals than others?  It's an important and under-researched question.  In this study the authors show that part of the explanation lies in "future work selves", or how people's hopes and aspirations as they relate to work.

- Think self-reports of CWBs are biased?  Perhaps not, according to this new study.

- Interested in what causes proactive customer service behavior?  According to this multi-national study, self-efficacy is a key (along with service climate).

- Why do some leaders engage in more self-interested behavior than others?  Perhaps not surprisingly, it appears due in part to the strength of their moral identity.


The May issue of the Journal of Applied Social Psychology has a couple gems...

- Hey, look, turns out being sensitive to your subordinates pays off.  Talk about a lesson that needs frequent repeating...

- And that's it.  Oh, wait, just this little study about using Facebook profiles to predict job performance...that I wrote about before....available in FULL right now...


Okay, getting to the end...The May/June issue of HRM:

- An interesting study of adverse impact in promotion decisions for managers in a Fortune 500 retailer.  The authors compared three methods (top-down assessment, assessment centers, and  multisource appraisal) and the results demonstrate how complex these analyses are!

- Speaking of complex.  Think that successful job postings on the web is just fancy graphics?  Think again--it still involves some classic factors like the labor market, firm reputation, and compensation incentives.  The more things change...

- Identifying future leaders.  There are few other issues that are as important for most organizations.  Yet how exactly to do it eludes many.  These authors propose a model that focuses on four main features: analytical ability, learning agility, drive, and emergent leadership.


Finally, a few from PARE:

- Does item order impact response anxiety?  Not according to this study.

- What's that?  How do we use a new jacknife procedure to eliminating items and improve structural equation modeling?  You're in luck.

- Looks like a lot of research rely on beta weights when interpreting and reporting multiple linear regression results.  But there's so much more...


Happy reading!

April research update

Okay, so I didn't quite hit my March update...date. But I'm awful close, so without further ado let's take a look at what research has come out lately. And boy is there a lot to cover...

First, the Spring Personnel Psychology, which it should be noted is all free at the time of this writing (!):

- Moore, et al. describe the development and test of a measure of "an individual's propensity to morally disengage", which is really (as the title suggests) about investigating why people do bad things at work. Looks like it has promise beyond existing measures that predict things like CWBs.

- Next, O'Boyle and Aguinis present the results of a fascinating study of the distribution of human performance. Turns out it may not be normal after all, but rather Paretian. This has big implications for...well, all sorts of things, including selection. Read here for more.

- Avery, et al. describe results of a study of racioethnic matching (employees and customers) and the impact on productivity (which turned out to be positive, through customer satisfaction). The authors present several very practical ways of interpreting this finding without jumping to hiring based on race.


Next, the March Journal of Applied Psychology:

- First, van Hooft and Born with a fascinating study of eye-tracking to investigating faking on personality and integrity measures. Looks like eye movement differs depending on the intent to inflate, and it also suggests response time could be an indicator of inflation.

- Next, Madera and Hebl with another eye-tracking study, but this time on the impact that facial stigmatization has on interview performance. Discouragingly (but perhaps not surprising), the results suggest individuals with facial stigmatization may receive lower ratings, in part due to the interviewer being distracted.

- Into core self-evaluations? You might want to read this study by Wu and Griffin, in which they argue that CSEs are predictors of, but also influenced by, contextual factors such as job satisfaction.

- Lievens and Sackett provide evidence that individuals' procedural knowledge of interpersonal behavior may be valuable in predicting performance (in this case, medical students).

- Bernerth and colleagues discuss the usefulness of credit scores in predicting job performance, which I wrote about in an earlier blog post.



Next up, the May Journal of Organizational Behavior:

- Peng, et al. suggest that deployed soldiers with higher levels of conscientiousness and lower levels of neuroticism may be able to better cope with psychological distress (the effect of extraversion was mixed).

- Derous, et al. discuss discrimination in resume screening among individuals who belong to multiple minority groups (in this case with a focus on Arab women). Applicant, job, and recruiter characteristics were all important.



The March Industrial and Organizational Psychology has a fascinating focal article on how I/O psychology and HR can contribute to organizational strategy and competitive advantage. Several commentaries follow, at least one of which directly addresses selection. Move quick, because right now both the focal article and the commentaries are free!


Now here are some miscellaneous articles you may be interested in:

- Jackson, et al. describe a study that suggests going through military training may alter someone's personality...

- Using a 1- or 2-item measure of personality traits, thinking you don't need more than that? Think again.

- Looking for creative thinkers? Gino and Ariely provide evidence that may give you pause: those that are the most creative may be more dishonest...(!)

- Hiring people into a particularly political environment (naw, none of us ever have that)? Chang, et al. present results that suggest you may want to pay attention to their self-monitoring skill and level of conscientiousness...but maybe not in the way you think.

- Still getting over St. Patrick's Day? Then check out van den Born and van Witteloostuijn's research on "shamrock" organizations. They suggest this type of organization may explain the conflicting findings on modern job tenure.


Finally, all the presentations from the 2011 IPAC conference that were previously available only to members have been made public. There is so much good stuff here I can't even begin to summarize it. Just go check it out.

January 2012 research update

Okay, we've got a lot of ground to cover so let's jump right in...

- For you stats fans: Estimating ordinal reliability for Likert-type and ordinal response data

- And more: Effect size: Don't just report it, describe it

- And still more: A confidence interval approach to testing comparability of groups

- Shifting gears: CWBs: There's more than one type

- Femininity and military leadership

- Increasing HR's strategic participation

- HR practices do have an influence on organizational attractiveness

- IQ scores may be influenced by test motivation (in low-stakes settings)

- Learning agility is an important factor in identifying high-potentials

- Slicing and dicing the Big Five

- Extraversion, intelligence, and genetics

- Apparently being agreeable won't make you rich (especially if you're a man)

- Need scientists or engineers? Consider innovativeness and internal LOC

- What if you're looking for leaders of scientists or engineers? Consider three important criteria.

- Increase diversity cues to increase recruitment website stickiness

- Does transformational leadership relate to proactive behavior? Depends on the situation.

- Core self evaluations: More complicated than you might think

- No, seriously, it's much more complicated and involves general versus specific measures

- Speaking of complicated, the relationship between personality traits (Big 5) and performance isn't as simple as many make it out to be

That's all for now! See you in February.

August Research update

Okay, past time for a research update.

- The September issue of IJSA has several articles on job discrimination, including pieces by Anderson, Anseel, and Patterson & Zibarras. Looks like the focus is not only on actual job discrimination but perceived job discrimination.

- Krause, et al. describe assessment center practices in South Africa

- Ree and Carretta get serious about incremental validity versus unique prediction

- What do you need to be a top notch recruiter? Well if your measure of job performance is revenue, don't dismiss emotional intelligence, according to Downey, et al.

- Chen, et al. help us understand how applicant personality interacts with impression management tactics to influence interviewer perceptions

- What type of student succeeds at a campus recruitment drive? Gokuladas studied nearly 600 engineering graduates in South India and found that success correlated with engineering GPA and English proficiency. Interestingly female graduates outperformed their male counterparts for jobs in the software services industry.

- Trying to predict counterproductive work behaviors? Bowling et al. suggest that the interaction between conscientiousness, agreeableness, and neuroticism is important and complex.

- One of the focal articles in the September 2011 Industrial and Organizational Psychology is all about individual psychological assessment--something I don't write about very often. Silzer and Jeanneret focus on executive assessment but cover a lot of ground on the broader topic, including why IPA has its critics and how we can advance the science. It is, as with all the focal articles, followed by several commentaries.

- Son Hing, et al. present a fascinating study of meritocracy and how it differs from other hierarchy-legitimizing ideologies

- Stats fans: Bonett and Wright present a method for obtaining the proper sample size for obtaining a certain confidence interval when conducting multiple regression.

- van Vianen, et al. describe a study that contributes to our understanding of the important of person-organization and person-supervisor fit

Sorry there haven't been more updates lately. New baby + potential layoffs at work = little time for blogging!

July 2010 J.A.P.

A new round of journals is out, so let's start with the June issue of the Journal of Applied Psychology.

First up, Schleicher et al. looked at whether there were demographic differences in how much candidate scores improved upon retesting. Turns out there were several. Whites showed larger improvements than Blacks or Hispanics on several assessments, particularly on written tests. Women and applicants under 40 showed greater improvements than men and applicants 40+. Implications? In some situations allowing applicants to retest may exacerbate adverse impact.

Next, an important piece by Aguinis et al. (that you can read here) about test bias. This follows on the heels of the June IOP articles on the same topic and seems to represent a resurgence of interest in a topic that seemed dormant. In this article the authors report the results of a very large Monte Carlo simulation (billions and billions of data points) where they found that if bias is measured using slope-based techniques, it's likely to go undetected, and intercept-based bias favoring minority group members is likely to be found when in fact it does not exist. This study, combined with points made in the IOP article suggest that some of the "established" conclusions regarding test bias may not be as solid as we thought.

Third, for those of you interested in differential functioning (of items or scales), you should check out the piece by Adam Meade where he presents a taxonomy of potential differential functioning effect sizes and also describes a software program created for computing the indices and graphing differential functioning.

Next, a piece by Wang et al. on locus of control. Importantly, they found that when locus of control (LOC) is specific to work-related issues, there are stronger correlations between LOC and work-related criteria such as job satisfaction and commitment. Similarly, when LOC is defined more broadly to include non-work issues, there are some stronger correlations with non-work criteria such as life satisfaction. Implications? Much like research on personality items, specifying a work-related context would seem to increase the predictive power of LOC measures.

Last but not least, an important article on counterproductive work behavior (CWB) and organizational citizenship behavior (OCB) by Spector, et al. CWB and OCB seem like they should be opposites of each other--one demonstrated by disengaged, unhappy workers, the other by engaged, happy ones--right? Not so fast. The authors report the results of an experiment that suggest that the concepts are unrelated and do not necessarily have opposite relationships with other variables. The authors also recommend that when measuring these behaviors, frequency of performance be used rather than level of agreement.

Summer '09 Personnel Psychology

The Summer 2009 issue of Personnel Psychology covers a lot of ground. Take a look:

Kuncel & Tellegen demonstrate (with undergrads) that when inflating on personality inventories, people don't always max out their self-presentation; in fact for some traits a moderate level of endorsement is seen as more desirable.

Bledow & Frese describe how a situational judgment test can be used to predict not only overall job performance, but a particular construct--in this case, initiative. Participants were employees and supervisors at six banks in Germany.

This one particularly caught my eye. Yang & Diefendorff discovered (using ~200 employees in Hong Kong), among other things, that agreeableness and conscientiousness seem to moderate the relationship between negative emotions and counterproductive work behaviors (CWBs). Implication? If you're hiring for a job prone to negative emotions (e.g., customer service), consider adding a personality inventory to your screeening process to prevent CWBs.

De Pater, et al. studied both students and employees to determine that challenging job experiences reported by participants predicted promotability ratings above and beyond current job performance and job tenure. This has implications for both career development and performance management.

Want to know more about what executive coaches do? Then check out Bono et al.'s study of similarities and differences between practicing coaches that are also I/O psychologists versus those that aren't. (Turns out they do a lot of the same things)

Last but definitely not least, Aguinis et al. describe a web-based frame of reference training they used to decrease the amount of bias inherent in personality-based job analysis. The article describes in detail how the training was implemented, and it had quite dramatic effects. Useful stuff for anyone looking to add this tool to your assessment procedure (in this case they used Raymark et al.'s personality-related personnel requirements form, which they describe as superior to Hogan & Rybicki's performance improvement characteristics tool (which I've actually used and found quite user friendly).

Is age related to job performance?

Is there a relationship between age and job performance? It's an important question for many reasons, including the fact that claims of age discrimination appear to be on the rise. Ng and Feldman set out to better understand this issue and their meta-analysis is published in the March '08 issue of Journal of Applied Psychology.

Previous research has generally shown a weak relationship between age and job performance--at least when we look at objective measures. But the current authors set out to use a much broader array (10 to be exact) of criterion measures, including workplace aggression, safety performance, and OCBs.

So what did they find? Well, there's where things get a bit complex. Although there did not appear to be a relationship between age and several outcomes, including core task performance, creativity, and performance in training programs, it had stronger relationships with the other seven measures. In addition, age had a curvilinear relationship with core task performance and CWBs, and results varied depending on how the study was conducted.

So does age have a relationship with job performance? Like all important research questions, the answer is an emphatic it depends.


Other articles
There's quite a bit of good research in this volume, including:

- The development of a potentially useful way to predict team member performance

- A fascinating look at how frame-of-reference influences the validity of personality measures (pre-published version here)

- A discussion of the importance of the distinction between constructs (e.g., ability, personality) and methods (e.g., interviews) when comparing predictors in personnel selection

- How to test for adverse impact when your numbers are small (hint: significant testing bad, z-score good)

- Last but not least, a meta-analysis of the relationship direction between attitudes and job performance--what causes what? (hint: attitude matters...but not that much)

September '07 issue of J.A.P.

The September 2007 Journal of Applied Psychology is out and it's got some research we need to look at...

First, Hogan, Barrett, and Hogan present the results of a study of over 5,000 job applicants who took a 5-factor personality test on two separate occasions (6 months apart). Only 5% of applicants improved their score on the second administration, and scores were equally as likely to change in a negative direction as a positive one. The authors suggest that given these results, faking on personality measures is not a significant issue in real-world settings. Comment: This is faking defined as improving your score to match the job, not faking as misrepresenting yourself consistently over time. Also, I can't help but think of the recent article by Morgeson et al. in Personnel Psych where they argued that faking isn't the issue; it's the low validities we should be concerned about.

Next, De Corte, Lievens, and Sackett present a procedure designed to determine predictor composites (i.e., how much each testing method should be "worth") that optimize the trade-off between validity and adverse impact. The procedure is tested with various scenarios with positive results. You can actually download the executable code here and an in-press version of the article is here (thank you, Drs. De Corte and Lievens!).

Speaking of validity, the next article of interest is by Newman, Jacobs, and Bartram, and looks at the relative accuracy of three techniques for estimating validity and adverse impact (local validity studies, meta-analysis, and Bayesian analysis). The authors describe which method is optimal in different conditions, using measures of cognitive ability and conscientiousness as predictors. They even toss in recommendations for how to estimate local parameters.

Next, a fascinating and useful study of counterproductive work behaviors (CWBs; things like theft, sabotage, or assault) by Roberts, Harms, Caspi, and Moffitt that tackles the issue from a developmental perspective. Using data from a 23-year longitudinal study of 930 individuals, the authors found that individuals diagnosed with childhood conduct disorder were more likely to commit CWBs as young adults. On the other hand, criminal convictions occurring at a young age were unrelated to CWBs demonstrated later on. Job conditions and personality traits had their own impact on CWBs, above and beyond background factors. Great stuff, especially for those of you with a particular interest in biodata and/or background checks.

Last but not least, a study of person-organization (P-O) fit by Resick, Baltes, and Shantz. Using data from 299 participants in a 12-week internship program, the authors found that the relationship between P-O fit on the one hand and job satisfaction, job choice, and job offer acceptance on the other depends on the type of fit (needs-supplies vs. demands-abilities) as well as the conscientiousness of the individual. Good food for thought when thinking about P-O fit, a consistently popular concept.

Honorable mention: This meta-analysis by Humphrey, Nahrgang, and Morgeson of 259 studies that investigated work design impacts on worker attitudes and behaviors. Think behavior is determined solely by individual ability and disposition? Ya might want to take a gander at this study; it'll change your tune. A great reminder that satisfaction and performance are the result of both the individual and his/her work environment. Also available here.