tag:blogger.com,1999:blog-337504002024-03-13T14:04:39.058-07:00HR Tests - Recruitment, assessment, and personnel selectionCelebrating 10 years of the science and practice of matching employer needs with individual talent.BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.comBlogger625125tag:blogger.com,1999:blog-33750400.post-50477698484664213922017-05-14T12:50:00.000-07:002017-05-14T12:50:24.024-07:00Big research updateIt's been a while since I provided a research update, so let's take a look at some recent highlights:<br />
<br />
The <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2017.25.issue-1/issuetoc?campaign=woletoc" target="_blank">March 2017 issue of the International Journal of Selection and Assessment</a> (IJSA) (<b>free right now!</b>):<br />
<br />
<ul>
<li> <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12157/abstract" target="_blank">Some support for individual psychological assessment</a> in a sample of middle- and senior-level civil service managers in the UK</li>
<li><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12156/abstract" target="_blank">Concerns about personality measures</a> that are non-contextualized (i.e., not tailored to the job)</li>
<li>A study of the <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12158/abstract" target="_blank">personality traits of high potentials</a> (conscientiousness came out #1)</li>
<li>Support for the <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12160/abstract" target="_blank">equivalence of GMA tests on multiple devices</a>, including mobile</li>
</ul>
The <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2017.25.issue-2/issuetoc" target="_blank">June IJSA</a>:<br />
<br />
<ul>
<li>A fascinating twin study that found support for a <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12164/abstract" target="_blank">strong relationship between counterproductive work behaviors in personal life and work</a>.</li>
<li>Applicants higher in conscientiousness and emotional stability may be more likely to <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12166/abstract" target="_blank">re-test and improve their GMA scores</a></li>
<li>A study of undergrads suggesting that <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12168/abstract" target="_blank">Big 5 score results from internet-based tests and in-person tests</a> are equivalent</li>
<li>You may be able to <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12169/abstract" target="_blank">decrease the number of candidates that withdraw from selection</a> by engaging them more fully and ensuring your processes are fair</li>
<li><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12171/abstract" target="_blank">Other-reports of personality appear to be fakable</a>, but less so than self-reports</li>
</ul>
<br />
<br />
<a href="http://scholarworks.bgsu.edu/pad/vol2/iss1/" target="_blank">Vol 2(1) of Personnel Assessment and Decisions</a>:<br />
<br />
<ul>
<li>Trusting, intelligent raters may be more able to pick up on <a href="http://scholarworks.bgsu.edu/pad/vol2/iss1/1/" target="_blank">impression management during interviews</a></li>
<li>A study using the limited data available suggests <a href="http://scholarworks.bgsu.edu/pad/vol2/iss1/2/" target="_blank">applicants prefer in-person over technology-mediated interviews</a>; interview ratings were also lower. Beware varying interview mode across applicants!</li>
<li>A study of <a href="http://scholarworks.bgsu.edu/pad/vol2/iss1/3/" target="_blank">unproctored internet cognitive ability tests</a> suggests cheating is common, and the researchers strongly suggest implementing technological precautions</li>
<li><a href="http://scholarworks.bgsu.edu/pad/vol2/iss1/4/" target="_blank">Hiring managers may resist standardized testing</a> in part because they feel it reduces their usefulness/impact</li>
<li><a href="http://scholarworks.bgsu.edu/pad/vol2/iss1/5/" target="_blank">Free personality test items that can be used and mapped to the PPRF</a>, a personality-based job analysis tool</li>
</ul>
<br />
<br />
<a href="http://psycnet.apa.org/journals/bul/143/4/" target="_blank">April Psychological Bulletin</a>:<br />
<br />
<ul>
<li>A meta-analysis showing that <a href="http://psycnet.apa.org/journals/bul/143/4/428/" target="_blank">reaction time measures can be useful in detecting deception</a>, but are themselves susceptible to counter-measures</li>
</ul>
<br />
<br />
<a href="http://psycnet.apa.org/journals/apl/102/3/" target="_blank">March Journal of Applied Psychology</a>:<br />
<br />
<ul>
<li> <a href="http://psycnet.apa.org/journals/apl/102/3/291/" target="_blank">A review of 100 years of selection and recruitment research in this journal</a></li>
</ul>
<br />
<br />
<a href="http://psycnet.apa.org/index.cfm?fa=browsePA.volumes&jcode=apl" target="_blank">May Journal of Applied Psychology</a>:<br />
<br />
<ul>
<li>A study of a large group of applicants suggests that <a href="http://psycnet.apa.org/journals/apl/102/5/764/" target="_blank">recruiting candidates earlier (e.g., high school), and with more diagnostic methods, can influence their investment in their career</a> and make them better candidates</li>
<li>Using several computer simulations, researchers found that <a href="http://psycnet.apa.org/journals/apl/102/5/802/" target="_blank">incumbent-based estimates of range restriction may be downwardly biasing criterion-related validity</a> values, and can produce evidence of differential validity were none exists</li>
</ul>
<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1002/job.v38.3/issuetoc" target="_blank">March Journal of Organizational Behavior</a>:<br />
<br />
<ul>
<li>The Big 5 factors of <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.2123/full" target="_blank">neuroticism, conscientiousness, and agreeableness may prevent supervisors from turning frustration into abusive supervision</a></li>
</ul>
<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1002/job.v38.4/issuetoc" target="_blank">May Journal of Organizational Behavior</a>:<br />
<br />
<ul>
<li><a href="http://onlinelibrary.wiley.com/doi/10.1002/job.2129/full" target="_blank">Big age differences between subordinates and supervisors can negatively impact firm performance</a><span style="font-family: "Arial Narrow","sans-serif"; font-size: 11.0pt; line-height: 115%; mso-ansi-language: EN-US; mso-bidi-font-family: "Times New Roman"; mso-bidi-language: AR-SA; mso-bidi-theme-font: minor-bidi; mso-fareast-font-family: Calibri; mso-fareast-language: EN-US; mso-fareast-theme-font: minor-latin;">—</span>if they're discussed</li>
</ul>
<br />
<br />
<a href="https://link.springer.com/journal/10869/32/3/page/1" target="_blank">June Journal of Business and Psychology</a>:<br />
<br />
<ul>
<li>Is the <a href="https://link.springer.com/article/10.1007/s10869-016-9465-6" target="_blank">KSAO of communicating via computer</a> just another version of face-to-face communication? According to this study, they are distinct.</li>
<li><a href="https://link.springer.com/article/10.1007/s10869-016-9466-5" target="_blank">Do millennials have a worse work ethic than older employees?</a> It appears not based on this meta-analysis</li>
</ul>
<br />
That's it for now!BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com3tag:blogger.com,1999:blog-33750400.post-42762623116569156262017-03-29T06:10:00.003-07:002017-05-14T12:51:14.351-07:00Which employment tests work best? An update. <div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhSBfAtAIbSNclRmwoz5IyjikfAAqGkXYHs4em6-hDK1GXUXyVSFTrVeGOtzylCYgiqdGT6Iz8gCbZJaS7HZjcSgxF2NKxgTY_LEH15-5FQ51KOFLM30IkWUmar5AIzlupitAA/s1600/eyeglasses-2003188_640+%25281%2529.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><span style="font-size: large;"><img border="0" height="228" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhSBfAtAIbSNclRmwoz5IyjikfAAqGkXYHs4em6-hDK1GXUXyVSFTrVeGOtzylCYgiqdGT6Iz8gCbZJaS7HZjcSgxF2NKxgTY_LEH15-5FQ51KOFLM30IkWUmar5AIzlupitAA/s320/eyeglasses-2003188_640+%25281%2529.jpg" width="320" /></span></a></div>
<div class="prose" id="content" style="background-color: white; box-sizing: border-box; font-family: georgia, serif; line-height: 1.5; word-wrap: break-word;">
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;">I'm not sure how I missed this one, but three researchers are updating Schmidt & Hunter's famous study of the validity of personnel selection procedures. And unlike much of the research in this area, it's free (<a href="https://www.researchgate.net/publication/309203898_The_Validity_and_Utility_of_Selection_Methods_in_Personnel_Psychology_Practical_and_Theoretical_Implications_of_100_Years_of_Research_Findings" rel="nofollow noopener" style="box-sizing: border-box; color: #008cc9; text-decoration: none;" target="_blank">webpage</a>) (<a href="https://home.ubalt.edu/tmitch/645/articles/2016-100%20Yrs%20Working%20Paper%20for%20Research%20Gate%2010-17.pdf" rel="nofollow noopener" style="box-sizing: border-box; color: #008cc9; text-decoration: none;" target="_blank">PDF</a>)! It's also a working paper, so proceed with caution.</span></div>
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;">Oh, and some of the results as they stand will probably make your head spin.</span></div>
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;">Let's back up. In 1998, Frank Schmidt and John Hunter published "<a href="http://people.tamu.edu/~w-arthur/611/Journals/Schmidt%20%26%20Hunter%20(1998)%20PB.pdf" rel="nofollow noopener" style="box-sizing: border-box; color: #008cc9; text-decoration: none;" target="_blank"><em style="box-sizing: border-box;">The Validity and Utility of Selection Methods in Personnel Psychology: Practical and Theoretical Implications of 85 Years of Research Findings</em></a><em style="box-sizing: border-box;">." </em>Via <a href="https://en.wikipedia.org/wiki/Meta-analysis" rel="nofollow noopener" style="box-sizing: border-box; color: #008cc9; text-decoration: none;" target="_blank"><u style="box-sizing: border-box;">meta-analysis</u></a>, the authors reported the criterion-related validity coefficients of 19 selection methods. What does this mean? Basically, how well each type of employment test predicts job (or training) performance. It's what some consider the "gold standard" of validity because it's based on actual performance, not subject matter expert judgment. (I'll leave that debate for another day)</span></div>
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;">The bottom line is that when they crunched these numbers, there were several "winners", including cognitive ability, work samples, integrity tests, and structured interviews. It still stands as one of the most frequently-cited research articles in the field of industrial/organizational psychology.</span></div>
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;">Since then, there have been statistical advancements that researchers can use to improve the accuracy of their estimates, and of course more primary research has been done, which can be included in meta-analyses.</span></div>
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;">So all that said, what are the updated results (as currently reported)? Here are some highlights, which now include analyses of 31 different types of selection methods:</span></div>
<ol style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin: 2.4rem 0px; padding: 0px 0px 0px 2.4rem;">
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Cognitive ability or "general mental ability" (GMA) still reigns supreme</span>. Casting aside for now that these tests tend to result in adverse impact, the criterion validity coefficient went <em style="box-sizing: border-box;">up</em>.</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Unstructured interviews match structured interviews.</span> "<em style="box-sizing: border-box;">Whaaat?"</em> you say? Take a look, and check the explanation for why this is, statistically. Remember there are other factors in play that should inform your decision about how to structure interviews (e.g., legal defensibility, merit rules).</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Validity of interviews (both types) went up.</span> Bottom line: interviews can work.</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Validity of work samples went down. </span>The authors use the value found in a <a href="https://www.researchgate.net/publication/227526262_A_meta-analysis_of_work_sample_test_validity_Updating_and_integrating_some_classic_literature" rel="nofollow noopener" style="box-sizing: border-box; color: #008cc9; text-decoration: none;" target="_blank">2005 study</a>, and the results may have to do with these tests being used in different sectors than originally envisioned. Whatever the explanation, I scratch my head on this one because I'm a big believer in work sample tests.</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Conscientiousness went down</span>. But the authors remind us that studies using work-specific measures show improved results.</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">The T&E point method still under-performs</span>. Many organizations have become besotted with this training and experience (T&E) approach, which gives candidates points based on how applicants respond to self-reported inventories. They're easy to develop, and easy to automate. And they don't predict performance well compared to the others. Best used as an initial hurdle (if at all).</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Strictly relying on years of experience or years of education doesn't work.</span> Sorta calls the whole resume review thing into question, doesn't it?</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Job knowledge tests still performed quite well</span>. Some things never go out of style, like a well-developed test of concepts applicants must know to do the job.</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">Emotional intelligence measures did a decent job.</span> They're not close to the top, but they're not useless either.</span></li>
<li style="box-sizing: border-box; margin: 1.2rem 0px; padding: 0px;"><span style="font-size: medium;"><span style="box-sizing: border-box; font-weight: 700;">The best results still come from combining tests.</span> The authors are a fan of combining cognitive ability tests with integrity or job knowledge tests, but there are other combinations that work as well, and they out-perform using a single measure.</span></li>
</ol>
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;">So what does all this mean? Well, nothing and everything. <u style="box-sizing: border-box;">Nothing</u>, because how you test for a job should be based on <em style="box-sizing: border-box;">that job</em>. You should never just blindly pick an employment test out of a hat. The choice should be based on what competencies are required for that job, day one, along with other factors such as organizational context and operational considerations.</span></div>
<div style="box-sizing: border-box; color: rgba(0, 0, 0, 0.701961); line-height: 2.4rem; margin-bottom: 2.4rem; margin-top: 2.4rem;">
<span style="font-size: medium;"><u style="box-sizing: border-box;">Everything </u>because the only real way we know whether these things work is to look at the data—and this type of research is about as good as we get. For now. Let's see where we're at a few years from now, when we have more information about emerging forms of measurement, such as simulations and VR. Until then, keep using <em style="box-sizing: border-box;">good</em> tests.</span></div>
</div>
<hr style="background-color: white; box-sizing: border-box; font-family: sans-serif;" width="50%" />
<span style="font-size: large;"><br /></span>
<br />
<br />
<footer class="article-footer" role="contentinfo" style="background-color: white; box-sizing: border-box; font-family: sans-serif; margin: 2.4rem 0px 0px;"><h2 style="box-sizing: border-box; color: rgba(0, 0, 0, 0.54902); font-family: "helvetica neue", helvetica, sans-serif; font-weight: 400; line-height: 1.6rem; margin: 0px 0px 0.8rem;">
<span style="font-size: large;">
Written by</span></h2>
<div class="reader-row" style="box-sizing: border-box;">
<div id="colLeft" style="box-sizing: border-box; float: left;">
<span style="font-size: large;"><br /></span>
<br />
<br />
<figure class="article-author-image reader-item" style="background: rgb(230, 233, 236); border-radius: 50%; box-sizing: border-box; float: left; height: 36px; margin: 0px 0.8rem 0px 0px; overflow: hidden; width: 36px;"><a href="https://www.linkedin.com/in/bryanbaldwin" rel="author" style="box-sizing: border-box; color: #008cc9; text-decoration: none;" title="Bryan Baldwin"><span style="font-size: large;"><img alt="Bryan Baldwin" src="https://media.licdn.com/media/AAEAAQAAAAAAAAjeAAAAJDdiNzUzZDkxLTIyMzYtNGY5Zi1hMjMyLTAxY2ZkZWIzNGNiYw.jpg" style="border: 0px; box-sizing: border-box; display: block; width: 36px;" /></span></a></figure></div>
<div id="colwrap" style="box-sizing: border-box; overflow: hidden;">
<div id="colRight" style="box-sizing: border-box; float: right;">
<div class="reader-item is-a-link" id="article-author-follow" style="box-sizing: border-box;">
<span style="font-size: large;"><span style="font-size: xx-small;"><a href="pulse://follow-author" id="follow-author-link" style="box-sizing: border-box; color: #00a0dc; text-decoration: none;"></a></span><br /></span>
<br />
<div id="follow-status" style="box-sizing: border-box; display: table-cell; font-weight: 600; padding-left: 16px; vertical-align: middle;">
<a href="pulse://follow-author" id="follow-author-link" style="box-sizing: border-box; color: #00a0dc; text-decoration: none;"><span style="font-size: large;">+ Follow</span></a></div>
<a href="pulse://follow-author" id="follow-author-link" style="box-sizing: border-box; color: #00a0dc; text-decoration: none;"><span style="font-size: large;">
</span></a></div>
</div>
<div id="colCenter" style="box-sizing: border-box;">
<div class="reader-item" id="author-text" style="box-sizing: border-box;">
<h3 class="article-author" style="box-sizing: border-box; font-family: "helvetica neue", helvetica, sans-serif; margin: 0px 20px 0px 0px; overflow: hidden; padding-top: 0.2rem; text-overflow: ellipsis; white-space: nowrap;">
<a href="https://www.linkedin.com/in/bryanbaldwin" rel="author" style="box-sizing: border-box; color: black; text-decoration: none;" title="Bryan Baldwin"><span style="font-size: large;">Bryan Baldwin</span></a></h3>
<h3 class="article-author-headline" style="box-sizing: border-box; color: rgba(0, 0, 0, 0.54902); font-family: "helvetica neue", helvetica, sans-serif; font-weight: 400; line-height: 1.6rem; margin: 0px 20px 0px 0px; overflow: hidden; text-overflow: ellipsis; white-space: nowrap;">
<span style="font-size: large;">
Civil Service Improvement Project Oversight, Personnel Management Division at California Department of Human Resources</span></h3>
</div>
</div>
</div>
</div>
</footer>BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-87668451782512805712017-01-07T21:01:00.000-08:002017-01-07T21:01:34.603-08:00Mini research updateWithout further ado, a few research updates:<br />
<br />
<a href="http://psycnet.apa.org/journals/bul/143/1/" target="_blank">January 2017 Psychological Bulletin</a>:<br />
<br />
- Why is there better <a href="http://psycnet.apa.org/journals/bul/143/1/1/" target="_blank">gender balance in some STEM fields</a> than others? Possible reasons these authors cite include masculine cultures, lack of early experience, and lower self-efficacy.<br />
<br />
- There appears to be a <a href="http://psycnet.apa.org/journals/bul/143/1/36/" target="_blank">strong relationship between emotional intelligence and other personality factors</a>, particularly trait EI.<br />
<br />
<br />
<a href="http://psycnet.apa.org/journals/apl/102/1/" target="_blank">January 2017 Journal of Applied Psychology</a>:<br />
<br />
- Sackett & Lievens argue that a <a href="http://psycnet.apa.org/journals/apl/102/1/43/" target="_blank">modular perspective on selection procedures</a> --in other words, breaking selection procedures down into their design components such as response format -- allows for insights beyond a holistic view. Read this quite fascinating article <a href="http://users.ugent.be/~flievens/Modular.pdf" target="_blank">here</a>.<br />
<br />
<br />
Reminder: the Journal of Personnel Assessment and Decisions is <i>free</i>, available <a href="http://scholarworks.bgsu.edu/pad/" target="_blank">here</a>.BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-12042398549856226042016-11-15T09:47:00.000-08:002016-11-15T09:47:17.840-08:00Research updateSeveral research updates this time, including fascinating studies of how computers can assist with interview training, and how a brief writing exercise can lower stereotype threat for women:<br />
<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2016.24.issue-4/issuetoc" target="_blank"><b>International Journal of Selection and Assessment, December, 2016</b></a>:<br />
<br />
- International <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12149/abstract" target="_blank">support for the cultural intelligence scale</a><br />
<br />
- Looking to <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12150/full" target="_blank">improve applicant interview performance?</a> Maybe a computer can help.<br />
<br />
- This study found that <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12151/full" target="_blank">time lag and g-loading are important factors impacting re-testing results</a><br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12153/full" target="_blank">Status-seeking seems to be an important individual difference</a> when looking at self-presentation behaviors, including exaggeration and faking in job search<br />
<br />
- Development and validation of a <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12154/full" target="_blank">360-degree measure of leadership personality</a><br />
<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.2016.69.issue-4/issuetoc" target="_blank"><b>Personnel Psychology, Winter 2016</b></a>:<br />
<br />
- Do CEOs significantly impact firm performance? <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12140/full" target="_blank">This study</a> found evidence that they do.<br />
<br />
- More evidence that <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12141/full" target="_blank">the assumption that performance is normally distributed is questionable</a><br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12122/full#" target="_blank">A more accurate correction for range restriction</a> is presented, and an example analysis indicates the relationship between the Big 5 and job satisfaction may be greater than previously believed<br />
<br />
<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1002/job.v37.8/issuetoc" target="_blank"><b>Journal of Organizational Behavior, November, 2016</b></a> (which includes several articles devoted to the importance of theory in organizational sciences):<br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.2099/full" target="_blank">Are self-focused or other-focused recruiting advertisements more effective?</a> This study suggests it depends not only on cultural differences but individual regulatory focus<br />
<br />
<br />
<br />
<a href="http://psycnet.apa.org/journals/apl/101/10/" target="_blank"><b>Journal of Applied Psychology, October, 2016</b></a>:<br />
<br />
- A suggestion for <a href="http://psycnet.apa.org/journals/apl/101/10/1457/" target="_blank">improving meta-analytic structural equation modeling</a><br />
<br />
<br />
<br />
<a href="http://psycnet.apa.org/journals/apl/101/11/" target="_blank"><b>Journal of Applied Psychology, November, 2016</b></a>:<br />
<br />
- A fascinating study of how <a href="http://psycnet.apa.org/journals/apl/101/11/1585/" target="_blank">having women compose a brief written description of their personal values can help ameliorate stereotype threat</a> in competitive environmentsBryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-21067918748385921282016-09-03T08:50:00.000-07:002016-09-03T09:00:07.347-07:00How to create the ultimate hiring systemUnless your organization is primarily composed of robots (which is <a href="https://hbr.org/2016/06/the-knowledge-jobs-most-likely-to-be-automated" target="_blank">becoming more of a reality for some</a>*), arguably the most important thing you need to get right is hiring. To restate the obvious, without the right people, in the right places, at the right time, your organization hampers its ability to innovate, collaborate, deliver, and fulfill your mission.<br />
<br />
So how do you ensure that your organization <u>consistently</u> makes great hires? Before I get into the steps, let's talk a little bit about culture. None of the steps below will reliably deliver results unless you first get serious about two things: (1) disciplined processes and procedures, and (2) a clear understanding of the roles of HR versus hiring supervisors.<br />
<br />
In order to make great hires time and time again, you have to document your practices and put them in place across the organization. Everyone needs to understand that this is <i>the way things are done here</i>, not simply an initiative. Supervisors <u>and HR</u> need to be trained--and reinforced--for how successful they implement these steps.<br />
<br />
Speaking of these players, both hiring supervisors and HR need to be very clear about what their roles are. Hiring supervisors are expected to know the job they're hiring for and what it takes to succeed in it. HR is expected to have expertise in job analysis, recruiting, assessment, onboarding, and other aspects of talent management. This should be part of their job descriptions, and their performance should be in part based on how successful they are at serving in these roles.<br />
<br />
Okay, with that out of the way, let's talk about the steps your organization needs to have in place to ensure repeatable success in hiring.<br />
<br />
<div class="separator" style="clear: both; text-align: left;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg_VoL5KOQbTSS9VPBkRflwtQZIDTxxH_kj-2zKMcb0MSXm6j6n_KNNZHqBwCym20N-kbBA3_7KkVKyjIZmqFOqt1Uh4SnfeDf0KiWKqBLx1oPWk9BWYmYJ0w3rkNPABNJkHwE/s1600/ear-1355652_960_720.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg_VoL5KOQbTSS9VPBkRflwtQZIDTxxH_kj-2zKMcb0MSXm6j6n_KNNZHqBwCym20N-kbBA3_7KkVKyjIZmqFOqt1Uh4SnfeDf0KiWKqBLx1oPWk9BWYmYJ0w3rkNPABNJkHwE/s320/ear-1355652_960_720.jpg" width="240" /></a></div>
<br />
<b>Step 1: Know your Organizational Reputation.</b> Before you even think about hiring for a specific job, you need to think about the reputation of your organization. Is it a destination employer, or an employer of last resort? What do people say about your workplace? This is important because it drives the pipeline of talent. If you're a destination, the pump is primed and "hard to recruit jobs" becomes less of an issue, making the steps below that much easier. Find out what the word on the street is about your organization--how do your employees feel? Your customers? Prospective applicants?<br />
<br />
<br />
<div class="separator" style="clear: both; text-align: left;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgSlHgKlr9FV50ZsUOBAhL5acULdjq-8LSujiOzk2PZiAOBmzrMqonwkNlQ_ZcpuMVLKQNrTkG7xQYaeI0sXx1e0AUIgpn4pYM4CBng9uYFG-EI6lEt1WQxLOLsTD0S92wKmuI/s1600/microscope-275984_960_720.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="211" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgSlHgKlr9FV50ZsUOBAhL5acULdjq-8LSujiOzk2PZiAOBmzrMqonwkNlQ_ZcpuMVLKQNrTkG7xQYaeI0sXx1e0AUIgpn4pYM4CBng9uYFG-EI6lEt1WQxLOLsTD0S92wKmuI/s320/microscope-275984_960_720.jpg" width="320" /></a></div>
<br />
<b>Step 2. Analyze the job</b>. Yes, many jobs are becoming more fluid, but even narrowing the job to its occupational category helps. Think about the most important tasks the person will perform on a day-to-day basis and what competencies or knowledge, skills, and abilities are required to perform them. Sites like <a href="http://www.onetonline.org/find/" target="_blank">O*NET</a> are a huge resource so you don't reinvent the wheel. Without knowing the job, hiring is a roll of the dice.<br />
<br />
<br />
<div class="separator" style="clear: both; text-align: left;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhFY1otHfXRc83tRxHJw8ZgxnGaYKD95fxqndRfv94lD-50j7Rg8XPJn6DGl4cwgUp4_NhYmDCnYRcXNgymFbC6UfF9xBTUVbBcWPboafMkJNL5a9JjFtRbQULFblqEGzu_LyQ/s1600/insurance-539659_960_720.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="213" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhFY1otHfXRc83tRxHJw8ZgxnGaYKD95fxqndRfv94lD-50j7Rg8XPJn6DGl4cwgUp4_NhYmDCnYRcXNgymFbC6UfF9xBTUVbBcWPboafMkJNL5a9JjFtRbQULFblqEGzu_LyQ/s320/insurance-539659_960_720.jpg" width="320" /></a></div>
<br />
<b>Step 3. Develop a recruitment/assessment strategy</b>. Ya gotta have a plan. It doesn't have to be a 20-page missive, but you need to document what your plan is, otherwise you're unlikely to cover all the bases. Honestly here's where a lot of hiring processes fall apart--people have the best intentions but they forget about certain key steps. Hey, here's an idea: use the same document that you used to document the job in Step 2! The way the key competencies will be linked to how you plan to recruit and assess for each of them.<br />
<br />
<br />
<div class="separator" style="clear: both; text-align: left;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiObbGsmYvxtJLcMEuXnRd7HQGTfyDtXDfZa7URlFk68kTDp7uWyvtkAXzni40etiWHQ59gMojislHajWe6ZlDtfWMfUsq6biMlFzajer0b0XVtf7aG1In7f8uDlgBNw1ozLOs/s1600/colorful-1553246_960_720.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="216" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiObbGsmYvxtJLcMEuXnRd7HQGTfyDtXDfZa7URlFk68kTDp7uWyvtkAXzni40etiWHQ59gMojislHajWe6ZlDtfWMfUsq6biMlFzajer0b0XVtf7aG1In7f8uDlgBNw1ozLOs/s400/colorful-1553246_960_720.jpg" width="400" /></a></div>
<br />
<b>Step 4. Use multiple and creative recruitment strategies</b>. The only time "post and pray" is acceptable (and even then I'd argue against it) is if you've nailed your reputation as described in Step 1. Recruiting is sales, plain and simple--you're selling the job, the organization, and the people. Use the web, but also think about physical interactions, including open houses. Reach out to schools. Develop realistic job previews. Hire recruiters that have a marketing and sales background. Don't be afraid to push the envelope if you need to stand out from the crowd. Honestly, the sky is the limit.<br />
<br />
<br />
<div class="separator" style="clear: both; text-align: left;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjYc6HeRK8oGcOdN8fh1GyDDurYRUGlquCUIf9dM17rQVxrva3ZfqLj_widV2i8SzLS93G2A6kl_7y-zyt2-wLpYmyRBZMMOY0e1y5TZVJHPugeFhMxryj9cjvBlmYUnuBT3Ak/s1600/mobile-phone-1419275_960_720.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="125" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjYc6HeRK8oGcOdN8fh1GyDDurYRUGlquCUIf9dM17rQVxrva3ZfqLj_widV2i8SzLS93G2A6kl_7y-zyt2-wLpYmyRBZMMOY0e1y5TZVJHPugeFhMxryj9cjvBlmYUnuBT3Ak/s400/mobile-phone-1419275_960_720.jpg" width="400" /></a></div>
<br />
<b>Step 5. Use multiple high-quality assessments, internet and mobile whenever possible</b>. In-person interviews aren't going away any time soon (although many of those are migrating online), but they should be only one tool in your belt--not the only tool. Assessment starts with how you recruit, because you allow applicants to self-select in and out. It continues with assessments embedded in the application process, whether that's a statement of qualifications, an online survey, or a set of online skills assessments. And don't forget to make any "minimum qualifications" truly minimum--please don't rely on hard-and-fast "X years of experience" or "Y degree"--those should be suggestions. The important thing isn't the type of assessment, it's that you're using several and they're tied to those important competencies you identified in Step 2. In short, using a single assessment is like buying a house based on what it looks like from the outside.<br />
<br />
<br />
<div class="separator" style="clear: both; text-align: left;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh0mDF5tTH1JfCmeG3J4ctxQqtYChcnF_Pi9FQhsB-VsHw5eKDlZngL-mKKmo3uqLI85Dogb-gMBR6FoWkx-VsP-NGj0UzbB7KFopk5aTF4ZKc3jTVS_Jk_NQh-gZ3zeqCKttQ/s1600/board-1273128_960_720.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="213" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh0mDF5tTH1JfCmeG3J4ctxQqtYChcnF_Pi9FQhsB-VsHw5eKDlZngL-mKKmo3uqLI85Dogb-gMBR6FoWkx-VsP-NGj0UzbB7KFopk5aTF4ZKc3jTVS_Jk_NQh-gZ3zeqCKttQ/s320/board-1273128_960_720.jpg" width="320" /></a></div>
<br />
Step 6: <b>Don't forget about them once you make the offer</b>. Again, this is pretty obvious, but once you've made the offer, don't breath a sigh of relief and get back to your Inbox--your job isn't over yet, not by a long shot. Your new employee needs to feel welcomed to the organization, have the tools they need, understand what the expectations are, and get continual feedback--in other words, feel like they made the right choice and have a successful future with you.<br />
<br />
<br />
Get these simple steps right, make them part of your organizational DNA, and you will ensure that not only do you get hiring right--you'll get performance right.<br />
<br />
* Stay tuned for my signature article of 2018, "How to hire the right robot for the job"<br />
<br />
<b>p.s. this post marks 10 years for my blog! Thanks for reading!</b>BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com1tag:blogger.com,1999:blog-33750400.post-70996331941398609092016-08-21T16:54:00.001-07:002016-08-21T16:54:15.982-07:00Research updateSeveral recent journals to pore through:<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1002/job.v37.5/issuetoc" target="_blank">July 2016 issue of Journal of Organizational Behavior</a><br />
<br />
<a href="http://psycnet.apa.org/journals/apl/101/7/" target="_blank">July 2016 issue of Journal Applied Psychology</a>, including:<br />
<br />
- <a href="http://psycnet.apa.org/journals/apl/101/7/958/" target="_blank">Computer scoring of candidate essays</a><br />
<br />
- <a href="http://psycnet.apa.org/journals/apl/101/7/976/" target="_blank">Everything you've been told about assessment center ratings is confounded</a><br />
<br />
and the biggie...<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2016.24.issue-3/issuetoc" target="_blank">September 2016 issue of International Journal of Selection and Assessment</a>, including:<br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12142/full" target="_blank">Faking on assessment measures</a><br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12145/full" target="_blank">Emotional intelligence and service jobs</a><br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12146/full" target="_blank">A self-report measure of psychopathy in the workplace</a><br />
<br />BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-27989511969243028772016-07-30T14:47:00.000-07:002016-07-30T14:47:00.219-07:00Welcome to Sacramento, IPAC'ers!This year, <a href="http://ipacweb.org/2016" target="_blank">IPAC's annual conference</a> is here in my home of Sacramento from July 31 - August 3. I'll be there Monday afternoon for a session titled "<b>Fits and Starts: The
Evolution of Testing for
the State of California (Special Invited Session)</b>", where I'll be interviewing my good friend, Adria Jenkins-Jones. Here's the description:<br />
<br />
<i>In this lively discussion, the presenters will discuss the
current state of employment testing for the state of
California, including significant recent and upcoming
changes to our examination software. Using an interview
format, the presenters will discuss the massive changes
envisioned for statewide testing, and how the California
Department of Human Resources is attempting to
collaborate with stakeholders to change the traditional
paradigm, and significantly improve automation, while
maintaining the commitment to merit. The presenters
will engage in open dialogue and there will be time for
audience members to ask questions about current and
future directions of testing for the state.</i><br />
<br />
Feel free to use the comments section below to post the sessions you plan on attending, or anything about your experience!BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-32925545958988229062016-07-02T21:17:00.002-07:002016-07-02T21:17:50.400-07:00Hiring for goodwill (not Goodwill)<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgaOgAoyr2-4CscDbJ-RcAMTsZevHaGfsv7gnuLTxvIevinGke2c_LmYZ0lFer4QNBtWF5HZQZNmPXsFTzVMfbg8RICCPtfsW0L4ehyphenhyphenNmtU5i-0A-2YnB57oa8hqkxdqMuabds/s1600/fuzzy.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="213" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgaOgAoyr2-4CscDbJ-RcAMTsZevHaGfsv7gnuLTxvIevinGke2c_LmYZ0lFer4QNBtWF5HZQZNmPXsFTzVMfbg8RICCPtfsW0L4ehyphenhyphenNmtU5i-0A-2YnB57oa8hqkxdqMuabds/s320/fuzzy.jpg" width="320" /></a></div>
<br />
Those of us that write, teach, and consult on personnel assessment usually paint the process as a very rational process broken into several steps:<br />
<br />
Step 1) Study the job to identify the critical tasks<br />
<br />
Step 2) Identify the knowledge, skills, and abilities (or competencies) required day one to perform those tasks<br />
<br />
Step 3) Create selection systems that accurately measure candidates' levels of #2<br />
<br />
Step 4) Hire the person(s) who demonstrate the highest scores on #3<br />
<br />
But as you know, hiring is rarely so logical. In some cases this is due to organizations not having the expertise, or making the time, to follow the steps above.<br />
<br />
But in other cases, there are simply other factors at play--factors that can't be ignored by the decision makers because they exert such a significant influence on the process. And these factors are largely intangible, meaning they're more difficult to quantify and therefore not typically included explicitly in a standard assessment process.<br />
<br />
For the purposes of discussion, I'm not talking about negative factors, such as illegal discrimination or selections based purely on politics. Instead, let's think of potentially useful constructs.<br />
<br />
For example:<br />
<br />
1) <b>Physical presence</b> related to professionalism. Let's be honest, <a href="https://www.worldatwork.org/waw/Content/jobcenter/html/article-40.html" target="_blank">looks matter</a> when it comes to interviews. In general, polished shoes beat flip flops. Suits beat sweats. No scent beats heavy cologne/perfume. But this may not be given a formal rating during the process--for several reasons, including the difficulty of rating and the potential overlap with discriminatory considerations. But again, that doesn't mean it's not a factor.<br />
<br />
2) <b>Honesty.</b> How many times have you been on an interview panel and perceived a candidate more positively because he/she was honest--about a weakness, for example, or about what they need to be successful in the position. It matters, and one reason it matters is because so many candidates hide behind a veneer of perfection. But are you giving them a formal rating on honesty?<br />
<br />
3) <b>Potential</b>. The applicant may not have demonstrated the KSAs that are key for the job, and thus may score poorly on assessments that measure past performance. But that doesn't mean they aren't capable of learning those KSAs, and even exceeding the performance of those that have already mastered them. Why? Because individual performance is more than just the KSAs someone brings to the job--it's also about the organizational environment, onboarding, development opportunities, the supervisor, and other factors that often go unmeasured during the hiring process (e.g., personality).<br />
<br />
4) <b>Preexisting relationships</b>. It's quite common for organizations to seek out individuals who have existing relationships that can be capitalized on. For example, someone may have relationships with potential customers, or may be able to access a market in a different way. If an organization is trying to enhance its relationship with certain key stakeholders, they may seek out someone who already has established connections. Sales professions immediately comes to mind, but other types, such as consultants or leadership positions, may also benefit greatly from these connections.<br />
<br />
In many ways these factors can be thought of as individual <a href="https://en.wikipedia.org/wiki/Goodwill_(accounting)" target="_blank">goodwill</a>, similar to the accounting principle. In this context, an organization's brand is an example of an intangible asset that nonetheless has great value. And in a similar way, individual goodwill is difficult to quantify.<br />
<br />
So what is someone that cares deeply about hiring right to do about all this? <br />
<br />
First of all, acknowledge that these factors play a role. Any attempts to link your assessments to outcomes that don't take these factors into account is missing a huge potential explanatory factor. You may draw conclusions regarding your assessments that are simply false because of the nature of the selection decision.<br />
<br />
Second, attempt whenever possible to build these intangibles into the hiring process. For example, preexisting relationships could be considered part of a communication competency. If hiring for potential, break down what the core abilities are that you're considering for potential--chances are you can measure those. There are both overt and covert measures of honesty and integrity--that work.<br />
<br />
Third, as an assessment community, we should all recognize that these factors play a role. When we research, teach, and consult on hiring, acknowledge these factors, and help others understand how to take them into consideration when designing a successful selection system.<br />
<br />
In the end, it's a relatively simple prescription: let's make the intangible, tangible.BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com1tag:blogger.com,1999:blog-33750400.post-81244390491417710482016-06-11T07:25:00.002-07:002016-06-11T07:25:54.757-07:00One way to reduce interviewer leniency/severity<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi2EM44iLL1jyObQqhVBcjwbEatPgWpqBtGuqFMFmfe1omyTIJPQd64-ewO5rOir3vx_VMFrK5H7g2Ns9KRzBP11KXuVwEyQWIRhpU27SrKjYomtpocjVC3BRXkaSvuzhEX7vE/s1600/Picture1.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="232" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi2EM44iLL1jyObQqhVBcjwbEatPgWpqBtGuqFMFmfe1omyTIJPQd64-ewO5rOir3vx_VMFrK5H7g2Ns9KRzBP11KXuVwEyQWIRhpU27SrKjYomtpocjVC3BRXkaSvuzhEX7vE/s320/Picture1.jpg" width="320" /></a></div>
<br />
A persistent challenge in interviews is that certain interviewers tend to be lenient (i.e., score candidates highly) while others are consistently more severe (i.e., score candidates lower). This of course is not ideal as it introduces measurement bias as well as reduces the defensibly of the process.<br />
<br />
One way to reduce these tendencies discussed by <a href="http://psycnet.apa.org/journals/apl/101/6/757/" target="_blank">Hartwell and Campion in the June 2016 issue of Journal of Applied Psychology</a> is to provide interviewers with what they call "normative feedback interventions." Basically what this means is giving interviewers data on how they rate candidates over time compared to how other interviewers rated. It can reveal to interviewers that they tend to rate candidates more harshly, or more easily, than others.<br />
<br />
What Hartwell and Campion found in their study (of over 20,000 interviews using more than 100 interviewers) is that by providing this feedback to interviewers, it minimized interviewer differences and increased interview reliability--both obviously good things in terms of quality of the process. Interestingly, it did not seem to impact the validity of the interviews, but it did impact which particular candidates were hired.<br />
<br />
Up until now, one of the most often recommended practices for reducing rating errors has been pre-interview instructions and guidance regarding these errors. What this study suggests is we can do even better by providing interviewers with objective data about their ratings over time. Listening to someone talking about rating bias probably feels a lot different than actually seeing how you do compared to your peers!BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-6922389632999893972016-06-01T12:44:00.000-07:002016-06-01T12:44:04.850-07:00Some easy tests to improve your hiring success<div dir="ltr">
The interview is such a commonly used hiring assessment that it's hardly worth mentioning (although there is always room for improvement). <br />
<br /></div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
But what if you're already doing interviews and you want some easy to implement add-ons? No problem. Here are some ways to improve quality of hire for knowledge worker positions that don't take a long time, an automated solution, or a PhD to develop:<br />
<br /></div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
1. <strong>Pre-screening questionnaire</strong>. Whether you use something quick and cheap like <a href="https://www.surveymonkey.com/" target="_blank">SurveyMonkey</a> or your own proprietary assessment system, it's easy to create open- and closed-ended items that serve to screen out the uninterested, allow you to get some more detail from candidates, and even help you solve problems you've been struggling with! Keep it relatively short so you don't dissuade the most in-demand candidates.<br />
<br /><br />
2. <strong>Targeted cover letter</strong>. Don't just ask for a generic cover letter, ask applicants to describe in their letter how their background syncs with the core competencies you're looking for. Remember: limit the length; two pages is generally sufficient.<br />
<br /><br />
<br />
3. <strong>Research project</strong>. As part of the application process, as candidates to look into an issue that's relevant for the job. How do they think the new overtime regulations will impact the industry? What new technologies are on the horizon that will change the way this job is done? Have them briefly write up their results, and/or ask about it during your interview.<br />
<br /></div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
4. <strong>Writing exercise</strong>. There's no substitute for live demonstrations of writing ability. Have them correct a document you've messed up, ask them to write a quick memo to a customer--just something related to the core duties of the job that you would expect them to be able to do day one.<br />
<br /></div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
5. <strong>Rule/procedure application</strong>. Knowledge worker jobs are characterized by frequent application of laws, rules, and procedures to specific situations. Either provide them with the rules ahead of time or give them the short version, then give them a specific fact pattern and have them come up with a solution or options.<br />
<br /><br />
<br />
6. <strong>Oral presentation</strong>. Have you ever been on a hiring panel where there's an oral presentation? If not, you're missing out. Presentations are a great way to mix things up and see those different skillsets that a candidate brings. Of course realize that you're adding a presentation to an interview, which I'm pretty sure are both in the top five of most stressful events.<br />
<br /><br />
Notice that you can mix and match theses approaches: have them do a rule/procedure application and then write a memo. Have them do an oral presentation on a topic they researched ahead of time. Of course, the tests you use should be based on the requirements of the job; start with entry level KSAs needed and let the assessments flow from that. Beyond that, be creative!</div>
BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com2tag:blogger.com,1999:blog-33750400.post-61839506227641094782016-05-22T18:00:00.000-07:002016-05-22T18:00:07.419-07:00First, get the people basics right <div dir="ltr">
Competencies, talent, gamification... there's no doubt about it, we like us some buzzwords. Like bright shiny objects, these ideas entice--and largely detract.</div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
Sometimes new ideas and ways of thinking can lead to significant improvements in the way organizations manage their people. But here's the truth that no one seems to want to talk about: many organizations fail to get the basics right. So while leaders may be leaping headlong into the nanofied virtual talent management sunset, the foundation of HR is lacking. </div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
What are these basics of which I speak?</div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
1. <b>Adequately defining jobs</b>--based on subject matter expert data. Every single job should be defined and documented in terms of key tasks, requirements, and expectations. The form this takes is less important than the quality of the data. This is the bedrock that helps you recruit, select, reward, and manage effectively.</div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
2. <b>Recruiting like you're selling, not like you're being forced to. </b> Writing attractive job ads is so easy, why aren't we swimming in them? The same reason many organizations fail to accurately describe the job: laziness and lack of discipline.</div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
3. <b>Using valid hiring measures. </b>Speed of hire is important, but not even remotely as important as quality. I can make you a sandwich really quickly if it's just bread. Do you think Google gets millions of resumes each year because candidates are hoping for a quick hire? Importantly, the higher in the organization, the <u>more </u>time should be spent on valid assessment. </div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
4. <b>Holding leaders accountable for being leaders.</b> This really should be #1 except I was trying to go chronologically (and will fail miserably). All too often, it's the line staff who are quickly called to the carpet when they make mistakes. But holding leaders accountable for their behavior (<i>hint: ask their subordinates</i>) is exponentially more powerful. </div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
5. <b>Listening to each other. </b> Many if not most good ideas for improving your organization are in the heads of your line staff. Do you ask them regularly and implement their ideas? Is listening skill considered critical for all employees?</div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
6. <b>Saying thank you. </b>It's easy, it's cheap. Do it more, and mean it. </div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
7. <b>Dealing firmly with poor performance. </b> This is top to bottom, from not being helpful on the phone to running productive meetings. Again, the higher in the organization, the more important this is. </div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
8. <b>Growing your people--forever.</b> Sure, they may leave, but they'll leave sooner if you don't invest in them. And like everything else on this list, it grows your reputation. </div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
9. <b>Treating people with respect and fundamental human decency. </b> If you have this as a backbone, many other things simply follow. There's a reason why one of the most popular business books recently is <a href="http://www.amazon.com/Asshole-Rule-Civilized-Workplace-Surviving/dp/0446698202/ref=sr_1_1?ie=UTF8&qid=1463963871&sr=8-1&keywords=the+no+asshole+rule" target="_blank">The No Asshole Rule</a>.</div>
<div dir="ltr">
<br />
<br /></div>
<div dir="ltr">
None of this is incredibly difficult, it just takes the most precious resource of any organization: time. And it takes commitment and discipline. But these aren't initiatives. They're part of an organization's DNA--or not. They're how people respond when asked what it's like to work there. And who is responsible for ensuring they happen ? The people at the top. </div>
<div dir="ltr">
<br /></div>
<div dir="ltr">
So before your organization jumps on to the latest buzzword bandwagon, make sure it's getting these basics right (by, I dunno, measuring them). Just promise me this, if you pick just one thing on this list:<br />
<br />
<b>Select. Good. Leaders.</b></div>
BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-76670817502841688152016-05-04T19:41:00.000-07:002016-05-04T19:41:28.129-07:00Research updateA few new journal issues have come out lately:<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.2016.69.issue-2/issuetoc" target="_blank"><b>Summer 2016 Personnel Psychology</b></a>, including:<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12105/abstract" target="_blank">Transparency of Assessment Centers: Low Criterion-related Validity but Greater Opportunity to Perform?</a><br />
<br />
<b><a href="http://psycnet.apa.org/journals/apl/101/5/" target="_blank">May 2016 Journal of Applied Psychology</a></b>, including:<br />
<br />
<span style="font-family: inherit;"><a href="http://psycnet.apa.org/journals/apl/101/5/625/" target="_blank">Initial impressions: What they are, what they are not, and how they influence structured interview outcomes.</a></span><br />
<span style="font-family: inherit;"><br /></span>
<span style="font-family: inherit;"><a href="http://psycnet.apa.org/journals/apl/101/5/657/" target="_blank">Racioethnicity, community makeup, and potential employees’ reactions to organizational diversity management approaches.</a></span><br />
<br />
<b><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2016.24.issue-2/issuetoc" target="_blank">June 2016 International Journal of Selection and Assessment</a></b>, including:<br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12134/abstract" target="_blank">Applicant Reactions to Selection Events: Four studies into the role of attributional style and fairness perceptions</a><br />
<br />
<span style="background-color: white; line-height: 14px;"><span style="font-family: inherit;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12135/abstract" target="_blank">Behavioral Cues as Indicators of Deception in Structured Employment Interviews</a></span></span><br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12136/abstract" target="_blank">The Role of Self-focused Attention and Negative Self-thought in Interview Anxiety: A test of two interventions</a><br />
<br />
<span style="background-color: white; line-height: 14px;"><span style="font-family: inherit;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12137/abstract" target="_blank">The Influence of Candidate Social Effectiveness on Assessment Center Performance Ratings: A field study</a></span></span><br />
<span style="background-color: white; line-height: 14px;"><span style="font-family: inherit;"><br /></span></span>
<span style="background-color: white; line-height: 14px;"><span style="font-family: inherit;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12138/abstract" target="_blank">Discrimination due to Ethnicity and Gender: How susceptible are video-based job interviews?</a></span></span><br />
<span style="font-family: inherit;"><br /></span>
<span style="background-color: white; line-height: 14px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12139/abstract" target="_blank">A Comparison of General and Work-specific Personality Measures as Predictors of Organizational Citizenship Behavior</a></span><br />
<span style="background-color: white; line-height: 14px;"><br /></span>
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12140/abstract" target="_blank">The Perceived Nature and Incidence of Dysfunctional Assessment Center Features and Processes</a><br />
<br />
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12141/abstract" target="_blank">Who is Being Judged Promotable: Good actors, high performers, highly committed or birds of a feather?</a>BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-59981384822774089602016-02-28T11:41:00.000-08:002016-02-28T11:41:53.271-08:00New journal issues<span style="font-family: inherit;">Two new journal issues to make you aware of:</span><br />
<span style="font-family: inherit;"><br /></span>
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2016.24.issue-1/issuetoc" target="_blank"><b><span style="color: blue; font-family: inherit;">International Journal of Selection and Assessment - March 2016</span></b></a><br />
<span style="font-family: inherit;"><br /></span>
<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12124/abstract" target="_blank"><span style="font-family: inherit;"><span style="background-color: white; font-weight: bold; line-height: 9.33333px;">Unintended Consequences of Transparency During Personnel Selection: Benefitting some </span><span style="background-color: white; font-weight: bold; line-height: 9.33333px;">candidates, but harming others?</span></span></a><br />
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><span style="font-family: inherit;"><br /></span></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12125/abstract" target="_blank"><span style="font-family: inherit;">Ethnic Differences in Perceptions of Cognitive Ability Tests: The explanatory role of self-serving attributions</span></a></span><br />
<span style="font-family: inherit;"><span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12125/abstract" target="_blank"><br /></a></span><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12126/abstract" style="font-weight: bold; line-height: 9.33333px;" target="_blank">Conditional Reasoning Test for Aggression: Further evidence about incremental validity</a></span><br />
<span style="font-family: inherit;"><br /></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12127/abstract" target="_blank"><span style="font-family: inherit;">For Love or for Money: Intrinsic and extrinsic value congruence in recruitment</span></a></span><br />
<span style="font-family: inherit;"><br /></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12128/abstract" target="_blank"><span style="font-family: inherit;">Social Influences in Recruitment: When is word-of-mouth most effective?</span></a></span><br />
<span style="font-family: inherit;"><br /></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12129/abstract" target="_blank"><span style="font-family: inherit;">Highlighting Tensions in Recruitment and Selection Research and Practice</span></a></span><br />
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12130/abstract" target="_blank"><span style="font-family: inherit;"><br /></span></a></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12130/abstract" target="_blank"><span style="font-family: inherit;">Tests of Integrity, HEXACO Personality, and General Mental Ability, as Predictors of Integrity Ratings in the Royal Dutch Military Police</span></a></span><br />
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><span style="font-family: inherit;"><br /></span></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12131/abstract" target="_blank"><span style="font-family: inherit;">Training Affects Variability in Training Performance Both Within and Across Jobs</span></a></span><br />
<span style="font-family: inherit;"><br /></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12132/abstract" target="_blank"><span style="font-family: inherit;">Examining Applicant Reactions to Different Media Types in Character-based Simulations for Employee Selection</span></a></span><br />
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><span style="font-family: inherit;"><br /></span></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12133/abstract" target="_blank"><span style="font-family: inherit;">When Will Interviewers Be Willing to Use High-structured Job Interviews? The role of personality</span></a></span><br />
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><span style="font-family: inherit;"><br /></span></span>
<span style="background-color: white; font-weight: bold; line-height: 9.33333px;"><span style="font-family: inherit;"><br /></span></span>
<span style="background-color: white; line-height: 9.33333px;"><a href="http://psycnet.apa.org/journals/apl/101/3/" target="_blank"><b><span style="color: blue; font-family: inherit;">Journal of Applied Psychology - March 2016</span></b></a></span><br />
<span style="background-color: white; line-height: 9.33333px;"><span style="font-family: inherit;"><br /></span></span>
<span style="background-color: white; line-height: 9.33333px;"><span style="font-family: inherit;"><br /></span></span>
<a href="http://psycnet.apa.org/journals/apl/101/3/313/" target="_blank"><span style="font-family: inherit;"><b>How and why do interviewers try to make impressions on applicants? A qualitative study.</b></span></a><br />
<span style="font-family: inherit;"><b><br /></b></span>
<a href="http://psycnet.apa.org/journals/apl/101/3/333/" target="_blank"><span style="font-family: inherit;"><b>The long road to employment: Incivility experienced by job seekers.</b></span></a><br />
<span style="font-family: inherit;"><b><br /></b></span>
<a href="http://psycnet.apa.org/journals/apl/101/3/350/" target="_blank"><span style="font-family: inherit;"><b>The role of self-determined motivation in job search: A dynamic approach.</b></span></a><br />
<span style="font-family: inherit;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif; font-size: 10.6667px;"><br /></span>BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-61234857973487704342016-01-24T06:42:00.000-08:002016-01-24T06:42:15.770-08:00How a mobile game made me re-think the nature of jobsI have a lot of games on my iPad. They go on for several pages as you swipe left.<br />
<br />
Some are quite good, but most are just good enough that I can't bring myself to delete them, but not good enough that I play them regularly.<br />
<br />
Every once in a while though, one comes along where I find myself playing it whenever I get downtime, usually due to some clever reward scheme that borrows heavily from the concept of variable interval reinforcement. (come to think of it, most of them do) You Candy Crush players out there know what I'm talking about.<br />
<br />
Quite unexpectedly, I came across one recently that's not only fun, but made me re-think my approach to jobs. Frankly it was rather eye-opening. I know this sounds odd, but stay with me.<br />
<br />
<img src="http://almostnerdy.com/wp-content/uploads/2013/02/pixel-people.jpg" height="240" width="320" /><br />
<br />
It's a game called <a href="https://www.youtube.com/watch?v=GHn905EGCZ0" target="_blank">Pixel People</a>. It's a "city building" game, drawn from the rich history of games like SimCity and Civilization. There are many games, like Clash of Clans, that have an element of city building, but unlike most of them, Pixel People doesn't focus on fighting, but instead on building your city. <br />
<br />
The graphics aren't anything to write home about, you can see an example below. The word "pixel" isn't in the title by accident.<br />
<br />
<img src="http://citybuildinggames.com/wp-content/uploads/2014/10/Pixel-People12.jpg" height="240" width="400" /><br />
<br />
Fortunately, the game doesn't need high-resolution graphics to pull off addicting gameplay. And part of what makes it addictive--actually, the biggest part--is how you create people to populate your city.<br />
<br />
Every citizen starts off as a clone, tabula raza. You individualize them by giving them professions. And the way you give them professions is by combining <i>other</i> professions from different categories.<br />
<br />
For example, you start off with a Mayor and a Mechanic. The Mayor belongs to the "Administration" occupational category, the Mechanic to the "Technical" category. It was right about this point that something tickled at the back of my mind and I was reminded of a typical job classification system (O*NET being a prime example).<br />
<br />
The best part of the game is that in order to move forward and create new professions and buildings, you combine two different professions. For example, if you combine the professions of Mayor with the profession of Mechanic, you get an Engineer. By doing so you create not only an Engineer, but access to the Garage and Mine structures. You continue combining professions to create new ones, create new buildings which offer new abilities, etc.<br />
<br />
Here are some other profession creation combinations, of which there are <a href="http://pixelpeople.wikia.com/wiki/Professions" target="_blank">currently 400</a>:<br />
<br />
Mechanic + Engineer = Mechanical Engineer (duh)<br />
Director + Model = Actor<br />
Doctor + Park Ranger = Vet<br />
Farmer + Farmer = Botanist<br />
Mechanic + Police Officer = Firefighter<br />
Architect + Dreamer = Artist<br />
<br />
As you can see, the game designers put some thought into how different professions relate to one another. They're not perfect, but close enough to make you smile when you create a new profession.<br />
<br />
<b>So what does this have to do with assessment? </b>Thanks for hanging in there. Well, the game mechanic got me thinking about how overly logical and rational most of our classification systems are, and how little we acknowledge the overlap and relationships between occupations.<br />
<br />
Most of us in HR structure our worlds around the idea that jobs can be categorized and differentiated. And in some cases, this makes perfect sense. A doctor is not the same as a computer programmer. Different educational requirements. Many core competencies required for the position are different.<br />
<br />
But I submit to you that in many cases, occupations have more overlap than we pretend. They are related to one another in ways that we don't typically acknowledge. And this has implications for recruiting, assessment, compensation, promotional paths--i.e., the core work involved in talent management. For example:<br />
<br />
<u>Recruiting</u>: currently, the ideal model of recruiting is to identify through job analysis the core KSAs or competencies required, and craft your recruitment campaign to attract those that possess them. KSAs can get very specific, resulting in recruiting efforts often focused on a pretty narrow desired profile. If we acknowledge that many jobs in our organizations have more overlap than we normally pretend, it becomes obvious that recruitment campaigns can become broader in two major ways: (1) you start to focus more on recruiting for the organization, not specific jobs, and (2) you start recruiting for broader skillsets or competencies, like analytical skill and conscientiousness. I don't think it's a coincidence that the last 40+ years of assessment research has repeatedly underlined the predictive power of these qualities.<br />
<br />
<u>Assessment:</u> like recruiting, assessment strategies typically target very specific KSAs--knowledge of a particular programming language, knowledge of a particular area of HR law, etc. If we acknowledge the overlap and relationship between jobs, it changes our assessment strategy. Like our recruitment strategy, we focus on broader targets such as communication ability and ability to work as part of a team. I'm not suggesting we shouldn't focus on those things that are critical to job performance and necessary upon entry to the position, but rather that we not prioritize those above more general qualities of the individual.<br />
<br />
<u>Compensation:</u> most often, particularly in civil service systems, compensation is based on the job category someone belongs to and their tenure. If we instead acknowledge the somewhat artificial nature of our classification structures, it shifts the focus to compensation being based on contribution to the organization. I recognize pay-for-performance has had inconsistent success, but I suspect that has as much to do with what's being compensated as it does with the concept.<br />
<br />
Thinking about recruitment, assessment, and compensation in this way broadens our horizons when it comes to other aspects of talent management, such as career mobility. It becomes easier to see how transferable skills benefit the organization, increasing its ability to adjust to new conditions, including unexpected turnover. Instead of staffing focused on narrow KSAs, we fill our organization with people whose strengths allow them to move relatively fluidly between jobs, which helps the individuals as well in their career development.<br />
<br />
Am I suggesting that we ignore specific skillsets when recruiting? Definitely not. Obviously sometimes you need people with a very particular ability or knowledge. What I am suggesting is we shift the balance toward a much more inclusive perspective when it comes to the qualities we seek.<br />
<br />
What do you think? Has your organization already acknowledged the overlap between jobs? Do you already recruit and select based on a broader mindset than simply those KSAs required for a particular position? Have the long hours spent in front of a tablet warped my perspective?<br />
<br />
<br />
<br />
<i>Footnote</i>: long-time readers will have noticed that I'm not posting nearly as much as I used to, and for that I apologize. I took a new job last summer and since then my blogging has suffered. If you want to follow me, I recommend <a href="https://www.facebook.com/HR-Tests-113523611995541/" target="_blank">my Facebook page</a>, which I update more often. Thanks for hanging in there! This year marks the 10-year anniversary of HR Tests and I hope to do something special in celebration.<br />
<div>
<br /></div>
BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-57743983696537714042015-08-13T19:06:00.001-07:002015-08-13T19:06:49.109-07:00Where there's a will, there's a way: OPM shows how to do UIT the right way<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgDoTKn4Ovi8HkWDpDW9b7IN57b-2bJ5Qid97B8pwPaxKgEk1woq3Dwqhu_TtW-7qWnUr2JLRD0RvAdKDEjEQ_wemkKX-s9oMJNJqDUkRZ3eNDeg4xe4vial-FxJRkl2dvDFcU/s1600/wwwtest.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgDoTKn4Ovi8HkWDpDW9b7IN57b-2bJ5Qid97B8pwPaxKgEk1woq3Dwqhu_TtW-7qWnUr2JLRD0RvAdKDEjEQ_wemkKX-s9oMJNJqDUkRZ3eNDeg4xe4vial-FxJRkl2dvDFcU/s320/wwwtest.jpg" width="208" /></a></div>
<br />
On August 10 and 12, <a href="http://ptcnc.org/" target="_blank">PTC-NC</a> was privileged to have Dr. Patrick Sharpe from the U.S. Office of Personnel Management (OPM) deliver a presentation about <a href="https://www.opm.gov/services-for-agencies/assessment-evaluation/online-assessment/" target="_blank">USA Hire</a>, part of a suite of online platforms that has allowed OPM to revolutionize the way they deliver assessment services to their diverse customers.<br />
<br />
The idea to ask Dr. Sharpe to present occurred to me when I read an article in the Washington Post on April 2 about USA Hire titled, "<a href="http://www.washingtonpost.com/blogs/federal-eye/wp/2015/04/02/for-federal-worker-hopefuls-the-civil-service-exam-is-making-a-comeback/" target="_blank">For federal-worker hopefuls, the civil service exam is making a comeback</a>". It provides an overview of what OPM has managed to accomplish with its partner, <a href="https://www.pdri.com/images/uploads/PDRI_EP_HA_OPM_FW.pdf" target="_blank">PDRI</a>, in the area of unproctored internet testing (UIT). Start there if you want to learn more because it includes some examples of the items--although significantly absent is an example of the excellent video avatar-based assessment used for things like situational judgment.<br />
<br />
Dr. Sharpe did an excellent job painting the picture for the audience of how much work was involved in the project, and how important things like stakeholder communication and contract management were to ensuring the project was a success. He then showed us a demo version of USA Hire, where he lead us through what it looks like from the applicant's perspective as they proceed through a series of competency-based assessments. The item formats range from the traditional (e.g., reading comprehension multiple-choice) to the modern (avatar-based SJT) to the groundbreaking--at least for the public sector (forced-choice non-cognitive assessment).<br />
<br />
Here are some of the key points I took away:<br />
<br />
- The technology is just a part of successfully putting an UIT program together, you have to step back and look first at what you're trying to accomplish. For example, are you interested in whole person assessment (as OPM is) or simply focusing on certain KSAs?<br />
<br />
- USA Hire is the culmination of <u>years</u> of research and analysis, and traces its history back 20-30 years within the federal government. Translation : don't jump into UIT without careful planning.<br />
<br />
- Start with the basics when delivering UIT: make sure the customer has a solid job analysis foundation before jumping to the assessment platform<br />
<br />
- Getting a larger, more influential, customer successfully implemented can cause others to jump on board<br />
<br />
- Realize that, particularly in a decentralized testing environment, you may still end up with a hybrid of different testing approaches following the roll-out of UIT, and this includes T&Es. But the best way to move the practice is to show what success looks like.<br />
<br />
- Consider carefully whether you want to build, buy, or lease the technology. There are benefits and drawbacks to each.<br />
<br />
- Starting with a pilot can be a great way to test the system (no pun intended), and also demonstrate the potential to stakeholders.<br />
<br />
- Collaboration between assessment professionals, HR specialists, and vendors is critical.<br />
<br />
- Don't underestimate the importance of change management. Fears (e.g., about losing control) come easily and have to be addressed head-on.<br />
<br />
- Organizational and system readiness is very important. Part of the reason this effort was successful is because hiring organizations were fed up with the extremely low utility (and perception) of point-based T&Es.<br />
<br />
For someone passionate about assessment and technology, the presentation was educational and motivational. I walked away, as did others, with a new-found optimism for what sufficient will, resources, and tenacity can accomplish. It's seductive to focus on what <i>can't </i>be done in the public sector, so to hear and see what <i>can</i> be done reemphasizes the importance of leadership--both in HR and at the top of the organization.<br />
<br />
Unproctored internet testing has been talked about for so long, but to see it in action, in a research-based way in the public sector, is truly inspirational. Truly where there is a will, there is a way.BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com3tag:blogger.com,1999:blog-33750400.post-24268935982658642002015-03-14T22:03:00.001-07:002015-03-14T22:03:31.654-07:00The secret to successful organizations: Let HR drive hiring<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiwxMbcA2oO2kpRG2eDMPuchQj5BxEawWr7qJrrxYlujb2YbPHKb1T3CvhwLjexDjTCMXGS0h_HFoJiLuHbkGxnmTAh87nzehsMx8tq24LZ-SwuyjnBu7fgQ3Fgiho6NbSiTus/s1600/Wrong_way_sign.JPG" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiwxMbcA2oO2kpRG2eDMPuchQj5BxEawWr7qJrrxYlujb2YbPHKb1T3CvhwLjexDjTCMXGS0h_HFoJiLuHbkGxnmTAh87nzehsMx8tq24LZ-SwuyjnBu7fgQ3Fgiho6NbSiTus/s1600/Wrong_way_sign.JPG" height="213" width="320" /></a></div>
<br />
<br />
Why do organizations make bad hires? Because they rely too much on supervisors to do the hiring.<br />
<br />
Imagine this scenario. You take your car into the shop because it's making a strange sound. The mechanic fixes it, you pay, and you're about to leave. But on your way out, the mechanic stops you. She* notices that you're frustrated with your iPad because it's being sluggish. She offers to fix it for you, reasoning that cars and iPads can't be all that different.<br />
<br />
Would you take the mechanic up on her offer?<br />
<br />
Of course not. But handing over important decisions--arguably <i>the</i> most important decisions--to the wrong people is something organizations do every day.<br />
<br />
Auto mechanics are trained to deal with a specific situation, and to do it successfully: fix cars. Their education and experience prepares them to do so.<br />
<br />
Similarly, supervisors are trained to do primarily one thing: supervise the day-to-day work. They're usually promoted because they excelled at the line level (i.e., they understand the work) and they show aptitude for leadership (hopefully). They are not, generally speaking, schooled or experienced with the professional side of personnel selection.<br />
<br />
Am I suggesting supervisors NOT be involved? Absolutely not. Am I suggesting that <u>all</u> HR shops are staffed with experts in personnel assessment and measurement? Nope.<br />
<br />
What I am suggesting is organizations get serious about this issue and stop treating supervisors as if they are people measurement professionals.<br />
<br />
In the modern workplace with information overload and time at a premium, it's tough enough to ensure that hiring and promotion decisions get made in a thoughtful fashion. The problem is exacerbated by the fact that most supervisors overestimate their hiring ability. After all, how hard can it be to interview someone?<br />
<br />
Not hard, <u>if you don't care about getting it right</u>. But getting it right requires careful thought and planning; hiring right is not something done at the last minute without regard to competencies that drive success in the specific position. It's not something that looks exactly the same time. It's tailored to the position, the culture, and the particular needs at the time.<br />
<br />
Great hires happen <u>systematically</u> for one reason: a tight partnership between line supervisors and talented HR consultants. The supervisor knows the job. They often know best what competencies are needed to perform the job successfully (although a good internal HR consultant will have a pretty good idea). HR professionals are trained in the professional side of selection, recognizing the pitfalls and identifying those measures most likely to predict success.<br />
<br />
"<i>But our HR shop doesn't know what it's doing. They don't have the expertise!</i>" some might say.<br />
<br />
Perhaps. If so, you've just identified your second strategic problem. And it should be fixed. That's like having people in your budget office that are bad at math.<br />
<br />
But consider this: you may be surprised to learn that many hiring supervisors <u>welcome</u> being removed as the primary driver of hiring. Good supervisors recognize that this isn't their greatest strength, and they will be happy to have HR assist them in identifying the most qualified applicants. Particularly in this age of online questionnaires and massive candidate lists for many jobs.<br />
<br />
So who is responsible for ensuring this supervisor-HR partnership happens systematically and is built into the organizational culture? <u>The leaders at the top</u>. Director. CEOs. They're the ones minding the store, and they're ultimately responsible for organizational success. They should be instituting policies, procedures, and cultural norms that emphasize how important and critical hiring is--so critical that it requires a team approach to get it right.<br />
<br />
Anything else is simply not taking the success of the enterprise seriously.<br />
<br />
<br />
* Did I throw you with a female mechanic? Now might be a good time to take <a href="https://implicit.harvard.edu/implicit/Study?tid=-1" target="_blank">the implicit association test for gender and careers</a>.BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com2tag:blogger.com,1999:blog-33750400.post-58819891905798758922015-03-05T08:13:00.000-08:002015-03-05T08:13:40.716-08:00Mega research updateI hope you like research, because there's a lot of it coming your way...and many are free as of this posting!<br />
<br />
Without further ado...<br />
<br />
<br />
Let's start with the <a href="http://psycnet.apa.org/journals/apl/100/1/" target="_blank">Journal of Applied Psychology, January 2015</a> issue:<br />
<br />
- We see a lot of research involving large candidate groups, but much less for individuals. In this <a href="http://psycnet.apa.org/journals/apl/100/1/5/" target="_blank">meta-analysis of individual assessments</a>, the authors found support for their usefulness, but it varied significantly across studies. Highest validity was found for managerial jobs and assessments that included a cognitive ability test.<br />
<br />
- Being in the wrong job can be frustrating for both the employee and the employers. In this study, the authors show a <a href="http://psycnet.apa.org/journals/apl/100/1/21/" target="_blank">relationship between poor vocational fit and counterproductive work behaviors</a> (CWBs).<br />
<br />
- Speaking of <a href="http://psycnet.apa.org/journals/apl/100/1/75/" target="_blank">CWB, there may be more of them going on than you would think</a> based on the assessment literature...<br />
<br />
- And even more on CWB! These authors found support for both self- and acquaintance-reported <a href="http://psycnet.apa.org/journals/apl/100/1/237/" target="_blank">personality ratings, specifically conscientiousness and agreeableness, in predicting "workplace deviance"</a>.<br />
<br />
- Unfortunately, <a href="http://psycnet.apa.org/journals/apl/100/1/128/" target="_blank">gender bias</a> still exists in selection. In this meta-analysis, the authors found this to be particularly the case in male-dominated jobs. On a positive note, they do suggest ways of mitigating this: provide clear evidence of the competence of applicants, encourage careful decision making, and use experienced raters.<br />
<br />
- The over-/under-prediction of cognitive ability tests debate for different ethnic groups continues. In this study, the authors <a href="http://psycnet.apa.org/journals/apl/100/1/162/" target="_blank">find support of overprediction for African Americans</a>, suggesting the tests are not predictively biased.<br />
<br />
<br />
<br />
Next, the <a href="http://psycnet.apa.org/journals/apl/100/2/" target="_blank">March issue of J.A.P.</a>:<br />
<br />
- More support for the <a href="http://psycnet.apa.org/journals/apl/100/2/298/" target="_blank">predictive validity of emotional intelligence</a>, but more importantly, how the concept overlaps with other constructs such as the Big 5 and self-efficacy.<br />
<br />
- All <a href="http://psycnet.apa.org/journals/apl/100/2/399/" target="_blank">situational judgment tests (SJTs) are not equal</a>, and according to these authors in a large number of instances the context that is presumably important? Not so much.<br />
<br />
- Speaking of SJTs, these researchers suggest that <a href="http://psycnet.apa.org/journals/apl/100/2/464/" target="_blank">putting the "situational" back in SJTs</a>--i.e., assessing how the situation is analyzed rather than the response options--is a useful method.<br />
<br />
- A fascinating update of <a href="http://psycnet.apa.org/journals/apl/100/2/431/" target="_blank">effect size benchmarks</a> that can be used for a variety of purposes.<br />
<br />
- Trying to <a href="http://psycnet.apa.org/journals/apl/100/2/481/" target="_blank">predict safety-related behavior</a>? This research suggests that personality traits, particularly agreeableness, can usefully predict this behavior.<br />
<br />
<br />
Moving on to the <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2015.23.issue-1/issuetoc" target="_blank">March issue of IJSA</a> (<b>free right now!</b>):<br />
<br />
- Some guidelines on preparing <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12091/abstract" target="_blank">norms for personality inventories</a>.<br />
<br />
- Evidence that <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12092/abstract" target="_blank">different cultures have different procedural justice perceptions</a> of different selection mechanisms<br />
<br />
- Some important findings on the <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12093/abstract" target="_blank">equivalence and stability of job performance ratings</a> over time<br />
<br />
- Development of a <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12094/abstract" target="_blank">new measure of subjective career success</a><br />
<br />
- More evidence that both technical knowledge and prosocial knowledge are important factors in <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12095/abstract" target="_blank">predicting medical student clinical performance</a><br />
<br />
- This study found that <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12097/abstract" target="_blank">CWBs are under-reported</a> and organizational commitment increases the likelihood that peers will report them<br />
<br />
- Evidence that <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12098/abstract" target="_blank">forced-choice and Likert-type scales used in personality inventories</a> have similar measurement properties<br />
<br />
<br />
On to the <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.2015.68.issue-1/issuetoc" target="_blank">Spring issue of Personnel Psych</a> (<b>also free right now!</b>):<br />
<br />
- This <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12072/abstract" target="_blank">meta-analysis on narcissism showed that it is related to leadership</a> emergence (through extraversion) and leadership effectiveness in a curvilinear fashion. <br />
<br />
- More evidence of the <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12066/abstract" target="_blank">importance of political skill</a>--particularly the aspects of networking ability, interpersonal influence, and apparent sincerity--in predicting a range of important outcomes, including task performance beyond GMA and the Big 5. It would be interesting to see how this is related to emotional intelligence (yes this is a foreshadowing).<br />
<br />
<br />
Turning to the <a href="http://psycnet.apa.org/journals/bul/141/2/" target="_blank">March issue of Psych Bulletin</a>:<br />
<br />
- More on narcissism: this time, researchers found that <a href="http://psycnet.apa.org/journals/bul/141/2/261/" target="_blank">men consistently report higher levels of narcissism</a> compared to women, which is interesting when taken in combination with the study above.<br />
<br />
<br />
In the <a href="http://onlinelibrary.wiley.com/doi/10.1111/iops.2014.7.issue-4/issuetoc?campaign=woletoc" target="_blank">December issue of Industrial and Organizational Psychology</a>:<br />
<br />
- The first focal article <a href="http://onlinelibrary.wiley.com/doi/10.1111/iops.12184/abstract" target="_blank">calls out researchers for using incorrect assumptions about criterion reliabilities</a>, thus impacting criterion validity values. They make suggestions for how to improve meta-analyses moving forward.<br />
<br />
- The second makes the important argument that <a href="http://onlinelibrary.wiley.com/doi/10.1111/iops.12195/abstract" target="_blank">utility analyses should consider measures of well-being</a> when determining the effectiveness of interventions (such as an employment test).<br />
<br />
<br />
Finally, in the <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.v36.1/issuetoc?campaign=woletoc" target="_blank">January issue of JOB</a> (<b>also free right now</b>):<br />
<br />
- a proposal for improving the calculation and reporting of <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.1960/abstract" target="_blank">Cronbach's alpha</a><br />
<br />
- a fascinating study showing that <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.1949/abstract" target="_blank">high conscientiousness may hinder performance during stressful situations</a><br />
<br />
- in support of EI, this study found a <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.1975/abstract" target="_blank">link between emotion recognition ability and income</a> (interestingly through political skill and interpersonal facilitation...remember the earlier study on political skill?).<br />
<br />
<br />
That's all for now!BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-69616066524318453182015-02-12T16:09:00.000-08:002015-02-12T16:09:17.875-08:00"Power posing" impacts interview performanceMany people have watched <a href="http://www.ted.com/talks/amy_cuddy_your_body_language_shapes_who_you_are?language=en" target="_blank">Amy Cuddy's riveting TED talk</a> on how body language impacts thought processes. Specifically, over 23.5 million people as of today have watched that particular video, millions more through YouTube and other outlets.<br />
<br />
In the presentation she specifically talks about how "power posing"--standing in a way that denotes confidence (hands on hips)--impacts testosterone and cortisol levels and ultimately behavior. <br />
<br />
In an <a href="http://psycnet.apa.org/psycinfo/2015-04973-001/" target="_blank">upcoming issue of the Journal of Applied Psychology</a>, Cuddy and her colleagues describe the results of an experiment where university students were told to adopt either a high-power (shown on left) or low-power (shown on right) posture:<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="http://4.bp.blogspot.com/-3Sj1hyWbCvY/VN05xcJoViI/AAAAAAAAH7k/EqNMmhaYeHk/s1600/power%2Bpostures.JPG" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://4.bp.blogspot.com/-3Sj1hyWbCvY/VN05xcJoViI/AAAAAAAAH7k/EqNMmhaYeHk/s1600/power%2Bpostures.JPG" height="320" width="242" /></a></div>
<br />
They were instructed to stand in this pose for 5-6 minutes while preparing for a job interview speech. They then delivered said speech, which was videotaped, to two evaluators/interviewers. These evaluators subsequently rated the participants on (a) performance, and (b) hirability. They also judged the participants on their verbal and nonverbal behavior.<br />
<br />
Results (N=61)? Those who prepared for their speech while in a high-power pose were rated significantly higher (p<.01) on both factors than those who prepared in a low-power pose. And the results could not be explained by nonverbal behavior in the interview itself. Per the authors, "<i>Compared to low-power posers, high-power posers
appeared to better maintain their composure, project more confidence, and present more
captivating and enthusiastic speeches, which led to higher overall performance evaluations</i>."<br />
<br />
This suggest, in the words of the authors, "<i>By nonverbally manipulating their
own sense of power, the high-power posers were effectively imbued with the psychological and
physiological advantages typically associated with high power, despite their low-power position
relative to the evaluators</i>."<br />
<br />
So what does this mean? I believe it has several important implications. First, it indicates a potential source of "error", akin to test anxiety, that may impact assessment performance. Second, it suggests a potential avenue that those plagued by test anxiety may pursue to increase their chances of success. This includes those who experience stereotype threat. Third, it may help explain why even a "perfect" measurement of job-related KSAs does not yield a perfect correlation with performance (I'm thinking of similar confounding effects like mood or physical appearance).<br />
<br />
You can read what appears to be the <a href="http://faculty.haas.berkeley.edu/dana_carney/pp_performance.pdf" target="_blank">submitted version here</a>. I recommend reading it as well as the excellent TED talk if this subject interests you.BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com1tag:blogger.com,1999:blog-33750400.post-19111934417258701002015-01-31T15:01:00.002-08:002015-01-31T15:01:29.111-08:00Federal civil service reform is HR reform<div class="separator" style="clear: both; text-align: center;">
<a href="http://2.bp.blogspot.com/-VcoCuogOO9c/VM1Ti-i_zJI/AAAAAAAAH2I/n0lVuM-r0UM/s1600/pic1.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://2.bp.blogspot.com/-VcoCuogOO9c/VM1Ti-i_zJI/AAAAAAAAH2I/n0lVuM-r0UM/s1600/pic1.jpg" height="320" width="320" /></a></div>
Texas. Georgia. Washington. Florida. California.<br />
<br />
What do these states have in common? They are some of the states that have undertaken civil service reform in an attempt to modernize and streamline all those laws and rules associated with human resources.<br />
<br />
The U.S. federal government is no stranger to reform efforts either. In the <a href="http://edition.pagesuite-professional.co.uk/Launch.aspx?EID=206c816d-f8a6-4e33-9086-322707301151" target="_blank">latest issue of Government Executive magazine</a>, there is an interesting article about the challenges associated with the current state of affairs in the U.S. federal civil service--<u>the largest employer in the world</u>. Things like excessively long time-to-hire, outdated hiring rules, and onerous discipline systems. There are efforts afoot (again) to fix this.<br />
<br />
They could very easily have been talking about state or local civil service systems. Or--in many places--HR in general.<br />
<br />
Here are some selected quotes. See if any of them sound familiar...<br />
<br />
"...'<i>if you don’t
view your HR specialist as a consultant
prior to posting the vacancy
announcements, then you are going
to get people who are not qualified for
your job</i>.'"<br />
<br />
"<i>USAJobs, the government’s online
warehouse of job vacancies, is still difficult to navigate and lacks sophisticated
search capabilities to help applicants
find positions that meet their interests
and qualifications</i>."<br />
<br />
“'<i>What we’ve seen across managers,...they are
almost sourcing a unicorn...They could
be looking at too technical or specialized
of a skill set, or they are looking for too many competencies or experiences
creating this kind of applicant that
we can’t actually find</i>.'”<br />
<i><br /></i>
<i>"When
HR and program supervisors
work closely throughout the
hiring process, communicating
at every stage, it increases
the likelihood that the system
works the way it should: fairly,
as expeditiously as possible,
and yielding the most qualified candidates for the job."</i><br />
<br />
It's worth a read, and I bet many of you will find much that resonates. None of the principles behind reform are particularly revolutionary, but for various reasons many organizations have difficulty getting it right. There are no shortcuts to outstanding HR systems, and only those organizations that recognize the strategic and competitive value inherent in a talented, engaged workforce will put the required resources into ensuring that it's done right.<br />
<br />
<i>Next time: research update</i>BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-25815422176855942412015-01-04T09:01:00.000-08:002015-01-04T09:01:23.113-08:002014 Research of the Year (+ research update)<div class="separator" style="clear: both; text-align: center;">
<a href="http://2.bp.blogspot.com/-nMJrp8DqbKs/VKlxRr6B-2I/AAAAAAAAHf8/Nd1zOxMX2QY/s1600/trophy1.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://2.bp.blogspot.com/-nMJrp8DqbKs/VKlxRr6B-2I/AAAAAAAAHf8/Nd1zOxMX2QY/s1600/trophy1.jpg" height="200" width="159" /></a></div>
<br />
Happy New Year! As I've done in previous years, I present below the research articles I ran across in this area that I think were the most impactful and/or important of 2014. But first, let's catch up on two issues:<br />
<br />
First, the <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.2014.67.issue-4/issuetoc" target="_blank">Winter issue of Personnel Psychology</a>:<br />
<br />
- Situational judgment tests have been shown to be useful for measuring interpersonal skills, but beware: <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12056/abstract" target="_blank">levels of "angry hostility" moderate that relationship</a>. (Is there a happy hostility?)<br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12057/abstract" target="_blank">When hiring leaders, should you look for those that have a busy home life, or be wary of them?</a> In this fascinating study, the authors found that leader family-to-work <u>conflict </u>negatively impacts followers in that it can increase their burnout. However, family-to-work <u>enrichment </u>increased follower engagement through leader engagement. So the answer is, as usual, not simple: home/family life <i>can</i> be a good thing for followers if it makes the leader more engaged; but if the home/family life is increasing burnout, the leader may pass that along to others. So it would seem it all depends on how the individual is handling their life outside of work!<br />
<br />
Let's look at the <a href="http://psycnet.apa.org/journals/apl/99/6/" target="_blank">November issue of the Journal of Applied Psychology</a>:<br />
<br />
- <a href="http://psycnet.apa.org/journals/apl/99/6/1129/" target="_blank">Are men or women perceived as better leaders?</a> According to this meta-analysis, it depends on how you ask the question. If you limit the question to other-ratings, women are rated significantly higher. But if you look at self-ratings, men rate themselves significantly higher. Which leads to the next question: is it a biological perception or a <u>gender</u> perception, and if the latter, what traits are the most important?<br />
<br />
- An intriguing study of how <a href="http://psycnet.apa.org/journals/apl/99/6/1146/" target="_blank">applicant confidence interacts with and can be altered by the recruitment experience</a>, in this case among recruits for the U.S. military.<br />
<br />
- Next, a study of <a href="http://psycnet.apa.org/journals/apl/99/6/1159/" target="_blank">employment and job search efficacy</a>. Not surprisingly, within-person frequency of job search behavior correlated with job offers; interestingly, the relationship between perceived job search progress and efficacy beliefs were moderated by beliefs of internal attribution.<br />
<br />
- Last but not least, more evidence of the importance of defining the criteria when <a href="http://psycnet.apa.org/journals/apl/99/6/1222/" target="_blank">predicting job performance</a>. In this meta-analysis, the researchers found more support for personality traits out-predicting cognitive ability in predicting counterproductive work behavior, that the two predictors are approximately equal in predicting organizational citizenship behaviors, and that cognitive ability outperforms personality when predicting task and overall performance. So do you want high task performance, OCBs, or do you want to avoid CWB? :) (of course the situation is even more complicated depending on whether you're looking at individual, team, leader performance, over what period of time, etc.)<br />
<br />
<br />
Okay, on to the awards! Without further ado, here are my nominations for <b>Research of the Year for 2014</b>:<br />
<br />
1) Important advancements in our understanding of <a href="http://onlinelibrary.wiley.com/doi/10.1111/jasp.12193/abstract" target="_blank">weight-based discrimination at work</a>: Vanhove & Gordon.<br />
<br />
2) A study of <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12058/abstract" target="_blank">applicants posting <i>faux pas</i> on their social networking sites</a>: Roulin.<br />
<br />
3) Two important looks at assessments delivered remotely via mobile devices: <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12062/abstract" target="_blank">Arthur, Doverspike, Munoz, Taylor, & Carr</a>, and <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12063/abstract" target="_blank">Morelli, Mahan, & Illingworth</a>.<br />
<br />
4) Two fascinating looks at personality at work: <a href="http://psycnet.apa.org/journals/apl/99/2/199/" target="_blank">Judge, Simon, Hurst, & Kelley</a>; and <a href="http://psycnet.apa.org/journals/apl/99/2/262/" target="_blank">Wille & De Fruyt</a><br />
<br />
5) An excellent study of how <a href="http://psycnet.apa.org/journals/apl/99/3/361/" target="_blank">effective staffing and training practices impact firm-level flexibility and adaptability</a>: Kim & Ployhart.<br />
<br />
6) An important study of the <a href="http://onlinelibrary.wiley.com/doi/10.1111/iops.12151/abstract" target="_blank">movement of impactful I/O researchers to business schools</a>: Aguinis, Bradley, & Brodersen.<br />
<br />
7) The<a href="http://psycnet.apa.org/journals/apl/99/4/564/" target="_blank"> relationship between conscientiousness and job performance is more accurately described as curvilinear</a>: Carter, Dalal, Boyce, O'Connell, Kung & Delgado<br />
<br />
Finally, honorable mention to two great developments in 2014: the change of some publishers to making access to articles more affordable, and the announcement of an additional journal, the <a href="http://scholarworks.bgsu.edu/pad/" target="_blank">Journal of Personnel Assessment and Decisions</a>.<br />
<br />
<br />
I'm continually amazed at the quality of thought and research in our area and the passion and practicality you exhibit. <b>Here's to an amazing 2014 and more in 2015!</b>BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-18262119053075177252014-11-28T08:58:00.000-08:002014-11-28T08:58:35.624-08:00Why leadership in the public sector is harder to find--but more important<i>Occasionally I post about things that are related to recruitment and assessment, but not focused exclusively on them. This is one of those times.</i><br />
<i><br /></i>
I have the following quote from <a href="http://www.valvesoftware.com/company/Valve_Handbook_LowRes.pdf" target="_blank">Valve Software's New Employee Handbook</a> (a fascinating document) posted on my office door:<br />
<br />
<b>"Hiring well is the most important thing in the universe.</b><br />
<b>Nothing else comes close. It’s more important than breathing.</b><br />
<b>So when you’re working on hiring—participating in</b><br />
<b>an interview loop or innovating in the general area of</b><br />
<b>recruiting—everything else you could be doing is stupid</b><br />
<b>and should be ignored!"</b><br />
<br />
The older I get, the more I wonder whether I should cross out "hiring" and write in "leadership". I just can't bring myself to do it because they're both so darn important.<br />
<br />
But this post will be about leadership. Specifically, leadership in the public (i.e., government) sector. More specifically, lack of leadership and what to do about it. I don't pretend that leaders in the private sector are uniformly outstanding, but public sector is what I'm most familiar with.<br />
<br />
First things first: in some important ways, leadership in the public sector (PS) is different from the private sector. Not night-and-day I grant you, but there are some relatively unique boundary conditions that apply, namely:<br />
<br />
- Not only are PS leaders bound by normal organizational policies and procedures, they labor under an additional layer of laws and rules, whether federal, state, or local. Unlike policies and procedures, they cannot be easily changed--in fact in many cases this requires moving heaven and earth. As one (very important) example, typically there are laws/rules about how you can hire someone. Many of these laws and rules were created 50+ years ago in reaction to spoils systems and haven't been seriously evaluated since.<br />
<br />
- Many PS employees have civil service protections. This isn't a bad thing, but it means moving employee that are bad fits (either over or out) is difficult. This greatly inhibits your talent mobility strategy.<br />
<br />
- In the PS, leadership is often treated as an afterthought, rather than the linchpin upon which organizational success relies. The assumption seems to be that the organizational systems and processes are so strong that it almost doesn't matter who's in charge. This means things like leadership development and training are half-hearted.<br />
<br />
These conditions combine with several other factors to result in true leadership being relatively rare in the PS:<br />
<br />
- Failure is invisible. There is very little measurement of leadership success and very little transparency and accountability, absent a media storm. <br />
<br />
- There are fewer people in management positions that have the important leadership competencies. Things like listening ability, strategic planning ability, and emotional intelligence. Instead they are usually chosen based on technical ability and without the benefit of rigorous assessment results.<br />
<br />
- There is a lack of understanding of leadership. This stems from the lack of attention paid to it as a serious discipline; without operational definitions of leadership, there is no measurement and no accountability.<br />
<br />
- An unwillingness to treat leadership seriously. For whatever reasons--politics, lack of motivation, entrenched cultures--leadership is relegated to second-class status when it comes to analyzing department/agency success. Focus tends to rest on line-level employees, technology, and unions--and only on top-level leaders when there is a phenomenally bad outcome.<br />
<br />
<b>So why is leadership more important in the PS than the private sector?</b><br />
<br />
- Governments regulate many aspects of our lives. They're not making consumer products. Leaders in PS organizations have purview over things like public safety, the environment, education, housing, and taxes. Things you literally touch every day. <br />
<br />
- There is less accountability, less transparency. PS leaders often do not report to a board. They don't have to produce annual reports that detail their successes and failures. What they do is often mysterious, poorly defined, and rarely sees the light of day.<br />
<br />
- PS leaders work <u>for you</u>. Elected or not, their salary typically comes from taxpayers. They ultimately report to the citizens. This means you should care about what they're doing, and whether they are worthy stewards of your investment.<br />
<br />
<b>So what can be done?</b> Much like the answer to "how do we hire well?", the answers are known. They're just not practiced very well:<br />
<br />
1. Publicly acknowledge the scope of the problem. Like frogs in a pot, somehow we find ourselves in a situation where slowly over time the current situation is accepted as normal. It's time to stop pretending that all PS Managers are leaders. They're not. And we must look in the mirror ourselves and acknowledge that we are likely part of the problem.<br />
<br />
2. Acknowledge the urgency to improve. Stop pretending that leadership is a secondary concern. Sub-par leadership has a negative impact on our lives every day. Improving the quality of that leadership is one of the most critical things we can do as a society.<br />
<br />
3. Publicly commit to change, and actually follow through. Specifically describe what you will change, and when, and provide regular status updates.<br />
<br />
4. Define leadership in measurable terms and behaviors. Here's just a sample list of what real leaders do (and not a particularly good one);<br />
<br />
= continuously improve operations<br />
= champion and reward innovation<br />
= hold their people accountable for meeting SMART goals<br />
= continually seek feedback and signs of their own success and failure<br />
= create and sustain a culture that attracts high performers and dissuades poor fits<br />
= make hiring and promoting the most qualified people THE most important part of their job<br />
<br />
5. Hire and promote those with leadership competencies, not the best technicians. While knowledge of the work being performed is important, it is far from <u>the</u> most important competency.<br />
<br />
6. Make the topic of leadership a core activity for every management team. Eliminate "information sharing" meetings and replace them with discussions on how to be better leaders.<br />
<br />
7. Set clear goals of leaders up front, and hold them accountable. What does this mean?<br />
<br />
= consequences for hiring poor fits<br />
= consequences for poor morale on their team<br />
= consequences for not setting and meeting SMART goals<br />
= recognition for doing all of the above well<br />
<br />
8. Measure leadership success and make the results transparent. Develop plans to address gaps and follow through.<br />
<br />
9. Instill a culture of boldness and innovation. Banish fear, often borne of laboring under layers of red tape. Encourage risk-taking, and learn from mistakes rather than punishing them.<br />
<br />
10. Relentlessly seek out and banish inefficiencies, especially related to the use of time. Critically evaluate how email and meetings are used; establish rules regarding their use.<br />
<br />
11. Stop pretending that all of this applies only to first-line supervisors. If anything, they're more important the higher you go in the organizational chart.<br />
<br />
12. When it comes to recruiting, stop focusing on low relative salaries, and capitalize on the enormous benefit of the PS an employer--namely the mission of public service.<br />
<br />
13. View leadership as a competency, not a position. Leadership behaviors can be found everywhere in an organization--they should be recognized and promoted.<br />
<br />
<br />
My intent here is not to be a downer, but to emphasize how much more focus needs to be placed on leadership in the public sector. The current state of affairs is unacceptable. And for those of us familiar with research and best practices in organizational behavior, it's painful.<br />
<br />
So I apologize for the decidedly <i>un-Thanksgivingy</i> nature of this post. But I <u>am</u> thankful for free speech and open minds. Thanks for reading.BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com7tag:blogger.com,1999:blog-33750400.post-55142198639750049742014-10-27T21:11:00.001-07:002014-10-27T21:11:40.439-07:00Just kidding...more research update!Seriously? Just <a href="http://hrtests.blogspot.com/2014/10/research-update.html" target="_blank">yesterday I did my research update</a>, ending with a note that the December 2014 issue of the International Journal of Selection and Assessment should be out soon.<br />
<br />
Guess what? It <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2014.22.issue-4/issuetoc" target="_blank">came out today</a>.<br />
<br />
So that means--you guessed it--another research update! :)<br />
<br />
- First, a test of <a href="http://en.wikipedia.org/wiki/Spearman's_hypothesis" target="_blank">Spearman's hypothesis</a>, which states that the magnitude of White-Black mean differences on tests of cognitive ability vary with the test's <i>g</i> loading. Using a large sample of GATB test-takers, <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12081/abstract" target="_blank">these authors found support for Spearman's hypothesis</a>, and that reducing <i>g</i> saturation lowered validity and increased prediction errors. <br />
<br />
So does that mean practitioners have to choose between high-validity tests of ability or increasing the diversity of their candidate pool? Not so fast. Remember...<a href="http://psycnet.apa.org/journals/apl/99/4/547/" target="_blank">there are other options</a>.<br />
<br />
- Next, <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12082/abstract" target="_blank">international (Croatian) support for the Conditional Reasoning Test of Aggression</a>, which can be used to predict counterproductive work behaviors. I can see this increasingly being something employers are interested in.<br />
<br />
- Applicants that do well on tests have favorable impressions of them, while those that do poorly don't like them. Right? Not necessarily. These researchers found that above and beyond how people actually <i>did</i> on a test, <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12083/abstract" target="_blank">certain individual differences predict applicant reactions</a>, and suggest these be taken into account when designing assessments.<br />
<br />
- Although personality testing continues to be one of the most popular topics, concerns remain about applicants "faking" their responses (i.e., trying to game the test by responding inaccurately but hopefully increase the chances of obtaining the job). <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12084/abstract" target="_blank">This study investigates the use of blatant extreme responding</a>, consistently selecting the highest or lowest response option, to detect faking, and looked at how this behavior correlated with cognitive ability, other measures of faking, and demographic factors (level of job, race, and gender).<br />
<br />
- Next, a <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12085/abstract" target="_blank">study of assessment center practices in Indonesia</a>.<br />
<br />
- Do individuals high in neuroticism have higher or lower job performance? Many would guess lower performance, but according to this research, <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12087/abstract" target="_blank">the impact of neuroticism on job performance is moderated by job characteristics</a>. This supports the more nuanced view that the relationship between personality traits and performance is in many cases non-linear and depends on how performance is conceptualized.<br />
<br />
- ...which leads oh so nicely into the next article! In it, the authors studied air traffic controllers and found results consistent with previous studies--<a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12088/abstract" target="_blank">ability primarily predicted task performance while personality better predicted citizenship behavior</a>. Which raises an interesting question: which version of "performance" are you interested in? My guess is for many employers the answer is both--which suggests of course using multiple methods when assessing candidates.<br />
<br />
- Last but not least, an important study of using cognitive ability and personality to predict job performance in a <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12089/abstract" target="_blank">three studies of Chilean organizations</a>. Results were consistent with studies conducted elsewhere, namely ability and personality significantly predicted performance.<br />
<br />
Okay, I think that's it for now!<br />
<br />BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-4961769328565209022014-10-25T14:01:00.000-07:002014-10-25T14:01:22.912-07:00Research updateOkay, so it been a couple months, huh? Well, what say we do a research update then.<br />
<br />
But before I dive in, I discovered something interesting and important. Longtime readers know that one of my biggest pet peeves is how difficult research articles are to get a hold of. And by difficult I mean expensive. Historically, unless you were affiliated with a research institution or were a subscriber, you had to pay exorbitant (IMHO) fees to see research articles. So imagine my pleasure when I discovered that at least one publisher--Wiley, who publishes several of the research journals in this area--now allows you to read-access for an article for as low as $6. Now that's only for 48 hours and you can't print it, but hey--that's a heck of a lot better than something like $30-40, which historically has been the case! So kudos.<br />
<br />
Moving on.<br />
<br />
Let's start with a bang with an article from the <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.2014.67.issue-3/issuetoc" target="_blank">Autumn 2014 issue of Personnel Psych</a>. A few years back <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12060/full#peps12060-bib-0016" target="_blank">several researchers argued</a> that the assumption that performance is distributed normally was incorrect; and it got <a href="http://www.npr.org/2012/05/03/151860154/put-away-the-bell-curve-most-of-us-arent-average?ps=cprs" target="_blank">a bit of press</a>. Not so fast, say new researchers, who show that <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12060/abstract" target="_blank">when defined properly, performance is in fact more normally distributed</a>.<br />
<br />
For those of you wondering, "why do I care?" Whether we believe performance is normally distributed or not significantly impacts not only the statistical analyses performed on selection mechanisms but theories and practices surrounding HRM.<br />
<br />
<br />
Moving to the <a href="http://psycnet.apa.org/journals/apl/99/4/" target="_blank">July issue of the Journal of Applied Psychology</a>:<br />
<br />
- If you're going to use a cognitively-loaded selection mechanism (which in many cases has some of the highest predictive validity), be prepared to accept high levels of adverse impact. Right? Not to fast, say these researchers, who show that <a href="http://psycnet.apa.org/journals/apl/99/4/547/" target="_blank">by weighting the subtests, you can increase diversity decisions without sacrifice validity</a>.<br />
<br />
- Here's another good one. As you probably know, the personality trait of conscientiousness has shown value in predicting performance in certain occupations. Many believe that conscientiousness may in fact have a curvilinear relationship with performance (meaning after a certain point, more conscientiousness may not help)--but this theory has not been consistently supported. According to these researchers, this may have to do with the assumption that higher scores equal more conscientiousness. In fact, <a href="http://psycnet.apa.org/journals/apl/99/4/564/" target="_blank">when using an "ideal point" model, results were incredibly consistent in terms of supporting the curvilinear relationship between conscientiousness and performance</a>.<br />
<br />
- Range restriction is a common problem in applied selection research, since you only have performance data on a subset of the test-takers, requiring us to draw inferences. A few years back, <a href="http://www.biz.uiowa.edu/faculty/fschmidt/meta-analysis/Hunter_Schmidt_Le_2006.pdf" target="_blank">Hunter, Schmidt, and Le</a> proposed a new correction for range restriction that requires less information. But is it in fact superior? <a href="http://psycnet.apa.org/journals/apl/99/4/587/" target="_blank">According to this research</a>, the general answer appears to be: yes.<br />
<br />
<br />
Let's move to the <a href="http://psycnet.apa.org/journals/apl/99/5/" target="_blank">September issue of JAP</a>:<br />
<br />
- Within-person variance of performance is an important concept, both conceptually and practically. Historically <a href="http://psycnet.apa.org/journals/apl/99/5/898/" target="_blank">short-term and long-term performance variance</a> have been treated separately, but these researchers show the advantage of integrating the two together.<br />
<br />
- Next, a fascinating study of the <a href="http://psycnet.apa.org/journals/apl/99/5/915/" target="_blank">choice of (and persistence in) STEM fields as a career</a>, the importance of both interest and ability, and how gender plays an important role. In a nutshell, as I understand it, interest and ability seem to play a more important role in predicting STEM career <i>choices </i>for men than for women, whereas ability is more important in the <i>persistence</i> in STEM careers for women.<br />
<br />
<br />
Let's take a look at a couple from recent issue of Personnel Review:<br />
<br />
- From volume 43(5), these researchers found support for <a href="http://www.emeraldinsight.com/doi/abs/10.1108/PR-12-2012-0207" target="_blank">ethics-based hiring decisions</a> resulting in improved work attitudes, include organizational commitment.<br />
<br />
- From 43(6), an expanded conceptual model of <a href="http://www.emeraldinsight.com/doi/abs/10.1108/PR-06-2013-0104" target="_blank">how hiring supervisors perceive "overqualification"</a>, which I would love to see more research on.<br />
<br />
<br />
Last but not least, for you stats folks, what's new from <a href="http://pareonline.net/" target="_blank">PARE</a>?<br />
<br />
- What happens when you have <a href="http://pareonline.net/getvn.asp?v=19&n=10" target="_blank">missing data on multiple variables</a>?<br />
<br />
- <a href="http://pareonline.net/getvn.asp?v=19&n=11" target="_blank">Equivalence testing: samples matter</a>!<br />
<br />
- <a href="http://pareonline.net/getvn.asp?v=19&n=12" target="_blank">What sample size is needed when using regression models</a>? Here's one suggestion on how to figure it out.<br />
<br />
<br />
The December 2014 issue of IJSA should be out relatively soon, so look for a post on that soon!<br />
<br />
<br />
<br />BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-39048527752847408922014-08-06T21:10:00.002-07:002014-08-06T21:10:56.965-07:00Research updateI can't believe it's been three months since a research update. I was waiting until I got critical mass, and with the release of the September issues of IJSA, I think I've hit it. <br />
<br />
So let's <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.2014.22.issue-3/issuetoc" target="_blank">start there</a>:<br />
<br />
- Experimenting with using different <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12072/abstract" target="_blank">rating scales on SJTs</a> (with "best and worst" response format doing the best of the traditional scales)<br />
<br />
- Aspects of a <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12073/abstract" target="_blank">semi-structured interview</a> added incremental validity over cognitive ability in predicting training performance<br />
<br />
- Studying the use of <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12074/abstract" target="_blank">preselection methods</a> (e.g., work experience) prior to assessment centers in German companies<br />
<br />
- The proposed <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12075/abstract" target="_blank">general factor of personality</a> may be useful in selection contexts (this one was a military setting)<br />
<br />
- Evidence that <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12076/abstract" target="_blank">effective leaders show creativity and political skill</a><br />
<br />
- Investigating the relationship (using survey data) between <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12077/abstract" target="_blank">personality facets and CWBs</a> (with emotional stability playing a key role)<br />
<br />
- Corrections for <i>indirect </i>range restriction boosted the upper end of <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12078/abstract" target="_blank">structured interview validity</a> substantially<br />
<br />
- A method of <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12079/abstract" target="_blank">increasing the precision of simulations</a> that analyze group mean differences and adverse impact<br />
<br />
- A very useful study that looked at the <a href="http://onlinelibrary.wiley.com/doi/10.1111/ijsa.12080/abstract" target="_blank">prediction of voluntary turnover as well as performance using biodata and other applicant information</a>, including recruitment source, among a sample of call center applicants. Reuslts? Individuals who had previously applied, chose to submit additional information, were employed, or were referrals had significantly less voluntary turnover.<br />
<br />
<br />
<br />
Moving on...let's check out the <a href="http://psycnet.apa.org/journals/apl/99/3/" target="_blank">May issue of JAP</a>; there are only two articles but both worth looking at:<br />
<br />
- First, a fascinating study of the <a href="http://psycnet.apa.org/journals/apl/99/3/361/" target="_blank">firm-level impact of effective staffing and training</a>, suggesting that the former allow organizations greater flexibility and adaptability (e.g., to changing financial conditions).<br />
<br />
- Second, another study of <a href="http://psycnet.apa.org/journals/apl/99/3/535/" target="_blank">SJT response formats</a>. The researchers found, using a very large sample, the "rate" format (e.g., "rate each of the following options in terms of effectiveness") to be superior in terms of validity, reliability, and group differences.<br />
<br />
<br />
Next, the <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.v35.5/issuetoc?campaign=woletoc" target="_blank">July issue of JOB</a>, which is devoted to leadership:<br />
<br />
- You might want to check out <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.1931/abstract" target="_blank">this overview/critique</a> of the various leadership theories.<br />
<br />
- This study suggests that newer models proposing <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.1921/abstract" target="_blank">morality</a> as an important component of leadership success have methodological flaws.<br />
<br />
- Last, a study of <a href="http://onlinelibrary.wiley.com/doi/10.1002/job.1927/abstract" target="_blank">why Whites oppose affirmative action</a> programs<br />
<br />
<div>
<br />
Let's move to the <a href="http://onlinelibrary.wiley.com/doi/10.1111/iops.2014.7.issue-3/issuetoc?campaign=woletoc" target="_blank">September issue of Industrial and Organizational Psychology:</a><br />
<br />
- The first focal article discusses the increasing <a href="http://onlinelibrary.wiley.com/doi/10.1111/iops.12151/abstract" target="_blank">movement of I/O psychology to business schools</a>. The authors found evidence that this is due in large part to some of the most active and influential I/O researchers moving to business schools.<br />
<br />
- The second is about <a href="http://onlinelibrary.wiley.com/doi/10.1111/iops.12167/abstract" target="_blank">stereotype threat</a>--specifically its importance as a psychological construct and the paucity of applied research about it.<br />
<br />
<br />
Coming into the home stretch, the <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.2014.67.issue-2/issuetoc" target="_blank">Summer issue of Personnel Psych</a>:<br />
<br />
- The distribution of individual performance may not be normal if, as these researchers suggest, "<a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12054/abstract" target="_blank">star performers</a>" have emerged<br />
<br />
- <a href="http://onlinelibrary.wiley.com/doi/10.1111/peps.12036/abstract" target="_blank">Executives</a> with high levels of conscientiousness and who display transformational leadership behavior may directly contribute to organizational performance<br />
<br />
<br /></div>
<div>
Rounding out my review, check out a few recent articles from <a href="http://pareonline.net/" target="_blank">PARE</a>:<br />
<br />
- I'm not even gonna attempt to summarize this, so here's the title: <a href="http://pareonline.net/getvn.asp?v=19&n=7" target="_blank">Multiple-Group confirmatory factor analysis in R – A tutorial in measurement invariance with continuous and ordinal indicators</a><br />
<br />
- Improving <a href="http://pareonline.net/getvn.asp?v=19&n=5" target="_blank">exploratory factor analysis for ordinal data</a><br />
<br />
- Improving <a href="http://pareonline.net/getvn.asp?v=19&n=2" target="_blank">multidimensional adaptive testing</a><br />
<br />
<br />
Last but not least, it's not related to recruitment or assessment, but check out this study that found <a href="http://psycnet.apa.org/journals/apl/99/3/504/" target="_blank">productivity increases during bad weather</a> :)<br />
<br />
That's all folks!</div>
BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com0tag:blogger.com,1999:blog-33750400.post-87428706424479658092014-06-22T08:13:00.002-07:002014-06-22T08:13:29.257-07:00Are job ads a relic?<div class="separator" style="clear: both; text-align: center;">
<span style="font-family: Times, Times New Roman, serif; margin-left: 1em; margin-right: 1em;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhXaV8nnKP8wQz2r5dekKQGbHhfSBsgCflf5trqrMdyOxwx_ftZctS9EvSzBTJOFLu071Btm00nNdzm-MYNTd2fbU4JCd05gQqnekS_PvOQkq25e8Q9oeq9LumqSszBM51In5I/s1600/nojobad2.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhXaV8nnKP8wQz2r5dekKQGbHhfSBsgCflf5trqrMdyOxwx_ftZctS9EvSzBTJOFLu071Btm00nNdzm-MYNTd2fbU4JCd05gQqnekS_PvOQkq25e8Q9oeq9LumqSszBM51In5I/s1600/nojobad2.jpg" height="195" width="200" /></a></span></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<span style="font-family: Times, Times New Roman, serif;">Lately at my day job we've been working with a few customers on replacing their traditional "one-shot" job ads with continuously posted career opportunities. Why?</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- It helps capture qualified candidates regardless of where they are in the search process (i.e., it helps solve the "I didn't see the ad" problem).</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- It gives hiring supervisors a persistent, fresh pool of applicants that they can immediately draw from.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- It saves a ton of time that gets wasted in the traditional model due to requesting to fill a position, tailoring the duty statement, determining the assessment strategy, etc.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- It changes the focus--importantly and appropriately--from filling a single position to career opportunities.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- It presents an opportunity to critically review the way we advertise our jobs, which too often are boring and uninspired.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- With the appropriate technology, it can create another community of minds; for businesses this means customers, for public sector, it means solution generators.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- With the appropriate technology, connections can be potentially tapped to increase reach.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">Apparently we're not alone in going down this road. As <a href="http://www.hreonline.com/HRE/view/story.jhtml?id=534357229&topic=Main" target="_blank">this article</a> describes, online retailer Zappos has created Zappos Insider, with the goal being to create more of a talent community than a one-time transactional relationship. This move toward "candidate relationship management" is not new but seems to be gaining steam, which is also reflected in HR technology as vendors build this approach into their products.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">So what are some <b>challenges </b>associated with the model?</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Without specific application dates, it becomes more critical that applicants can determine their status at any time.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- It may dissuade applicants who are actively seeking for work, who may see this model as too slow.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- It requires significant up-front work to design and determine the administration (but pays dividends on the back-end).</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Hiring supervisors may be skeptical of the change.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">Here are some related issues<b> </b>that moving to this model <b><u>doesn't</u> automatically solve</b>:</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Engaging in a timely manner with candidates so they understand the status of their application/interest.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Communicating effectively with those not selected.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Giving applicants a real person to contact if they have questions (Zappos makes these contacts very clear).</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Creating attractive yet realistic descriptions of positions in the organization.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Focusing on the KSAOs that are most strongly linked to job performance.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">- Developing an assessment strategy that most effectively measures those KSAOs.</span><br />
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;"><br /></span>
<span style="font-family: Times, Times New Roman, serif;">Until there is a free worldwide talent pool that matches high quality candidate assessment with realistic job profiles (yes, that's my dream of how to replace the current extremely wasteful job matching process), things like this may have the best shot of streamlining and updating a process that is holding us back rather than helping both applicants and organizations achieve their goals.</span>BryanBhttp://www.blogger.com/profile/00254854039712516086noreply@blogger.com2