Sources
AbilityRating's design is tracked in a register of 496 sources, each graded for reliability: 76 meta-analyses, systematic reviews, professional standards or laws (grade A), 262 peer-reviewed studies, books or official documents (grade B), 98 preprints and reports (grade C) and 60 vendor pages or claims still being checked (grade D). The website cites only A and B.
This page lists the 310 entries graded A or B on the research and law behind the design. Entries still being checked, market and competitor reports and software components are not listed. The register is kept as data; this page is generated from it. What the research supports
Selection validity and combination
- S001 (grade A) Sackett, Zhang, Berry, Lievens (2022). Revisiting meta-analytic estimates of validity in personnel selection. Journal of Applied Psychology 107(11), 2040-2068 (published online first in 2021, which explains the linked file name) siop.org gwern.net DOI
- S002 (grade B) Sackett and colleagues (2023). Revisiting the design of selection systems in light of new findings regarding the validity of widely used predictors (focal article). Industrial and Organizational Psychology 16(3), 283-300 DOI
- S003 (grade B) Sackett and colleagues (2023). Reply to commentaries on revisiting the design of selection systems in light of new findings regarding the validity of widely used predictors. Industrial and Organizational Psychology 16(3), 371-377 DOI cambridge.org
- S004 (grade A) Sackett et al. (2024). A contemporary look at the relationship between general cognitive ability and job performance. Journal of Applied Psychology 109(5) experts.umn.edu
- S005 (grade A) Berry, Lievens, Zhang, Sackett (2024). Journal of Applied Psychology 109(10), 1611-1634 DOI
- S006 (grade A) Schmidt, Hunter (1998). The validity and utility of selection methods. Psychological Bulletin 124(2), 262-274 DOI
- S007 (grade A) Kuncel, Klieger, Connelly, Ones (2013). Mechanical versus clinical data combination in selection and admissions decisions. Journal of Applied Psychology 98(6), 1060-1072 gwern.net DOI
- S008 (grade A) Grove and colleagues (2000). Clinical versus mechanical prediction. Psychological Assessment 12(1), 19-30 DOI
- S009 (grade B) Dawes (1979). The robust beauty of improper linear models. American Psychologist 34(7), 571-582
- S010 (grade B) Johnson, Carter (2010). Validating synthetic validation. Personnel Psychology 63(3), 755-795 DOI
- S011 (grade A) Steel, Huffcutt, Kammeyer-Mueller (2006). Synthetic validity. International Journal of Selection and Assessment 14(1), 16-36 DOI
- S012 (grade B) Murphy (2010). Synthetic validity: a great idea whose time never came. Industrial and Organizational Psychology 3(3), 356-359
- S013 (grade B) Schmidt, Oh (2010). Can synthetic validity methods achieve discriminant validity? Industrial and Organizational Psychology 3 cambridge.org
- S014 (grade B) Lawshe, C. H. (1952). What can industrial psychology do for small business? (A symposium): Employee selection. Personnel Psychology 5(1), 31-34 DOI
- S015 (grade B) Campion and colleagues (2011). Doing competencies well. Personnel Psychology 64(1), 225-262 DOI
- S016 (grade B) O\*NET, Software Developers (15-1252.00) onetonline.org
- S017 (grade A) Roth, Bobko, McFarland (2005). Work sample tests. Personnel Psychology 58(4), 1009-1037 DOI
- S018 (grade A) Roth, Bobko, McFarland, Buster (2008). Work sample group differences. Personnel Psychology 61(3), 637-661 DOI
- S019 (grade B) Lievens, De Soete (2012). Simulations. In Schmitt (Ed.), The Oxford Handbook of Personnel Assessment and Selection, 383-410
- S020 (grade B) Lievens, Sackett (2006). Journal of Applied Psychology 91(5), 1181-1188 DOI
- S021 (grade B) Lievens, Sackett (2012). Journal of Applied Psychology 97(2), 460-468 DOI
- S022 (grade A) Christian, Edwards, Bradley (2010). Situational judgment tests: constructs assessed and criterion-related validities. Personnel Psychology 63(1), 83-117 qic-wd.org DOI
- S023 (grade A) Hoffman et al. (2015). Assessment-centre exercise validity. Journal of Applied Psychology 100(4) academicnewsletter.sufe.edu.cn
- S024 (grade B) Jackson, Michaelides, Dewberry, Kim (2016). Everything that you have ever been told about assessment center ratings is confounded. Journal of Applied Psychology 101, 976-994 ueaeprints.uea.ac.uk
- S025 (grade B) Kuncel, Sackett (2014). Resolving the assessment center construct validity problem (as we know it). Journal of Applied Psychology 99, 38-47
- S026 (grade B) Lance, C. E. (2008). Why assessment centers do not work the way they are supposed to. Industrial and Organizational Psychology 1(1), 84-97 DOI
- S027 (grade B) Lievens, Motowidlo (2016). Situational judgment tests: from measures of situational judgment to measures of general domain knowledge. Industrial and Organizational Psychology 9(1), 3-22
- S028 (grade B) Krumm and colleagues (2015). How "situational" is judgment in situational judgment tests? Journal of Applied Psychology 100, 399-416
- S029 (grade B) Motowidlo, Beier (2010). Specific job knowledge versus implicit trait policies in an SJT. Journal of Applied Psychology 95
- S030 (grade B) Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006). Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items. Journal of Applied Psychology 91(4), 749-761 DOI
- S031 (grade B) Frederiksen, N., Saunders, D. R., & Wand, B. (1957). The in-basket test. Psychological Monographs: General and Applied 71(9), whole no. 438, 1-28 DOI
- S032 (grade B) Bray, D. W., & Grant, D. L. (1966). The assessment center in the measurement of potential for business management. Psychological Monographs: General and Applied 80(17), whole no. 625, 1-27 DOI
Interviews and interviewer judgment
- S033 (grade A) Huffcutt, Conway, Roth, Stone (2001). Constructs measured in employment interviews. Journal of Applied Psychology 86(5) scholarsmine.mst.edu web.pdx.edu
- S034 (grade B) Peck, Levashina (2017). Frontiers in Psychology, reporting Barrick, Shaffer, DeGrassi (2009) on self-presentation and interview ratings pmc.ncbi.nlm.nih.gov
- S035 (grade B) Barrick, Swider, Stewart (2010). Initial evaluations in the interview. Journal of Applied Psychology 95 iro.uiowa.edu
- S037 (grade A) Levashina, Hartwell, Morgeson, Campion (2014). The structured employment interview. Personnel Psychology 67(1), 241-293 DOI
- S038 (grade B) Roulin, Bangerter, Levashina (2015). Interviewers' detection of deceptive impression management ncbi.nlm.nih.gov
- S039 (grade B) Rivera (2012). Hiring as cultural matching. American Sociological Review 77(6) edbatista.com
- S040 (grade A) Arthur et al. (2006). Person-organisation fit in selection. Journal of Applied Psychology 91 academicnewsletter.sufe.edu.cn
- S041 (grade A) Hosoda, Stone-Romero, Coats (2003). Attractiveness bias. Personnel Psychology 56 stars.library.ucf.edu
- S043 (grade B) Behroozi, Shirolkar, Barik, Parnin (2020). Does stress impact technical interview performance? ESEC/FSE 2020 2020.esec-fse.org news.ncsu.edu DOI
- S044 (grade B) Behroozi, Parnin, Barik (2019). Hiring is broken. VL/HCC DOI
- S048 (grade B) Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin 51(4), 327-358 DOI
- S049 (grade B) McClelland, D. C. (1998). Identifying competencies with behavioral-event interviews. Psychological Science 9(5), 331-339 DOI
- S496 (grade B) Overholser, J. C. (1993). Elements of the Socratic method: I. Systematic questioning. Psychotherapy: Theory, Research, Practice, Training 30(1), 67-74 DOI
Personality, character and colleague ratings
- S051 (grade A) Connelly, Ones (2010). An other perspective on personality. Psychological Bulletin 136 people.ict.usc.edu
- S052 (grade A) Oh, Wang, Mount (2011). Observer ratings of personality and job performance. Journal of Applied Psychology 96 papers.ssrn.com
- S053 (grade B) US Office of Personnel Management, reference checking (including Hunter and Hunter 1984 validity) opm.gov
- S054 (grade B) Taylor and colleagues (2004). Structured telephone reference check. Personnel Psychology 57(3), 745-772 DOI
- S055 (grade B) Hedricks, Robie, Oswald (2013). Web-based multi-rater references. International Journal of Selection and Assessment 21(1), 99-110 DOI
- S056 (grade B) Mussel (2013). Epistemic curiosity and job performance. Journal of Organizational Behavior 34(4) researchgate.net
- S057 (grade B) Owens, Johnson, Mitchell (2013). Expressed humility in organisations. Organization Science 24(5) ideas.repec.org
- S058 (grade A) Lee, Berry, Gonzalez-Mulé (2019). Honesty-humility and work outcomes. Journal of Applied Psychology 104(12) DOI
- S059 (grade A) Pletzer et al. (2019). HEXACO and workplace deviance. Journal of Vocational Behavior dare.uva.nl
- S060 (grade A) Credé, Tynan, Harms (2017). Grit meta-analysis. Journal of Personality and Social Psychology 113(3) (published online first in 2016, which explains the linked file name) gwern.net
- S061 (grade A) Spitzmuller et al. (2015), proactive personality incremental validity; Tornau, Frese (2013), proactivity meta-analysis works.bepress.com fis.leuphana.de
- S062 (grade A) Payne, Youngcourt, Beaubien (2007), goal orientation meta-analysis; Anseel et al. (2015), feedback seeking academicnewsletter.sufe.edu.cn experts.umn.edu
- S063 (grade A) Sisk et al. (2018), mindset meta-analyses, Psychological Science; Macnamara, Burgoyne (2023) englelab.gatech.edu gwern.net
- S064 (grade A) O'Boyle et al. (2012). Dark Triad and work behaviour. Journal of Applied Psychology 97(3) facultystaff.richmond.edu
- S065 (grade B) Fischbacher, U., & Föllmi-Heusi, F. (2013). Lies in disguise: An experimental study on cheating. Journal of the European Economic Association 11(3), 525-547 DOI
- S066 (grade B) Van Dyne, L., & LePine, J. A. (1998). Helping and voice extra-role behaviors: Evidence of construct and predictive validity. Academy of Management Journal 41(1), 108-119 DOI
- S067 (grade B) Rest, J. R. (with Barnett, R., et al.) (1986). Moral Development: Advances in Research and Theory. New York: Praeger
- S068 (grade B) Bebeau, M. J., Rest, J. R., & Yamoor, C. M. (1985). Measuring dental students' ethical sensitivity. Journal of Dental Education 49(4), 225-235 DOI
- S069 (grade B) Tenbrunsel, A. E., & Messick, D. M. (2004). Ethical fading: The role of self-deception in unethical behavior. Social Justice Research 17(2), 223-236 DOI
- S070 (grade A) Mabe, P. A., & West, S. G. (1982). Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology 67(3), 280-296 DOI
- S071 (grade B) James, L. R. (1998). Measurement of personality via conditional reasoning. Organizational Research Methods 1(2), 131-163 DOI
- S072 (grade A) Berry, C. M., Sackett, P. R., & Tobares, V. (2010). A meta-analysis of conditional reasoning tests of aggression. Personnel Psychology 63(2), 361-384 DOI
Cognitive ability, reasoning and problem solving
- S073 (grade B) Prat et al. (2020). Predictors of learning Python. Scientific Reports ilabs.uw.edu
- S074 (grade B) Nye, Ma, Wee (2022). Specific cognitive abilities and job performance. Journal of Business and Psychology gwern.net
- S075 (grade A) Ritchie, Tucker-Drob (2018). Education and intelligence pmc.ncbi.nlm.nih.gov
- S076 (grade B) Otero, Salgado, Moscoso (2021). Cognitive reflection and job performance. Frontiers in Psychology frontiersin.org
- S077 (grade B) Haran, Ritov, Mellers (2013). Actively open-minded thinking. Judgment and Decision Making 8(3) dlab.sauder.ubc.ca
- S078 (grade B) Bruine de Bruin, Parker, Fischhoff (2007). Adult decision-making competence gwern.net
- S079 (grade B) Wason, P. C. (1960). On the failure to eliminate hypotheses in a conceptual task. Quarterly Journal of Experimental Psychology 12(3), 129-140 DOI
- S080 (grade B) Pólya, G. (1945). How to Solve It: A New Aspect of Mathematical Method. Princeton University Press en.wikipedia.org
- S081 (grade B) Schoenfeld, A. H. (1985). Mathematical Problem Solving. Orlando, FL: Academic Press (chapters "Resources", "Heuristics", "Control") DOI
- S082 (grade B) Dörner, D. (1989). Die Logik des Misslingens: Strategisches Denken in komplexen Situationen. Reinbek: Rowohlt. English: The Logic of Failure (1996), Metropolitan Books / Basic Books, trans. R. & R. Kimber
- S083 (grade B) Nutt, P. C. (1999). Surprising but true: Half the decisions in organizations fail. Academy of Management Executive 13(4), 75-89 (Crossref: 75-90) DOI
- S084 (grade B) Simon, H. A. (1973). The structure of ill structured problems. Artificial Intelligence 4(3-4), 181-201 DOI
- S085 (grade B) Rittel, H. W. J., & Webber, M. M. (1973). Dilemmas in a general theory of planning. Policy Sciences 4(2), 155-169 DOI
- S086 (grade B) Getzels, J. W., & Csikszentmihalyi, M. (1976). The Creative Vision: A Longitudinal Study of Problem Finding in Art. New York: Wiley DOI
- S087 (grade B) Kotovsky, K., Hayes, J. R., & Simon, H. A. (1985). Why are some problems hard? Evidence from Tower of Hanoi. Cognitive Psychology 17(2), 248-294 DOI
- S088 (grade B) Hayes, J. R., & Simon, H. A. (1977). Psychological differences among problem isomorphs. In N. J. Castellan, D. B. Pisoni & G. R. Potts (Eds.), Cognitive Theory (Vol. 2, pp. 21-41). Hillsdale, NJ: Erlbaum. Companion: Simon & Hayes (1976), Cognitive Psychology 8(2), 165-190 DOI
- S089 (grade B) Duncker, K. (1945). On problem-solving (L. S. Lees, Trans.). Psychological Monographs 58(5), whole no. 270, i-113. German original 1935 DOI
- S090 (grade B) Ericsson, K. A., & Simon, H. A. (1984; rev. ed. 1993). Protocol Analysis: Verbal Reports as Data. Cambridge, MA: MIT Press
- S092 (grade B) Arkes, H. R., & Blumer, C. (1985). The psychology of sunk cost. Organizational Behavior and Human Decision Processes 35(1), 124-140 DOI
- S093 (grade B) March, J. G. (1991). Exploration and exploitation in organizational learning. Organization Science 2(1), 71-87 DOI
- S095 (grade B) Kahn, R. L., Wolfe, D. M., Quinn, R. P., Snoek, J. D., & Rosenthal, R. A. (1964). Organizational Stress: Studies in Role Conflict and Ambiguity. New York: Wiley
- S096 (grade B) OECD (2014). PISA 2012 Results: Creative Problem Solving: Students' Skills in Tackling Real-Life Problems (Volume V). Paris: OECD Publishing DOI
- S097 (grade A) Claim: complex-problem-solving measures add modestly to reasoning tests in predicting outcomes. Evidence: Stadler and colleagues (2015), meta-analysis (S488); Kretzschmar and colleagues (2016) (S489); Wüstenberg, Greiff, Funke (2012) (S490) DOI DOI DOI
- S488 (grade A) Stadler, M., Becker, N., Gödker, M., Leutner, D., & Greiff, S. (2015). Complex problem solving and intelligence: A meta-analysis. Intelligence 53, 92-101 DOI
- S489 (grade B) Kretzschmar, A., Neubert, J. C., Wüstenberg, S., & Greiff, S. (2016). Construct validity of complex problem solving. Intelligence 54, 55-69 DOI
- S490 (grade B) Wüstenberg, S., Greiff, S., & Funke, J. (2012). Complex problem solving: More than reasoning? Intelligence 40(1), 1-14 DOI
Adaptability, creativity and learning
- S098 (grade B) Pulakos, Arad, Donovan, Plamondon (2000). Adaptability in the workplace. Journal of Applied Psychology 85(4), 612-624 DOI
- S099 (grade B) Jundt, Shoss, Huang (2015). Individual adaptive performance in organisations. Journal of Organizational Behavior 36(S1), S53-S71 DOI
- S100 (grade A) Huang, Ryan, Zabel, Palmer (2014). Personality and adaptive performance. Journal of Applied Psychology 99(1), 162-179 academicnewsletter.sufe.edu.cn DOI
- S101 (grade B) DeRue, D. S., Ashford, S. J., & Myers, C. G. (2012). Learning agility: In search of conceptual clarity and theoretical grounding. Industrial and Organizational Psychology 5(3), 258-279 DOI
- S102 (grade B) Lang, Bliese (2009). General mental ability and two types of adaptation to unforeseen change. Journal of Applied Psychology cris.maastrichtuniversity.nl
- S104 (grade B) Amabile, T. M. (1982). Social psychology of creativity: A consensual assessment technique. Journal of Personality and Social Psychology 43(5), 997-1013 DOI
- S105 (grade B) Hough (1984). Accomplishment record. Journal of Applied Psychology 69(1), 135-146 DOI
- S106 (grade A) Kim (2008). Creative achievement, IQ and divergent thinking. Journal of Creative Behavior 42(2), 106-130
- S107 (grade B) Koivisto, Grassini (2023). Chatbots and humans on the Alternate Uses Task. Scientific Reports pmc.ncbi.nlm.nih.gov
- S108 (grade B) Doshi, Hauser (2024). Science Advances 10(28) pmc.ncbi.nlm.nih.gov
- S109 (grade B) Organisciak, Acar, Dumas, Berthiaume (2023). Thinking Skills and Creativity 49 openscoring.du.edu
- S110 (grade B) Mumford, Reiter-Palmon, Redmond (1994), problem construction and creative problem solving, and later measures synapsesocial.com
- S111 (grade B) Stein, M. I. (1953). Creativity and culture. Journal of Psychology 36(2), 311-322 DOI
- S112 (grade B) Runco, M. A., & Jaeger, G. J. (2012). The standard definition of creativity. Creativity Research Journal 24(1), 92-96 DOI
- S113 (grade B) Stokes, P. D. (2005/2006). Creativity from Constraints: The Psychology of Breakthrough. New York: Springer Publishing
- S114 (grade B) Koestler, A. (1964). The Act of Creation. London: Hutchinson; New York: Macmillan en.wikipedia.org
- S115 (grade B) Sawyer, K. (2007). Group Genius: The Creative Power of Collaboration. New York: Basic Books
- S116 (grade B) Vygotsky, L. S. (1978). Mind in Society. Harvard University Press; Feuerstein, R., Rand, Y., & Hoffman, M. B. (1979). The Dynamic Assessment of Retarded Performers: The Learning Potential Assessment Device. Baltimore: University Park Press; Campione, J. C., & Brown, A. L. (1987). Linking dynamic assessment with school achievement. In C. S. Lidz (Ed.), Dynamic Assessment (pp. 82-115). New York: Guilford
- S117 (grade B) Petersen, C. R., & Al-Haik, A. R. (1976). The development of the Defense Language Aptitude Battery (DLAB). Educational and Psychological Measurement 36(2), 369-380; Carroll, J. B., & Sapon, S. M. (1959). Modern Language Aptitude Test. New York: Psychological Corporation DOI
- S118 (grade B) Grant, D. A., & Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology 38(4), 404-411 DOI
- S119 (grade B) Berlyne, D. E. (1960). Conflict, Arousal, and Curiosity. New York: McGraw-Hill
- S120 (grade B) Graesser, A. C., & Person, N. K. (1994). Question asking during tutoring. American Educational Research Journal 31(1), 104-137 DOI
Collaboration, teams and AI teammates
- S121 (grade B) Weidmann, Deming (2021). Team Players: how social skills improve team performance. Econometrica 89(6) nber.org
- S122 (grade B) Deming (2017). The growing importance of social skills in the labor market. Quarterly Journal of Economics 132(4) nber.org
- S126 (grade A) Riedl, Kim, Gupta, Malone, Woolley (2021). Collective intelligence. PNAS 118(21) pmc.ncbi.nlm.nih.gov
- S127 (grade B) Bates, Gupta (2017). Smart groups of smart people. Intelligence (published online first in 2016, which explains the linked file name) gwern.net
- S128 (grade B) O'Neill, Goffin, Gellatly (2012). Teamwork KSA test validity. International Journal of Selection and Assessment 20(1) cin.ufpe.br
- S130 (grade B) Herborn, Stadler, Mustafić, Greiff (2020). Human versus agent partners in collaborative problem solving. Computers in Human Behavior 104, 105624 epub.ub.uni-muenchen.de DOI
- S131 (grade A) Bell (2007). Deep-level composition variables and team performance. Journal of Applied Psychology 92(3); Mount, Barrick, Stewart (1998) pubmed.ncbi.nlm.nih.gov gwern.net
- S132 (grade B) Hannay et al. (2010). Personality and pair programming. IEEE Transactions on Software Engineering 36(1) simula.no
- S134 (grade B) Lenberg, Feldt (2018). Psychological safety and norm clarity in software teams. CHASE arxiv.org
- S135 (grade B) Galizzi, Navarro-Martinez (2019). External validity of social-preference games. Management Science 65(3) econ-papers.upf.edu
- S136 (grade A) Marlow et al. (2018). Team communication and performance psychiatry.ucsd.edu
- S139 (grade B) Stasser, G., & Titus, W. (1985). Pooling of unshared information in group decision making: Biased information sampling during discussion. Journal of Personality and Social Psychology 48(6), 1467-1478 DOI
- S140 (grade B) Edmondson, A. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly 44(2), 350-383 DOI
- S141 (grade B) Fisher, R., & Ury, W. (1981). Getting to Yes: Negotiating Agreement Without Giving In. Boston: Houghton Mifflin
- S142 (grade B) Organ, D. W. (1988). Organizational Citizenship Behavior: The Good Soldier Syndrome. Lexington, MA: Lexington Books; Grant, A. (2013). Give and Take. New York: Viking
- S143 (grade B) London, M., & Smither, J. W. (2002). Feedback orientation, feedback culture, and the longitudinal performance management process. Human Resource Management Review 12(1), 81-100 DOI
Empathy and social perception
- S145 (grade B) Higgins et al. (2023). Psychometrics of the Reading the Mind in the Eyes test. Assessment DOI
- S147 (grade B) Greenberg et al. (2018). Sex and autism differences in empathy scores. PNAS pmc.ncbi.nlm.nih.gov
- S148 (grade A) Munyon et al. (2015). Political skill (umbrella summary) qic-wd.org
- S149 (grade B) Galinsky, Maddux, Gilin, White (2008). Perspective taking and empathy in negotiations. Psychological Science willmaddux.web.unc.edu
- S150 (grade B) Grant, Berry (2011). Perspective taking and creativity. Academy of Management Journal faculty.wharton.upenn.edu
- S151 (grade B) Sunahara et al. (2022). Self-reported versus performance-based empathy. Journal of Experimental Psychology: General sites.bu.edu
- S152 (grade B) Baez et al. (2017). Gender differences in empathy measures pmc.ncbi.nlm.nih.gov
- S153 (grade B) Gunatilake, Grundy, Hoda, Mueller (2023). Empathy models and software engineering. Journal of Systems and Software 203; TOSEM 2024 arxiv.org arxiv.org
- S154 (grade B) Gunawardena et al. (2022). Destructive criticism in code review. CSCW research.google
- S155 (grade B) Crompton et al. (2020). Autistic and non-autistic information transfer pmc.ncbi.nlm.nih.gov
- S156 (grade B) Dziobek et al. (2008). Multifaceted Empathy Test dev2.imp10.ruhr-uni-bochum.de
- S158 (grade B) Ickes, W., Stinson, L., Bissonnette, V., & Garcia, S. (1990). Naturalistic social cognition: Empathic accuracy in mixed-sex dyads. JPSP 59(4), 730-742; Ickes, W. (Ed.) (1997). Empathic Accuracy. New York: Guilford DOI guilford.com
- S160 (grade B) Krackhardt, D. (1990). Assessing the political landscape: Structure, cognition, and power in organizations. Administrative Science Quarterly 35(2), 342-369; Weick, K. E. (1995). Sensemaking in Organizations. Thousand Oaks, CA: Sage DOI us.sagepub.com
- S161 (grade B) Kawakita, J. (1967). Hassōhō: Sōzōsei kaihatsu no tame ni [Abduction/ideation method]. Tokyo: Chūō Kōron (Chūkō Shinsho 136)
- S162 (grade B) Hall, E. T. (1976). Beyond Culture. Garden City, NY: Anchor Press/Doubleday
- S163 (grade A) Teding van Berkhout, E., & Malouff, J. M. (2016). The efficacy of empathy training: A meta-analysis of randomized controlled trials. Journal of Counseling Psychology 63(1), 32-41. Correction: 63(1), 41 DOI
- S491 (grade B) Dennett, D. C. (2013). Intuition Pumps and Other Tools for Thinking. New York: W. W. Norton themarginalian.org
Humor, speech and self-presentation
- S165 (grade B) Greengross, Miller (2011). Humor ability and intelligence. Intelligence 39 uniad.org.br
- S166 (grade B) Christensen, Silvia, Nusbaum, Beaty (2018). Humor production and intelligence beatylab.la.psu.edu
- S167 (grade B) Bitterly, Brooks, Schweitzer (2017). Risky business: when humor increases and decreases status faculty.wharton.upenn.edu
- S168 (grade B) Evans et al. (2019). Gender and leader humor. Journal of Applied Psychology 104 management.eller.arizona.edu
- S170 (grade B) Cooper, Kong, Crossley (2018). Leader humor and subordinate citizenship. Academy of Management Journal vivo.colorado.edu
- S171 (grade B) Jiang, Li, Hou (2019). Cultural differences in humor pmc.ncbi.nlm.nih.gov
- S172 (grade B) Anderson, Brion, Moore, Kennedy (2012). Status-enhancement account of overconfidence. Journal of Personality and Social Psychology cdn.vanderbilt.edu
- S173 (grade B) Kennedy, Anderson, Moore (2013). Overconfidence after exposure. Organizational Behavior and Human Decision Processes escholarship.org
- S174 (grade B) DeGroot, Motowidlo (1999). Vocal and visual interview cues facultyprofile.csuohio.edu
- S175 (grade B) MacLaren et al. (2020). Testing the babble hypothesis. Leadership Quarterly researchconnect.suny.edu
- S176 (grade A) Spence et al. (2022). Accent discrimination in hiring. Personality and Social Psychology Bulletin journals.sagepub.com
- S177 (grade B) Huang, Frideger, Pearce (2013). Nonnative accent and managerial hiring. Journal of Applied Psychology knowledge.wharton.upenn.edu
- S178 (grade B) Kraus et al. (2019). Social class from brief speech and hiring. PNAS pmc.ncbi.nlm.nih.gov
- S179 (grade B) Sasson et al. (2017). First impressions of autistic adults. Scientific Reports 7 pmc.ncbi.nlm.nih.gov
- S180 (grade B) Murphy et al. (2012). "Explain in plain English" and code writing. ICER opus.lib.uts.edu.au
Verification, judgment and AI reliance
- S184 (grade B) Pallier et al. (2002). Individual differences in confidence and calibration home.csulb.edu
- S186 (grade B) Perry et al. (2023). Security of code written with AI assistants. CCS arxiv.org
- S187 (grade B) Buçinca et al. (2021). Cognitive forcing and over-reliance on AI. CSCW arxiv.org
- S189 (grade B) Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science 211(4481), 453-458 DOI
- S190 (grade B) Stanovich, K. E., & West, R. F. (1997). Reasoning independently of prior belief and individual differences in actively open-minded thinking. Journal of Educational Psychology 89(2), 342-357; Stanovich, K. E., West, R. F., & Toplak, M. E. (2013). Myside bias, rational thinking, and intelligence. Current Directions in Psychological Science 22(4), 259-264 DOI DOI
- S191 (grade B) Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review 78(1), 1-3 DOI
- S492 (grade B) Tetlock, P. E. (2005). Expert Political Judgment. Princeton UP
- S493 (grade B) Tetlock & Gardner (2015). Superforecasting. Crown
- S192 (grade B) Mellers, B., Ungar, L., Baron, J., Ramos, J., Gurcay, B., et al. (2014). Psychological strategies for winning a geopolitical forecasting tournament. Psychological Science 25(5), 1106-1115 DOI
- S193 (grade B) Erickson, T. D., & Mattson, M. E. (1981). From words to meaning: A semantic illusion. Journal of Verbal Learning and Verbal Behavior 20(5), 540-551 DOI
- S194 (grade B) Popper, K. R. (1959). The Logic of Scientific Discovery. London: Hutchinson (German original Logik der Forschung, 1934/1935) en.wikipedia.org
- S196 (grade B) Baltes, P. B., & Staudinger, U. M. (2000). Wisdom: A metaheuristic (pragmatic) to orchestrate mind and virtue toward excellence. American Psychologist 55(1), 122-136 DOI
- S197 (grade B) King, P. M., & Kitchener, K. S. (1994). Developing Reflective Judgment. San Francisco: Jossey-Bass
- S198 (grade B) Suedfeld, P., & Tetlock, P. E. (1977). Integrative complexity of communications in international crises. Journal of Conflict Resolution 21(1), 169-184 DOI
- S199 (grade B) Martin, R. L. (2007). The Opposable Mind: How Successful Leaders Win Through Integrative Thinking. Boston: Harvard Business School Press
- S200 (grade B) Budner, S. (1962). Intolerance of ambiguity as a personality variable. Journal of Personality 30(1), 29-50; Klein, G. (1998). Sources of Power: How People Make Decisions. Cambridge, MA: MIT Press DOI
Language models and assessment integrity
- S202 (grade B) Hickman (2025). Unproctored testing and language models. International Journal of Selection and Assessment 33(2) news.vt.edu
- S203 (grade B) Webb, Holyoak, Lu (2023). Emergent analogical reasoning. Nature Human Behaviour arxiv.org
- S204 (grade B) Phillips, Robie (2024). Faking of personality tests by GPT-4. Personality and Individual Differences hrreporter.com wlu.ca
- S205 (grade B) Dabdoub, Pool. Aggregate score change after ChatGPT. International Journal of Selection and Assessment citedrive.com
- S207 (grade B) Mittelstädt et al. (2024). Language models outperform humans on a social situational judgment test. Scientific Reports ncbi.nlm.nih.gov
- S208 (grade B) Hagendorff, Fabi, Kosinski (2023). Intuitive reasoning errors in language models. Nature Computational Science pmc.ncbi.nlm.nih.gov
Psychometrics and scoring methods
- S209 (grade B) Mislevy, Steinberg, Almond (2003). On the structure of educational assessments. Measurement 1(1), 3-62 DOI
- S210 (grade B) Kane (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement 50(1), 1-73 DOI
- S211 (grade B) van der Linden, W. J. (2005). Linear Models for Optimal Test Design. New York: Springer DOI
- S212 (grade B) Glas, C. A. W., & van der Linden, W. J. (2003). Computerized adaptive testing with item cloning. Applied Psychological Measurement 27(4), 247-261 DOI
- S213 (grade B) Weiss (1982). Adaptive testing. Applied Psychological Measurement 6(4), 473-492 DOI
- S214 (grade B) Yamamoto, Shin, Khorramdel (2018). Multistage adaptive testing. Educational Measurement: Issues and Practice 37(4), 16-27 DOI
- S215 (grade B) Tonidandel, Quiñones, Adams (2002). Journal of Applied Psychology 87(2), 320-332 DOI
- S216 (grade B) Rasch, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen: Danish Institute for Educational Research (expanded ed. 1980, University of Chicago Press)
- S217 (grade B) Elo, A. E. (1978). The Rating of Chessplayers, Past and Present. New York: Arco
- S218 (grade B) Klinkenberg, S., Straatemeier, M., & van der Maas, H. L. J. (2011). Computer adaptive practice of Maths ability using a new item response model for on the fly ability and difficulty estimation. Computers & Education 57(2), 1813-1824 DOI
- S219 (grade B) Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. New York: Wiley DOI
- S220 (grade B) Cascio, W. F., Outtz, J., Zedeck, S., & Goldstein, I. L. (1991). Statistical implications of six methods of test score use in personnel selection. Human Performance 4(4), 233-264 DOI
- S221 (grade B) Thurstone, L. L. (1927). A law of comparative judgment. Psychological Review 34(4), 273-286 DOI
- S222 (grade B) Bradley, R. A., & Terry, M. E. (1952). Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika 39(3/4), 324-345 DOI
- S223 (grade B) Pollitt, A. (2012). The method of Adaptive Comparative Judgement. Assessment in Education: Principles, Policy & Practice 19(3), 281-300. See also Pollitt (2012), International Journal of Technology and Design Education 22(2), 157-170 DOI DOI
- S224 (grade B) Saaty, T. L. (1980). The Analytic Hierarchy Process: Planning, Priority Setting, Resource Allocation. New York: McGraw-Hill
- S225 (grade B) Gierl, M. J., & Haladyna, T. M. (Eds.) (2012). Automatic Item Generation: Theory and Practice. New York: Routledge DOI
- S226 (grade B) Gierl, Lai (2013). Automatic item generation. Educational Measurement: Issues and Practice 32(3), 36-50
- S227 (grade B) Sommer, Arendasy (2025). Journal of Intelligence 13(8), 102 pmc.ncbi.nlm.nih.gov
- S228 (grade B) Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56(2), 81-105 DOI
- S229 (grade B) Green, D. M., & Swets, J. A. (1966). Signal Detection Theory and Psychophysics. New York: Wiley
- S230 (grade B) Luce, R. D., & Tukey, J. W. (1964). Simultaneous conjoint measurement: A new type of fundamental measurement. Journal of Mathematical Psychology 1(1), 1-27 DOI
- S231 (grade A) Hausknecht et al. (2007). Retesting in selection: practice effects. Journal of Applied Psychology depaul.elsevierpure.com
- S233 (grade B) Goldhammer and colleagues (2014). Time on task. Journal of Educational Psychology 106(3), 608-626 DOI
- S485 (grade B) Green, P. E., & Rao, V. R. (1971). Conjoint measurement for quantifying judgmental data. Journal of Marketing Research 8(3), 355-363 DOI
- S487 (grade B) Bramley, T., & Vitello, S. (2019). The effect of adaptivity on the reliability coefficient in adaptive comparative judgement. Assessment in Education: Principles, Policy & Practice 26(1), 43-58 (online 2018) DOI
Fairness and adverse impact
- S236 (grade B) Ployhart, Holtz (2008). The diversity-validity dilemma. Personnel Psychology 61(1), 153-172 DOI
- S237 (grade B) De Corte, Lievens, Sackett (2007). Journal of Applied Psychology 92(5), 1380-1393 DOI
- S238 (grade B) Song, Wee, Newman (2017). Journal of Applied Psychology 102(12), 1636-1657 DOI
- S239 (grade B) Putnick, Bornstein (2016). Measurement invariance conventions and reporting. Developmental Review 41, 71-90 pmc.ncbi.nlm.nih.gov
- S240 (grade A) Ramos-Villagrasa et al. (2022). Game-related assessments ncbi.nlm.nih.gov
- S241 (grade B) Liang et al. (2023). AI-text detectors biased against non-native writers pmc.ncbi.nlm.nih.gov
- S242 (grade B) Koenecke et al. (2020). Racial disparities in speech recognition. PNAS pmc.ncbi.nlm.nih.gov
- S243 (grade B) Hofmann et al. (2024). Dialect prejudice in language models. Nature pmc.ncbi.nlm.nih.gov
- S245 (grade B) Hickman et al. (2022). Automated video interview personality assessments. Journal of Applied Psychology 107 par.nsf.gov
- S247 (grade B) Hickman, Langer, Saef, Tay (2025). Transcription bias in automated interviews. Journal of Applied Psychology 110 academicnewsletter.sufe.edu.cn
- S248 (grade B) Goldin, C., & Rouse, C. (2000). Orchestrating impartiality: The impact of "blind" auditions on female musicians. American Economic Review 90(4), 715-741 DOI
- S249 (grade B) Cleary, T. A. (1968). Test bias: Prediction of grades of Negro and white students in integrated colleges. Journal of Educational Measurement 5(2), 115-124 DOI
Candidate reactions and adoption
- S250 (grade A) Hausknecht, Day, Thomas (2004). Applicant reactions. Personnel Psychology 57(3), 639-683 DOI
- S251 (grade A) Anderson, Salgado, Hülsheger (2010). International Journal of Selection and Assessment 18(3), 291-304 DOI
- S252 (grade B) McCarthy and colleagues (2017). Journal of Management 43(6), 1693-1725 DOI
- S253 (grade B) Gilliland, S. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. Academy of Management Review 18(4), 694-734 DOI
- S254 (grade B) Highhouse (2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology 1(3), 333-342
- S255 (grade B) Rynes, Colbert, Brown (2002). Human Resource Management 41(2), 149-174
- S256 (grade B) Lodato, Highhouse, Brooks (2011). Journal of Managerial Psychology emerald.com
- S257 (grade B) Nolan, Carter, Dalal (2016). Personnel Assessment and Decisions 2(1) scholarworks.bgsu.edu
- S258 (grade B) Kausel, Culbertson, Madrid (2016). Organizational Behavior and Human Decision Processes
- S259 (grade B) Dietvorst, Simmons, Massey (2015). Algorithm aversion. Journal of Experimental Psychology: General
- S260 (grade B) Dietvorst, Simmons, Massey (2018). Overcoming algorithm aversion. Management Science marketing.wharton.upenn.edu
- S261 (grade B) Logg, Minson, Moore (2019). Algorithm appreciation. Organizational Behavior and Human Decision Processes 151, 90-103
- S262 (grade B) Neumann, Niessen, Tendeiro, Meijer (2022). Journal of Behavioral Decision Making 35(4) DOI
- S263 (grade B) Önkal and colleagues (2009). Advice from human experts and statistical methods. Journal of Behavioral Decision Making researchportal.northumbria.ac.uk
- S264 (grade B) König, Klehe, Berchtold, Kleinmann (2010). International Journal of Selection and Assessment uni-saarland.de
- S266 (grade B) Brooks, Dalal, Nolan (2014). Journal of Applied Psychology
- S267 (grade B) Cucina, Berger, Busciglio (2017). Personnel Assessment and Decisions 3(1) scholarworks.bgsu.edu
- S268 (grade B) Langer, M., König, C. J., & Busch, V. (2021). Changing the means of managerial work: Effects of automated decision support systems on personnel selection tasks. Journal of Business and Psychology 36(5), 751-769 (online 16 September 2020) DOI link.springer.com
- S269 (grade B) Newman, Fast, Harmon (2020). Organizational Behavior and Human Decision Processes 160, 149-167
- S270 (grade B) Kupfer and colleagues (2023). Frontiers in Psychology pmc.ncbi.nlm.nih.gov
- S272 (grade B) Langer, M., Baum, K., König, C. J., Hähne, V., & Oster, D. (2021). Spare me the details: How the type of information about automated interviews influences applicant reactions. International Journal of Selection and Assessment 29(2), 154-169 DOI publikationen.sulb.uni-saarland.de
- S273 (grade B) Malin and colleagues (2025). Frontiers in Artificial Intelligence public-pages-files-2025.frontiersin.org
- S274 (grade B) Yurrita and colleagues (2023). Disentangling fairness perceptions in algorithmic decision-making. CHI research.tudelft.nl
Standards, audits and reviews
- S279 (grade A) SIOP (2018). Principles for the Validation and Use of Personnel Selection Procedures (5th ed.) cambridge.org
- S280 (grade A) SIOP (2023). Considerations and Recommendations for the Validation and Use of AI-Based Assessments for Employee Selection siop.org
- S281 (grade A) ITC, ATP (2022). Guidelines for Technology-Based Assessment siop.org
- S282 (grade A) International Test Commission (2017). ITC Guidelines for Translating and Adapting Tests (2nd ed.). International Journal of Testing 18(2), 101-134
- S283 (grade A) EFPA (2025). Test Review Model, version 5.0 infocop.es
- S284 (grade B) British Psychological Society, test reviews and registration bps.org.uk
- S285 (grade B) COTAN (Dutch test review) cotandocumentatie.nl
- S286 (grade B) DTK (German test review board)
- S287 (grade B) Buros Center for Testing, Mental Measurements Yearbook buros.org
- S288 (grade B) DIN CERTCO, fee schedule for job-related aptitude assessment under DIN 33430 (valid from 1 July 2025) dincertco.de
- S289 (grade A) ISO 10667-2:2020, assessment service delivery iso.org
- S290 (grade A) ISO/IEC 42006:2025, requirements for bodies certifying AI management systems iso.org
- S291 (grade A) ISO/IEC 42001:2023, AI management system
- S292 (grade A) ISO/IEC 17024:2012. Conformity assessment: General requirements for bodies operating certification of persons. Geneva: ISO law.resource.org
- S293 (grade A) WCAG 2.2, level AA
- S294 (grade B) Landers, Behrend (2023). Auditing the AI auditors. American Psychologist 78(1), 36-49 DOI
- S295 (grade B) Tippins, Oswald, McPhail (2021). Scientific, legal and ethical concerns about AI-based personnel selection tools. Personnel Assessment and Decisions 7(2) scholarworks.bgsu.edu
- S296 (grade B) Wilson and colleagues (2021). Building and auditing fair algorithms: a case study in candidate screening. FAccT ccs.neu.edu
Law and regulation
- S299 (grade A) EU AI Act (Regulation (EU) 2024/1689), Annex III, point 4: employment uses are high-risk artificialintelligenceact.eu artificialintelligenceact.eu
- S300 (grade A) EU AI Act, Article 5 (prohibited practices, emotion recognition in the workplace) artificialintelligenceact.eu
- S301 (grade A) EU AI Act, Article 43 and provider duties (Articles 9-17, 26, 43, 47-49, 72; Annex VI internal control) artificialintelligenceact.eu
- S302 (grade A) EU AI Act, Article 50 (disclosure of AI role-players and teammates)
- S303 (grade A) European Commission (2025). Guidelines on prohibited artificial intelligence practices, C(2025) 884; FPF commentary ec.europa.eu fpf.org
- S306 (grade A) GDPR, Regulation (EU) 2016/679 (Articles 6, 9, 22)
- S307 (grade A) CJEU C-634/21 SCHUFA (2023), via Bird & Bird commentary twobirds.com
- S308 (grade A) CJEU C-203/22 Dun & Bradstreet Austria (2025)
- S309 (grade A) CJEU C-184/20 (2022), special-category data by inference, via Inside Privacy insideprivacy.com
- S310 (grade A) Griggs v. Duke Power Co., 401 U.S. 424 (1971) law.cornell.edu
- S311 (grade A) Uniform Guidelines on Employee Selection Procedures (1978), 29 CFR 1607 (sections 7B, 14C, 15) ecfr.gov uniformguidelines.com
- S313 (grade B) EEOC (2022). Guidance on AI and the ADA (withdrawn 2025)
- S314 (grade B) Office of the New York State Comptroller (2025). Audit of Local Law 144 enforcement osc.ny.gov
- S315 (grade A) Illinois HB 3773 (in force 1 January 2026), via Morgan Lewis morganlewis.com
- S316 (grade A) Colorado AI law (SB 26-189), via JD Supra (2026) jdsupra.com
- S317 (grade A) California Civil Rights Council regulations on automated-decision systems (in force 1 October 2025), via Proskauer proskauer.com
- S318 (grade A) Mobley v. Workday, collective certification (May 2025), via HR Dive hrdive.com
- S319 (grade A) Americans with Disabilities Act (ADA)
- S320 (grade B) ICO (2024). Audit of AI recruitment tools, via Hunton hunton.com
- S321 (grade A) UK SI 2026/82, commencement of Data (Use and Access) Act 2025 provisions legislation.gov.uk
- S322 (grade A) Equality Act 2010 (UK), reasonable adjustments
- S323 (grade A) Government Legal Service v Brookes, UKEAT/0302/16 (2017) employmentcasesupdate.co.uk
- S324 (grade A) EBA and ESMA, guidelines on the suitability of management body members and key function holders eba.europa.eu
- S325 (grade A) FCA Handbook, FIT: The Fit and Proper test handbook.fca.org.uk
- S326 (grade A) Works Constitution Act (Betriebsverfassungsgesetz), section 95 gesetze-im-internet.de
- S327 (grade B) US OPM (2026). Chance to Compete Act implementation plan opm.gov
- S328 (grade B) NHS Employers (2026). Professional registration and qualification checks nhsemployers.org
- S484 (grade A) Regulation (EU) 2026/1744 of the European Parliament and of the Council of 8 July 2026 amending Regulations (EU) 2024/1689, (EU) 2018/1139 and (EU) 2023/1230 (Digital Omnibus on AI) eur-lex.europa.eu
AI adoption and labour market
- S348 (grade B) UK DSIT (2026). Entry-level hiring in the UK: a snapshot gov.uk
Hiring practice and assessment integrity
- S350 (grade B) Canva Engineering (2025). Yes, you can use AI in our interviews canva.dev
- S360 (grade B) US Department of Justice (2025). Christina Chapman sentencing justice.gov
- S362 (grade B) Anthropic, guidance for candidates on AI use anthropic.com
Other work domains: employers and frameworks
- S431 (grade B) ESCO, skill reusability level esco.ec.europa.eu
- S432 (grade B) SFIA 9, generic attributes and levels of responsibility sfia-online.org
- S433 (grade B) Health Education England, MSRA applicant guide heeoe.hee.nhs.uk
- S434 (grade B) EPSO, competency framework eu-careers.europa.eu
Software engineering practice and AI-assisted development
- S438 (grade B) Cui et al. Field experiments on generative AI and developer productivity. Management Science papers.ssrn.com
- S442 (grade B) Li, Ko, Zhu (2015). What makes a great software engineer? ICSE; follow-up 2019 faculty.washington.edu faculty.washington.edu
- S443 (grade B) Bergersen, Sjøberg, Dybå (2014). IEEE Transactions on Software Engineering 40(12), 1163-1184 DOI
- S444 (grade B) Forsgren and colleagues (2021). The SPACE of developer productivity. ACM Queue 19(1) queue.acm.org
- S446 (grade B) Fagan, M. E. (1976). Design and code inspections to reduce errors in program development. IBM Systems Journal 15(3), 182-211 DOI
- S447 (grade B) DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1978). Hints on test data selection: Help for the practicing programmer. Computer 11(4), 34-41 DOI
- S448 (grade B) Gould, J. D. (1975). Some psychological evidence on how people debug computer programs. International Journal of Man-Machine Studies 7(2), 151-182; Vessey, I. (1985). Expertise in debugging computer programs: A process analysis. IJMMS 23(5), 459-494 DOI DOI
- S494 (grade A) Davis, A., Dieste, O., Hickey, A., Juristo, N., & Moreno, A. M. (2006). Effectiveness of requirements elicitation techniques: Empirical results derived from a systematic review. 14th IEEE International Requirements Engineering Conference (RE'06), 179-188 DOI
- S495 (grade B) Pitts, M. G., & Browne, G. J. (2007). Improving requirements elicitation: An empirical investigation of procedural prompts. Information Systems Journal 17(1), 89-110 DOI
Other
- S483 (grade B) Headquarters, Department of the Army (1993). TC 25-20: A Leader's Guide to After-Action Reviews. Washington, DC, 30 September 1993 en.wikipedia.org