Artificial intelligence and judicial decision-making: Evaluating the role of AI in debiasing

Giovana Lopes

doi:10.14512/tatup.33.1.28

Authors

Giovana Lopes Department of Legal Studies, University of Bologna, Bologna (IT) https://orcid.org/0000-0003-4798-2542 giovana.figueiredo@unibo.it

DOI:

https://doi.org/10.14512/tatup.33.1.28

Keywords:

judicial decision-making, judicial biases, artificial intelligence, risk assessment, debiasing

Abstract

As arbiters of law and fact, judges are supposed to decide cases impartially, basing their decisions on authoritative legal sources and not being influenced by irrelevant factors. Empirical evidence, however, shows that judges are often influenced by implicit biases, which can affect the impartiality of their judgment and pose a threat to the right to a fair trial. In recent years, artificial intelligence (AI) has been increasingly used for a variety of applications in the public domain, often with the promise of being more accurate and objective than biased human decision-makers. Given this backdrop, this research article identifies how AI is being deployed by courts, mainly as decision-support tools for judges. It assesses the potential and limitations of these tools, focusing on their use for risk assessment. Further, the article shows how AI can be used as a debiasing tool, i. e., to detect patterns of bias in judicial decisions, allowing for corrective measures to be taken. Finally, it assesses the mechanisms and benefits of such use.

References

Allhutter, Doris; Cech, Florian; Fischer, Fabian; Grill, Gabriel; Mager, Astrid (2020): Algorithmic profiling of job seekers in Austria. How austerity politics are made effective. In: Frontiers in Big Data 3 (5), pp. 1–17. https://doi.org/10.3389/fdata.2020.00005 DOI: https://doi.org/10.3389/fdata.2020.00005

Angwin, Julia; Larson, Jeff; Mattu, Surya; Kirchner, Lauren (2016): Machine bias. There’s software used across the country to predict future criminals. And it’s biased against blacks. In: ProPublica, 23. 05. 2016. Available online at https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing, last accessed on 22. 01. 2024.

Arnold, David; Dobbie, Will; Hull, Peter (2020): Measuring racial discrimination in bail decisions. In: NBER Working Paper Series, pp. 1–84. https://doi.org/10.3386/w26999 DOI: https://doi.org/10.3386/w26999

Barabas, Chelsea; Virza, Madars; Dinakar, Karthik; Ito, Joichi; Zittrain, Jonathan (2018): Interventions over predictions. Reframing the ethical debate for actuarial risk assessment. In: Proceedings of the 1st Conference on Fairness, Accountability and Transparency, PMLR 81, pp. 62–76. Available online at https://proceedings.mlr.press/v81/barabas18a.html, last accessed on 22. 01. 2024

Bielen, Samantha; Marneffe, Wim; Mocan, Naci (2021): Racial bias and in-group bias in virtual reality courtrooms. In: The Journal of Law and Economics 64 (2), pp. 269–300. https://doi.org/10.1086/712421 DOI: https://doi.org/10.1086/712421

Bystranowski, Piotr; Janik, Bartosz; Próchnicki, Maciej; Skórska, Paulina (2021): Anchoring effect in legal decision-making. A meta-analysis. In: Law and Human Behavior 45 (1), pp. 1–23. https://doi.org/10.1037/lhb0000438 DOI: https://doi.org/10.1037/lhb0000438

Chatziathanasiou, Konstantin (2022): Beware the lure of narratives. ‘Hungry Judges’ should not motivate the use of “Artificial Intelligence” in law. In: German Law Journal 23 (4), pp. 452–464. https://doi.org/10.1017/glj.2022.32 DOI: https://doi.org/10.1017/glj.2022.32

Chen, Daniel (2019a): Machine learning and the rule of law. In: Michael Livermore and Daniel Rockmore (eds.): Law as Data. Santa Fe, NM: SFI Press, pp. 433–441. DOI: https://doi.org/10.37911/9781947864085.16

Chen, Daniel (2019b): Judicial analytics and the great transformation of American law. In: Artificial Intelligence and Law 27 (1), pp. 15–42. https://doi.org/10.1007/s10506-018-9237-x DOI: https://doi.org/10.1007/s10506-018-9237-x

Chen, Daniel; Loecher, Markus (2019): Mood and the malleability of moral reasoning. In: SSRN Electronic Journal, pp. 1–62. https://dx.doi.org/10.2139/ssrn.2740485 DOI: https://doi.org/10.2139/ssrn.2740485

Danziger, Shai; Levav, Jonathan; Avnaim-Pesso, Liora (2011): Extraneous factors in judicial decisions. In: Proceedings of the National Academy of Sciences 108 (17), pp. 6889–6892. https://doi.org/10.1073/pnas.1018033108 DOI: https://doi.org/10.1073/pnas.1018033108

Dietterich, Thomas (2019): Robust artificial intelligence and robust human organizations. In: Frontiers of Computer Science 13 (1), pp. 1–3. https://doi.org/10.1007/s11704-018-8900-4 DOI: https://doi.org/10.1007/s11704-018-8900-4

Dunn, Matt; Sagun, Levent; Şirin, Hale; Chen, Daniel (2017a): Early predictability of asylum court decisions. In: ICAIL ’17. Proceedings of the 16th edition of the International Conference on Artificial Intelligence and Law. New York, NY: Association for Computing Machinery, pp. 233–236. https://doi.org/10.1145/3086512.3086537 DOI: https://doi.org/10.1145/3086512.3086537

European Commission (2021): Proposal for a regulation of the European Parliament and the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain union legislative acts. Brussels: European Commission. Available online at https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=celex:52021PC0206, last accessed on 22. 01. 2024.

CEPEJ – European Commission for the Efficiency of Justice (2018): European ethical charter on the use of artificial intelligence in judicial systems and their environment. Strasbourg: Council of Europe. Available online at https://rm.coe.int/ethical-charter-en-for-publication-4-december-2018/16808f699c, last accessed on 22. 01. 2024.

CEPEJ (2023): Resource centre on cyberjustice and AI. Available online at https://public.tableau.com/app/profile/cepej/viz/ResourceCentreCyberjusticeandAI/AITOOLSINITIATIVESREPORT, last accessed on 22. 01. 2024.

Ghasemi, Mehdi; Anvari, Daniel; Atapour; Mahshid; Wormith, Stephen; Stockdale, Keira; Spiteri, Raymond (2021): The application of machine learning to a general risk-need assessment instrument in the prediction of criminal recidivism. In: Criminal Justice and Behavior 48 (4), pp. 518–538. https://doi.org/10.1177/0093854820969753 DOI: https://doi.org/10.1177/0093854820969753

Green, Ben; Chen, Yiling (2021): Algorithmic risk assessments can alter human decision-making processes in high-stakes government contexts. In: Proceedings of the ACM on Human-Computer Interaction 5 (CSCW2). New York, NY: Association for Computing Machinery, pp. 1–33. https://doi.org/10.1145/3479562 DOI: https://doi.org/10.1145/3479562

Green, Ben (2022): The flaws of policies requiring human oversight of government algorithms. In: Computer Law & Security Review 45, pp. 1–22. https://doi.org/10.1016/j.clsr.2022.105681 DOI: https://doi.org/10.1016/j.clsr.2022.105681

Heaven, Will (2020): Predictive policing algorithms are racist. In: MIT Technology Review, 17. 07. 2020. Available online at https://www.technologyreview.com/2020/07/17/1005396/predictive-policing-algorithms-racist-dismantled-machine-learning-bias-criminal-justice/, last accessed on 10. 01. 2024.

Heyes, Anthony; Saberian, Soodeh (2019): Temperature and decisions. In: American Economic Journal 11 (2), pp. 238–265. https://doi.org/10.1257/app.20170223 DOI: https://doi.org/10.1257/app.20170223

Kleinberg, Jon; Lakkaraju, Himabindu; Leskovec, Jure; Ludwig, Jens; Mullainathan, Sendhil (2018): Human decisions and machine predictions. In: The Quarterly Journal of Economics 133 (1), pp. 237–293. https://doi.org/10.1093/qje/qjx032 DOI: https://doi.org/10.3386/w23180

Larret-Chahine, Louis (2023): Predictice lance assistant, une IA générative pour les professionnels du droit. In: Predictice Blog, 26. 05. 2023. Available online at https://blog.predictice.com/assistant-ia-pour-les-professionnels-du-droit, last accessed on 10. 01. 2024.

Jordan, Kareem; Bowman, Rachel (2022): Interacting race/ethnicity and legal factors on sentencing decisions. A test of the liberation hypothesis. In: Corrections 7 (2), pp. 87–106. https://doi.org/10.1080/23774657.2020.1726839 DOI: https://doi.org/10.1080/23774657.2020.1726839

Lidén, Moa; Gräns, Minna; Juslin, Peter (2019): ‘Guilty, no doubt’. Detention provoking confirmation bias in judges’ guilt assessments and debiasing techniques. In: Psychology, Crime & Law 25 (3), pp. 219–247. https://doi.org/10.1080/1068316X.2018.1511790 DOI: https://doi.org/10.1080/1068316X.2018.1511790

Mayson, Sandra (2019): Bias in, bias out. In: The Yale Law Journal 128 (8), pp. 2218–2300. Available online athttps://www.yalelawjournal.org/article/bias-in-bias-out, last accessed on 10. 01. 2024.

Miller, Andrea (2019): Expertise fails to attenuate gendered biases in judicial decision making. In: Social Psychological and Personality Science 10 (2), pp. 227–234. https://doi.org/10.1177/1948550617741181 DOI: https://doi.org/10.1177/1948550617741181

Parasuraman, Raja; Manzey, Dietrich (2010): Complacency and bias in human use of automation. In: Human Factors 52 (3), pp. 381–410. https://doi.org/10.1177/0018720810376055 DOI: https://doi.org/10.1177/0018720810376055

Rachlinski, Jeffrey; Wistrich, Andrew (2021): Benevolent sexism in judges. In: San Diego Law Review 58 (1), pp. 101–142. Available online at https://digital.sandiego.edu/sdlr/vol58/iss1/3, last accessed on 22. 01. 2024.

Rassin, Eric (2020): Context effect and confirmation bias in criminal fact finding. In: Legal and Criminological Psychology 25 (2), pp. 80–89. https://doi.org/10.1111/lcrp.12172 DOI: https://doi.org/10.1111/lcrp.12172

Salo, Benny; Laaksonen, Toni; Santtila, Pekka (2019): Predictive power of dynamic (vs. static) risk factors in the Finnish risk and needs assessment form. In: Criminal Justice and Behavior 46 (7), pp. 939–960. https://doi.org/10.1177/0093854819848793 DOI: https://doi.org/10.1177/0093854819848793

Steponenaite, Vilte; Valcke, Peggy (2020): Judicial analytics on trial. An assessment of legal analytics in judicial systems in light of the right to a fair trial. In: Maastricht Journal of European and Comparative Law 27 (6), pp. 759–773. https://doi.org/10.1177/1023263X20981472 DOI: https://doi.org/10.1177/1023263X20981472

Shroff, Ravi; Vamvourellis, Konstantinos (2022): Pretrial release judgments and decision fatigue. In: Judgment and Decision Making 17 (6), pp. 1176–120. https://doi.org/10.1017/S1930297500009384 DOI: https://doi.org/10.1017/S1930297500009384

Rudin, Cynthia; Wang, Caroline; Coker, Beau (2020): The age of secrecy and unfairness in recidivism prediction. In: Harvard Data Science Review 2 (1), pp. 1–53 https://doi.10.1162/99608f92.6ed64b30 DOI: https://doi.org/10.1162/99608f92.6ed64b30

SWR (2022): OLG Stuttgart setzt KI bei Diesel-Klagen ein. In: SWR Aktuell, 24. 10. 2022. Available online at https://www.swr.de/swraktuell/baden-wuerttemberg/stuttgart/olg-stuttgart-mit-ki-gegen-flut-von-dieselklagen-100.html, last accessed on 10. 01. 2024.

Justice Data Lab (2016): Incorporating offender assessment data to the justice data lab process. London: Ministry of Justice. Available online at https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/491688/oasys-methodology.pdf, last accessed on 22. 01. 2024.

Van Essen, Laurus; Van Alphen, Huib; Van Tuinen, Jan-Maarten (n.d.): Risk assessment the Dutch way. A scalable, easy to use tool for probation reports. In: Confederation of European Probation News. Available online at https://www.cep-probation.org/risk-assessment-the-dutch-way-a-scalable-easy-to-use-tool-for-probation-reports/, last accessed on 22. 01. 2024.

Van Dijck, Gijs (2022): Predicting recidivism risk meets AI act. In: European Journal on Criminal Policy and Research 28 (3), pp. 407–423. https://doi.org/10.1007/s10610-022-09516-8 DOI: https://doi.org/10.1007/s10610-022-09516-8

Wistrich, Andrew; Rachlinski, Jeffrey (2017): Implicit bias in judicial decision making. How it affects judgement and what judges can do about it. In: Sarah Redfield (ed.): Enhancing justice: Reducing bias, pp. 87–130. https://doi.org/10.31228/osf.io/sz5ma DOI: https://doi.org/10.31228/osf.io/sz5ma

Zenker, Frank (2021): De-biasing legal factfinders. In: Christian Dahlman, Alex Stein and Giovanni Tuzet (eds.): Philosophical foundations of evidence law. Oxford: Oxford University Press, pp. 395–410. https://doi.org/10.1093/oso/9780198859307.003.0027 DOI: https://doi.org/10.1093/oso/9780198859307.003.0027