TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis

TATuPDates 33/1 (2024): News from the editorial office

TATuP Redaktion — Fri, 15 Mar 2024 00:00:00 +0100

AI‑based decision support systems and society: An opening statement

Diana Schneider, Karsten Weber — Fri, 15 Mar 2024 00:00:00 +0100

Although artificial intelligence (AI) and automated decision-making systems have been around for some time, they have only recently gained in importance as they are now actually being used and are no longer just the subject of research. AI to support decision-making is thus affecting ever larger parts of society, creating technical, but above all ethical, legal, and societal challenges, as decisions can now be made by machines that were previously the responsibility of humans. This introduction provides an overview of attempts to regulate AI and addresses key challenges that arise when integrating AI systems into human decision-making. The Special topic brings together research articles that present societal challenges, ethical issues, stakeholders, and possible futures of AI use for decision support in healthcare, the legal system, and border control.

Cui bono? Judicial decision-making in the era of AI: A qualitative study on the expectations of judges in Germany

Anna-Katharina Dhungel, Moreen Heine — Fri, 15 Mar 2024 00:00:00 +0100

Despite substantial artificial intelligence (AI) research in various domains, limited attention has been given to its impact on the judiciary, and studies directly involving judges are rare. We address this gap by using 20 in-depth interviews to investigate German judges’ perspectives on AI. The exploratory study examines (1) the integration of AI in court proceedings by 2040, (2) the impact of increased use of AI on the role and independence of judges, and (3) whether AI decisions should supersede human judgments if they were superior to them. The findings reveal an expected trend toward further court digitalization and various AI use scenarios. Notably, opinions differ on the influence of AI on judicial independence and the precedence of machine decisions over human judgments. Overall, the judges surveyed hold diverse perspectives without a clear trend emerging, although a tendency toward a positive and less critical evaluation of AI in the judiciary is discernible.

AI and access to justice: How AI legal advisors can reduce economic and shame-based barriers to justice

Brandon Long, Amitabha Palmer — Fri, 15 Mar 2024 00:00:00 +0100

ChatGPT – a large language model – recently passed the U.S. bar exam. The startling rise and power of generative artificial intelligence (AI) systems such as ChatGPT lead us to consider whether and how more specialized systems could be used to overcome existing barriers to the legal system. Such systems could be employed in either of the two major stages of the pursuit of justice: preliminary information gathering and formal engagement with the state’s legal institutions and professionals. We focus on the former and argue that developing and deploying publicly funded AI legal advisors can reduce economic and shame-based cultural barriers to the information-gathering stage of pursuing justice.

Artificial intelligence and judicial decision-making: Evaluating the role of AI in debiasing

Giovana Lopes — Fri, 15 Mar 2024 00:00:00 +0100

As arbiters of law and fact, judges are supposed to decide cases impartially, basing their decisions on authoritative legal sources and not being influenced by irrelevant factors. Empirical evidence, however, shows that judges are often influenced by implicit biases, which can affect the impartiality of their judgment and pose a threat to the right to a fair trial. In recent years, artificial intelligence (AI) has been increasingly used for a variety of applications in the public domain, often with the promise of being more accurate and objective than biased human decision-makers. Given this backdrop, this research article identifies how AI is being deployed by courts, mainly as decision-support tools for judges. It assesses the potential and limitations of these tools, focusing on their use for risk assessment. Further, the article shows how AI can be used as a debiasing tool, i. e., to detect patterns of bias in judicial decisions, allowing for corrective measures to be taken. Finally, it assesses the mechanisms and benefits of such use.

Borderline decisions?: Lack of justification for automatic deception detection at EU borders

Daniel Minkin, Lou Therese Brandner — Fri, 15 Mar 2024 00:00:00 +0100

Between 2016 and 2019, the European Union funded the development and testing of a system called “iBorderCtrl”, which aims to help detect illegal migration. Part of iBorderCtrl is an automatic deception detection system (ADDS): Using artificial intelligence, ADDS is designed to calculate the probability of deception by analyzing subtle facial expressions to support the decision-making of border guards. This text explains the operating principle of ADDS and its theoretical foundations. Against this background, possible deficits in the justification of the use of this system are pointed out. Finally, based on empirical findings, potential societal ramifications of an unjustified use of ADDS are discussed.

Situativity, functionality and trust: Results of a scenario-based interview study on the explainability of AI in medicine

Fri, 15 Mar 2024 00:00:00 +0100

A central requirement for the use of artificial intelligence (AI) in medicine is its explainability, i. e., the provision of addressee-oriented information about its functioning. This leads to the question of how socially adequate explainability can be designed. To identify evaluation factors, we interviewed healthcare stakeholders about two scenarios: diagnostics and documentation. The scenarios vary the influence that an AI system has on decision-making through the interaction design and the amount of data processed. We present key evaluation factors for explainability at the interactional and procedural levels. Explainability must not interfere situationally in the doctor-patient conversation and question the professional role. At the same time, explainability functionally legitimizes an AI system as a second opinion and is central to building trust. A virtual embodiment of the AI system is advantageous for language-based explanations

Artificial intelligence in melanoma diagnosis: Three scenarios, shifts in competencies, need for regulation, and reconciling dissent between humans and AI

Jan C. Zoellick, Hans Drexler, Konstantin Drexler — Fri, 15 Mar 2024 00:00:00 +0100

Tools based on machine learning (so-called artificial intelligence, AI) are increasingly being developed to diagnose malignant melanoma in dermatology. This contribution discusses (1) three scenarios for the use of AI in different medical settings, (2) shifts in competencies from dermatologists to non-specialists and empowered patients, (3) regulatory frameworks to ensure safety and effectiveness and their consequences for AI tools, and (4) cognitive dissonance and potential delegation of human decision-making to AI. We conclude that AI systems should not replace human medical expertise but play a supporting role. We identify needs for regulation and provide recommendations for action to help all (human) actors navigate safely through the choppy waters of this emerging market. Potential dilemmas arise when AI tools provide diagnoses that conflict with human medical expertise. Reconciling these conflicts will be a major challenge.

Book review: Coeckelbergh, Mark (2022): The political philosophy of AI

Michael W. Schmidt — Fri, 15 Mar 2024 00:00:00 +0100

Book review: Timon, McPhearson; Nadja, Kabisch; Niki, Frantzeskaki (eds.) (2023): Nature-based solutions for cities

Jaewon Son, Somidh Saha — Fri, 15 Mar 2024 00:00:00 +0100

Meeting report: “Religion and technology in an era of rapid digital and climate change”. Conference, 2023, Chennai, IN (hybrid)

Axel Siegemund, John Bosco Lourdusamy, Johann Fiedler, Renny Thomas — Fri, 15 Mar 2024 00:00:00 +0100

Meeting report: “Generative artificial intelligence – Opportunities, risks and policy challenges”. EPTA Conference, 2023, Barcelona, ES

Steffen Albrecht, Reinhard Grünwald — Fri, 15 Mar 2024 00:00:00 +0100

Meeting report: “PartWiss23”. Conference, 2023, Chemnitz, DE

Bettina Brohmann, Regina Rhodius, Melanie Mbah — Fri, 15 Mar 2024 00:00:00 +0100

Decarbonization of Berlin’s transport sector: Citizens’ assembly on scientifically developed scenarios

Fri, 15 Mar 2024 00:00:00 +0100

As part of this work, a citizens’ assembly was set up to obtain feedback on measures to decarbonize Berlin’s transport sector. The general goal of decarbonization was widely supported. Based on existing studies, discussions were held for private passenger transport, commercial passenger transport, freight transport, and all other transport modes. Agreement could be found on the decarbonization paths for all segments, with the exception of private passenger transport. For the latter, pull measures, like improvements of public transport or bike lanes, are generally accepted, going along with a general desire to switch to non-fossil fuels and to make the transport system in Berlin less car-oriented. Simulations show that pull measures will be far from sufficient to decarbonize private passenger transport. However, more effective push measures, such as higher prices or ban on fossil-fueled vehicles, did not yield clear majorities for this segment.

Editorial

Armin Grunwald — Fri, 15 Mar 2024 00:00:00 +0100

Artificial intelligence out of control?: Interview with Karl von Wendt

Karl von Wendt, Reinhard Heil — Fri, 15 Mar 2024 00:00:00 +0100

TA Focus 33/1 (2024): News for the TA community

Jonas Moosmüller — Fri, 15 Mar 2024 00:00:00 +0100

AI for decision support: What are possible futures, social impacts, regulatory options, ethical conundrums and agency constellations?

Diana Schneider, Karsten Weber (Special topic editors) — Fri, 15 Mar 2024 00:00:00 +0100