When Trust is Zero Sum: Automation’s Threat to Epistemic Agency

Ethics and Information Technology 27 (2):1-8 (2025)
  Copy   BIBTEX

Abstract

AI researchers and ethicists have long worried about the threat that automation poses to human dignity, autonomy, and to the sense of personal value that is tied to work. Typically, proposed solutions to this problem focus on ways in which we can reduce the number of job losses which result from automation, ways to retrain those that lose their jobs, or ways to mitigate the social consequences of those job losses. However, even in cases where workers keep their jobs, their agency within those roles might be severely downgraded. For instance, human employees might work alongside artificial intelligence (AI) but not be allowed to make decisions or not be allowed to make decisions without consulting with or coming to agreement with the AI. Here, we argue that this is a kind of epistemic harm (which could be an injustice if it is distributed on the basis of identity prejudice). It diminishes human agency (in constraining people’s ability to act independently), and it fails to recognize the workers’ epistemic agency as qualified experts. Workers, in this case, aren’t given the trust they are entitled to. This means that issues of human dignity remain even in cases where everyone keeps their job. Further, job retention focused solutions, such as designing an algorithm to work alongside the human employee, may only enable these harms. In response to this, we propose an alternative design solution, adversarial collaboration, which addresses the traditional retention problem of automation, but also addresses the larger underlying problem of epistemic harms and the distribution of trust between AI and humans in the workplace.

Other Versions

No versions found

Similar books and articles

Calibrating machine behavior: a challenge for AI alignment.Erez Firt - 2023 - Ethics and Information Technology 25 (3):1-8.
Critically engaging the ethics of AI for a global audience.Samuel T. Segun - 2021 - Ethics and Information Technology 23 (2):99-105.
The tragedy of the master: automation, vulnerability, and distance.Mark Coeckelbergh - 2015 - Ethics and Information Technology 17 (3):219-229.
Political responsibility for responsibility gaps.Sietze Kai Kuilman - 2026 - Ethics and Information Technology 28 (2):32.
Ethical issues in interaction design.Toni Robertson - 2006 - Ethics and Information Technology 8 (2):49-59.

Analytics

Added to PP
2025-05-06

Downloads
967 (#57,668)

6 months
308 (#21,559)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Emmie Malone
San Jose State University
Jason D'Cruz
State University of New York, Albany
1 more

Citations of this work

No citations found.

Add more citations

References found in this work

A Theory of Justice.John Rawls - 1971 - Oxford,: Harvard University Press. Edited by Steven M. Cahn.
Superintelligence: Paths, Dangers, Strategies.Tim Mulgan - forthcoming - Philosophical Quarterly:pqv034.

View all 14 references / Add more references