Description

Artificial intelligence can make institutional power harder to locate by converting human choices into technical outputs that appear to have no author. A loan is declined, a payment suspended, a worker ranked or a patient classified, while the people who designed the categories, evidence, thresholds and consequences recede from view.

This episode of The Deeper Thinking Podcast uses AI-generated narration.

This episode examines AI as an institutional arrangement, asking when a tool that extends human agency becomes a process that assigns people to the shrinking gaps left by automation. Cory Doctorow’s reverse centaur clarifies this inversion, while Frederick Winslow Taylor’s scientific management reveals its older ambition: to move practical knowledge away from workers and into systems of control.

James C. Scott’s account of administrative legibility and Hannah Arendt’s understanding of judgment show what is lost when complicated lives must become readable from a distance. A human being may remain inside the process, yet their authority can become ceremonial when automation bias makes the system’s recommendation more credible than the person closest to its failure.

The episode names the resulting condition automation debt: people, skill, memory and redundancy are removed before the system has proved it can carry what was transferred to it. Immediate savings remain visible; the costs return later through exceptions, crises and change. The central question is therefore not whether AI is useful, but whether its usefulness is arranged to enlarge judgment, preserve contestability and keep institutions answerable.

For those drawn to the politics of automation, the concealment of responsibility and the fragile conditions of human judgment.

Reflections

The episode’s central tension lies between automation that assists judgment and automation that makes judgment difficult to locate.

• The system’s apparent judgment contains human choices that have been made difficult to find.
• Automation can move uncertainty downward while allowing the institution to appear more certain.
• Human presence does not create human control when the system defines the only acceptable response.
• The machine seems autonomous because its dependencies have been hidden inside other people’s lives.
• The person closest to a system’s failure is often recoded as the failure.
• Removing discretion does not remove values. It relocates them.
• A fluent explanation is not the same as a traceable reason.
• An organisation can know more about a population while becoming less capable of seeing a person.

Why Listen?

• Understand how AI can conceal institutional choices and diffuse responsibility.
• Recognise the hidden labour and uncertainty that automation can relocate rather than remove.
• Examine why human oversight can remain present while becoming largely symbolic.
• Consider how contestability, memory and skilled dissent can keep automated systems answerable.

Listen On:

• YouTube
• Spotify
• Apple Podcasts

Support This Work

If this episode stayed with you and you would like to support the ongoing work, you can do so here: Buy Me a Coffee.

Further Reading

• Doctorow, Cory. The Internet Con: How to Seize the Means of Computation. Verso, 2023.
• Scott, James C. Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed. Yale University Press, 1998.
• Taylor, Frederick Winslow. The Principles of Scientific Management. Harper & Brothers, 1911.
• Arendt, Hannah. Lectures on Kant’s Political Philosophy. Edited by Ronald Beiner. University of Chicago Press, 1982.
• Royal Commission into the Robodebt Scheme. Report of the Royal Commission into the Robodebt Scheme. Commonwealth of Australia, 2023.
• Wallis, Nick. The Great Post Office Scandal. Bath Publishing, 2021.

Further Reading Relevance

• Cory Doctorow: Examines how technical infrastructures distribute power and make users dependent on decisions made elsewhere.
• James C. Scott: Explains how administrative simplification can erase local knowledge and complicated realities.
• Frederick Winslow Taylor: Provides the historical model for transferring practical knowledge from workers to management systems.
• Hannah Arendt: Grounds the distinction between judgment and the mechanical application of rules.
• Robodebt Royal Commission: Documents the consequences of automated administration that obscured legality, responsibility and lived reality.
• Nick Wallis: Shows how institutional deference to a faulty technical system can overpower human testimony and accountability.

A system capable of producing an answer is not necessarily capable of knowing when the answer has damaged the world; for that, it still needs someone who can answer back.

#ArtificialIntelligence #Automation #AlgorithmicGovernance #AutomationBias #CoryDoctorow #FrederickWinslowTaylor #JamesCScott #HannahArendt #InstitutionalPower #TheDeeperThinkingPodcast