Jaron Lanier on AI as Ideology — This Is The World podcast
Jaron Lanier has spent over thirty years at the intersection of technical innovation and humanistic critique. His conversation on This Is The World shifts focus away from the raw computational capabilities of AI and toward something more troubling: the ideology being constructed around it.
The Myth of the Autonomous Machine
One of Lanier’s most striking arguments is that the primary danger of AI is not the code itself, but how we conceptualise it. Silicon Valley has begun to treat AI as a burgeoning deity — a new tech-religion that views technology as an inevitable, autonomous force that will eventually transcend human agency.
When the industry talks about AI as if it is an independent, thinking entity, it participates in what Lanier calls a “denial of the human.” By framing AI outputs as the independent thoughts of a machine rather than the collective results of human data, we risk devaluing the very people who make the technology possible. The machine does not think; it averages the expressions of millions of real human beings.
From Capitalism to Behavioural Modification
This mystification feeds directly into a chilling evolution in the tech landscape: the shift from traditional capitalism to direct behavioural modification. Social media was never just about connecting people; it became a system designed to manipulate user behaviour through algorithmic loops.
Lanier maps this using two frameworks. Siren Servers: high-performance data-gathering systems that aggregate human data, generate immense wealth from it, and structurally alter the economics of the web. Shoshana Zuboff’s The Age of Surveillance Capitalism maps the same economic reality from an academic perspective — on the surface the language differs, yet the diagnosis is the same. And BUMMER: Behaviours of Users Modified, and Made into an Empire for Rent.
His core concern is that AI deepens this trap. If we allow AI to become the intermediary for every human interaction, we hand our agency over to systems optimised purely for engagement and data extraction. Human agency doesn’t disappear overnight; it simply stops being actively exercised.
His longer-term counter-proposal, Data Dignity, was the argument that individuals should be compensated when their creative output generates value for others — data as labour rather than a free resource.
Data Dignity and the Paradox of Provenance
Instead of viewing AI as a magic box that generates content out of thin air, Lanier argues we must see it as a sophisticated collaboration tool. If an AI generates an image or writes a programme, it does so because it was trained on the work of millions of humans. Those contributors should be recognised and compensated. This creates a paradox when viewed alongside modern transparency initiatives like C2PA:
| The Lanier Vision | The Corporate Reality |
|---|---|
| Attribution + Compensation Tracking data lineages so creators are both credited and financially compensated when their work trains a model. |
Attribution Without Compensation The tracking infrastructure exists via cryptographic signatures, but the payment layer is entirely absent. |
| Economic Redistribution Data unions and royalty systems that rewrite the economic balance between users and platforms. |
System Preservation Siren Servers adopt the technical framework of provenance while quietly removing the part that threatens their business model. |
The uncomfortable truth is that we actually used to have Data Dignity. The earliest architecture of the internet, before it was financialised by massive platform aggregators, relied on a model of reciprocal value — creators linked directly to users, and the open-source nature of the network ensured that contribution led to direct visibility, community equity, or direct transaction.
What we have is attribution without compensation. The tracking infrastructure exists. What hasn’t been built is the payment infrastructure — no data unions, no royalty system, no legal requirement for platforms to compensate the people whose creative work trained their models. The economic layer that was supposed to make it meaningful was never built.
OpenAI and the Irrelevance of Money
The conversation also touches on the internal philosophies of organisations like OpenAI. Lanier discusses the radical, utopian notion held by some tech leaders that we are approaching a post-scarcity world where money itself could become irrelevant because machines will handle all production.
Without a human-centric framework, such a shift is profoundly dangerous. It leads to a total loss of human meaning and an absolute reliance on the select few who control the underlying algorithms. True dignity requires that humans remain the source of value, not passive dependents of a corporate cloud.
Why VR Hasn’t Lived Up to the Hype
As a VR pioneer, Lanier’s critique of current iterations of the Metaverse is pointed. Meta’s approach attempted to port the manipulative advertising and tracking models of social media directly into a 3D space. Virtual reality was originally conceived to expand human creativity, perception, and connection — not to build another digital cage for behavioural tracking and biometric data harvesting.
A Framework Worth Examining
Lanier’s diagnosis of AI deification suggests the mystification of these systems is a genuine risk, and content provenance requires effective, scalable solutions. But the framework he presents fails to recognise who is best placed to develop those solutions.
Viewing current tech platforms purely as extractive entities, with data compensation as the singular cure, is perhaps too binary. Technology culture is messy. Where the industry lands as it matures around these verification technologies is, at minimum, a fascinating contradiction. We are watching the industry attempt to retroactively engineer the trust we used to have for free, trying to solve with cryptography a problem that was originally corrupted by business models.
The tool metaphor is a separate question, and arguably a more interesting one. The Translation Tax →
Books by Jaron Lanier
To explore these concepts further, Lanier’s authored works provide a comprehensive roadmap of how the modern digital landscape was formed, and how we might fix it.
You Are Not a Gadget (2010): An essential critique of how the early web quietly forced humans to degrade their own personalities to fit into rigid digital formats.
Who Owns the Future? (2013): The foundational text mapping Siren Servers and the economic argument for why creators should be paid for their data. Introduces the framework for Data Dignity.
Dawn of the New Everything (2017): Part memoir, part technical history, detailing the early, idealistic vision of virtual reality.
Ten Arguments for Deleting Your Social Media Accounts Right Now (2018): A practical, urgent breakdown of the BUMMER machine and how to reclaim your personal agency.