The Language Fallacy: Why We Can’t Predict the Future of AI

Source record

The Language Fallacy: Why We Can’t Predict the Future of AI

Public debates about artificial intelligence often split into two opposing certainties. One insists that scaling today’s models will inevitably lead to AGI. The other argues that large language models will never become intelligent because they only predict the next word. Both positions project confidence. Both rest on the mistaken belief that we already understand the limits of intelligence and the trajectory of technological change.

A clearer view begins with something far more familiar — and deeply human.

We tend to treat fluency as proof of cognition and speech impairment as evidence of diminished thought. Yet neuroscience tells a more intricate story. Patients with certain forms of aphasia — people who struggle to speak — often retain the ability to reason, plan, judge, recognize intentions, and navigate social cues. Their inner life persists even when their verbal tools falter.

This does not mean that language and thought are unrelated. They interact constantly. But it does mean that language is not identical to thought. It is an expressive layer, an interface rather than the underlying engine.

→ Which leads to a crucial insight: a model of language is not automatically a model of mind.

Large language models operate entirely within linguistic patterns. They excel at predicting the next word — and that alone enables them to display astonishing fluency across countless tasks. But fluency is not the same as understanding. These systems lack embodied experience, causal models, grounded perception, stable goals, or an internal representation of reality. They generate coherence, not cognition.

Recognizing the limits of current AI systems matters. Yet declaring that AI will never achieve meaningful intelligence is just another form of overconfidence.

Technological history is filled with overlooked turning points:

Gutenberg’s printing press was a mechanical shortcut, until it reshaped literacy, religion, and science. Electricity seemed impractical, until it became the backbone of industrial civilization. Computers and the internet were niche instruments, until they became the nervous system of modern life.

Even in AI, breakthroughs have repeatedly defied expectations: AlphaZero learned superhuman strategy without human examples. AlphaFold solved a biological puzzle unsolved for half a century.

→ Inflection points rarely announce themselves. They appear modest — even trivial — right up until the moment they redefine the world.

We imagine innovation as a straight line: incremental improvements accumulating over time. But transformative change often happens when independent ideas collide and amplify one another.

Printing met cheap paper. Electricity met motors. Semiconductors met global networks. Machine learning met simulation and massive compute.

Large language models may be a single ingredient in a far more complex future architecture. Systems of the coming decades may blend:

language + perception perception + embodied interaction simulation + causal reasoning memory + self-refinement or new mechanisms we have not yet conceived.

→ Judging the limits of AI from this first generation of models is like predicting aviation’s future by looking at early gliders.

Parallel to the technological surge, an investment wave has risen — steep, fast, and inflated by narrative. Some of this capital is strategic. Much of it is not.

For many investors, “AI” has become less a technical category than a story:

Pitch decks rely on keywords rather than capabilities. Products built entirely atop third-party models receive valuations as if they owned foundational technology. FOMO substitutes for analysis. Momentum replaces due diligence.

This doesn’t mean AI is overvalued as a field. It means that confidence is growing faster than comprehension.

And bubbles form precisely when understanding fails to keep pace with conviction.

This dynamic reinforces the central point of the essay:

Dogmatic predictions — “AGI is imminent” or “AI will never think” — arise from the same cognitive error: mistaking the present moment for a fixed map of what is possible.

The AI boom is not only technological. It is psychological. It reveals how deeply we crave certainty — especially in domains defined by the absence of it.

Three statements capture the only ground we can stand on with confidence:

Today’s AI systems are not intelligent. They lack grounded reasoning, autonomous intention, and genuine understanding.

We cannot assert they will never become intelligent. History consistently punishes such declarations.

We are operating within radical uncertainty. And in such conditions, humility is not hesitation — it is rigor.

Whether AI achieves intelligence is ultimately less urgent than how we shape the systems already permeating society. We are embedding algorithms into decision-making, communication, creativity, finance, and governance. This demands:

transparent, auditable mechanisms; verifiable human participation; protection from manipulation; human-centric design principles; and responsible governance.

AI is no longer just a technological project. It is a societal, economic, and ethical one.

Yes — today's language models are not intelligent. But insisting they never will be is not an argument. It is a refusal to confront complexity.

“Never” is not analysis. “Never” is a symptom of fear — of uncertainty, ambiguity, and intellectual humility.

A mature relationship with AI requires clarity, responsibility, and the courage to acknowledge what we do not yet know.

In the end, AI is not a test of machines.

It is a test of our ability to think clearly about the unknown.