What AI Actually Is (and What It Isn't)

Series: AI Governance for Community Leaders — Understanding Village AI for Trustees, Councillors, and Board Members (Article 1 of 5) Author: My Digital Sovereignty Ltd Date: March 2026 Licence: CC BY 4.0 International

A Machine That Finishes Your Sentences

You will have encountered claims that artificial intelligence is going to transform public services, community governance, and the way organisations operate. You may also have encountered claims that it is overstated, or that it cannot do anything genuinely new. Both positions miss the point, and understanding why will support better governance decisions.

Here is the plainest description of what AI does today: it predicts what word should come next.

When someone types a query into ChatGPT or asks a voice assistant a question, the system is not reasoning about the query the way a councillor or a trustee would reason about a board paper. It is doing something more mechanical. It has been shown billions of pages of text — legislation, reports, correspondence, technical papers, news articles, social media, medical literature — and from all of that material, it has learned patterns. When you ask it a question, it generates an answer by predicting, one word at a time, what a plausible response looks like based on everything it has previously processed.

This is genuinely useful. A system that has absorbed the patterns of billions of pages of text can help draft correspondence, summarise lengthy documents, answer factual questions, or suggest how to word a sensitive communication. These are real capabilities, and they can reduce administrative burden.

But it is not thinking. It is not understanding. It is pattern matching at an extraordinary scale.

"AI Cannot Do Anything New" — It Depends What You Mean by New

People who dismiss AI by saying it cannot create anything original are making a claim that is narrowly true and broadly misleading.

A language model cannot originate from experience. It has never sat in a public consultation where residents were angry. It has never felt the weight of a funding decision that affects a community's wellbeing. It cannot understand why the precise wording of a council resolution matters — it can only reproduce patterns that statistically resemble understanding. In that sense, everything it produces is a recombination of material it absorbed during training.

But consider what "recombination" actually means at this scale.

No single person has read every piece of local government legislation, every community trust annual report, every academic paper on participatory governance, and every regulatory impact assessment published in the last decade. The AI has been trained on a corpus that includes many of these sources. When it draws a connection between polycentric governance theory and community development practice, that connection may be genuinely novel to any individual reader, even though both ideas existed separately. When it synthesises patterns across domains that no single person has studied together, the synthesis itself is a kind of novelty — not the novelty of lived experience, but the novelty of combination at a scale no individual can match.

A trustee who has read community development literature but not governance theory would find the AI's synthesis informative. A policy analyst who has read governance theory but not community development practice would find the same synthesis informative from the other direction. The atoms are not new, but the molecules are.

So "AI cannot do anything new" is true at the level of origination and false at the level of synthesis. Both things matter, and responsible governance of this technology requires holding both.

Can AI Actually Reason?

There is a deeper question that researchers are actively investigating, and the straightforward answer is: we do not yet know.

When early AI systems produced fluent text, it was reasonable to describe them as sophisticated pattern-matching. But as these systems have grown larger and more capable, something unexpected has happened. They have developed internal structures — circuits, if you like — that look surprisingly like reasoning. Not identical to human reasoning, but not simple retrieval either.

Researchers have found that large language models can solve problems they were never explicitly trained on. They can follow chains of logic across multiple steps. They can draw analogies between domains. Some researchers cautiously describe these capabilities as emergent — meaning they appeared at scale without being specifically designed in.

Whether this constitutes genuine reasoning or very sophisticated pattern-matching that mimics reasoning is an open question. It may ultimately be a philosophical distinction rather than an empirical one. If a system produces the correct answer by a process that resembles reasoning, at what point does the distinction between "real reasoning" and "reasoning-like behaviour" cease to matter in practice?

The research is genuinely inconclusive. Anyone who tells you AI definitively can or cannot reason is overstating what the evidence supports.

What we can say is this: the trajectory is steep. Five years ago, these systems could barely produce a coherent paragraph. Today, they can write essays, pass professional examinations, generate computer code, and hold conversations that many people find indistinguishable from corresponding with a human. Five years from now, their capabilities will be significantly greater again.

Why This Matters for Governance Bodies Now

No one knows with certainty what happens if an AI system ever develops something resembling its own intent — its own purposes and priorities that may not align with the interests of the communities it serves. We are likely still some distance from that threshold. But the architecture we build now, the habits of governance we establish today, will determine whether we are prepared when that moment arrives or whether we discover too late that we handed over control without noticing.

This is not speculative. It is a straightforward observation about institutional preparedness. Your council has a constitution. Your board has standing orders. Your trust has a governing document. These exist not because every meeting descends into disorder, but because governance structures need to be in place before they are needed, not after.

The same principle applies to AI. The EU AI Act (Regulation 2024/1689) reflects precisely this logic — establishing governance frameworks now, before the technology outpaces regulatory capacity. Organisations that adopt AI without governance structures in place may find themselves non-compliant, exposed to liability, or unable to account for decisions made with AI assistance.

The Real Issue: Whose Patterns?

Here is where it becomes practical for your organisation.

When a large AI system is trained on the internet, it absorbs the internet's biases, assumptions, and cultural defaults. The internet is overwhelmingly English-language, Western, commercially oriented, and shaped by the values of the technology industry. This is not a conspiracy — it is simply what happens when you train a system on data that disproportionately represents one culture and one set of priorities.

The consequences are subtle but material.

When a resident submits a query to an AI system about a difficult neighbour dispute, the system defaults to the language of individual rights and legal remedies — because that is what dominates its training data. It does not reach for the language of mediation, community obligation, or the long view that comes from knowing you will live next to this person for the next twenty years.

When a council officer asks an AI system to help draft a communication about a sensitive planning matter, the system defaults to corporate stakeholder-management language — because business correspondence vastly outnumbers civic communication in its training data.

The system is not hostile to civic values. It simply does not know civic values. It knows what is statistically common, and what is statistically common is not what is most appropriate for your constituents.

This is the real issue with AI for governance bodies. Not whether it can think. Not whether it will replace officials. The real issue is: whose patterns does it carry? And can your organisation choose its own?

Two Paths Forward

There are two ways an organisation can engage with AI.

The first path is to use Big Tech AI — systems such as ChatGPT, Google Gemini, or Microsoft Copilot. These are powerful, convenient, and often inexpensive to access. But they come with conditions. Your data flows to their servers. Your communications become part of their systems. The AI's behaviour is governed by the company's policies, which can change without your agreement. And the patterns the AI carries — its defaults, its assumptions, its cultural framing — are set by its training data, which you have no influence over. Under GDPR, this raises questions about data controllership, lawful basis for processing, and the right to explanation that every governance body should consider before adoption.

The second path is to use AI that your organisation controls. A smaller system, less powerful in raw capability, but trained on your content, running on infrastructure within your jurisdiction, governed by rules your board or council sets. A system that knows the difference between a council minute and a blog post, because your organisation's records taught it. A system whose responses are checked against your actual documents by mathematical verification layers that operate independently of the AI itself.

This is what Village AI is. It is not the most powerful AI system available. It is designed to be accountable to your community — to your content, your values, and your governance framework.

The next article in this series explains how Village AI is structurally different from Big Tech AI, and why that difference matters more than raw power.

This is Article 1 of 5 in the "AI Governance for Community Leaders" series. For the full technical architecture, visit Village AI — Agentic Governance.

Next: Big Tech AI vs. Community-Governed AI — Why the Difference Matters