Compliance and PIPEDA

What LLMs Still Cannot Do — And What a Well-Built Agent System Gets Right

What LLMs Still Cannot Do — And What a Well-Built Agent System Gets Right

Language models are capable of a great deal. They are also consistently wrong about specific things — and the pattern of failure is predictable enough that responsible builders account for it before deployment. The honest answer to “what will AI never do?” is that nobody can prove never — the research is moving too fast. What we can say with confidence is what current systems get wrong today, why those failures compound in real business environments, and how agent systems built with clear boundaries and human accountability handle those gaps. If you are a Canadian business owner evaluating AI, the question is not whether the technology is perfect. It is whether the system built around it is responsible enough to use.

What This Means for Canadian Businesses

Most businesses evaluating AI are not evaluating a language model in isolation. They are evaluating a vendor, a system, and a set of promises. The gap between what a language model can do in a demo and what it does reliably inside a real business workflow is where most implementations fail. For a Canadian law firm, accounting practice, dental office, or trades operation, that gap has real consequences: a client told the wrong thing, a document mishandled, a deadline missed because the system confidently produced the wrong answer and nobody caught it.

Understanding current AI limitations is not pessimism. It is the foundation of a system design that actually works. TAS builds agent systems with those limitations mapped before the first line of infrastructure is written. You can review how we approach system design across our full range of custom AI services — the principle is the same across every engagement: build to the boundaries of the technology, not beyond them.

The Real Problem with AI Limitations

There are three failure categories that appear repeatedly in current research and in practical deployment. None of them are secrets. All of them are regularly ignored by vendors who want to close a sale.

Failure compounds on long tasks. A 2025 study examining agent behavior on extended, multi-step tasks found that failure rates increase significantly as task length and coordination complexity grow. Tool failures, planning errors, and coordination breakdowns stack — a small error early in a task does not stay small, it propagates. An agent system that performs well on a three-step task may behave very differently on a twelve-step one. The research is specific: this is a current architectural limitation, not a configuration problem a better prompt will fix.

Language models do not have a grounded world model. Recent research on multimodal language models found that even systems that process images and text still lack what researchers describe as a nonverbal grounded world model — the kind of embodied understanding humans use to reason about physical space, cause and effect in the real world, and context that is not encoded in language. For most business applications this is not a daily problem. But it matters when a system is expected to reason about physical records, interpret ambiguous documents, or make inferences that require understanding context the text does not spell out.

Language models do not self-verify against ground truth. A language model generates a response based on pattern. It does not check that response against an authoritative external record. It does not know when it is wrong. It may produce a confident, fluent, grammatically correct answer that is factually incorrect — and it has no internal mechanism to flag that. This is the failure mode that matters most in regulated industries: HST rules, CRA filing deadlines, legal procedure, clinical documentation. Confidence is not accuracy. A well-designed system treats these as separate things and adds verification scaffolding where it counts.

These are not theoretical risks. They are documented in current peer-reviewed research. They are also the exact reasons TAS builds human checkpoints, clear task boundaries, and defined escalation paths into every system rather than treating an agent as an autonomous decision-maker.

What Strategic Reallocation Looks Like in Practice

The following is a representative scenario, not a documented client case study. Details are illustrative.

Consider a mid-size accounting firm in Ontario. The intake process involves a client submitting documents, a staff member reviewing for completeness, a follow-up request if anything is missing, and a handoff to the file manager. Four steps. Each one involves judgment calls, client communication, and file handling that touches personal financial information.

In a representative Digital Landlord engagement, TAS would not build a system that handles this end to end without human involvement. That would be the wrong design. Instead, the agent system would handle the repeatable, bounded portion of the task: acknowledging receipt, checking a defined completeness checklist, sending a structured follow-up request for missing items, and logging the interaction for staff review. A staff member reviews the agent’s output and approves the handoff — within a defined window, typically the same business day.

This is what Strategic Reallocation means in practice: identifying which parts of a workflow are low-judgment, repetitive, and rule-bound — what TAS calls Cost Centers — and building agent infrastructure to handle those parts specifically. The human stays in the loop for decisions that require professional judgment, regulatory knowledge, or accountability. The agent handles what it can handle reliably within defined constraints. The result is that staff spend less time processing and more time on Income-Generating Activities — advisory work, client relationships, and the billable functions that actually grow the business.

A system like this is typically designed to reclaim several hours per week of administrative time per staff member. More importantly, it removes the after-hours backlog that drives the kind of chronic overload described in our founder’s operational background — the Friday 4:47pm pattern where senior staff are still processing intake when they should be finished for the week.

The agent does not make the professional judgment call. The agent does the prep work so the professional can make the judgment call faster, with complete information, during business hours.

How to Know If Your Business Is Ready

There are four questions worth asking before any agent system conversation.

  • Can you describe the task in rules? If a task requires someone to explain how they “just know” what to do, it is not a good first candidate for an agent system. If the task follows a defined checklist or a decision tree that could be written down, it is.
  • Do you have a human checkpoint in the workflow? Every agent system TAS builds includes a defined point where a qualified human reviews output before it reaches the client or produces a downstream consequence. If your workflow does not have that, the system design needs to create one.
  • Where does your client data go? If a system touches personal information — financial records, health data, legal documents — you need to know whether that data crosses the US border and which processors touch it. TAS uses Canadian-hosted infrastructure where possible. When US processors are involved — such as Anthropic for model inference, OpenAI where applicable, or Resend for transactional email — those are named in the architecture, not buried. PIPEDA compliance is not a feature. It is a baseline. You can read more about how TAS approaches Canadian data residency and PIPEDA-compliant system architecture before you engage any vendor.
  • What happens when the system is wrong? A responsible system has a defined recovery path. The agent flags uncertainty rather than fabricating confidence. A staff member is notified. The client receives a human response within a defined window. If a vendor cannot answer this question specifically, the system is not ready for your business.

This is what Human Middleware means in practical terms: humans are not removed from the process. They are repositioned to the decisions that require them, supported by infrastructure that handles the rest.

Frequently Asked Questions

Will an agent system make mistakes?

Yes. Any system built on a language model will produce errors. The relevant question is whether the system is designed to catch them before they reach your clients. A well-built agent system includes defined task boundaries so the model is not asked to do things it handles poorly, verification steps where accuracy matters, and human review at points where a wrong answer would have a real consequence. The goal is not a system that never fails — that does not exist. The goal is a system where failures are caught and corrected reliably.

Can an AI agent handle regulated tasks in my industry — legal, accounting, dental, or trades?

It depends on which part of the task you are describing. Agent systems can handle intake, document collection, scheduling, structured follow-up, and information routing without professional judgment. They should not be the final decision-maker on anything that requires a licensed professional’s accountability — legal advice, tax positions, clinical assessments, or code compliance. A responsible system draws that boundary explicitly in the design. TAS builds systems for professional services firms with those distinctions mapped before deployment.

What are the current AI limitations I should care about as a business owner?

The three that matter most in practical business contexts right now: first, agent failures compound on long or complex tasks — the longer the task chain, the higher the risk of cascading error. Second, language models do not verify their outputs against authoritative sources — they generate fluent responses that may be factually wrong without any internal flag. Third, they lack grounded real-world reasoning for situations where the relevant context is not explicitly in the text. A good system design treats all three as engineering constraints, not edge cases to be explained away after something goes wrong.

How does TAS handle situations where a language model produces the wrong answer?

Every system TAS builds includes defined escalation paths. For tasks where accuracy is non-negotiable, the system is designed to surface uncertainty rather than generate a confident wrong answer. A human reviewer is notified. The client receives a follow-up from a qualified person, not the agent. Where US processors like Anthropic or OpenAI are involved in model inference, that is disclosed in the architecture documentation — not hidden. The accountability for system output sits with the operator, not the model. That is a design principle, not a disclaimer.

Is a Canadian business better served by a custom-built agent system than an off-the-shelf AI tool?

For most professional services firms and trades operations, yes — not because off-the-shelf tools are useless, but because they are not built to your workflow, your compliance requirements, or your client relationships. A template-based system built on US cloud infrastructure by a vendor who does not understand CRA reporting, HST, or the Regulated Health Professions Act is a liability, not an asset. A custom system is built around your specific tasks, your data handling requirements, and the human checkpoints your industry requires. The difference shows up when something goes wrong — which it eventually will with any system.

Book a Free Systems Assessment

If this resonates with how your business operates, book a free 30-minute Systems Assessment. We’ll map your workflows and show you exactly where an agent system could help — no commitment required. Book your Systems Assessment here.

Get pricing or ask a question