← Charles Tay For SME owners ·

Who checks the AI?

A made-up distributor finds staff pasting price lists into a free chatbot, then gets offered an AI agent that can send quotes on its own. Six weeks later the owner has an answer. Here is how she got there, using free Singapore guides and one short course.

the short version

  • Name one person who answers for how the firm uses AI. In a small firm that is usually the owner.
  • Before an AI tool can act on its own, list what it can touch and decide which actions need a person to say yes first.
  • Start small, keep a log, and check every month whether anyone is still reading what the AI does.
  • Tell customers when AI is involved and who to call when it gets something wrong.
  • Singapore’s government publishes free guides for all of this. You don’t need a consultant to start.

the story

Siew Ling runs a building-supplies distributor in Kaki Bukit: 22 staff, four sales people, about 300 trade customers. She and her firm are made up. The problems are ones I hear about often.

Week 1: a price list in a chatbot

A sales executive shows her a quote he wrote in two minutes. He had pasted the customer’s past orders and the firm’s trade price list into a free chatbot on his phone. Two others do the same. Nobody asked, because nobody had said anything.

She doesn’t ban it. She writes one page: which AI tools staff may use, what never goes in (customer details, trade prices, anything under contract), and who to ask. She names herself and her operations manager as the two people who answer for AI use, and puts AI on the monthly management meeting.

UsedSection 2 of ISAGO, IMDA and PDPC’s free self-check guide: who is responsible, and does everyone know the rules.

Week 2: the agent demo

A software vendor demonstrates an AI agent. It reads email enquiries, checks stock, drafts quotes, sends them, and chases late payments. A chatbot only answers. An agent acts, in the firm’s name.

She asks the vendor to walk her through what the agent is made of. IMDA’s guide for agentic AI, updated in May 2026, lists eight parts. She writes the vendor’s answer under each one.

  • ModelThe AI that reads, plans and writes.
  • InstructionsWhat it is told to do and not do.
  • MemoryWhat it keeps between conversations, including customer details.
  • Planning and reasoningHow it breaks a job into steps.
  • ToolsWhat it can open and change: email, stock system, accounts.
  • ProtocolsHow it connects to other software and other agents.
  • ControlsAccess limits, guardrails and human approvals.
  • Logging and monitoringA record of what it did and why.

Two answers worry her. The agent would get full access to the accounts system, and the vendor can’t show her where its actions are recorded.

UsedSection 1 of IMDA’s Model AI Governance Framework for Agentic AI (version 1.5).

Week 3: where a person says yes

She sorts what the agent would do by two questions: how bad is a mistake, and can it be undone? Checking stock and drafting a quote: low harm, easy to undo, so the agent goes ahead. Sending a quote to a customer, giving a discount, writing off a payment or deleting a record: a person approves first. If the approver is away, the action waits. It doesn’t go ahead by default.

She asks the vendor to give the agent read-only access to the accounts system, and to block the approval-needing actions in the software itself, not just tell the agent in its instructions. Instructions can be ignored or forgotten. A blocked button can’t.

UsedSection 3 of ISAGO on the level of human involvement, and dimension 1 of IMDA’s agentic guide on bounding the risks upfront.

Weeks 4 and 5: two people, one log

The agent starts with two sales staff and one product range. Every action goes into a log nobody can edit. On Fridays the operations manager reads ten drafts at random.

At the end of the month she looks at one number: how often staff changed or rejected a draft before approving it. Early on it is about one in four. If it ever drops to zero, either the agent has become perfect or nobody is reading. IMDA’s May 2026 update suggests tracking this override rate and how fast people approve.

UsedSection 4 of ISAGO on operations, and dimension 3 of IMDA’s agentic guide on testing, gradual rollout and monitoring.

Week 6: telling customers

Quotes now carry one line: drafted with AI, checked by a named staff member, with that person’s number. Customers who reply get a person.

The vendor then asks to use the firm’s customer emails to improve its model. She says no for now. PDPC’s July 2026 guidelines on personal data in generative AI say that where a firm relies on consent to train AI on personal data, it must say so plainly. “To improve our services” is not enough. She would rather not start that conversation with 300 customers.

UsedSection 5 of ISAGO on stakeholder communication, and PDPC’s advisory guidelines on personal data in generative AI.

And the junior staff

Writing quotes was how new sales staff learned the products and the prices. If the agent writes them all, nobody learns. So each junior writes a few quotes a month by hand, and a senior checks them. If the agent stops working one day, someone still knows how.

UsedDimension 4 of IMDA’s agentic guide, on keeping skills and business continuity.

four questions she now asks every quarter

These follow the four areas in ISAGO. Shortened, in her words.

Who answers
Is it clear who is responsible for each AI tool we use, and do staff know the rules and who to ask?
Who approves
For each thing the AI does, could a mistake hurt a customer or cost us money? If so, does a person approve it first?
Is it working
Is our data clean and allowed to be used this way? Do we log what the AI does, and does anyone read the log?
Who knows
Do customers know when AI is involved, can we explain a decision, and is there a person they can complain to?

the free guides she used

  • ISAGO (PDF): IMDA and PDPC’s self-assessment guide, with the World Economic Forum, January 2020. Questions to ask yourself, with examples. It predates chatbots and agents, so pair it with the next one.
  • Model AI Governance Framework for Agentic AI, version 1.5 (PDF): IMDA, May 2026. The eight parts of an agent, the risks, where people should approve, and case studies from real firms.
  • AI Verify: process checks and a testing toolkit for checking an AI system against 11 principles. More than most small firms need to run themselves, but worth asking your vendor whether they have used it.
  • CSA, Securing Agentic AI addendum: the security side, for whoever sets up your systems.
  • PDPC on AI: the personal data rules, including the July 2026 guidelines on generative AI.

if you want a day or two of training

Siew Ling’s operations manager went on a one-day course before the agent went live. There are many to choose from. These seven are a sample from SWDA’s public course list: AI governance in the title, one or two days, from polytechnic, university and private providers. Not a ranking. Check dates and funding on each course page.

courseproviderlength
Principles of AI Ethics and Governance for Emerging TechnologiesAdept Academy1 day
Data Ethics and Governance for Responsible AINational University of Singapore2 days
Artificial Intelligence Ethics and GovernanceNTUC LearningHub1 day
AI Governance EssentialsAlso on STEP, the polytechnics’ course portalRepublic Polytechnic1 day
Advanced Certificate in Agentic AI, Module 6: Governance, Safety, and Ethical Management of Agentic AISingapore Management University1 day
Mastering AI Ethics & GovernanceSingapore University of Technology and Design2 days
AI Governance for SMEs and Enterprise AdoptionWong Fong Academy2 days

The one in this story is the polytechnic course. Its public description covers why AI governance matters, bias, transparency, accountability and human oversight, how to apply Singapore’s guides, and governance for AI agents.

For more, open Course Finder, search “governance” and set the provider type to all providers. The public list has more than 50 courses with AI and governance in the title.

sources

Written 11 Nov 2026. Siew Ling and her firm are made up. The guidance is from the linked public documents, and the steps she takes are my own reading of them. The course list is a sample, not a recommendation of one provider over another. I’m not a lawyer and this isn’t legal advice. Not affiliated with any agency or organisation mentioned.