On this page
Can an AI agent do tier-1 support?
Yes, for routine questions, with a person behind it. An AI support agent can answer the repeat questions that fill a tier-1 queue (where is my order, how do I reset my password, what is your return policy) from your own help content, around the clock, and hand everything else to your team. Organizations run this in production today. Gorgias reports that Orthofeet, an orthopedic footwear brand, automated 56% of its support tickets in under two months, with the AI agent handling order-tracking and return requests. Intercom's pricing page quotes Robin's Director of Technical Support reporting a 50% resolution rate with Intercom's Fin agent. Both figures are published by the vendors.
What the agent should not do on its own is give money back, bend policy or keep a customer who wants a person. Its replies go straight to customers, and a wrong one can cost you: a tribunal held Air Canada responsible for its chatbot's advice in one case, though legal responsibility depends on the facts and applicable law. So treat this as a supervised hire: the agent answers what your help content already answers, and a person owns refunds, exceptions and escalations.
This page covers answering customer questions in chat and email. For sorting and routing tickets see ticket triage, for calls see phone support, and for the role as a whole see customer service representative.
What the agent does and what stays with you
Agent
4of 9
- Answer how-to and policy questions from your help content
- Look up order status and tracking for a customer
- Hand off conversations the agent cannot or should not answer
- Record each conversation and its outcome on the ticket
Agent with review
1of 9
- Start a return within the written return policy
Human
4of 9
- Issue refunds, credits or goodwill gestures
- Decide exceptions to policy
- Handle complaints from angry or vulnerable customers
- Keep help content current when the agent gets something wrong
9 tasks: 4 agent, 1 agent with review, 4 human
| Task | Who does it | Why |
|---|---|---|
| Answer how-to and policy questions from your help content | Agent | This is the core of what Fin and Gorgias's AI Agent are sold for, and answers can be checked against the help article by sampling conversations. |
| Look up order status and tracking for a customer | Agent | Gorgias reports that Orthofeet's AI agent uses Shopify order data to handle order-tracking tickets; the answer is a read-only lookup that is easy to spot-check. |
| Start a return within the written return policy | Agent with review | Gorgias describes Orthofeet's agent checking return eligibility against written guidance and sending the return portal link; returns move money, so a person reviews exceptions and samples approvals. |
| Issue refunds, credits or goodwill gestures | Human | No source checked shows an agent issuing refunds without approval, and a refund is a spending decision. |
| Decide exceptions to policy | Human | The Air Canada and Cursor cases show agents stating policy wrongly; deciding when to bend policy stays with a person. |
| Hand off conversations the agent cannot or should not answer | Agent | Intercom documents Fin escalating immediately when a customer clearly asks for a human or an escalation rule explicitly configured to hand off applies, and offering escalation on strong frustration or a three-turn loop. |
| Record each conversation and its outcome on the ticket | Agent | Intercom records each Fin conversation's outcome (resolution, Procedure handoff or escalation) and shows which conversations were billed, so the record can be audited. |
| Handle complaints from angry or vulnerable customers | Human | Intercom documents Fin offering escalation when it detects strong frustration, possibly after first trying to resolve the issue, and no source checked shows an agent handling complaints on its own. |
| Keep help content current when the agent gets something wrong | Human | The agent answers only as well as the content it reads; a person decides what the correct policy is and updates it. |
The split follows one rule: the agent can do anything a reviewer can check against your written content, and a person does anything that commits money or changes the rules. Answering from help articles and looking up order status are checkable, so they go to the agent. Returns sit in the middle: Gorgias describes Orthofeet's agent checking return eligibility against written guidance and sending the return portal link, which is fine for the standard case but needs a person for exceptions.
Handoff is a task the agent does, not a failure. Intercom documents that Fin escalates immediately when a customer clearly asks for a human, and offers escalation, rather than handing off at once, when a customer shows strong frustration or repeats themselves across three turns; Fin may first try to resolve a frustrated customer's issue. You can add rules on top that change this, for example escalating whenever a conversation contains an order total over a set value. Write that list before you switch the agent on.
A worked example: one ticket
This is an illustration, not a customer story. Assume, for this example, that you sell online, your return window is 30 days, and refunds over $200 need a lead's approval.
A customer writes in chat at 11 p.m.: "My shoes don't fit, can I send them back?" The agent opens with a line saying it is an AI agent, asks for the order number, and looks up the order: delivered 12 days ago, $140. That is inside the 30-day window, so it explains the return steps from your help article and sends the return portal link. The customer replies "thanks" and leaves. The conversation is tagged resolved.
A second customer asks the same question about an order delivered 45 days ago and adds, "this is ridiculous, I want my money back." The order is outside the window and the customer is frustrated, so the agent does not argue policy. It says it is passing the conversation to the team, tags it "return outside window, refund request," and hands off. In the morning, your support lead reads the thread and decides whether to make an exception. The agent never refused or approved the refund itself.
What you need to provide
The agent touches customer personal data (names, emails, addresses, order history) and needs access to your help desk and, if it looks up orders, your ecommerce or billing system. Give it the least access that gets the job done:
- Your help center articles and written policies. If a policy lives only in a senior agent's head, write it down first; the agent can only be as accurate as what it reads.
- Read access to the help desk and conversation history, so it can match your tone and see past tickets.
- Read-only access to order or account data. Do not give it permission to refund, cancel or edit accounts in the first months.
- A written list of topics that always go to a person, and the team inbox they go to.
- A disclosure line telling customers they are talking to an AI agent.
Disclosure rules vary by jurisdiction. In the EU, Article 50 of the AI Act requires providers to design AI systems that interact directly with people so that those people are informed they are interacting with an AI system, unless this is obvious from the context. Ask counsel which obligations apply to your role and jurisdiction. Separately from the law, Cursor said after its incident that AI responses in its email support are now clearly labeled.
Job brief template
Use this as the brief for a vendor, an operator or an internal team setting up the agent. Replace the bracketed values with your own.
Copy-ready brief
- Goal
- Every routine customer question that arrives by chat or email gets a correct answer from your help content, or a clean handoff to a person, within 5 minutes, at any hour.
- Deliverable
- Replies sent in the help desk under a label that says the customer is talking to an AI agent, every conversation tagged with its outcome (resolved, handed off, abandoned), and a weekly report of handoff reasons and unanswered questions.
- Inputs
- Your help center articles, macros and written policies (returns, shipping, billing, account access)
- Read access to the help desk and its conversation history
- Read-only access to order or account data, if the agent should look up a customer's status
- A list of topics the agent must always hand to a person (refunds, legal threats, safety, cancellations, VIP accounts)
- Business hours, the team inbox for handoffs and the handoff message to customers
- Acceptance criteria
- On a weekly sample of 50 conversations the agent closed, at most 2 contain an answer that contradicts your written policy or help content.
- Every conversation on an always-hand-off topic reaches a person; zero exceptions on the sample.
- A customer who asks for a person is handed off in the same conversation, with no more than one offer to keep trying first.
- Customer satisfaction on agent-closed conversations is no lower than on human-closed conversations of the same topic over the trial.
- No refund, credit, account change or policy exception is granted by the agent.
- Systems
- help desk with chat and email (for example Intercom, Gorgias or Zendesk)
- help center or knowledge base
- ecommerce or billing system, read-only (for example Shopify)
- Constraints
- The agent reads personal data (names, emails, addresses, order history); access is read-only and limited to support data.
- Customers are told they are talking to an AI agent at the start of the conversation.
- The agent cannot issue refunds, change account details or override policy.
- Your data retention and data-location rules apply to conversation data the provider stores.
- Volume
- Example: 500–5,000 chat and email conversations a month
- Cadence
- Example: continuous, with a weekly sample review
- Human checkpoints
- Escalation path: a customer who asks for a person is escalated to the team inbox (this requires a configured human routing target), conversations on your always-hand-off topics are routed there by your configured rules, and a frustrated customer may first be offered a handoff; a named agent replies within your normal response time.
- Refunds, credits and policy exceptions: a support lead approves.
- Weekly: a support lead reviews a 50-conversation sample and every negative-rated conversation, and fixes the help content behind each wrong answer.
The acceptance criteria are the part to keep. A weekly sample of 50 conversations read against your written policies tells you more than any resolution rate, because a resolution rate counts conversations that ended, not answers that were right.
What it costs
Human benchmark
Customer service representatives
$44,770
per year (median annual wage)
BLS 2025 national median for SOC 43-4051 ($21.53 an hour), as published by O*NET OnLine; wage only, no benefits or overhead
Agent price range
$0.90 to $1.50
per resolved conversation
Gorgias: $0.90 per automated interaction on an annual contract, $1.00 on a monthly contract, $1.50 for overage above the plan's included allowance, plus a helpdesk plan from $10 a month. Intercom: $0.99 per Fin outcome, plus seats from $19 per seat a month on Essential (annual billing) or, with your own help desk, a monthly minimum such as 50 outcomes. Help desk seats and plans are excluded from the per-resolution range.
Sources: Gorgias pricing, Intercom pricing
The two figures use different units. Compare them at your own volume.
The human figure is the 2025 national median annual wage for customer service representatives (SOC 43-4051), $44,770, or $21.53 an hour, as published on O*NET OnLine from BLS data. It is wage only.
The agent figures are published per-resolution prices from two vendors, and each sits on top of a help desk subscription. Gorgias charges $0.90 per automated interaction on an annual contract, $1.00 on a monthly contract and $1.50 for overage above the plan's included allowance; its helpdesk plans start at $10 a month for 50 tickets, and each automated interaction also counts as a helpdesk ticket. Intercom charges $0.99 per Fin outcome, at most once per conversation, plus seats from $19 per seat a month on its Essential plan billed annually; used with another help desk, Fin needs no seats but has a monthly minimum, which Intercom's pricing page gives as "e.g. 50 outcomes."
Read the billing definition before you compare. Intercom counts a resolution when the customer confirms the answer helped or leaves without asking for more help, and it bills that second case too. A customer who gave up is billed the same as one who was helped. Your reviewer's time and the work of writing down policies sit outside both numbers; measure them in your trial.
Risks and human checkpoints
The agent states a policy that does not exist or gets a real one wrong, and the customer acts on it.
How you notice it
Sample agent-closed conversations weekly against your written policies; Cursor's bot told users a multi-device logout was expected behavior, a policy Cursor did not have.
A wrong answer creates a legal or financial claim against your company.
How you notice it
Treat agent answers as your own statements: review policy-sensitive topics first, and route them to a person until the sample is clean. A Canadian tribunal ordered Air Canada to pay a passenger over its chatbot's wrong advice.
Unhappy customers leave without asking for more help and are counted, and billed, as resolved.
How you notice it
Compare satisfaction scores and repeat contacts for agent-closed conversations with human-closed ones; Intercom counts a customer who leaves without asking for more help as an assumed resolution.
Customers who need a person get stuck in a loop with the agent.
How you notice it
Track how often customers ask for a human and how many turns pass before handoff; read every conversation that ends with a negative rating.
Costs rise with volume, through per-resolution fees and overage.
How you notice it
Set usage reminders or hard limits in the help desk and review the per-resolution bill weekly during the trial.
Human checkpoints
- Escalation path: a customer who asks for a person is escalated to the team inbox (this requires a configured human routing target), conversations on your always-hand-off topics are routed there by your configured rules, and a frustrated customer may first be offered a handoff; a named agent replies within your normal response time.
- Refunds, credits and policy exceptions: a support lead approves.
- Weekly: a support lead reviews a 50-conversation sample and every negative-rated conversation, and fixes the help content behind each wrong answer.
Wrong answers are the risk that justifies the checkpoints. In February 2024 a British Columbia tribunal ordered Air Canada to pay a passenger $812 (Canadian) after its website chatbot gave incorrect advice about bereavement fares; according to CBC News, the tribunal member rejected the airline's argument that the chatbot was responsible for its own actions and found Air Canada did not take reasonable care to ensure its chatbot was accurate. That was one tribunal's finding in one dispute; legal responsibility depends on the facts and applicable law, so ask counsel how it applies to you. CBC reported that it appeared to be the first such case in the CanLII database, which is why it is cited here despite its age. In April 2025, Cursor's AI support bot told users that being logged out when using several machines was expected behavior, a policy that did not exist; Cursor's co-founder apologized publicly, and according to The Register, his early investigation suggested the logouts appeared to result from a session race condition.
Our recommendation: answer both cases with process, not tooling. Keep written policies the agent can read, a list of topics it must hand off, and a person reading a sample every week.
How to run a trial
Run the agent on part of your queue for one month before you widen it.
- Pick a slice: 3–5 high-volume topics (order status, returns inside the window, password resets) on one channel, usually chat.
- Configure handoff first. Write the always-hand-off list and test it with your own messages before any customer sees the agent.
- Turn on the AI disclosure line and read-only access only.
- Each week, read 50 agent-closed conversations against your written policies and count wrong answers against the brief's criteria. Read every conversation with a negative rating.
- Compare satisfaction and repeat contacts for agent-closed and human-closed conversations on the same topics.
- Track handoff reasons. A topic that keeps getting handed off usually needs a help article, not a different agent.
- Watch the bill. Set a usage limit and compare billed resolutions with the conversations you judged correct.
Pick a slice
3–5 high-volume topics on one channel, usually chat
Configure handoff first
Write the always-hand-off list and test it before any customer sees the agent
Turn on the AI disclosure line
Read-only access only
Each week, read 50 agent-closed conversations
Against your written policies; read every conversation with a negative rating
Compare satisfaction and repeat contacts
Agent-closed against human-closed conversations on the same topics
Track handoff reasons
A topic that keeps getting handed off usually needs a help article
Watch the bill
Set a usage limit and compare billed resolutions with the ones you judged correct
If the samples meet the criteria for two weeks in a row, add the next topic. For more on structuring the test, see how to run a paid trial with an AI agent, and for writing the brief, how to write a job description for an AI agent. Related support jobs: knowledge base maintenance and the customer support overview.
Sources
- 43-4051.00 - Customer Service Representatives
O*NET OnLine (U.S. Department of Labor)PrimaryAccessed Nov 14, 2026
- Article 50: Transparency obligations for providers and deployers of certain AI systems
European Commission, AI Act Service DeskPrimaryAccessed Nov 14, 2026
- Regulation (EU) 2024/1689 (Artificial Intelligence Act)
EUR-Lex, Publications Office of the European UnionPrimaryAccessed Nov 14, 2026
- Manage Fin AI Agent's escalation guidance and rules
IntercomPrimaryAccessed Nov 14, 2026
- Fin AI Agent outcomes
IntercomPrimaryAccessed Nov 14, 2026
- Intercom pricing
IntercomVendorAccessed Nov 14, 2026
- Gorgias pricing
GorgiasVendorAccessed Nov 14, 2026
- Orthofeet automating 56% of tickets in 2 months with Gorgias
GorgiasVendorAccessed Nov 14, 2026
- Air Canada found liable for chatbot's bad advice on plane tickets
CBC NewsPressAccessed Nov 14, 2026
- Cursor AI's own support bot hallucinated its usage policy
The RegisterPressAccessed Nov 14, 2026
What we could not verify
- Automation and resolution rates on this page (Orthofeet 56% automated, Robin 50% resolution) are vendor-published customer figures for single deployments; no independent study of AI support agent accuracy was found.
- Zendesk's per-resolution prices appear only in third-party blog posts that could not be confirmed on a Zendesk-owned page, so Zendesk is not in the cost range.
- Intercom's standalone Fin minimum ("e.g. 50 outcomes") is given on its pricing page only as an example; the exact minimum for a given account was not confirmed.
- The official EUR-Lex page for Regulation (EU) 2024/1689 blocked automated access; Article 50 was read on the European Commission's AI Act Service Desk, which states it reproduces the EUR-Lex consolidated text.
- The Moffatt v. Air Canada decision on CanLII blocked automated access; the tribunal's findings are reported here as quoted by CBC News.
- How often support agents give wrong answers in production is not published by any vendor checked; the error risk is shown through two public incidents, not a rate.
Related
- AI agents for customer service: what to hand over first
- Can AI replace customer service representatives?
- AI ticket triage: what an agent sorts, routes and misses
- AI agent for knowledge base upkeep: scope, checks, cost
- AI phone agent for customer service: scope, cost, checks
- AI agent job description: how to write one, with template
- How to test an AI agent before buying: run a paid trial
