What you will be able to do
- Look into an existing business process before you automate it, and judge whether Claude is a better fit than traditional ML
- Turn a vague business goal into specific, measurable success criteria across several dimensions
- Pick a starting design and build path (Messages API, Claude Agent SDK, Claude Managed Agents) using the simplest-solution-first principle
- Link model, effort and architecture choices to cost, latency and quality
Key concept
Simplest solution first — Start a Claude design with the least complex thing that could meet the business goal, often a single well-prompted model call. Add workflows or agents only when measured results show the extra latency and cost pay for themselves.
1.Start with the business process, not the model
A business problem rarely shows up as a model specification. It shows up as a pain point: support tickets land with the wrong team, legal documents take too long to summarize, moderators can't keep up. Before you design anything, find out how the work is done today. Anthropic's ticket-routing guide is the model case. Before you automate routing, it asks how the team currently decides which SLA applies, whether routing picks the support tier or a specialist, which automated rules already exist and where they fail, how ambiguous tickets are handled, and how tickets get prioritized. Its reasoning is that the more you know about how humans handle certain cases, the better you can work with Claude to do the task.
The second question is whether an LLM is the right tool at all. For classification, the guide lists signs that Claude beats traditional ML. Traditional ML needs massive labeled datasets, while Claude can work from a few dozen examples. Claude adapts to changed or new class definitions without extensive relabeling. It handles unstructured text without heavy feature engineering, and applies rules when classes are defined by conditions rather than examples. It gives human-readable explanations for its decisions, copes better with outliers and ambiguous inputs, and classifies across languages without a separate model per language. If none of these apply, a simpler non-LLM solution may be the honest answer. The category design matters too: the guide says Claude's routing accuracy is directly proportional to how well-defined your categories are.
Checkpoint 1 of 8· Check yourself
A retailer wants to automate ticket classification but has only about 40 labeled historical tickets, and its categories change every quarter. Which point most strongly favours Claude over a traditional ML classifier?
The guide's indicators for choosing Claude include a small labeled set and easy adaptation to changing class definitions. Category definitions still matter: routing accuracy tracks how well-defined they are.
“can effectively classify tickets with just a few dozen labeled examples, significantly reducing data preparation time and costs”Source: platform.claude.com
Sources1
2.Translate the goal into measurable success criteria
"Make support faster" isn't a requirement you can design against. Anthropic's evaluation guidance says that building a successful LLM application starts with clearly defining your success criteria and then designing evaluations to measure performance against them. Good criteria are specific, measurable, achievable and relevant. A weak criterion says the model should classify sentiment well. A strong one names an F1 score of at least 0.85 on a held-out set of 10,000 diverse posts, a 5% improvement over the current baseline.
Business problems almost never come down to one number. The guidance notes that most use cases need multidimensional evaluation along several success criteria, such as task fidelity, consistency, tone, privacy handling, context use, response time and budget. One well-formed target combines accuracy, toxicity, error severity and latency: an F1 of at least 0.85, 99.5% non-toxic outputs, 90% of errors being inconveniences rather than egregious errors, and 95% of responses under 200ms. In ticket routing, the guide tells you to work with the support team to set benchmarks. Some are specific to LLMs: classification consistency of 95% or higher, at least 80% accuracy on edge cases, and no more than a 5–10% accuracy drop in non-primary languages. Others are business outcomes that hold whether or not you use an LLM, such as routing accuracy, rerouting rate below 10%, escalation rate, and cost per ticket.
Checkpoint 2 of 8· Check yourself
Which success criterion is best formed according to Anthropic's guidance?
It is specific and measurable, and it covers more than one dimension (quality and latency). Choosing a model is a design decision, not a success criterion.
“Most use cases need multidimensional evaluation along several success criteria.”Source: platform.claude.com
Checkpoint 3 of 8· Check yourself
A team setting ticket-routing benchmarks wants one criterion that only makes sense because they are using an LLM, rather than a business outcome that would apply to any routing system. Which one is it?
Consistency of how the model classifies similar tickets is listed among the LLM-specific criteria. Rerouting, escalation and cost per ticket are business outcomes that hold whether or not an LLM is used.
“Here are some common success criteria that may be useful regardless of whether an LLM is used”Source: platform.claude.com
Checkpoint 4 of 8· Exam question
A retail company is building a customer-support chat widget that must handle very high message volume during flash sales, respond within a few hundred milliseconds, and stay within a tight per-conversation cost budget, while still handling multi-turn troubleshooting reasoning correctly. Which model should the architecture team select as the primary model for this workload?
Correct answer: B — Deploy Claude Haiku 4.5, since it delivers near-frontier reasoning at the lowest per-token cost with the fastest response times available.
- A. Incorrect. Opus 4.8 is positioned for complex agentic coding and enterprise work with moderate latency, not for the lowest-latency, cost-sensitive, high-volume support workload described here.
- B. Correct. Haiku 4.5 is described as the fastest model with near-frontier intelligence at the most economical price point, matching the flash-sale volume, latency, and cost constraints.
- C. Incorrect. Sonnet 5 is a strong general-purpose choice for coding and agentic workflows, but its cost and latency profile is not the best fit when Haiku 4.5 already meets the reasoning bar at lower cost and higher speed.
- D. Incorrect. Fable 5 targets long-running agentic intelligence at premium pricing and slower comparative latency, which conflicts directly with the sub-second, cost-sensitive requirement.
3.Choose the simplest solution shape and a build path
Once the criteria exist, pick the least complex design that could meet them. Anthropic's agent guidance says agentic systems often trade latency and cost for better task performance, and that you should decide when that trade makes sense. A ticket router, for example, is a classification call. It isn't an autonomous agent.
The second decision is how much of the implementation you run yourself. Claude's use-case guides describe three paths. The Messages API gives you the most control: you write the agent loop and run your own tools and infrastructure. The Claude Agent SDK sits in between, providing the agent loop and tool execution in a process you operate. With Claude Managed Agents, Anthropic hosts the agent loop, tool execution and runtime for you. The trade is control against how much you offload.
Checkpoint 5 of 8· Match them up
Match each build path to what it hands off
Tap a term, then the definition that fits it.
The three paths differ in how much control you keep and how much you offload to Anthropic. The Messages API keeps the most control and Managed Agents offloads the most.
“The Messages API gives you the most control: you write the agent loop and run your own tools and infrastructure.”Source: platform.claude.com
4.Map design decisions to cost, latency and quality
Every architecture decision has a business price. Anthropic frames model selection as balancing capabilities, speed and cost, and offers two ways to start. Cost-first: begin with Claude Haiku 4.5, test the use case thoroughly, evaluate against your requirements, and upgrade only where there are specific capability gaps. This suits prototyping, tight latency, cost-sensitive work and high-volume straightforward tasks. Capability-first: start with Claude Opus 5.5, tune prompts, evaluate, then lower effort or downgrade over time. This suits complex reasoning and work where accuracy outweighs cost. The guide notes that most workloads start with Claude Opus 5.5. If your evals at xhigh or max effort still fall short on demanding reasoning or long-horizon agentic work, the guide says to move to Claude Fable 5.1. A model swap isn't the only dial. Effort trades intelligence for latency and cost within a single model, and the docs say tuning it is often a better lever than switching models.
| When you need... | Consider starting with... | Example use cases |
|---|---|---|
| The highest available capability | Claude Fable 5.1 | Agent sessions that run for hours, multistep deep research |
| Complex agentic coding and enterprise work | Claude Opus 5.5 | Multihour autonomous coding agents, large-scale refactoring |
| Speed and capability for everyday coding, agent, and enterprise workloads | Claude Sonnet 5.5 | Code generation, data analysis, agentic tool use |
| The lowest latency and price, with extended thinking | Claude Haiku 4.5 | Real-time applications, high-volume processing, sub-agent tasks |
Checkpoint 6 of 8· Put it in order
Put the cost-first model-selection approach in order
- 1.Evaluate if performance meets your requirements
- 2.Upgrade only if necessary for specific capability gaps
- 3.Test your use case thoroughly
- 4.Begin implementation with Claude Haiku 4.5
You start on the faster, cheaper model and move up only when testing against requirements shows a gap.
“Upgrade only if necessary for specific capability gaps.”Source: platform.claude.com
In production, cost becomes a first-class design constraint. Anthropic separates two kinds of levers. Free wins cut spend without touching quality: prompt caching, token hygiene, a prompt audit, batch processing at 50% off for work that can wait up to 24 hours, and workspace spend limits. Tradeoffs exchange cost for intelligence: model choice, effort, output caps and task budgets, an elapsed-time clock, and multi-model architectures. In Anthropic's measurements, prompt caching was the largest lever by a wide margin. So if a business asks for lower cost, look at the free wins before you accept lower quality.
Checkpoint 7 of 8· Check yourself
A nightly report job must cut cost without any loss of output quality. Results are needed by the next morning. Which lever fits?
Batch processing is one of the free wins that cut spend without touching quality. Model choice, effort and output caps are tradeoff levers that exchange cost for intelligence.
“batch processing at 50% off for work that can wait up to 24 hours”Source: platform.claude.com
Checkpoint 8 of 8· Exam question
An enterprise engineering organization needs an agent that can autonomously plan and execute a multi-hour refactor across a large, complex legacy codebase with minimal human checkpoints, prioritizing correctness over cost. Which model is the best fit for this workload?
Correct answer: C — Claude Opus 4.8, because it is built for complex agentic coding and large-scale refactoring with minimal supervision at enterprise scale.
- A. Incorrect. Running many cheap parallel attempts does not substitute for the sustained reasoning depth an autonomous multi-hour refactor with minimal checkpoints requires.
- B. Incorrect. Sonnet 5 handles many agentic coding tasks well, but it is not the model Anthropic positions for the most complex, high-autonomy, enterprise-scale refactoring work described here.
- C. Correct. Opus 4.8 is explicitly positioned for complex agentic coding and enterprise work, including multi-hour autonomous coding agents and large-scale refactoring.
- D. Incorrect. Context window size is independent of reasoning depth; extending Haiku 4.5's context does not give it Opus-level reasoning for a correctness-prioritized, low-supervision refactor.
Exam traps
Each one states something that sounds right. Open it to see what is actually true.
1.If a model's quality or latency is wrong for the job, the fix is always to switch to a different model.Why is that wrong?
Effort trades intelligence for latency and cost within a single model, and the docs say tuning it is often a better lever than changing models.
Covered in Map design decisions to cost, latency and quality
2.One accuracy number is enough to define success for a business use case.Why is that wrong?
Most use cases need several criteria at once, such as quality, consistency, latency, safety and budget, each measurable against a baseline.
Covered in Translate the goal into measurable success criteria
Sources
Every claim above is drawn from one of these pages, quoted as it was written on the date shown.
- 1.
“The more you know about how humans handle certain cases, the better you can work with Claude to do the task.”
↩︎ Start with the business process, not the model“can effectively classify tickets with just a few dozen labeled examples, significantly reducing data preparation time and costs”
↩︎ Start with the business process, not the model“Work with your support team to define clear success criteria with measurable benchmarks, thresholds, and goals.”
↩︎ Translate the goal into measurable success criteria“Aim for a rerouting rate below 10%, with top-performing systems achieving rates as low as 5% or less.”
↩︎ Translate the goal into measurable success criteria“Here are some common success criteria that may be useful regardless of whether an LLM is used”
↩︎ Checkpoint - 2.
“Building a successful LLM-based application starts with clearly defining your success criteria and then designing evaluations to measure performance against them.”
↩︎ Translate the goal into measurable success criteria“Most use cases need multidimensional evaluation along several success criteria.”
↩︎ Exam trap 2“Most use cases need multidimensional evaluation along several success criteria.”
↩︎ Checkpoint - 3.https://www.anthropic.com/engineering/building-effective-agentsSecondary source
“Agentic systems often trade latency and cost for better task performance, and you should consider when this tradeoff makes sense.”
↩︎ Choose the simplest solution shape and a build path“we recommend finding the simplest solution possible, and only increasing complexity when needed. This might mean not building agentic systems at all.”
↩︎ Key concept“For many applications, however, optimizing single LLM calls with retrieval and in-context examples is usually enough.”
↩︎ Prediction - 4.
“The Claude Agent SDK sits in between, providing the agent loop and tool execution in a process you operate.”
↩︎ Choose the simplest solution shape and a build path“With Claude Managed Agents, you offload the most: Anthropic hosts the agent loop, tool execution, and runtime for you.”
↩︎ Choose the simplest solution shape and a build path“The Messages API gives you the most control: you write the agent loop and run your own tools and infrastructure.”
↩︎ Checkpoint - 5.
“Choosing a Claude model means balancing capabilities, speed, and cost.”
↩︎ Map design decisions to cost, latency and quality“Most workloads start with Claude Opus 5.5.”
↩︎ Map design decisions to cost, latency and quality“If your evals at xhigh or max effort still fall short on demanding reasoning or long-horizon agentic work, move to Claude Fable 5.1.”
↩︎ Map design decisions to cost, latency and quality“Tuning effort is often a better lever than switching models.”
↩︎ Exam trap 1“Upgrade only if necessary for specific capability gaps.”
↩︎ Checkpoint - 6.https://platform.claude.com/docs/en/about-claude/models/optimizing-for-cost-and-intelligenceOfficial docs
“When a workload moves from prototype to production, cost becomes a first-class design constraint.”
↩︎ Map design decisions to cost, latency and quality“prompt caching was the largest lever by a wide margin”
↩︎ Map design decisions to cost, latency and quality“batch processing at 50% off for work that can wait up to 24 hours”
↩︎ Checkpoint