What you will be able to do
- Pick between prompt chaining, routing, parallelization, orchestrator-workers and evaluator-optimizer from the shape of a task
- Explain how orchestrator-workers differs from parallelization
- Weigh the token cost of multi-agent designs and split work by context, not by job role
1.Prompt chaining and routing: fixed paths with easier steps
All workflow patterns have one thing in common: code fixes the control flow, and each LLM call gets a narrower job. The simplest is prompt chaining. It splits a task into a sequence of steps, and each LLM call works on the output of the one before. You can add programmatic checks, called gates, on any intermediate step to make sure the process is still on track. Chaining fits tasks that split cleanly into fixed subtasks. You accept extra latency, and in return each call has an easier job and accuracy goes up. Anthropic's examples are writing marketing copy and then translating it, and writing an outline, checking it against criteria, and then writing the document from it. The cookbook chain does the same with data. One step extracts metrics from a quarterly summary, later steps normalize and sort them, and the last step formats them as a table.
Routing classifies an input and sends it to a specialized follow-up task. This separates concerns and lets you write more specialized prompts. Without routing, tuning a single prompt for one kind of input can hurt performance on others. Routing works when the categories are distinct and the classification is accurate, whether an LLM or a traditional classifier does it. Anthropic gives two examples. One sends general questions, refund requests and technical support down different processes. The other sends easy or common questions to smaller, cheaper models like Claude Haiku 4.5 and hard ones to more capable models. Managed Agents applies the same cost logic to multiagent work with its escalation pattern, where harder subtasks go to a more capable agent or model.
Checkpoint 1 of 6· Check yourself
A single support prompt handles refunds, account access and technical questions. Each time the team tunes it for refund wording, answers to technical questions get worse. The categories are easy to tell apart. Which pattern fixes this?
Routing gives each category its own specialized prompt. That stops tuning for one input type from degrading the others, and the clear categories make accurate classification possible.
“Without this workflow, optimizing for one kind of input can hurt performance on other inputs.”Source: www.anthropic.com
2.Parallelization versus orchestrator-workers: who decides the subtasks
Parallelization runs LLM calls at the same time and combines their outputs in code. It comes in two forms. Sectioning splits a task into independent subtasks. One example is a guardrail, where one model instance screens a query for inappropriate content while another writes the response. That tends to work better than asking one call to do both. Voting runs the same task several times to get diverse outputs, for example several prompts each reviewing code for vulnerabilities. Use parallelization when splitting the work saves time, or when you need several perspectives to be more confident in the result.
Orchestrator-workers looks similar in a diagram, but it works differently. A central LLM breaks the task down at runtime, delegates the pieces to worker LLMs, and combines their results. The difference is flexibility: in parallelization your code defines the subtasks, while here the orchestrator decides them for each input. The cookbook says when not to use it: when subtasks are predictable (use simpler parallelization instead) and when latency is critical. Managed Agents describes the same fan-out pattern, where a coordinator sends independent subtasks to agents at the same time and combines the results. The research example below shows the shape. A lead agent splits the query into facets, runs one subagent per facet concurrently, and synthesizes the findings.
async def research_topic(query: str) -> dict:
# Lead agent breaks query into research facets
facets = await lead_agent.decompose_query(query)
# Spawn subagents to research each facet in parallel
tasks = [
research_subagent(facet)
for facet in facets
]
results = await asyncio.gather(*tasks)
# Lead agent synthesizes findings
return await lead_agent.synthesize(results)| Pattern | How it works | Use when |
|---|---|---|
| Prompt chaining | Each LLM call processes the previous output, with optional gates | The task splits cleanly into fixed subtasks |
| Routing | Classify the input, then send it to a specialized follow-up | Categories are distinct and can be classified accurately |
| Parallelization | Sectioning or voting, with outputs combined in code | Subtasks are independent, or several attempts raise confidence |
| Orchestrator-workers | A central LLM decides the subtasks, delegates them and synthesizes the results | You cannot predict the subtasks in advance |
| Evaluator-optimizer | One call generates and another evaluates, in a loop | There are clear evaluation criteria and refinement adds measurable value |
Checkpoint 2 of 6· Match them up
Match each parallelization variant or pattern to its description
Tap a term, then the definition that fits it.
Sectioning and voting are the two forms of parallelization, and in both, code defines the subtasks. In orchestrator-workers, the orchestrator LLM decides them for each input.
“Voting: Running the same task multiple times to get diverse outputs.”Source: www.anthropic.com
Checkpoint 3 of 6· Exam question
A customer support system receives billing questions, technical bugs, and account cancellations. Each category needs a differently tuned prompt, and an initial step must first determine which category a given ticket belongs to before further processing. Which pattern should the team implement?
Correct answer: B — Routing, where an initial LLM call classifies the ticket and directs it to the specialized prompt for that category
- A. Incorrect. Parallelization runs independent subtasks or repeated attempts concurrently; it does not classify an input into one of several distinct categories.
- B. Correct. An initial classification step that directs the ticket to a category-specific specialized prompt is the defining shape of routing.
- C. Incorrect. Prompt chaining passes every ticket through every step in sequence; here only one category-specific prompt should run per ticket, not all three.
- D. Incorrect. Orchestrator-workers is for tasks whose subtasks are unpredictable and must be dynamically decomposed, not for a single classification-to-specialized-prompt decision.
3.Evaluator-optimizer, verification, and the cost of multiple agents
In the evaluator-optimizer pattern, one LLM call generates a response and another evaluates it and gives feedback, in a loop. It works when you have clear evaluation criteria and refining the output adds measurable value. Look for two signs of a good fit. First, responses clearly improve when someone gives feedback. Second, an LLM can give that feedback itself. Anthropic's examples are literary translation and complex search, where the evaluator decides whether more searching is needed. A related multi-agent version is the verification subagent, whose only job is to check the main agent's work. It works well because verifying something needs very little context.
Every multi-agent design comes with a cost structure you need to know. On Managed Agents, each agent runs in its own isolated thread with its own model, prompt and tools. Anthropic's guidance names three situations where multiple agents reliably beat one: context pollution that degrades performance, work that can run in parallel, and specialization that improves tool selection or focus. Outside those situations, the cost of coordinating the agents is usually higher than the benefit. Multi-agent systems typically use 3 to 10 times more tokens, and they often take longer overall, so their main benefit is thoroughness, not speed. When you do split the work, divide it by context, not by job role. Planning, implementing and testing the same feature share too much context to separate.
On Managed Agents, you set up a coordinator by declaring which agents it can delegate to:
Checkpoint 4 of 6· Fill the gap
Which value makes this Managed Agents definition a multiagent lead that delegates to the listed agents?
---
name: Engineering Lead
model: claude-opus-5-5
tools:
- type: agent_toolset_20260401
multiagent:
type: ?
agents: # paths: ant apply substitutes {type: agent, id, version}
- ./reviewer.md
- ./test-writer.md
---Managed Agents calls the delegating agent the coordinator, and multiagent.agents lists the roster it can delegate to.
Source: platform.claude.comCheckpoint 5 of 6· Check yourself
A team plans four agents for one feature: planner, implementer, tester and reviewer. Based on Anthropic's guidance, what is the most likely result?
Splitting by type of work separates phases that share context, which produces a lossy chain of handoffs. Work should be split only where context can truly be isolated.
“Planning, implementation, and testing of the same feature share too much context.”Source: claude.com
Checkpoint 6 of 6· Exam question
A security team wants one LLM call to check generated code for vulnerabilities while a second, independent LLM call simultaneously checks the same code for licensing issues, with both outputs combined into a single report. Which pattern does this describe?
Correct answer: A — Parallelization by sectioning, running the vulnerability and licensing checks as independent, simultaneous LLM calls
- A. Correct. Two distinct subtasks running independently and simultaneously, with their outputs combined afterward, is parallelization by sectioning.
- B. Incorrect. Voting repeats the same prompt multiple times to build confidence in one answer; here the two checks are different tasks, not repeated attempts at the same task.
- C. Incorrect. Evaluator-optimizer involves one LLM iteratively critiquing and refining another's output toward a quality target, not two independent checks combined into a report.
- D. Incorrect. Prompt chaining feeds one step's output into the next sequential step; the scenario describes two checks running independently and simultaneously, not sequentially.
Exam traps
Each one states something that sounds right. Open it to see what is actually true.
1.Orchestrator-workers is just parallelization with a different name, since both fan work out to several LLMs.Why is that wrong?
They look similar in a diagram but differ in who defines the subtasks. In parallelization, code defines them in advance. In orchestrator-workers, the orchestrator decides them for each input.
Covered in Parallelization versus orchestrator-workers: who decides the subtasks
2.Choose a multi-agent architecture when the main requirement is lower latency.Why is that wrong?
Multi-agent systems use several times more tokens and often take longer overall. They are worth it for thoroughness, such as covering a large search space, not for speed.
Covered in Evaluator-optimizer, verification, and the cost of multiple agents
3.The cleanest way to decompose work across agents is by role: planner, implementer, tester, reviewer.Why is that wrong?
Decompose by context boundaries, not by type of problem. Split work only where its context can truly be isolated.
Covered in Evaluator-optimizer, verification, and the cost of multiple agents
Sources
Every claim above is drawn from one of these pages, quoted as it was written on the date shown.
- 1.
“Escalation: Consult a more capable agent or model for a subset of complex subtasks.”
↩︎ Prompt chaining and routing: fixed paths with easier steps“Parallelization: Fan out independent subtasks simultaneously (searching multiple sources, analyzing separate files) and have the coordinator synthesize the results.”
↩︎ Parallelization versus orchestrator-workers: who decides the subtasks“each agent runs in its own session thread, a context-isolated event stream with its own conversation history”
↩︎ Evaluator-optimizer, verification, and the cost of multiple agents“When defining your agent, set multiagent to declare the roster of agents the coordinator can delegate to:”
↩︎ Evaluator-optimizer, verification, and the cost of multiple agents - 2.https://www.anthropic.com/engineering/building-effective-agentsSecondary source
“This workflow is ideal for situations where the task can be easily and cleanly decomposed into fixed subtasks.”
↩︎ Prompt chaining and routing: fixed paths with easier steps“The main goal is to trade off latency for higher accuracy, by making each LLM call an easier task.”
↩︎ Prompt chaining and routing: fixed paths with easier steps“Routing easy/common questions to smaller, cost-efficient models like Claude Haiku 4.5”
↩︎ Prompt chaining and routing: fixed paths with easier steps“Sectioning: Breaking a task into independent subtasks run in parallel.”
↩︎ Parallelization versus orchestrator-workers: who decides the subtasks“This workflow is particularly effective when we have clear evaluation criteria, and when iterative refinement provides measurable value.”
↩︎ Evaluator-optimizer, verification, and the cost of multiple agents“subtasks aren't pre-defined, but determined by the orchestrator based on the specific input”
↩︎ Exam trap 1“Without this workflow, optimizing for one kind of input can hurt performance on other inputs.”
↩︎ Checkpoint“subtasks aren't pre-defined, but determined by the orchestrator based on the specific input”
↩︎ Prediction“Voting: Running the same task multiple times to get diverse outputs.”
↩︎ Checkpoint - 3.
“Subtasks are predictable and can be pre-defined (use simpler parallelization)”
↩︎ Parallelization versus orchestrator-workers: who decides the subtasks - 4.
“Verification requires minimal context transfer by nature, so a verifier can blackbox-test a system without needing the full history of how it was built.”
↩︎ Evaluator-optimizer, verification, and the cost of multiple agents“In our testing, multi-agent implementations typically use 3-10x more tokens than single-agent approaches for equivalent tasks.”
↩︎ Evaluator-optimizer, verification, and the cost of multiple agents“Outside these situations, the coordination costs typically exceed the benefits.”
↩︎ Evaluator-optimizer, verification, and the cost of multiple agents“Work should only be split when context can be truly isolated.”
↩︎ Evaluator-optimizer, verification, and the cost of multiple agents“The primary benefit of parallelization is thoroughness, not speed.”
↩︎ Exam trap 2“The key insight is to adopt a context-centric view rather than a problem-centric view when decomposing work.”
↩︎ Exam trap 3“Planning, implementation, and testing of the same feature share too much context.”
↩︎ Checkpoint