Anthropic Claude Certified Architect - Professional CCAR-P Exam Questions

Page: 1 / 14
Total 114 questions

Want more questions? Get Premium Access.
()

Question 1

You are a solution architect designing a Claude-based assistant with access to 60 internal tools across multiple business domains. Loading every tool definition on every request increases token usage and time to first response.

Which design pattern best addresses this issue without sacrificing capability breadth?

AApply progressive tool discovery so a curated initial subset is exposed and additional tools are loaded on demand based on the task.

BUse a separate model call to summarize all 60 tool definitions before each user turn.

CIncrease the maximum context length and load all 60 tool definitions on every request, accepting the higher token cost and latency as necessary for full capability.

DHard-code a fixed set of five tools per request to reduce token usage, regardless of whether those tools are relevant to the current task.

Answer : A

Progressive tool discovery preserves the complete capability catalog while limiting initial context to a curated set of common common common tools and a discovery mechanism. When the task requires an additional capability, Claude searches the catalog and loads only the relevant tool definitions.

Anthropic's Tool Search mechanism implements implements this pattern through deferred loading. The context initially contains the search search search tool and any deliberately non-deferred tools; relevant definitions are expanded only when discovered. This reduces token consumption and helps maintain tool-selection accuracy in large catalogs. ToolTool Search Tool

Option B adds a model call and still repeatedly processes all definitions, increasing latency latency latency and cost while potentially losing important schema details. Option C treats a larger context window as permission to waste context and does not address time-to-first-response overhead. Option D reduces capability breadth because the fixed five tools may be irrelevant to a given task.

The architect should provide clear tool and server server server descriptions, define which high-frequency tools remain immediately available, and evaluate discovery recall, selection accuracy

Question 2

You are defining transparency practices for a customer-facing assistant whose responses are materially shaped by AI.

Which transparency practice most directly supports responsible deployment?

AMisrepresent the AI's role in producing responses in order to make the assistant feel more trustworthy or more human, undermining informed user consent and organizational transparency.

BRefuse to answer any user question about how the responses were produced or whether AI was involved, treating the AI's role as confidential operational information.

CDisclose AI involvement to end users in line with the organization's transparency policy and provide a documented path to reach a human when needed.

DDisclose AI involvement only to internal staff and operators while withholding that information from the end users whose interactions are materially shaped by the AI system.

Answer : C

Responsible deployment requires users to receive an accurate representation of the system with which they are interacting. Option C provides that transparency while also establishing a practical escalation path. Disclosure should be proportionate to the material role AI plays, expressed in language appropriate to the audience, and aligned with organizational policy and applicable regulatory obligations.

A documented human-contact route is important when the assistant cannot resolve an issue, produces a disputed result, encounters a high-impact exception, or handles a matter requiring human authority. Anthropic's Responsible Scaling Policy recognizes escalation to human reviewers as an appropriate safeguard for edge cases and situations requiring human judgment. Responsible Scaling Policy

Options A and D intentionally conceal material AI involvement from affected users, weakening informed decision-making, auditability, and trust. Option B is also unsuitable because transparency does not require revealing proprietary prompts, confidential controls, or internal security mechanisms; however, it does require an honest explanation of AI involvement and the system's operational role.

The correct design combines disclosure, understandable limitations, human escalation, and records demonstrating that the organization's transparency requirements are consistently applied.

Study Guide references/topics: AI transparency; informed user interaction; human escalation; responsible deployment; disclosure policy; operational accountability.

===============

Question 3

You are running a controlled experiment to compare two prompts and must complete the design steps before executing the experiment.

Which two steps must be completed BEFORE running the experiment with random assignment? (Select two.)

Each correct answer presents part of the solution.

ADetermine the minimum detectable effect size and the sample size needed for power.

BDecide whether to promote, reject, or iterate the candidate based on the analysis.

CDefine the hypothesis and the primary success metric for the comparison.

DAnalyze the results against the predefined success metric and significance threshold.

EDocument the recommendation, the trade-offs accepted, and the alternatives considered.

Answer : A, C

A controlled prompt experiment must begin with a falsifiable hypothesis and a predefined primary metric. Option C prevents the team from examining results first and then selecting whichever metric makes the candidate look successful. The metric might measure task accuracy, rubric score, citation validity, escalation rate, latency, cost, or another criterion directly connected to the hypothesis.

Option A determines whether the experiment can detect a practically meaningful improvement. The minimum detectable effect expresses the smallest difference worth acting upon, while the power calculation determines the required sample size. Without this step, the experiment may be too small to detect a real improvement or unnecessarily large and expensive.

Random assignment should then distribute representative traffic between the control and candidate prompts while controlling model version, retrieval configuration, tool availability, and other confounding variables.

Options B and D occur after data collection. Option E follows the completed analysis and decision. The team should also define significance thresholds, stopping rules, guardrail metrics, exclusion criteria, and treatment of repeated observations before launch.

Study Guide references/topics: Prompt A/B testing; hypothesis definition; primary metrics; minimum detectable effect; statistical power; random assignment; decision sequencing.

===============

Question 4

You are defining an SLA for a Claude-based assistant.

Which SLA definition is most operationally meaningful?

AA target tied to a stakeholder sentiment measure such as ''the team feels satisfied,'' which cannot be measured objectively or used to trigger a documented breach response.

BA measurable target with a defined metric, threshold, evaluation window, and consequence for breach---for example, ''p95 per-request latency under 800 ms over a 28-day window.''

CA qualitative commitment such as ''the system will be fast and reliable,'' which names no metric, threshold, or evaluation window.

DA target that names the metric and threshold but omits the evaluation window and breach consequence, leaving compliance periods and remediation triggers undefined.

Answer : B

An operational SLA must be objectively measurable and enforceable. Option B defines the metric, percentile, threshold, and observation window, allowing both parties to determine whether service performance complied with the agreement. A complete SLA also defines what follows a breach, such as escalation, remediation, service credits, capacity changes, or architectural review. Percentile latency is preferable to an average because it exposes degraded tail performance experienced by a meaningful portion of users. Anthropic provides usage, cost, and operational data that can support monitoring and alerting through the Usage and Cost API. Options A and C are subjective. Option D remains incomplete because neither assessment periods nor breach handling can be applied consistently.

Study Guide references/topics: SLA construction; p95 latency; thresholds; evaluation windows; breach consequences; operational measurement.

Question 5

A healthcare organization is evaluating two Claude-powered AI architectures for a clinical documentation assistant. Architecture X produces higher output quality scores but costs $0.18 per documentation session and averages 4.2 seconds per response. Architecture Y scores slightly lower on quality metrics but costs $0.09 per session and averages 2.1 seconds per response. The stated SLA requires responses under 3 seconds, and the annual volume is projected at 2 million documentation sessions.

Which evaluation approach correctly applies business value pillar analysis to this decision?

ASelect Architecture Y based solely on the 50% cost reduction, since solution cost is the most important value pillar in healthcare budget-constrained environments.

BSelect Architecture X because the higher quality scores justify the cost premium, and any SLA gap can be addressed through infrastructure optimization after deployment.

CEliminate Architecture X on SLA grounds, then evaluate Architecture Y against the efficiency and solution cost pillars by calculating annual cost difference and assessing whether the quality delta materially impacts clinical workflow productivity.

DRecommend a hybrid approach using Architecture X for complex cases and Architecture Y for routine cases, without additional analysis, since this preserves quality where it matters most.

Answer : C

Architecture X fails a stated production gate: its 4.2-second average exceeds the required three-second response SLA. It should therefore not remain a qualifying architecture unless it is redesigned and retested before selection. A promise to optimize after deployment is not evidence of compliance.

Architecture Y meets the latency requirement at 2.1 seconds. Its annual inference cost is $180,000 at two million sessions, compared with $360,000 for Architecture X---a difference of $180,000 annually. However, cost alone does not establish suitability. The organization must determine whether Y's lower quality score causes material omissions, correction effort, clinician dissatisfaction, documentation risk, or reduced workflow productivity.

Option C correctly treats the SLA as a threshold and then analyzes the remaining architecture across cost, efficiency, quality, and productivity. Option A ignores clinical quality. Option B disregards an explicit SLA failure. Option D may eventually be viable, but it introduces routing complexity and leaves unanswered how complex cases are detected, whether X's latency becomes acceptable for them, and how both paths are evaluated.

The final choice should be gated by clinical-quality evaluation, human review requirements, safety metrics, operational latency, and total annual cost.

Study Guide references/topics: Business-value pillars; performance gates; solution cost; workflow efficiency; quality trade-offs; healthcare architecture evaluation.

===============

Question 6

You must present an architectural recommendation to deploy a Claude-based contract review assistant to a steering committee that includes the CFO, the general counsel, and the CIO. Each stakeholder cares about different aspects of the decision.

How should you structure the recommendation document?

ALead with the technical architecture diagram and the full component list before any other section.

BLead with detailed cost projections across the full multi-year horizon before the rationale section.

CPresent the same dense narrative throughout with no stakeholder differentiation in any section.

DLead with the architectural decision, then address each stakeholder's primary concerns directly.

Answer : D

A steering committee needs an answer-first recommendation that states the proposed architectural decision, the business outcome it supports, and the approval or action required. After establishing that common decision frame, the document should address each stakeholder's concerns separately.

The CFO requires implementation and operating costs, expected savings, consumption assumptions, financial exposure, and cost-control mechanisms. General counsel needs evidence concerning confidentiality, privilege, data handling, human legal review, explainability, retention, and regulatory risk. The CIO needs integration architecture, security boundaries, availability, scalability, operational ownership, technical dependencies, and lifecycle support.

Option A begins at an implementation depth unsuitable for the entire committee. Option B overweights the CFO's concerns and delays the rationale required by the other decision-makers. Option C ignores audience-specific responsibilities and forces every stakeholder to extract relevant information from an undifferentiated narrative.

The recommended structure is: decision and executive rationale, expected outcomes, accepted trade-offs, stakeholder-specific impact sections, major risks and controls, implementation implications, success metrics, and the requested governance decision. Technical appendices can preserve component-level detail without overwhelming the principal recommendation.

Study Guide references/topics: Executive communication; stakeholder differentiation; decision-first structure; financial, legal, and technology concerns; architectural recommendations.

===============

Question 7

You are assessing data-exfiltration risk in a Claude-based assistant that has tools for both internal-document retrieval and outbound HTTP calls.

Which scenario most directly indicates a data-exfiltration risk?

AThe outbound HTTP tool returns a 200 response when the assistant calls an allow-listed domain to fulfil a user-initiated data-lookup request.

BThe user submits a routine question and receives a routine answer.

CAdversarial content in a retrieved document instructs the model to call the outbound HTTP tool and send sensitive content to an attacker-controlled URL.

DThe internal-document retrieval tool returns a document that the user is authorized to view.

Answer : C

Option C describes indirect prompt injection combined with an outbound transmission channel. The attacker embeds instructions in content that the assistant treats as evidence. If the model follows those instructions, it can retrieve sensitive information and transmit it through the HTTP tool to an attacker-controlled destination. Authorization to read a document does not automatically authorize external disclosure. The architecture should treat retrieved content as untrusted, restrict outbound domains, separate data access from external communication, apply least-privilege tool permissions, and require approval for sensitive transmissions. Options A, B, and D describe normal authorized behavior without evidence of unintended disclosure. Anthropic specifically warns that combining untrusted content, sensitive data, and network tools creates exfiltration risk. Web-fetch security guidance; handling untrusted tool results