InterviewsVector
Arc 11
Design reviewAdvanced105 min estimateOriginal publication

Build, Buy, or Partner for AI Capability

Turn a vague make-or-buy debate into a reversible decision record: define the capability, hard gates, evaluation population, lifecycle economics, supplier obligations, ownership, and exit plan before comparing eligible options.

Authorship
InterviewsVector
Published / updated
2026-09-27 / 2026-09-27
Review status
Artifact tests passing · primary sources recorded

Original InterviewsVector teaching. Executable artifacts are deterministic illustrative audits with focused tests and recorded primary sources; they do not claim procurement approval, vendor qualification, security certification, production readiness, measured SLOs, financial forecasts, benchmark results, or universal architecture guidance.

The decision in one pass

Build, buy, and partner are operating models, not identities. Start by defining the product capability and the decisions it enables, then declare hard constraints for task quality, harm-bearing slices, latency, data handling, security, interoperability, reliability, cost, time, jurisdiction, auditability, and exit. Compare complete options over the same workload and lifecycle: an internal build still depends on models, chips, libraries, data, and staff; a purchased service still requires integration, evaluation, incident response, and vendor management; a partner still needs decision rights and knowledge transfer. Disqualify any option that misses a hard gate. Among eligible options, optimize one declared objective with explicit tie-breakers rather than hiding trade-offs in an arbitrary score. Record assumptions, evidence, owners, review date, triggers, fallback, and the smallest reversible commitment. Revisit the decision when workload, providers, regulation, economics, capability, or organizational capacity changes.

Why this matters

Teams often frame sourcing as control versus speed and compare an aspirational internal platform with a mature vendor—or compare a vendor demo with the first quarter of internal delivery. That asymmetry hides integration labor, evaluation, migration, support, security, concentration, data rights, and opportunity cost. The wrong boundary can trap differentiated product logic in a contract, turn commodity infrastructure into years of undifferentiated work, or create a supplier dependency that the team cannot safely leave. A bounded decision record makes disagreement testable and preserves an exit.

You will be able to

  • Define the capability and product decision before naming suppliers, models, or implementation modes.
  • Separate hard eligibility gates from the primary objective and tie-breakers used among eligible options.
  • Compare build, buy, and partner options on equivalent lifecycle, risk, quality, operating, and exit evidence.
  • Design contracts and internal ownership for audit, incidents, changes, data handling, portability, and termination.
  • Sequence discovery and commitments so the organization can learn before making an irreversible bet.

Your Vector Loop for this lab

  1. 01

    Model

    Map the product capability, users, protected decisions, workload, data, constraints, dependencies, owners, and differentiated versus commodity layers.

  2. 02

    Derive

    Derive comparable quality, harm, latency, reliability, security, compliance, cost, time, staffing, concentration, interoperability, and exit gates over one horizon.

  3. 03

    Build

    Build an immutable decision record over invented build, buy, and partner evidence with independent disqualification and one declared objective.

  4. 04

    Stress

    Inject stale demos, missing controls, slice regressions, demand growth, price changes, supplier outage, contract gaps, staff loss, knowledge-transfer failure, and blocked exit.

  5. 05

    Operate

    Track realized quality, cost, incidents, supplier changes, control evidence, integration toil, concentration, internal capability, renewals, and exit readiness.

  6. 06

    Defend

    Defend the chosen boundary, rejected alternatives, uncertainty, reversible first commitment, review triggers, and why local evidence is not procurement approval.

Define the capability before debating the mode

A sourcing decision is only coherent at a named boundary. 'Build AI' could mean training a foundation model, adapting a model, operating inference, creating an evaluation platform, integrating a managed API, or owning product workflow and policy. Draw the value stream and label what must be unique for the product, what creates regulated or safety-critical responsibility, what can be standardized, and what can remain behind an interface. Then compare modes for that bounded capability, not for an imagined all-or-nothing stack.

QuestionEvidenceWhy it changes sourcing
What decision does the capability improve?user journey, baseline, target, harm analysisdefines quality and failure rather than feature presence
Where is differentiation?product strategy, learning loop, proprietary contextidentifies what should remain close to the product
What must remain controllable?policy, data, rollback, audit, incident dutiessets non-negotiable authority and evidence
What is the operating workload?shape, volume, geography, burst, retentionchanges economics, architecture, and supplier fit
How would we leave?exports, interfaces, rights, replacement time, rehearsalsturns portability claims into an executable option

Apply hard gates before optimizing an objective

  1. 01Freeze comparable scenariosUse the same demand distribution, data classes, regions, quality slices, reliability target, horizon, growth cases, and organizational constraints for every option.
  2. 02Declare eligibility gatesSet minimum task and boundary quality, maximum latency and cost, required controls, data and rights constraints, launch horizon, concentration, and exit readiness before seeing favorable results.
  3. 03Price the lifecycleInclude integration, evaluation, migration, platform, support, security, incident, vendor-management, staffing, retraining, reserved capacity, egress, overlap, and termination—not only API or salary lines.
  4. 04Choose one primary objectiveFor example, minimize risk-adjusted lifecycle cost subject to all gates. State deterministic tie-breakers and keep the underlying dimensions visible.
  5. 05Sequence reversible evidenceUse time-boxed discovery, a representative pilot, contract review, load and failure tests, and an exit exercise before a larger commitment.

eligible(option) = quality ∧ harm slices ∧ latency ∧ reliability ∧ controls ∧ cost ∧ time ∧ exit

A high score on one dimension cannot compensate for a failed hard obligation. Optimize only across the set of options that meet every declared gate, and preserve the failed reasons for review.

Audit three options against one declared contract

sourcing_decision.py
1def decide_sourcing(contract: SourcingContract, evidence: SourcingEvidence):
2 contract = validate_record(contract, SourcingContract)
3 evidence = validate_record(evidence, SourcingEvidence)
4 if evidence.scope != contract.scope or evidence.contract_content_id != contract.content_id:
5 raise ValueError("evidence belongs to another sourcing contract")
6 # Disqualify each build, buy, and partner option independently.
7 # Select among eligible options by declared annual cost, then stable tie-breakers.

Expected output

example=illustrative_only
decision=SELECT_ELIGIBLE_OPTION
selected=managed-service;mode=buy
eligible=internal-platform,managed-service
violations=delivery-partner/quality
claim=LOCAL_SOURCING_AUDIT_NOT_PROCUREMENT_APPROVAL

Verify: python3 -m unittest discover courses/ai-engineering/reference-impl/build_buy_partner

The fixture binds capability, risk, evaluation, security, exit, and fixture identities into one scope. Each option carries exact integer quality counts, latency, lifecycle cost units, launch time, supplier concentration, exit readiness, and four controls bound to its option identity, sourcing mode, and evidence digest. Cross-option control reuse is rejected. The partner option misses its own quality floor; that failure cannot be averaged with the other candidates. The eligible managed service wins the declared cost objective over the internal platform. All numbers are invented, and the result authorizes no purchase or production use.

Choose an eligible sourcing path

Inspect invented build, buy, and partner evidence. Predict which options survive the declared quality, latency, cost, time, concentration, exit, and control gates before applying the stated objective.

Choose the capability-sourcing posture

Treat sourcing as a bounded architecture decision. Inspect differentiation, hard requirements, evidence, ownership, and exit conditions before choosing a posture.

Select a sourcing scenario

Illustrative records only. Procurement, legal, security, finance, and domain owners must validate a real decision.

Sourcing decision evidence
SignalDeclared constraintAvailable evidence
differentiationnot a product moatworkflow is required but does not change the customer promise
qualificationquality ≥ 0.96; p95 ≤ 900 mstwo products pass the frozen representative set
data rightsno training retentioncontract and technical setting both prohibit retention
exitportable corpus and API boundaryfixtures export cleanly; replacement drill passes
Which posture best fits the declared evidence?

Commit to a decision before revealing the bounded recommendation.

Design the failure and exit contract before signing

FailureRequired pre-commitment evidenceExit or containment
supplier changes model or policyversion notice, qualification window, pinninghold rollout, pin, or route to qualified fallback
price or quota shockscenario model, rate card, metering reconciliationbudget stop, workload degradation, alternate route
data or rights conflictdata flow, retention, training-use terms, deletion proofdisable affected flow and export or delete evidence
partner knowledge losspaired delivery, documentation, acceptance testsinternal takeover rehearsal and named owners
internal build stallsmilestones, staffing reality, kill criteriareuse interfaces to adopt an external capability
provider or region outagefailure exercise and dependency mapbounded fallback that preserves policy and semantics
  • Contract for export formats, provenance, configuration, evaluation records, logs, deletion, assistance, notice, and post-termination access—not a generic portability promise.
  • Retain internal competence to evaluate releases, operate incidents, interpret telemetry, enforce product policy, and execute the exit even when delivery is external.
  • Keep product-owned interfaces and tests at the boundary so replacement does not require rewriting business workflows around a vendor-shaped payload.
  • Treat dual-running and migration capacity as part of the exit cost; an export file alone is not a working replacement.

Operate sourcing as a revisable architecture decision

The decision record needs an owner, an evidence snapshot, explicit uncertainty, a review cadence, and event-driven triggers. Monitor realized task quality and boundary slices, latency, availability, spend, integration toil, incidents, supplier roadmap and control changes, internal staffing, concentration, and exit readiness. Reopen the record when an assumption moves beyond its declared envelope; do not wait for renewal pressure to discover that the exit path has decayed.

  • Review control evidence and supplier changes on a schedule proportional to impact, not only during procurement.
  • Reconcile invoices and metering with product outcomes; token or seat growth is not automatically delivered value.
  • Exercise export, fallback, credential rotation, incident contact, and replacement interfaces before they are urgently needed.
  • Use expiry dates for exceptions, exclusivity, pilots, and temporary partner authority.
  • Publish why rejected options failed so future teams can update evidence instead of restarting a political debate.

Operate at three altitudes

Production lens

  • — Version the capability contract, evaluation set, workload forecast, supplier terms, control evidence, integration, and exit plan; a decision tied to stale evidence is not current architecture.
  • — Monitor per-slice quality, dependency and product latency, realized cost, incidents, quota, roadmap changes, concentration, integration toil, and fallback readiness after selection.
  • — Keep a bounded kill switch and tested alternative for high-impact dependency failures; a paper termination clause does not restore service.

Staff lens

  • — Frame sourcing as an allocation of decision rights, operating responsibility, learning speed, and reversibility—not as a referendum on engineering pride or vendor trust.
  • — Make finance, legal, security, product, data, reliability, and delivery owners review the same assumptions and evidence instead of producing disconnected approvals.
  • — Use the smallest commitment that answers the next uncertainty, then expand only after representative evaluation and operating evidence survive review.

Interview defense

Your company needs an AI capability in six months. How do you decide whether to build, buy, or partner?

I would first bound the capability and the product decision it supports, separating differentiated workflow and evaluation from commodity infrastructure. I would freeze representative workload, data, regions, quality and harm slices, SLOs, controls, horizon, and growth scenarios. Build, buy, and partner would be compared on the same lifecycle evidence, including integration, staffing, evaluation, operations, incidents, supplier concentration, and exit. Hard obligations disqualify an option; among eligible options I would use one declared objective with visible tie-breakers. I would sequence a reversible pilot, contract and security review, load and failure tests, knowledge transfer, and an exit exercise. The record would name owners, uncertainty, rollback, and triggers for reopening the decision.

Expect the interviewer to press on

  • — Which capability would you refuse to outsource, and why?
  • — How do you compare a mature service with an unfinished internal build fairly?
  • — What evidence proves an exit plan is usable?
  • — When should a good sourcing decision be reopened?

Misconceptions to remove

“Building provides control while buying removes it.”

Both distribute control across dependencies. The useful question is which decisions, evidence, interfaces, data, operations, changes, and exit rights remain under accountable authority.

“The lowest modeled total cost should win.”

Cost is meaningful only for comparable scope and uncertainty, and no cost advantage compensates for a failed quality, safety, legal, security, reliability, or exit obligation.

“A pilot proves production fit.”

A pilot can reduce selected uncertainties, but production requires representative workload, tails, operations, controls, incidents, lifecycle change, and exit evidence.

Check your model

1. Why disqualify options before applying a weighted score?

A score can let strength on a preference hide failure of a mandatory obligation. Hard gates preserve the constraints; the objective only compares options that satisfy them.

2. What makes an exit plan more than a contract clause?

Export formats and rights must be joined by product-owned interfaces, qualified alternatives, capacity, knowledge, credentials, migration time, dual-running budget, and a rehearsed transition.

3. Why must an internal build include supplier risk?

Internal systems still depend on external models, data, libraries, accelerators, cloud capacity, and scarce labor; build changes the boundary rather than eliminating a supply chain.

Prove the mechanism

Extend the artifact with scenario-specific workload growth, uncertainty bands, and a time-bounded exception path. Preserve independent hard gates, immutable scope binding, deterministic output, and an explicit exit-readiness decision.

Add a production constraint

Write and defend a sourcing record for a high-impact AI workflow. Include capability boundaries, three comparable options, quality and harm slices, lifecycle economics, supplier and internal dependencies, data and rights, control evidence, operating ownership, knowledge transfer, reversible milestones, exit rehearsal, and review triggers.

Artifact: AI capability sourcing decision record

courses/ai-engineering/reference-impl/build_buy_partner/sourcing_decision.py

Download reference implementation

Primary references and next links

References

  1. 1. Artificial Intelligence Risk Management Framework (AI RMF 1.0)

    NIST. Primary risk-management framework covering lifecycle governance, accountability, measurement, third-party integration, and organizational context.

  2. 2. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile

    NIST. Primary guidance on generative-AI value chains, supplier assessment, component integration, monitoring, and documentation.

  3. 3. Cybersecurity Supply Chain Risk Management Practices for Systems and Organizations

    NIST. Official supply-chain risk-management guidance relevant to technology acquisition, supplier relationships, and lifecycle controls.

Continue through the graph

Glossary: make-or-buy · sourcing boundary · lifecycle cost · hard gate · supplier concentration · exit readiness · switching cost · decision right · knowledge transfer · architecture decision record