Build, Buy, or Partner for AI Capability
Turn a vague make-or-buy debate into a reversible decision record: define the capability, hard gates, evaluation population, lifecycle economics, supplier obligations, ownership, and exit plan before comparing eligible options.
- Authorship
- InterviewsVector
- Published / updated
- 2026-09-27 / 2026-09-27
- Review status
- Artifact tests passing · primary sources recorded
Original InterviewsVector teaching. Executable artifacts are deterministic illustrative audits with focused tests and recorded primary sources; they do not claim procurement approval, vendor qualification, security certification, production readiness, measured SLOs, financial forecasts, benchmark results, or universal architecture guidance.
The decision in one pass
Build, buy, and partner are operating models, not identities. Start by defining the product capability and the decisions it enables, then declare hard constraints for task quality, harm-bearing slices, latency, data handling, security, interoperability, reliability, cost, time, jurisdiction, auditability, and exit. Compare complete options over the same workload and lifecycle: an internal build still depends on models, chips, libraries, data, and staff; a purchased service still requires integration, evaluation, incident response, and vendor management; a partner still needs decision rights and knowledge transfer. Disqualify any option that misses a hard gate. Among eligible options, optimize one declared objective with explicit tie-breakers rather than hiding trade-offs in an arbitrary score. Record assumptions, evidence, owners, review date, triggers, fallback, and the smallest reversible commitment. Revisit the decision when workload, providers, regulation, economics, capability, or organizational capacity changes.
Why this matters
Teams often frame sourcing as control versus speed and compare an aspirational internal platform with a mature vendor—or compare a vendor demo with the first quarter of internal delivery. That asymmetry hides integration labor, evaluation, migration, support, security, concentration, data rights, and opportunity cost. The wrong boundary can trap differentiated product logic in a contract, turn commodity infrastructure into years of undifferentiated work, or create a supplier dependency that the team cannot safely leave. A bounded decision record makes disagreement testable and preserves an exit.
You will be able to
- Define the capability and product decision before naming suppliers, models, or implementation modes.
- Separate hard eligibility gates from the primary objective and tie-breakers used among eligible options.
- Compare build, buy, and partner options on equivalent lifecycle, risk, quality, operating, and exit evidence.
- Design contracts and internal ownership for audit, incidents, changes, data handling, portability, and termination.
- Sequence discovery and commitments so the organization can learn before making an irreversible bet.
Your Vector Loop for this lab
- 01
Model
Map the product capability, users, protected decisions, workload, data, constraints, dependencies, owners, and differentiated versus commodity layers.
- 02
Derive
Derive comparable quality, harm, latency, reliability, security, compliance, cost, time, staffing, concentration, interoperability, and exit gates over one horizon.
- 03
Build
Build an immutable decision record over invented build, buy, and partner evidence with independent disqualification and one declared objective.
- 04
Stress
Inject stale demos, missing controls, slice regressions, demand growth, price changes, supplier outage, contract gaps, staff loss, knowledge-transfer failure, and blocked exit.
- 05
Operate
Track realized quality, cost, incidents, supplier changes, control evidence, integration toil, concentration, internal capability, renewals, and exit readiness.
- 06
Defend
Defend the chosen boundary, rejected alternatives, uncertainty, reversible first commitment, review triggers, and why local evidence is not procurement approval.
Define the capability before debating the mode
A sourcing decision is only coherent at a named boundary. 'Build AI' could mean training a foundation model, adapting a model, operating inference, creating an evaluation platform, integrating a managed API, or owning product workflow and policy. Draw the value stream and label what must be unique for the product, what creates regulated or safety-critical responsibility, what can be standardized, and what can remain behind an interface. Then compare modes for that bounded capability, not for an imagined all-or-nothing stack.
| Question | Evidence | Why it changes sourcing |
|---|---|---|
| What decision does the capability improve? | user journey, baseline, target, harm analysis | defines quality and failure rather than feature presence |
| Where is differentiation? | product strategy, learning loop, proprietary context | identifies what should remain close to the product |
| What must remain controllable? | policy, data, rollback, audit, incident duties | sets non-negotiable authority and evidence |
| What is the operating workload? | shape, volume, geography, burst, retention | changes economics, architecture, and supplier fit |
| How would we leave? | exports, interfaces, rights, replacement time, rehearsals | turns portability claims into an executable option |
Apply hard gates before optimizing an objective
- 01Freeze comparable scenariosUse the same demand distribution, data classes, regions, quality slices, reliability target, horizon, growth cases, and organizational constraints for every option.
- 02Declare eligibility gatesSet minimum task and boundary quality, maximum latency and cost, required controls, data and rights constraints, launch horizon, concentration, and exit readiness before seeing favorable results.
- 03Price the lifecycleInclude integration, evaluation, migration, platform, support, security, incident, vendor-management, staffing, retraining, reserved capacity, egress, overlap, and termination—not only API or salary lines.
- 04Choose one primary objectiveFor example, minimize risk-adjusted lifecycle cost subject to all gates. State deterministic tie-breakers and keep the underlying dimensions visible.
- 05Sequence reversible evidenceUse time-boxed discovery, a representative pilot, contract review, load and failure tests, and an exit exercise before a larger commitment.
eligible(option) = quality ∧ harm slices ∧ latency ∧ reliability ∧ controls ∧ cost ∧ time ∧ exit
A high score on one dimension cannot compensate for a failed hard obligation. Optimize only across the set of options that meet every declared gate, and preserve the failed reasons for review.
Audit three options against one declared contract
1def decide_sourcing(contract: SourcingContract, evidence: SourcingEvidence):2 contract = validate_record(contract, SourcingContract)3 evidence = validate_record(evidence, SourcingEvidence)4 if evidence.scope != contract.scope or evidence.contract_content_id != contract.content_id:5 raise ValueError("evidence belongs to another sourcing contract")6 # Disqualify each build, buy, and partner option independently.7 # Select among eligible options by declared annual cost, then stable tie-breakers.Expected output
example=illustrative_only
decision=SELECT_ELIGIBLE_OPTION
selected=managed-service;mode=buy
eligible=internal-platform,managed-service
violations=delivery-partner/quality
claim=LOCAL_SOURCING_AUDIT_NOT_PROCUREMENT_APPROVALVerify: python3 -m unittest discover courses/ai-engineering/reference-impl/build_buy_partner
The fixture binds capability, risk, evaluation, security, exit, and fixture identities into one scope. Each option carries exact integer quality counts, latency, lifecycle cost units, launch time, supplier concentration, exit readiness, and four controls bound to its option identity, sourcing mode, and evidence digest. Cross-option control reuse is rejected. The partner option misses its own quality floor; that failure cannot be averaged with the other candidates. The eligible managed service wins the declared cost objective over the internal platform. All numbers are invented, and the result authorizes no purchase or production use.
Choose an eligible sourcing path
Inspect invented build, buy, and partner evidence. Predict which options survive the declared quality, latency, cost, time, concentration, exit, and control gates before applying the stated objective.
Choose the capability-sourcing posture
Treat sourcing as a bounded architecture decision. Inspect differentiation, hard requirements, evidence, ownership, and exit conditions before choosing a posture.
Illustrative records only. Procurement, legal, security, finance, and domain owners must validate a real decision.
| Signal | Declared constraint | Available evidence |
|---|---|---|
| differentiation | not a product moat | workflow is required but does not change the customer promise |
| qualification | quality ≥ 0.96; p95 ≤ 900 ms | two products pass the frozen representative set |
| data rights | no training retention | contract and technical setting both prohibit retention |
| exit | portable corpus and API boundary | fixtures export cleanly; replacement drill passes |
Commit to a decision before revealing the bounded recommendation.
Design the failure and exit contract before signing
| Failure | Required pre-commitment evidence | Exit or containment |
|---|---|---|
| supplier changes model or policy | version notice, qualification window, pinning | hold rollout, pin, or route to qualified fallback |
| price or quota shock | scenario model, rate card, metering reconciliation | budget stop, workload degradation, alternate route |
| data or rights conflict | data flow, retention, training-use terms, deletion proof | disable affected flow and export or delete evidence |
| partner knowledge loss | paired delivery, documentation, acceptance tests | internal takeover rehearsal and named owners |
| internal build stalls | milestones, staffing reality, kill criteria | reuse interfaces to adopt an external capability |
| provider or region outage | failure exercise and dependency map | bounded fallback that preserves policy and semantics |
- Contract for export formats, provenance, configuration, evaluation records, logs, deletion, assistance, notice, and post-termination access—not a generic portability promise.
- Retain internal competence to evaluate releases, operate incidents, interpret telemetry, enforce product policy, and execute the exit even when delivery is external.
- Keep product-owned interfaces and tests at the boundary so replacement does not require rewriting business workflows around a vendor-shaped payload.
- Treat dual-running and migration capacity as part of the exit cost; an export file alone is not a working replacement.
Operate sourcing as a revisable architecture decision
The decision record needs an owner, an evidence snapshot, explicit uncertainty, a review cadence, and event-driven triggers. Monitor realized task quality and boundary slices, latency, availability, spend, integration toil, incidents, supplier roadmap and control changes, internal staffing, concentration, and exit readiness. Reopen the record when an assumption moves beyond its declared envelope; do not wait for renewal pressure to discover that the exit path has decayed.
- Review control evidence and supplier changes on a schedule proportional to impact, not only during procurement.
- Reconcile invoices and metering with product outcomes; token or seat growth is not automatically delivered value.
- Exercise export, fallback, credential rotation, incident contact, and replacement interfaces before they are urgently needed.
- Use expiry dates for exceptions, exclusivity, pilots, and temporary partner authority.
- Publish why rejected options failed so future teams can update evidence instead of restarting a political debate.
Operate at three altitudes
Production lens
- — Version the capability contract, evaluation set, workload forecast, supplier terms, control evidence, integration, and exit plan; a decision tied to stale evidence is not current architecture.
- — Monitor per-slice quality, dependency and product latency, realized cost, incidents, quota, roadmap changes, concentration, integration toil, and fallback readiness after selection.
- — Keep a bounded kill switch and tested alternative for high-impact dependency failures; a paper termination clause does not restore service.
Staff lens
- — Frame sourcing as an allocation of decision rights, operating responsibility, learning speed, and reversibility—not as a referendum on engineering pride or vendor trust.
- — Make finance, legal, security, product, data, reliability, and delivery owners review the same assumptions and evidence instead of producing disconnected approvals.
- — Use the smallest commitment that answers the next uncertainty, then expand only after representative evaluation and operating evidence survive review.
Interview defense
Your company needs an AI capability in six months. How do you decide whether to build, buy, or partner?
I would first bound the capability and the product decision it supports, separating differentiated workflow and evaluation from commodity infrastructure. I would freeze representative workload, data, regions, quality and harm slices, SLOs, controls, horizon, and growth scenarios. Build, buy, and partner would be compared on the same lifecycle evidence, including integration, staffing, evaluation, operations, incidents, supplier concentration, and exit. Hard obligations disqualify an option; among eligible options I would use one declared objective with visible tie-breakers. I would sequence a reversible pilot, contract and security review, load and failure tests, knowledge transfer, and an exit exercise. The record would name owners, uncertainty, rollback, and triggers for reopening the decision.
Expect the interviewer to press on
- — Which capability would you refuse to outsource, and why?
- — How do you compare a mature service with an unfinished internal build fairly?
- — What evidence proves an exit plan is usable?
- — When should a good sourcing decision be reopened?
Misconceptions to remove
“Building provides control while buying removes it.”
Both distribute control across dependencies. The useful question is which decisions, evidence, interfaces, data, operations, changes, and exit rights remain under accountable authority.
“The lowest modeled total cost should win.”
Cost is meaningful only for comparable scope and uncertainty, and no cost advantage compensates for a failed quality, safety, legal, security, reliability, or exit obligation.
“A pilot proves production fit.”
A pilot can reduce selected uncertainties, but production requires representative workload, tails, operations, controls, incidents, lifecycle change, and exit evidence.
Check your model
1. Why disqualify options before applying a weighted score?
A score can let strength on a preference hide failure of a mandatory obligation. Hard gates preserve the constraints; the objective only compares options that satisfy them.
2. What makes an exit plan more than a contract clause?
Export formats and rights must be joined by product-owned interfaces, qualified alternatives, capacity, knowledge, credentials, migration time, dual-running budget, and a rehearsed transition.
3. Why must an internal build include supplier risk?
Internal systems still depend on external models, data, libraries, accelerators, cloud capacity, and scarce labor; build changes the boundary rather than eliminating a supply chain.
Prove the mechanism
Extend the artifact with scenario-specific workload growth, uncertainty bands, and a time-bounded exception path. Preserve independent hard gates, immutable scope binding, deterministic output, and an explicit exit-readiness decision.
Add a production constraint
Write and defend a sourcing record for a high-impact AI workflow. Include capability boundaries, three comparable options, quality and harm slices, lifecycle economics, supplier and internal dependencies, data and rights, control evidence, operating ownership, knowledge transfer, reversible milestones, exit rehearsal, and review triggers.
Artifact: AI capability sourcing decision record
courses/ai-engineering/reference-impl/build_buy_partner/sourcing_decision.py
Download reference implementationPrimary references and next links
References
- 1. Artificial Intelligence Risk Management Framework (AI RMF 1.0)
NIST. Primary risk-management framework covering lifecycle governance, accountability, measurement, third-party integration, and organizational context.
- 2. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile
NIST. Primary guidance on generative-AI value chains, supplier assessment, component integration, monitoring, and documentation.
- 3. Cybersecurity Supply Chain Risk Management Practices for Systems and Organizations
NIST. Official supply-chain risk-management guidance relevant to technology acquisition, supplier relationships, and lifecycle controls.
Continue through the graph
- Design a Multi-Tenant AI Gateway →
Use a product-owned capability boundary to reduce supplier-shaped coupling.
- Design an Evaluation System, Not a Benchmark Script →
Create the comparable task and boundary evidence every sourcing option must satisfy.
Glossary: make-or-buy · sourcing boundary · lifecycle cost · hard gate · supplier concentration · exit readiness · switching cost · decision right · knowledge transfer · architecture decision record