Interview prompt
Problem context
Skills being evaluated
Use the sequence below to surface constraints, choose boundaries, test failure behavior, and defend trade-offs. Concrete numbers are interview assumptions, not claims about a real production system.
Clarify the decision
- Define which journeys survive a region loss, degraded throughput, recovery duration, and provider scaling lead time. Classify workloads by evictability and stateful capacity by expansion speed.
Establish scale assumptions
- Model N-minus-one at actual peak plus replication, backlog, and failover overhead. Include quota, IP, database connections, caches, licenses, and downstream capacity, not just compute.
Functional and non-functional requirements
- Critical traffic has a protected floor, reclaimable capacity can be freed within RTO, stateful tiers are pre-sized, and exercises prove the model. Normal utilization should remain economical.
High-level architecture
- Maintain per-region critical reservations, a pool of preemptible batch and development work, autoscaling headroom, preapproved quotas, and evacuation policy that reclaims in priority order. Use traffic cells to ramp failover.
Data model and flow
- Capacity telemetry feeds a scenario model and reservation controller. Eviction notices checkpoint suitable jobs; global routing increases traffic only after regional saturation and dependency gates pass.
Consistency and transaction boundaries
- Eviction and rescheduling use operation identities so batch work does not duplicate effects. Stateful promotion follows the data authority and fencing protocol, independent of compute availability.
Failure modes and recovery
- Plan for failover during peak, provider control-plane impairment, and a second localized failure. Keep manual admission and emergency quotas outside the affected region.
Security and privacy
- Standby identities, keys, allowlists, and policy must already exist and be tested. Reclaim mechanisms cannot let low-priority tenants influence critical traffic priority.
Observability and SLOs
- Track protected, borrowed, and actually reclaimable capacity; reclaim time, quota headroom, N-minus-one margin, cold-start duration, and exercise performance.
Capacity and cost
- Use commitments for stable critical floors and interruptible economics for reclaimable work. Price the residual nonreclaimable reserve against outage risk and contract value.
Alternatives and trade-offs
- Idle reserve is simple and expensive; reclaimable work improves utilization but adds checkpoint and evacuation risk. Count capacity as standby only if it can be freed within the measured objective.
Evolution and migration
- Tag workloads and measure reclaim time, then move safe batch into the reserve, preapprove quotas, and run progressive evacuations. Revise the model after every demand or architecture change.
What Staff and Principal candidates should emphasize
- Principal candidates know that capacity is a timed operational capability. They include stateful bottlenecks, quotas, reclaim proof, degraded product policy, and correlated-failure margin.
Decision trade-offs
Standby utilization
Option A
Leave failover capacity idle
Option B
Fill it with preemptible workloads
Recommendation:Use reclaimable work only when checkpoint, eviction, and replacement capacity meet the failover RTO under exercise.
Capacity source
Option A
Rely on emergency cloud autoscaling
Option B
Reserve critical base plus elastic burst
Recommendation:Reserve the critical floor and preapprove burst; provider capacity and quota are least reliable during a regional event.
Follow-up interview questions
- 01Which workloads are truly reclaimable within fifteen minutes?
- 02How much margin remains after absorbing a lost region?
- 03What if the cloud provider cannot grant emergency quota?
- 04How do database and cache warm-up change the model?
Common weak answers and mistakes
- 01Counting all low-priority capacity as instantly reclaimable.
- 02Modeling compute while ignoring stateful tiers, quotas, and dependencies.
- 03Assuming average traffic when region loss occurs at peak.
- 04Calling untested autoscaling a capacity reservation.
Interviewer evaluation rubric
Sets target utilization but cannot prove N-minus-one capacity, reclaim time, or stateful readiness.
Defines critical floors, reclaimable classes, quota preparation, stateful headroom, and evacuation tests.
Models peak and replay overhead, gates traffic ramps, measures reclaimability, and balances commitments with interruptible work.
Integrates capacity insurance with product degradation, cloud negotiation, correlated risk, and continuous evidence from real exercises.