Senior·AI / GenAI·Troubleshooting
A model gives confident answers that are not supported by retrieved documents. How would you troubleshoot it?
RAGhallucinationgroundingevaluation
Interviewer is testing
- • Layered diagnosis
- • Evidence-based evaluation
- • Fallback design
Senior·ML / MLOps·Troubleshooting
A model's production quality dropped even though the training pipeline did not change. What would you investigate?
driftML monitoringfeaturesevaluation
Interviewer is testing
- • Production ML diagnosis
- • Data quality
- • Model comparison
Architect·Troubleshooting·Troubleshooting
A production API is intermittently timing out. Explain how you would isolate the failure and prevent recurrence.
Interviewer is testing
- • Problem isolation and evidence-based reasoning
- • Safe mitigation and verification
- • Prevention and operational learning
Foundation·Troubleshooting·Troubleshooting
A production API suddenly becomes slow. Walk through the first five things you would check before changing anything.
Interviewer is testing
- • Problem isolation and evidence-based reasoning
- • Safe mitigation and verification
- • Prevention and operational learning
Professional·Troubleshooting·Troubleshooting
A production API's latency doubled overnight. What do you investigate first?
latencyobservabilityincidentdebugging
Interviewer is testing
- • Incident framing
- • Hypothesis-driven investigation
- • Safe mitigation
Professional·AI / GenAI·Troubleshooting
A RAG application has good latency but poor answer quality. How do you isolate the problem?
ai-genai
Interviewer is testing
- • Problem isolation and evidence-based reasoning
- • Safe mitigation and verification
- • Prevention and operational learning
Professional·AI / GenAI·Troubleshooting
A RAG application has good latency but poor answer quality. How do you isolate the problem?
RAGretrievalevaluationLLM
Interviewer is testing
- • Evaluation design
- • Retrieval isolation
- • Grounding reasoning
Professional·AWS / Cloud·Troubleshooting
An event consumer is falling behind during traffic spikes. Design the recovery and scaling strategy.
aws-cloud
Interviewer is testing
- • Problem isolation and evidence-based reasoning
- • Safe mitigation and verification
- • Prevention and operational learning
Professional·Reliability·Troubleshooting
An event consumer is falling behind during traffic spikes. How would you recover safely?
queuesback-pressurescalingretries
Interviewer is testing
- • Evidence-driven diagnosis
- • Safe scaling
- • Downstream protection
Architect·Architecture·System Design
Design a multi-region API for a business that has explicit RTO and RPO requirements.
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations
Senior·AI / GenAI·System Design
Design a production AI agent that can call business tools without becoming an uncontrolled automation risk.
ai-genai
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations
Senior·MLOps·System Design
Design a production ML platform that can safely promote models from training to serving.
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations
Architect·AI / GenAI·System Design
Design a production RAG platform for an enterprise knowledge base with strict access controls.
RAGenterprisesecurityevaluation
Interviewer is testing
- • End-to-end architecture
- • Authorization
- • Evaluation
- • Operations
Senior·AI / GenAI·System Design
Design a production RAG platform handling 10M queries per month.
ai-genai
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations
Professional·Security·System Design
Design a secure large-file upload flow without proxying every byte through the API.
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations
Professional·AWS / Cloud·System Design
Design an event-driven AWS pipeline that remains reliable when downstream processing slows down.
aws-cloud
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations
Senior·Reliability·System Design
How do RTO and RPO change a multi-region architecture?
RTORPODRmulti-region
Interviewer is testing
- • Business-to-technical translation
- • Recovery design
- • Cost reasoning
Senior·Cost Optimization·Trade-off
How do you balance cost against reliability when presenting an architecture to a customer?
costreliabilitycustomertrade-offs
Interviewer is testing
- • Business translation
- • Risk reasoning
- • Architecture communication
Professional·Databases·Architecture Decision
How do you decide between a relational database and a NoSQL database for a new system?
SQLNoSQLdata modelingconsistency
Interviewer is testing
- • Workload modeling
- • Consistency reasoning
- • Operational trade-offs
Senior·Architecture·Trade-off
How do you recognize when an architecture is becoming over-engineered?
complexitysimplicityoperationstrade-offs
Interviewer is testing
- • Judgment
- • Operational cost
- • Requirement discipline
Professional·Reliability·System Design
How would you design a customer-facing application that survives a single availability-zone failure?
HAMulti-AZload balancingRTO/RPO
Interviewer is testing
- • Failure-domain thinking
- • Recovery design
- • Operational verification
Professional·Data Engineering·System Design
How would you design a data pipeline that can recover safely after a downstream processing failure?
data pipelinesretriesidempotencyback-pressure
Interviewer is testing
- • Durability
- • Recovery
- • Data correctness
Professional·Security·Architecture Decision
How would you design least-privilege access for multiple application roles?
IAMleast privilegeidentityaudit
Interviewer is testing
- • Trust boundaries
- • Authorization design
- • Auditability
Professional·Communication·Behavioral
How would you explain a complex architecture trade-off to a non-technical stakeholder?
stakeholdersbusinesstrade-offs
Interviewer is testing
- • Clarity
- • Business impact
- • Decision framing
Senior·AI / GenAI·System Design
How would you keep an AI agent from performing an unsafe tool action?
agentstool callingguardrailsauthorization
Interviewer is testing
- • Security boundaries
- • Tool authorization
- • Safe failure
Professional·Scalability·System Design
How would you protect an API from a sudden 20× traffic spike while keeping legitimate users served?
rate limitingautoscalingload balancingresilience
Interviewer is testing
- • Capacity planning
- • Fairness
- • Graceful degradation
Senior·AI / GenAI·Trade-off
How would you reduce the cost of a high-volume LLM application without sacrificing the required quality?
LLMcostevaluationmodel routing
Interviewer is testing
- • Quality-cost trade-offs
- • Measurement
- • Workload optimization
Professional·DevOps·Trade-off
How would you safely roll out a new version of a Kubernetes workload?
Kubernetesdeploymentrollbackobservability
Interviewer is testing
- • Release safety
- • Failure signals
- • Rollback planning
Professional·Kubernetes·Troubleshooting
Kubernetes workloads are being OOMKilled intermittently. How would you investigate?
OOMKillresourcescontainers
Interviewer is testing
- • Container resource reasoning
- • Evidence gathering
- • Safe remediation
Professional·Behavioral·Behavioral
Pick the most important project on your resume. What was the hardest engineering decision you made and why?
resumeprojectownershiparchitecture
Interviewer is testing
- • Technical depth
- • Personal contribution
- • Decision quality
Senior·AI / GenAI·System Design
Reduce the cost of a high-volume LLM application without degrading its required quality target.
ai-genai
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations
Professional·Behavioral·Behavioral
Tell me about a production incident you handled. What did you do and what changed afterward?
STARincidentownershiplearning
Interviewer is testing
- • Ownership
- • Communication
- • Evidence
- • Learning
Professional·Behavioral·Behavioral
Tell me about a production incident you were involved in. Explain what happened, what you did, and what changed afterward.
Interviewer is testing
- • Ownership and judgment
- • Communication and collaboration
- • Impact, outcome, and learning
Senior·Behavioral·Behavioral
Tell me about a technical decision where you disagreed with another engineer or stakeholder. How did you handle it?
Interviewer is testing
- • Ownership and judgment
- • Communication and collaboration
- • Impact, outcome, and learning
Senior·Behavioral·Behavioral
Tell me about a time you improved an engineering system's cost, reliability, or delivery speed. What did you change and how did you measure success?
Interviewer is testing
- • Ownership and judgment
- • Communication and collaboration
- • Impact, outcome, and learning
Foundation·DevOps·Fundamentals
What does a safe CI/CD pipeline need beyond build and deployment steps?
CI/CDtestingsecuritydelivery
Interviewer is testing
- • Quality gates
- • Supply-chain awareness
- • Release safety
Senior·ML / MLOps·Architecture Decision
What gates should a model pass before it is promoted to production?
MLOpsevaluationmodel registryrollback
Interviewer is testing
- • Evaluation design
- • Artifact lineage
- • Release safety
Foundation·AI Fundamentals·Fundamentals
What is RAG primarily used for?
AIfundamentalsinterview-basics
Interviewer is testing
- • Core AI/GenAI concept recognition
- • Ability to explain the concept accurately and simply
Foundation·Interview Technique·Fundamentals
What questions should you ask before designing a system from an ambiguous interview prompt?
requirementsinterview techniquesystem designcommunication
Interviewer is testing
- • Problem framing
- • Requirement discovery
- • Communication
Foundation·Security·Fundamentals
What security controls would you expect around a production API?
API securityauthenticationauthorizationrate limiting
Interviewer is testing
- • Security breadth
- • Threat boundaries
- • Operational controls
Professional·Observability·Fundamentals
What would you instrument in a distributed service before calling it production-ready?
metricslogstracesSLO
Interviewer is testing
- • User-impact thinking
- • Signal selection
- • Incident readiness
Professional·Architecture·Architecture Decision
When is event-driven architecture a better fit than direct service-to-service calls?
eventsqueuesdecouplingdistributed systems
Interviewer is testing
- • Coupling
- • Failure isolation
- • Operational complexity
Foundation·Architecture·Architecture Decision
When should an API call stay synchronous, and when should work become asynchronous?
queuesAPIslatencydecoupling
Interviewer is testing
- • Requirement clarification
- • Latency and UX reasoning
- • Failure and retry thinking
Senior·Distributed Systems·Trade-off
When would you accept weaker consistency to improve latency or availability?
consistencylatencyavailabilitydistributed systems
Interviewer is testing
- • Business semantics
- • Distributed systems reasoning
- • Failure impact
Professional·Architecture·Architecture Decision
When would you choose a managed service over more infrastructure control?
managed servicesoperationscontrolcost
Interviewer is testing
- • Build-vs-buy reasoning
- • Operational trade-offs
- • Constraints
Professional·Performance·Trade-off
When would you introduce caching, and how would you prevent stale or incorrect data from becoming a problem?
cachinglatencyconsistency
Interviewer is testing
- • Performance reasoning
- • Consistency trade-offs
- • Invalidation strategy
Foundation·AI Fundamentals·Fundamentals
Which statement best describes agentic AI?
AIfundamentalsinterview-basics
Interviewer is testing
- • Core AI/GenAI concept recognition
- • Ability to explain the concept accurately and simply
Foundation·AI Fundamentals·Fundamentals
Which two components commonly appear in an AI agent workflow?
AIfundamentalsinterview-basics
Interviewer is testing
- • Core AI/GenAI concept recognition
- • Ability to explain the concept accurately and simply
Foundation·AI Fundamentals·Fundamentals
Which two practices improve the quality of a knowledge-based AI application?
AIfundamentalsinterview-basics
Interviewer is testing
- • Core AI/GenAI concept recognition
- • Ability to explain the concept accurately and simply
Foundation·Architecture·System Design
You need to process a task that may take several seconds. Explain when you would keep the request synchronous and when you would make it asynchronous.
Interviewer is testing
- • Requirements and constraints
- • Architecture and trade-offs
- • Reliability, security, cost, and operations