09 · Interview preparation
Approaching the interview
3 min read
The preceding topics developed the reasoning needed to connect requirements, data, models, evaluation, serving, and monitoring. An ML system design interview asks you to apply that reasoning to a particular application and explain your choices as the requirements become clearer. This topic focuses on organizing that discussion once you understand the components and their relationships.
Find out what the round evaluates
Applied ML design connects data, modeling, evaluation, and serving around an application such as search or recommendations. An ML infrastructure discussion may concentrate on training systems or serving capacity, while a model-depth discussion may examine a particular architecture or training method. Coding can be assessed in a separate round, so confirming the expected format helps you prepare at the right level of detail.
For an applied design discussion, practise explaining how an application obtains a prediction and how the model behind it is developed. A shared diagram can support that explanation by showing where data is prepared, where computation happens, and what each component needs from the others. The requirements give you the basis for deciding which connections deserve a deeper discussion.
Agree on the problem before drawing
Before drawing components, establish the action the application will support. A video recommendation prompt could concern a home feed, related videos, or the next video in an autoplay session, and each uses different context. Asking about the intended outcome, available data, catalog size, and freshness gives you a scope that the interviewer can confirm or correct.
With that scope agreed, describe what the model will receive and predict. A possible task is estimating whether a user will watch a candidate video for a defined duration during the current session. Explaining that duration makes the target measurable, which lets you begin connecting the data needed for training with the inputs needed when a prediction is requested.
Choose where to go deeper
Once the first sketch connects data collection, training, and prediction, use the requirements to decide which part needs more explanation. A large catalog raises the question of how to find a small set of relevant items without scoring everything. A short response deadline raises the question of which calculations can happen ahead of time. Following the constraint into the design gives the discussion a clear direction.
Comparing a simple starting approach, called a baseline, with one plausible alternative gives you room to explain the expected benefit and how you would measure it. When a component is unfamiliar, describing its required behavior and acknowledging the missing detail keeps the discussion grounded in what the design actually needs.
For a 45-minute practice session, you might reserve roughly five minutes for scope, ten for the learning task and data, fifteen for the main design, ten for evaluation and operational tradeoffs, and five for further discussion. This allocation is a rehearsal aid that you can adjust to the prompt, while the interviewer’s direction determines how the actual discussion develops.
Practise decisions, then defend them
Choose a practical design and use a blank page to connect its requirements to the data, model, and serving decisions you have learned. Trace how a request receives a prediction and how a new model is produced, explaining why each part is needed. Working with a partner who changes one requirement helps you practise adapting the design and identifying which other decisions must change with it.
Review whether your explanation accounts for the data available at prediction time, how quality is measured, and what happens when part of the system fails. Return to the relevant topic wherever the reasoning is incomplete, then revise that part of the design before attempting another problem. This makes each practice attempt a way to identify and strengthen a specific gap in understanding.