Glossary

Structured interview

By ScoringFactoryUpdated 4 min read
Definition

A structured interview is a job interview in which every candidate for a role is asked the same job-related questions in the same order, and each answer is rated against a predefined scale with written examples, so results can be compared across candidates and interviewers.

What makes an interview structured

An interview is structured when four things are fixed in advance. The U.S. Office of Personnel Management's guidance on structured interviews sets out the core of it: the same questions in the same order, and the same rating scale for every answer.

  1. Questions come from a job analysis. Each question targets a competency the role needs.
  2. Every candidate gets the same questions, in the same order, with the same follow-up prompts.
  3. Answers are rated on a defined scale. Usually 1 to 5, with a written example of a weak, adequate and strong answer at each anchor. That is a rubric, and rating answers against it is a form of qualitative scoring.
  4. Ratings are recorded per question, before interviewers talk to each other.

Questions come in two main types. Behavioral questions ask about the past ("Tell me about a time you had to tell a customer no"). Situational questions pose a scenario ("A customer threatens to cancel unless you ship a feature this week. What do you do?").

Are structured interviews more predictive?

Yes, on the best evidence available. Schmidt and Hunter (1998) pooled decades of selection research and estimated the validity of structured interviews for predicting job performance at 0.51, against 0.38 for unstructured interviews. Sackett and colleagues (2022) revisited those estimates with different corrections and found lower numbers across the board: 0.42 for structured interviews and 0.19 for unstructured. In their revised table, structured interviews had the highest mean validity of the procedures they reviewed.

The exact figures are debated. The direction is not. By the newer estimate, a structured interview has more than twice the validity of an unstructured one. Consistency also matters for fairness. When everyone gets the same questions and the same scale, it is easier to show that differences in outcome came from answers and not from who was asked what. That makes the structured interview one of the simplest steps in bias mitigation.

Worked example: scoring one question

Tidewater Software, a fictional company, is hiring a support team lead. One of six questions targets de-escalation.

Question: "Tell me about the last time a customer was angry about something that was our fault. What did you do, and what happened?"

RatingAnchor
1No specific example, or blames the customer
3Specific example, apologized and fixed the issue, little on follow-through
5Specific example, owned the error, fixed it, changed a process so it did not recur, and can say what happened to the account

Two interviewers hear Candidate E describe refunding a customer and writing a new release checklist. Both rate a 5 independently. For Candidate F, one rates 3 and the other 4. The gap goes to the debrief as a specific question (did F describe follow-through or not?) rather than a general impression. Across six questions, the per-question ratings feed a scorecard and the team's candidate scoring.

Structured vs unstructured interviews

Structured interviewUnstructured interview
QuestionsSame for everyone, from a job analysisChosen by each interviewer, often on the fly
ScoringPer question, on anchored scalesOverall impression, sometimes a thumbs up or down
Validity (Sackett et al., 2022)0.420.19
ComparabilityHigh across candidates and interviewersLow
Candidate experienceCan feel scripted if run stifflyFeels conversational

Semi-structured formats sit between the two: fixed core questions and anchors, plus room for follow-ups. Most teams that move away from unstructured interviews land here.

Common structured interview mistakes

  • Same questions, no anchors. Without a written scale, interviewers rate on private standards and much of the benefit is lost.
  • Rating at the end. Scoring all questions after the interview from memory blends them into one impression. Rate as you go.
  • Talking before scoring. Once a senior interviewer gives an opinion, others anchor on it. Submit ratings first.
  • Never checking agreement. Measure inter-rater reliability on a sample of interviews and retrain where raters diverge.
  • Never checking outcomes. Compare interview scores to quality of hire later. Questions that predict nothing can be replaced.

How ScoringFactory fits with structured interviews

ScoringFactory scores candidates by the work they have done, against a bar it learns from the team's past hiring decisions, and cites each score to the line in the record. That helps a team decide who to interview and which gaps the structured interview should probe. The interview and the decision stay with the team. See the hiring use case, and the hiring bar entry for setting the standard the interview tests.

Frequently asked questions

What is a structured interview?

A structured interview is one where every candidate for a role answers the same job-related questions, in the same order, and each answer is scored on a predefined scale with written examples. The structure makes answers comparable across candidates and across interviewers, which unstructured conversation does not.

Are structured interviews more predictive than unstructured ones?

Yes. Schmidt and Hunter (1998) estimated validity of 0.51 for structured interviews against 0.38 for unstructured. A 2022 reanalysis by Sackett and colleagues lowered both, to 0.42 and 0.19, and still ranked structured interviews highest among the selection methods it reviewed. The figures are debated, but the gap is consistent.

How do you score a structured interview?

Write a 1 to 5 scale for each question with an example answer at 1, 3 and 5. Each interviewer rates each answer during or right after the interview, independently, with a note on the evidence. Average across interviewers per question, then combine questions using the weights you set for the role.

Can a structured interview still feel like a conversation?

Yes. Explain the format at the start, ask the fixed questions in a natural voice, and use the planned follow-up prompts to draw out detail. Leave time at the end for the candidate's own questions, which you do not score. Structure governs what you ask and how you rate it, not your tone.

Sources

  1. Structured Interviews, U.S. Office of Personnel Management, current text
  2. Sackett et al. (2022), Revisiting meta-analytic estimates of validity in personnel selection, Journal of Applied Psychology (APA)