Interview Scorecard: How to Turn Answers Into Evidence

By Don Georgevich

Phase Three of the Scientific Hiring Method: Discovery

An interview scorecard turns a conversation into a record of what the candidate proved, what remains uncertain, and how the evidence compares with the role standard.

Most interview notes are useful only to the person who wrote them. One interviewer writes “strong leader.” Another writes “good fit.” A third circles a number without explaining what produced it.

Those notes preserve an impression, not evidence. An interview scorecard forces the interviewer to connect each rating to the work, the candidate’s answer, and the standard written before the interview began.

What an interview scorecard is

An interview scorecard is the completed record for one candidate after one interview or interview stage. It contains the criteria being evaluated, the evidence gathered, the rating assigned, the reason for the rating, and the questions that remain unresolved.

It is different from the Job Scorecard, which defines successful performance in the role. It is also different from the Interview Rubric, which describes what weak, acceptable, and strong interview evidence look like.

The job scorecard establishes the destination. The rubric establishes the grading standard. The interview scorecard records what this candidate demonstrated.

The chain from role to evidence

Score one defined criterion at a time

Do not give one overall interview score based on the entire conversation. A candidate may show strong process judgment, acceptable communication, and weak evidence of influencing resistant managers.

Separate criteria make the remaining risk visible. An overall score can hide a serious gap behind several less important strengths.

Choose the criteria from the job scorecard before the interview. Assign each interviewer a clear area of responsibility so the team does not repeatedly measure one capability while ignoring another.

Record what the candidate said before what you think it means

An evidence note should describe the situation, responsibility, actions, decisions, constraints, and result that support the score.

Weak note: “Great operator. Very confident.”

Evidence note: “Inherited three teams using separate scheduling trackers. Reviewed four weeks of delayed starts, identified conflicting definitions of confirmed, created a two-week pilot, and reduced delayed starts from fifteen to five per month. Vice president required the third manager to participate.”

Interpretation: “Strong process diagnosis. Influence is promising, but part of the adoption depended on executive authority.”

Keeping the evidence and interpretation separate makes it easier to challenge the judgment without arguing about the interviewer’s personal reaction.

Use the rating only after the evidence is complete

A score should summarize the evidence. It should not replace it.

OPM states that structured interviews use predetermined questions and common rating scales so candidates are evaluated accurately and consistently. Its guidance also describes interviewers rating responses individually before participating in a discussion to resolve meaningful scoring differences. See OPM’s Structured Interviews guidance and its discussion of individual panel ratings.

Finish the answer, complete the relevant probes, write the evidence, and then choose the rating that matches the rubric.

A completed scorecard entry

Role: Operations Manager

Criterion: Process diagnosis

Question: “Tell me about a time you inherited an operating process that produced unreliable results. How did you determine what was causing the problem?”

Evidence: Candidate described repeated late customer starts across three service locations. They reviewed four weeks of failures, interviewed sales and service managers, and found that the teams used different definitions of confirmed. They proposed a shared status and a two-week pilot. Delayed starts fell from fifteen to five per month during the following quarter.

Rating: 4 — Strong

Reason: The answer showed relevant scope, personal ownership, several evidence sources, testing before rollout, stakeholder resistance, and a measured result.

Open question: The candidate had analyst support. Can they simplify the same diagnostic approach in a smaller company with fewer resources?

Next evidence source: Use the Candidate Test Drive to test diagnosis and prioritization with incomplete information.

Write open questions, not vague concerns

“I am not sure about leadership” gives the next evaluator little direction.

“The candidate described gaining support from two managers, but the third participated only after executive direction. References should clarify how the candidate worked with that manager after the mandate” creates a question that another stage can test.

Every meaningful uncertainty should have one of three outcomes:

1. Test it through another assessment stage.
2. Accept it as a known and manageable risk.
3. Decide that the unresolved risk is too important to continue.

Do not let interviewers rewrite the standard afterward

A candidate may be impressive in an area the role does not require. Record the evidence, but do not give it more weight merely because it was memorable.

Likewise, do not add a new criterion after one candidate performs poorly or another performs unusually well. The central standard must remain fixed across candidates.

The EEOC advises that selection procedures should be job-related, appropriate for their intended purpose, and administered without regard to protected characteristics. Employers should also review selection procedures when job requirements change. See the EEOC’s Employment Tests and Selection Procedures.

Record scores before the debrief

Each interviewer should complete the scorecard before hearing the group’s opinions.

When the hiring manager speaks first, other interviewers may reinterpret their notes to match the strongest voice in the room. Independent scorecards preserve the original evidence long enough for the team to understand disagreement.

The debrief may change a rating when another interviewer reveals relevant evidence that was missed. Record the reason for the change rather than silently replacing the original judgment.

Debrief criterion by criterion

Do not begin with, “Who did everyone like best?”

Begin with the highest-priority outcome or capability. Ask each interviewer to state the rating, evidence, and open question. Resolve meaningful differences by returning to the answer and rubric.

Continue through the criteria before discussing an overall recommendation. This keeps the candidate’s strongest personality trait from becoming the organizing principle for the entire conversation.

Do not average scores blindly

An average can help summarize the record, but it should not make the decision.

A serious weakness in a critical capability may matter more than several high scores on secondary criteria. A high average may also hide conflicting evidence that needs to be understood.

Use the scorecard to organize the evidence. Use Candidate Evaluation to combine interviews with the résumé, phone screen, work sample, and references before comparing candidates.

Keep the scorecard focused on job-related evidence

OPM specifically advises that structured-interview notes and scores should record candidate responses to job-related questions rather than appearance, personal characteristics, or unrelated demeanor. See OPM’s guidance on what belongs in interview notes and scoring.

When communication style is a real job requirement, define the behavior the job needs and evaluate that behavior. Do not score accent, appearance, similarity, nervousness, or personality preference under a vague label such as executive presence.

This page is educational and is not legal advice.

Review scorecards after the hire

Return to the interview scorecards during the 30- and 90-day performance reviews.

Which interview evidence predicted the person’s work accurately? Which high rating did not appear in performance? Which concern became real? Which concern never mattered?

This review turns the scorecard into a learning tool rather than a document that disappears after the offer.

What comes next

Use the Interview Scorecard Template to create the working form. Use the Interview Rubric to define rating anchors and Structured Interviews for the complete interview method.

Return to Discover What a Candidate Can Really Do or the main Scientific Hiring Method.