NZATD 2025: Finding Real Learning Impact

In my previous posts (on NN/G, SAM2, and LTEM) based on my NZATD Tahu Ignite workshop, I looked at what UX/UI wisdom has to offer learning designers when it comes to testing e-learning during the design process, what the SAM2 process says about when in the design process different types of testing are good, and how Will Thalheimer’s LTEM model can help us work out what data we should be trying to find to evaluate success on different levels. This is my fourth and final post derived from the workshop.

Robert O. Brinkerhoff’s Success Case Method (SCM) offers a practical way to uncover the real impact of learning. It helps you focus on what drives success and what gets in the way.

What is the Success Case Method?

The Success Case Method blends quantitative and qualitative data to find out what’s really happening in the workplace. Instead of relying on averages, SCM examines the most and least successful learners in a program.

By looking at both ends of the spectrum, you can pinpoint:

• What enables success
• What prevents the application of learning
• What changes could increase overall impact

This approach looks particularly useful for pilot programs to me, where we need quick, actionable insights before scaling up.

By digging deep in a targeted way, we can get both breadth and depth in an evaluation to a degree we can’t possibly afford if we’re trying to do everything.

What good looks like

To get value from SCM, start with a clear picture of what success means and how you’ll measure it.

1. Define clear performance goals before the training begins.
2. After delivery, use data to identify top and bottom performers.
3. Interview successful learners to understand what helped them apply the learning.
4. Interview less successful learners to uncover what held them back.
5. Feed both sets of insights into the design refinement process.

What you need to succeed

SCM doesn’t require complex tools, but it does rely on clarity, curiosity, and a willingness to act on the findings.

You’ll need:

• Defined success criteria tied to performance outcomes
• Access to learner data soon after pilot completion
• Interview guides that focus more on ‘why’ than on ‘what’
• A design team ready to act on insights, even if that means making big changes.

Applying SCM in a pilot

Imagine a pilot of an online course for sales staff. After the program, an SCM review might reveal that:

• Top performers exceeded sales targets because they applied a questioning technique taught in the course, and they had opportunities to practise it during the pilot.
• Bottom performers forgot about the technique because they didn’t have a chance to practise before trying it with clients.

With that insight, the solution becomes clear: build more practice opportunities into the course and add a post-training job aid to reinforce the key technique.

Turning insights into impact

The SCM process typically follows a straightforward sequence:

1. Plan a Success Case study
2. Create an impact model to define what success looks like
3. Survey participants to identify the best and worst cases
4. Interview and document both success and failure stories
5. Communicate your findings and recommendations.

This process generates clear, evidence-based insights you can use to refine design, demonstrate value, and strengthen business alignment.

Where to learn more

Learn more about Robert Brinkerhoff’s Success Case Method here:
https://tinyurl.com/NZATD-SCM
https://tinyurl.com/NZATD-BrSCM