A COO at a growing company once called the firm's onboarding useless. The completion rate was 100%. The new hires still couldn't tell when to escalate a customer problem (Reddit, r/instructionaldesign).
That gap between finished and able to do it is the measurement problem in one sentence. Most L&D dashboards still lead with completions, hours and satisfaction scores. Leadership has stopped finding them convincing. In 2026, "showing value" was the fastest-rising topic in Donald H Taylor's L&D Global Sentiment Survey, which drew more than 3,500 voters from a record 105 countries (GSS 2026).
This guide covers how to measure training effectiveness in a way a CFO will accept, and how to start even when you have no access to business data. It draws on the Kirkpatrick model, Will Thalheimer's LTEM and the latest industry research.
EP 01Key takeaways.
- Completion, attendance and satisfaction show that training happened. They don't show that anyone learned anything.
- Use Kirkpatrick to talk to leadership and LTEM to design your measurement. They do different jobs.
- The level L&D can reach on its own is decision-making competence: can people make the right call in a realistic situation, right after training and weeks later?
- Agree the business metric with its owner before you build anything.
- Drop myths like "only 10% of training transfers". They damage your credibility with exactly the people you need to convince.
Why training measurement became urgent in 2026
Four data points from the past twelve months explain why boards are asking harder questions.
L&D is losing strategic ground. RedThread Research reported in June 2026 that L&D's strategic influence had declined for the third year in a row, although the top-performing quarter of organizations is reversing the trend (RedThread, State of L&D 2026).
Few companies believe their training builds the skills their strategy needs. In Josh Bersin's February 2026 study of more than 800 organizations in 60 countries, only 26% said they were effectively developing those skills (Bersin, Definitive Guide to Corporate Learning). The data is self-reported, and Bersin sells his own AI learning platform, so treat it as a direction rather than a precise figure.
Almost everyone wants to measure, but few fund it. In GP Strategies' 2025 survey, 98% of L&D teams wanted to measure business impact, but only 24% had a budget for it (GP Strategies, MBIL 2025). The sample is a vendor's, but the gap matches what practitioners describe.
Cost pressure is now explicit. At its October 2026 HR Symposium, Gartner named cost and efficiency pressure as one of the main drivers of an L&D "reset", alongside rapid reskilling and AI literacy (HR Dive). In the UK, CIPD found that alignment between L&D strategy and business priorities fell from 77% to 63% (CIPD).
The thread running through all four is a credibility loop. L&D measures activity because performance data sits with managers and business systems. Leadership then doubts that L&D builds strategic capability and invites it to fewer strategy conversations. The loop only breaks when L&D brings evidence that something changed.
What "training effectiveness" actually means
Training effectiveness is the degree to which training changes what people can do and actually do at work, and whether that change moves a business result.
It is not the same as training efficiency. Efficiency covers cost per learner, time to build and completion rate. Those numbers matter for running a function, but they say nothing about whether the training worked. A course can be cheap, fast and finished by everyone, and still have no effect at all.
The Kirkpatrick model: a useful map that is often misused
The Kirkpatrick model is the most widely used training evaluation framework. It has four levels:
- Reaction: did participants find the training relevant and engaging?
- Learning: did they acquire the intended knowledge and skills?
- Behavior: do they apply it on the job?
- Results: did business outcomes improve?
Jack Phillips later added a fifth level, ROI, which compares the monetary benefit with the program's cost.
The model's strength is that its language fits leadership conversations: behavior and results are what executives care about. The weakness lies in how it is used. Most organizations stop at Level 1, the post-course "smile sheet", and sometimes reach Level 2 with a knowledge quiz. Will Thalheimer and other evidence-focused practitioners have argued for years that learner satisfaction is not enough to show that learning happened (Huthwaite International). A course people enjoyed is not the same as a course that changed what they do.
LTEM: a stricter ladder for proving learning
In 2018 Will Thalheimer published the Learning-Transfer Evaluation Model (LTEM) as an alternative to Kirkpatrick. It has eight tiers, and the current version 13 was released in October 2024 (Work-Learning Research).
| Tier | What it measures | What it proves | Typical measure |
|---|---|---|---|
| 1. Attendance | Who showed up or enrolled | Nothing about learning | Enrollment, completion |
| 2. Activity | Participation, attention, interest | Nothing about learning | Clicks, time on page |
| 3. Learner perceptions | What learners think of the training | Very little on its own | Surveys, ratings |
| 4. Knowledge | Recall of facts and terms | Recognition, not ability | Quizzes, multiple choice |
| 5. Decision-making competence | Making the right call in realistic situations | Ability to decide | Scenario-based questions, branching scenarios |
| 6. Task competence | Deciding and doing the task | Ability to perform | Simulations, observed practice |
| 7. Transfer | Applying it on the job | Behavior change | Manager observation, work data |
| 8. Effects of transfer | Impact on people, the organization and beyond | Business result | KPIs, quality, risk, revenue |
The first three tiers are where most dashboards live, and LTEM treats them as inadequate evidence of learning. The important practical point is Tier 5. L&D can measure decision-making competence on its own, without waiting for HR systems or sales data. You put people in realistic situations and record what they decide, right after training and again several weeks later.
Kirkpatrick vs. LTEM: which one should you use?
Use both, for different jobs.
| Kirkpatrick | LTEM | |
|---|---|---|
| Best for | Talking to leadership in results language | Designing measurement that proves learning |
| Levels | 4 (5 with Phillips ROI) | 8 tiers |
| View of satisfaction surveys | Level 1, often treated as a starting point | Tier 3, "inadequate on its own" |
| Strongest contribution | Connects training to business results | Separates knowledge from decision and task competence |
| Common trap | Stopping at Levels 1 and 2 | Over-engineering small programs |
A practical rule: frame the goal in Kirkpatrick's Level 3 and 4 terms with your stakeholder, then build the evidence using LTEM Tiers 5 to 7.
How to measure training effectiveness in 5 steps
Step 1: Agree the business metric before you design anything
Kevin M. Yates, who calls himself the "L&D detective", argues that L&D has to move from activity metrics to performance impact, and from order-taker to performance consultant (360Learning). Lori Niles-Hofmann gives the simplest filter: a learning initiative should help the business make money, save money or reduce risk (DataCamp webinar).
Before you build anything, ask the business owner which number should move, by how much and by when. Write it down. If nobody can name a number, you have found your first problem.
Step 2: Check that it is a training problem
Julie Dirksen, author of Design for How People Learn and Talk to the Elephant, starts by asking whether the problem can be solved by training at all. Her example is a call center that measures call length instead of first-contact resolution. Agents rush customers because the incentive tells them to, and no course will change that (Infopro Learning, YouTube). If the system rewards the wrong behavior, fix the system first, or your measurement will show "training failed" when the training was never the cause.
Step 3: Define the decisions people must get right
Turn the business goal into 3 to 7 observable decisions. This is the core of Cathy Moore's action mapping: start from the goal, list what people need to do, then design practice, and add information last. For a customer service team, decisions might include "when to offer a refund without escalating" or "how to respond when a customer threatens to cancel".
Decisions are measurable in a way that "understands the refund policy" is not.
Step 4: Measure decision competence before, right after and weeks later
Build realistic scenarios around those decisions and use the same scenario three times:
- Before training: the baseline. It also shows where the real gaps are, so you don't train what people already know.
- Right after training: LTEM Tier 5, immediate decision competence.
- 4 to 8 weeks later: the delayed check, which shows what actually stuck.
There is a bonus. Testing is not only a measurement tool, it is also a learning method. In a classic study, students who were tested on a text remembered 56% of it a week later, compared with 42% for those who simply reread it (Roediger & Karpicke, 2006). Your delayed check reinforces learning while it measures it.
Step 5: Track transfer drivers and leading indicators with the business owner
Transfer to the job depends on more than the training itself. A meta-analysis of 89 studies found that the work environment and learner motivation matter more for open skills, such as leadership, sales and customer conversations, than for closed skills like operating software (Blume et al., 2010). Manager support is one of several factors, not the only one.
Agree two or three leading indicators with the business owner. These could be escalation rate, first-contact resolution, error rate or quality-audit scores. Then report the chain of evidence: decision competence went up, behavior indicators moved, and the business metric followed or didn't.
Training ROI: when to calculate it and when not to
Phillips' ROI formula is simple: (monetary benefit − program cost) ÷ program cost × 100. The hard part is isolating the effect of training from everything else that changed at the same time, such as a new manager, a price change or a seasonal peak.
Calculate full ROI for large, expensive programs where a control group or a staggered rollout is possible. For everything else, a credible chain of evidence (Tier 5 decision data plus agreed leading indicators) is more honest than an ROI figure built on assumptions.
Be wary of headline multipliers. Vendor research regularly claims that some approach delivers several times better performance. These figures are usually correlational, vary between a vendor's own publications and can't be replicated. Quoting them to a skeptical CFO costs you more credibility than it earns.
Three myths that quietly break your measurement
"Only 10% of training transfers to the job." This figure has no empirical basis. Researchers traced it to a speculative remark from 1982 and called it a myth in 2011 (Ford, Yelon & Billington). The best-known estimate (62% apply training immediately, 34% after a year) comes from a survey of trainers, not from observed behavior (Saks & Belcourt, 2006).
"People forget 70% within 24 hours." This is a distortion of Hermann Ebbinghaus' 19th-century experiments, in which he memorized nonsense syllables and tested himself. Forgetting depends heavily on the material and on how it is practiced (Murre & Dros, 2015).
"Interactive means better retention." A meta-analysis of 96 studies found that instructional method matters more than the delivery medium (Sitzmann et al., 2006). Interactivity helps when it makes people think and decide, not when it adds clicks.
What to report to leadership: a one-page example
| Level | Metric | Example result | What it tells leadership |
|---|---|---|---|
| Activity | Completion, time | 94% completed within 3 weeks | Reach and scheduling worked |
| Competence (LTEM 5) | Correct decisions, first attempt | 52% before → 81% after → 74% after 6 weeks | People can make the call, and most of it stuck |
| Behavior (LTEM 7) | Escalations per 100 tickets | 18 → 13 over the quarter | The team handles more cases itself |
| Result (LTEM 8) | Customer churn in the segment | Agreed target: −1 pt | Business owner validates the outcome |
Illustrative figures for layout only, not benchmarks.
Put competence and behavior in the middle of the page, not at the bottom. That is where L&D's contribution becomes visible.