Evaluation is critical to measuring learning impact and demonstrating ROI. This guide outlines best practices, sample questions, and real-world methods across all five levels of training evaluation—from reaction to ROI.
Level 1: Reaction – Measure Initial Impressions
Goal: Understand how learners felt about the program.
Key Practices:
Use the Net Promoter Score (NPS):
“On a scale from 0 to 10, how likely are you to recommend this program to others in a similar position?”
Ask follow-up:
“Why did you score the way you scored?”
Collect weighted reasons such as lack of vision, poor communication, or support.
Longitudinal Evaluation:
Reassess the same group 60–90 days later to detect drops in perceived effectiveness and identify causes (e.g., role change, lack of support).
Level 2: Learning – Validate Knowledge & Skill Gain
Goal: Confirm participants acquired intended knowledge and skills.
Methods:
Pre/Post Observation Checklists:
Rate learner performance before and after training on key skills.
Skill Assessments or Tests:
Create tests with items aligned to program objectives. Validate them by correlating scores with job performance.
ROI Example:
Test scores predicted a 17% increase in sales; the ROI forecast = 93% from improved sales margins.
Level 3: Application – Gauge On-the-Job Use
Goal: Assess how training is being applied on the job.
Common Questions:
“How frequently are you applying the skills?”
“What percent of your job requires these skills?”
“How effective are you at using them?”
Application Barriers vs. Enablers:
Barriers | Enablers |
No opportunity | Management support |
Lack of knowledge | Peer support |
System/process conflicts | Confidence |
Lack of confidence | Organization alignment |
Level 4: Impact – Link Training to Results
Goal: Determine if training influenced key business metrics.
Three Evaluation Models:
Unknown Measure
Ask open-ended questions like:
What changed in your work/team?
What metric improved?
What’s the estimated annual value?
Known Set of Metrics
Use a Likert scale to measure influence on:
Productivity, cost, quality, sales, time, satisfaction
Known Impact Measure
Ask respondents to define:
Unit of measurement
Improvement magnitude
Attribution to training
Confidence level
Level 5: ROI – Quantify Financial Return
Goal: Forecast or calculate the monetary return of training investment.
Methods to Forecast ROI:
Participants estimate:
% improvement in effectiveness
Estimated dollar value of change
Confidence in their estimate
Adjust high outliers for realism and multiply by confidence percentage.
Example Calculation:
Total benefit = $990,000
Program cost = $358,900
ROI = 176%
Advanced ROI Forecasting: Skill Contribution Model
In a hybrid team leadership program:
Skills improved job contribution by 15.2%
Average salary + benefits: $135,000
Annual benefit = $20,520
Program cost = $5,000
ROI = 310%
Follow-Up Questionnaire Tips
Use a mix of quantitative (Likert, %) and qualitative (open-ended) questions. Include:
Reaction (value, relevance, recommendation)
Learning (confidence, percent improvement)
Application (frequency, effectiveness)
Barriers/enablers
Results (defined metrics and ROI estimates)
Boosting Response Rates
Before the Survey:
Communicate purpose and use
Identify who will see results
Pilot test and design for simplicity
Offer incentives if culturally appropriate
During the Survey:
Send regular reminders
Share interim response rates
Keep the window short (2–3 weeks)
After the Survey:
Send thank-you notes
Share key findings
Show how insights will be used
Fully Loaded Cost Considerations
When evaluating ROI, include:
Program development and delivery
Participant time and salaries
Travel and materials
Admin overhead and evaluation
Cost items may be prorated (e.g., development) or expensed (e.g., travel).
Final Tips
Align evaluation to business outcomes.
Use progressive levels (1–5) for stronger analysis.
Capture both quantitative and qualitative data.
Forecast ROI conservatively using confidence-adjusted estimates.
Leverage feedback to continuously improve programs.
We've also included this handy survey question bank that you can use! Download it here.
Need help designing your evaluation strategy in Cognota? Reach out to our team—we’re here to help you prove learning value and improve performance.