Evaluate Online Training Beyond Attendance and Course Completion
A course can have high attendance and completion but still fail to improve the skill or behaviour it was meant to develop. Evaluation should begin with the intended outcome and collect evidence suitable for the decision being made.
Conversely, a demanding course may have lower completion for reasons that deserve investigation rather than an immediate verdict on its quality.
Separate participation, learning and application
These levels are related, but none automatically proves the next. A high completion rate on an easy quiz says little about workplace behaviour.
Four levels, four different questions
Did learners engage with the programme? Attendance, logins and activity completion.
Assessment performance or a practical demonstration of the target capability.
Do participants use the skill in their work or study after the course?
Did the change contribute to a wider objective? This needs the most careful attribution.
Choose evidence that matches the level you are actually claiming.
Gather a baseline where practical
Before the course, identify what learners currently know or can do and what managers or instructors expect to change. A short diagnostic task or structured self assessment may help, depending on the objective.
Claims become speculative
Later statements about improvement have nothing to compare against, even when the course was excellent.
Comparable evidence
Use comparable measures after training and record major contextual changes.
Use more than one evidence source
Use a source suited to the question. Satisfaction surveys do not prove competence, while quiz scores may not show whether a workplace behaviour changed.
Four sources, four different things they can show
Keep data collection proportionate and explain its purpose to participants.
Avoid attributing every change to the course
Performance may change because of other conditions entirely outside the training. Describe the evidence and limitations honestly.
- New tools
- Supervision
- Staffing
- Incentives
- External conditions
Turn findings into a decision
Ask which part of the course should change. Identify whether learners struggled with the content, access, assessment or opportunity to apply the skill.
- ActionKeep
- ActionRevise
- ActionExpand
- ActionRemove
Write the evaluation questions before choosing tools
Each question needs an appropriate evidence source. Starting with a favourite survey tool can lead to collecting lots of satisfaction scores without answering the decision the organisation needs to make.
Four questions worth asking
Write these before you write the survey. The tool should follow the question, not the other way around.
Keep surveys short and specific
Ask learners about concrete parts of the course, such as clarity of instructions, usefulness of practice and confidence in applying a task.
- Concrete questions about specific parts
- A clear explanation of who sees the data
- An honest note on anonymity
- A short set of questions tied to decisions
- Leading questions that invite praise
- A long survey with no clear purpose
- Treating low response rates as representative
- Questions nobody will act on
Record limitations honestly
Small cohorts, missing baseline data and changing workplace conditions can make results uncertain.
What the report should be honest about
A useful evaluation can still identify improvement opportunities without producing a headline percentage or claiming the course alone caused a wider business result.
Turn findings into a revision backlog
Separate small fixes from larger changes that require approval. When the course runs again, check whether the revision helped.
- Correct a confusing instruction
- Add a worked example
- Fix a broken link
- Clarify an assessment criterion
- Redesign an assessment
- Change the course structure
- Replace a core resource
- Adjust the delivery schedule
Build an evaluation plan that leads to a decision
Write one or two questions that matter to the programme owner, such as whether learners can perform a target task or which activity creates confusion. Choose an evidence source suited to each question.
Collect a baseline where practical and combine suitable sources, such as assessments, participant feedback and later observations. Explain how information will be used and protect identifiable records.
Summarise what the evidence supports, what remains uncertain and which course change should follow. Assign an owner and date to review the change in the next cohort. An honest, focused evaluation is more useful than an elaborate report that produces no implementation decision.
Choose measures learners can reasonably provide
Long surveys are often abandoned and can place an unnecessary burden on participants.
Ask only what will inform a decision
A modest, well designed evaluation is more useful than a large dataset gathered without a clear purpose or plan for analysis.
After a customer service course, the organisation combines three sources instead of relying on attendance.
Each source has limits, but together they provide more insight than attendance alone.
Frequently asked questions
Is learner satisfaction enough to evaluate training?
No. It is useful feedback but should be combined with evidence appropriate to the learning objective.
Can an evaluation prove business impact?
Only if the design supports that claim. Otherwise describe the evidence and limitations without overstating causation.
Action checklist
- The evaluation question is linked to a learning outcome.
- Participation, learning and application are distinguished.
- A baseline or comparable measure is used where practical.
- Evidence is drawn from suitable sources and limitations are reported.
- Findings lead to a concrete course decision.
Final thought
A credible evaluation plan uses the right evidence for the claim and acknowledges what it cannot prove. Use Moodle data as one part of a wider learning picture, not as a substitute for judgement.
Setting up the platform side of a training programme?
Stonehenge Digital KE's Moodle LMS Hosting service can support institutions establishing the platform side of an online training programme.
Explore the Moodle LMS Hosting Service →Interested in Moodle LMS Hosting?
Let's build this for your business
Fully hosted Moodle LMS on your own custom domain — built for Kenyan and East African schools, colleges, TVETs, and training providers.