Learning evaluation in the APS
Learning across the APS is changing. Learning practitioners are embracing the vision and targets established by the APS Learning & Development Strategy. Learning initiatives are evolving to reflect a continuous learning culture and taking advantage of technology in new ways.
With so much happening across Learning & Development (L&D) in the APS, we must start capturing stories of positive change and evaluate the effectiveness and impact of this transformation. This will help us understand the strengths and ongoing opportunities available.
The APS Learning Evaluation Framework (the Framework) and guidances help learning practitioners across the APS to evaluate the learning initiatives they offer.
Why evaluate?
There are lots of reasons to evaluate learning initiatives. Evaluation is an in-depth and values-based process that helps an organisation to understand what is happening and why.
Formative evaluation helps drive continuous improvement and innovation. It helps assess how well an initiative is, and is not, working and assists in determining what changes are needed for improvement.
More than a technical process, formative learning evaluation is deeply influenced by organisational values and the drive for continuous improvement. When done well, it aligns with your agency's purpose and strategic goals and leads to improved learning outcomes.
APS Learning Evaluation Framework
The Framework emphasises the relationship between continuous and routine monitoring, evaluation and organisational insights.
Evaluating the effectiveness of APS learning is central to ensuring the quality of L&D initiatives and individual learning.
The effectiveness of L&D practice across the APS is determined by evaluating against the following criteria:
- Efficiency
- Impact
- Relevance
- Flexibility
- Accessibility
Key evaluation questions
| Key evaluation questions | |||||
|---|---|---|---|---|---|
| Effectiveness | Accessibility | Flexibility | Relevance | Impact | Efficiency |
|
Key evaluation questions - How effective was the initiative in helping the participant perform their work? |
Key evaluation questions - To what extent did all the targeted audiences benefit equally? |
Key evaluation questions - How well does the initiative complement other initiatives? |
Key evaluation questions - How relevant is the initiative in responding to the learning needs of the participants, agency and APS? |
Key evaluation questions - What difference has the initiative made to participants, agencies, and the APS? |
Key evaluation questions - How efficient was the implementation of the initiative? |
| Information sources | ||||
|---|---|---|---|---|
|
Primary sources (eg participants and supervisors) - Questionnaires |
Other sources - Participation rates |
|||
Learning evaluation guidance
To accompany the Framework, the APSC has developed resources for learning practitioners to use when evaluating learning - these resources are found in the Learning Evaluation Handbook.
The Handbook is broken up into nine tasks, which are the foundations for good learning evaluation practice:
For more information, and to begin exploring the nine tasks, visit the Learning Evaluation Handbook page.