by Alan Nelson
A recent BBC article about learning by rote to pass GCSE exams raises an old question:
"Why do we test people’s retention of facts that they will never need other than to pass the exam?"
This rang bells for me because it is a subject that frequently comes up with regard to our online CPD courses.
The problem for me is that people associate testing with rigour. I can to some extent understand that with qualifications but it is really counterproductive in the case of CPD. The purpose of CPD is to help professionals to maintain and develop the skills and knowledge they need to continue to practice effectively. What that constitutes will be different for each individual depending on their experience and current role. Most professional bodies we work with specify that CPD must be "relevant", but the detail of what is and is not relevant is rightly left to the individual professional to determine.
The assertion is that the completion certificate can’t be worth much if you don’t have to pass to get it. But that implicitly assumes two things:
- That testing is appropriate for all topics; and
- That the alternative is to hand out certificates to anyone who turns up irrespective of their level of engagement.
The futility of validating completion by assessment becomes apparent if you look at some examples of the different sorts of topic they might engage with:
- Developing skills
Our course Networking Skills helps professionals to establish and maintain their professional networks. It is popular, despite or perhaps partly because we don’t promise to get everyone to the same specified end point. Success for the course could be defined as having enabled each user to acquire new skills and gain confidence, hardly something which can be assessed with a few multiple choice questions. What makes the process valuable for the learner is the process of digesting and reflecting on what is being learnt.
- Keeping up with the changing world
Our new course Social Media for Professionals provides a briefing on key developments in social media and suggestions and tools for using them in your professional life. I would regard a successful outcome to be that a learner had found out some useful and relevant things about the subject that they didn't previously know and that they had come up with a plan for how that could benefit their professional activity.
- Engaging with an issue or debate
Our most popular course for accountants is Ethical Issues for Accountants. It takes the form of a series of case studies. These present real world problems where it is genuinely difficult to decide what the right course of action is. We ask participants to suggest what they might do. In return, they get tips from the author on the key issues, and the chance to see what everyone else has said. I cannot imagine what an assessment could add to this process.
- Technical topics
In some cases our courses focus on ensuring that users stay up to date with a technical topic. Our short briefing on Irish Capital Acquisitions Tax is a case in point, as is the course on the concept of the Going Concern principle in accounting that we put together because of its significance in the recession. These courses focus primarily on knowledge and we do tend to include assessments. However these are presented as part of the learning experience rather than as a way of qualifying for the completion certificate. Even here, I would argue that assessment does not equal rigour. Imagine you are a tax expert. It’s getting close to the end of the year and you are running out of time to complete your CPD. You decide to enrol on the basic course on capital acquisitions tax. You don’t bother with any of the course itself because you know the subject inside out. You just complete the assessment and print off the certificate. An hour’s CPD completed in ten minutes flat.
These examples should, I hope, have put to bed the idea that assessment makes CPD more rigorous, but what about the second point about the certificate being worthless without the requirement to pass a test?
We define completion with reference to what we call an ASK analysis, which analyses the learning outcomes of a course. ASK is an acronym that stands Attitudes, Skills and Knowledge. The definition of completion depends on the balance between the three. We are careful not to be specific to avoid attempts to meet our criteria cynically, but the certificate is accessed only when the learner has met criteria that will generally include the amount of time spent in the course, the proportion of the screens they have visited and the extent of their engagement with the exercises that solicit their reflection and their contributions.
In case you still aren’t convinced by my arguments I have constructed a short multiple choice exercise to test whether you have been paying attention.
- What exams, happening at the moment, inspired the original BBC article
- SATS
- GCSE
- 11 plus
- Driving Test Theory
- Which of the following are implicitly assumed by the assertion that completion certificates must be accessed only if you pass an assessment (tick all that apply)
- Testing is always appropriate
- Professionals aren’t to be trusted
- The alternative is handing out certificates to anyone who turns up
- The earth is flat
- What does the acronym ASK stand for?
- Aristotle, Sartres and Kant
- Attitudes, Skills and Knowledge
- Aardvarks, Antelopes and Kangaroos
- Always Salute the Kaiser
- Which of the following most accurately describes your thoughts on this assessment as part of the blog
- A useful exercise that adds rigour to the experience
- Ha!
OK, so I have trivialised it to make a point, but I’m not sure what questions would have been better. A much better learning experience would be for us all to conclude this piece by spending some time thinking about it and sharing our thoughts.
And since this is a blog, why not add your comments below?