In “traditional” conditions, where sanctions and consequences apply, there’s greater likelihood that students will provide proper peer review of others’ work. But crowdsourcing can’t be relied upon when self-interest is at play.
For example, Trip Advisor is a great idea for booking accommodation, but the holiday maker should always bear in mind that hotel owners can covertly rate their own and others’ properties according to vested interests.
The crowd is not always right; nor is it always impartial.
Moral hazards
All this sounds as if I am being unfairly critical of Coursera: on the contrary, I applaud Coursera for having the courage to try essay-style assessment in the cloud on such a scale. It’s a great challenge, even in traditional modes of higher education.
Let’s not forget that in our current (mostly on campus) educational institutions, assessment is hardly a watertight process. Even in invigilated exams, people cheat, collude, and so on. Not often, but it happens enough for it to be an issue that we can’t dismiss.
In assessments that are not invigilated (essays, reports, take home exams), the person gaining the credits is not always necessarily the sole author of the work. Even so, we currently give credentials in all fields knowing about these uncertainties and mostly we get it about right.
Assessing assessments
Whether on campus or in the cloud, assessment is the most high stakes part of the business of education. The challenge of assessment is to be able to make meaningful judgements about graduates’ current and future capacity to perform within their intended professions.
Authentic assessment is what we aim for: to set tasks which are as similar as possible to the sort of challenges the new graduate will be expected to meet. Perhaps the most authentic assessment we ever undergo is the job interview: a selection panel reads our claim of evidence of achievements, then we get an hour to make our case in the face of random questions.
Perhaps then at least some key assessments during any degree could, first, emulate a job interview and be an oral test which requires the candidate to think on their feet; second, be face to face, so the examiners can see who’s answering the question, and whether they are receiving help from others and third, be on a user pays basis.
Face-to-face in the cloud
How does this all relate to the MOOCs? Maybe in the world of free content, assessment is the part that you pay for (already an option at Udacity).
But maybe this assessment should also include face-to-face tests online? FaceTime, Skype and Jabber are all programs that could enable this and verifying your identity in that mode is not insurmountable.
If MOOCs can be done at scale, so can assessment — but it should be a separate process, on a user-pays basis and it should include face-to-face assessment where possible.
The (MOOC) genie is out of the bottle. The challenge now is to add new ways of doing better quality face-to-face authentic assessment in the cloud.
Beverley Oliver is pro vice-chancellor (Learning Futures) at Deakin University. This article first appeared at The Conversation.
