Showing posts with label paperless assessment. Show all posts
Showing posts with label paperless assessment. Show all posts

Thursday, November 12, 2009

21st Century Assessment

I read an article on Internet use in exams on the BBC news site with interest. It begins:
"In Denmark, the government has taken the bold step of allowing pupils full access to the internet during their final school year exams."
Now that's eAssessment! For some time pupils in Denmark have been able to choose whether to handwrite answers or type them on a computer. I suppose it could be argued that this is just a logical extension. The article says that on the morning of the exam, the students are helped to set up "their laptops". It is not clear whether they are the student's own laptops or if it just means the laptops they will use. The opportunity to use your own machine, with the software etc. set up just the way you like it would be an interesting.

Clearly, allowing Internet access changes the nature of what you assess. For example, the article notes, "The teachers also think the nature of the questions make it harder to cheat in exams. Students are no longer required to regurgitate facts and figures. Instead the emphasis is on their ability to sift through and analyse information ."

There is a Have Your Say page linked to this article and the responses are fairly polarised. I find the number of people posting comments such as, "An even better way to ensure success would be to give them the examination answers already, that way nobody has to fail and feel upset." slightly depressing. Is that really what people think is happening or is it trolls at work? In the response page there is a clear school of thought that believes memorising and recalling facts is the only thing that assessment can do and that any deviation from that undermines and devalues examinations. And why is there an assumption that changing what is assessed and how it is assessed is about dumbing down? Analysis and synthesis are much higher order skills than factual recall.

What are your thoughts? Good thing? Bad thing? What kind of change would that bring to the kinds of exams we set and the way we teach if a system like that was introduced here?

Friday, March 27, 2009

CAL 2009: Paperless Assessment

Captured live at #cal09, posted late.

Using tablet technologies in marking paperless assessment
Hilary A. Cunningham-Atkins, Wendy A. Fisher The Open University


Practised what she preached - first thing she did was pass round a tablet for people to sign in and give their email. :-)

Biggest part of lecturers' job is marking! Researcher's university moved to paperless assessment in 1999. Meant that lecturers were constrained in where they could mark - had to be at desktop PC. Previously they could mark papers with pen anywhere. Also, how do you annotate a diagram. Example was given of an essay with tutor annotation compared with pro-forma feedback on electronic assessment. By going paperless, there was an impact on the quality and quantity of feedback. Filling in a pro-forma removes the location of the comments from the assignment being commented.

Researcher wanted to see if tablet allowed paperless assessment but with at least some of the advantages of hand-written annotation. Used software that comes with the tablet to annotate document (.doc, .html, .pdf, ...). Tutors can write in document' existing white space, can highlight sections and (if necessary) can create extra whitespace. Annotations and document saved together as a pdf. Used in conjunction with pro-forma but gives richer feedback to students.

The technology now costs around £600. They tried using a £20 graphic tablet but, although you can do most of the same things it is significantly harder!

Students liked the personalised feel of the feedback. They felt the handwritten notes were much more personal. Tutors gave significantly better feedback - perhaps even better than written feedback.

Use of technology by lecturers is individual and dependent on their pedagogical views as much as their technological skills.

Extension project is looking at recording audio or video annotations and embedding in the document.. {Record facility in Word? - DM}