Ensuring humans retain oversight of marking done by artificial intelligence is “more complex than one might initially think” and may not save academics any time in the long run, according to the initial results of a major UK trial.
Select universities and colleges in the UK have been experimenting with ways to introduce AI into their assessment processes with support of sector body Jisc.
Findings published on 21 May identified a “tension” between the AI marking tools and maintaining academic oversight.
While the trial did not enforce many restrictions on universities’ participation, they were required to ensure that “wherever AI was used to mark and give feedback on students’ work, a human should retain oversight of the process”.
But the trial found that “keeping the human in the loop is more complex than one might initially think” and may not deliver time savings to the marking process.
