The ISO 42001 Course That Refused To Pass
A technical post-mortem about false confidence, audit blind spots, and the difference between detection and reality. There is some AI in here, but this is not an AI story. It's an observability story wearing a compliance hat.
The bug report that wasn't a bug
It started the way these things always start: with a result that didn't fit the story we were telling ourselves.
We run a platform that generates structured compliance-training programmes — courses, assessments, the whole apparatus an awarding body needs to stand behind a credential. One of those programmes was an ISO 42001 Lead Auditor course (ISO 42001 is the management-system standard for AI). It kept failing our internal quality checks on a criterion we call standard-family consistency: roughly, "does this material talk about the standard it claims to teach, and not quietly drift into a different one?"
