Blog / Compliance
Evidence-Based Audits Versus Checklist Audits: Why 'Yes' Isn't an Answer an Auditor Should Accept
A checklist audit asks 'do you have a password policy' and accepts 'yes' as a complete answer. An evidence-based audit asks the same question and then asks to see the policy document, the system configuration that enforces it, and a log showing it was actually applied to a real account in the last quarter. The difference between these two audit styles isn't rigor for rigor's sake — it's the difference between measuring what an organization says it does and measuring what an organization can prove it does, and the gap between those two things is where most control failures actually live.
Why checklist audits keep passing organizations that then get breached
A checklist rewards documentation of intent, not verification of practice. An organization can have a beautifully written incident response plan that has never been tested, an access review policy that hasn't actually been run in eight months, and a vendor management process that exists as a document nobody follows — and pass a checklist audit on all three, because the checklist only asked whether the artifact exists. Evidence-based review closes this gap by requiring the artifact plus proof it was executed: a signed-off access review with a date and a reviewer, not just a policy stating access reviews happen quarterly.
What good evidence actually looks like, per control
- For access control: a dated access review record naming who reviewed which accounts and what changed, not a policy stating reviews occur
- For patching: a report showing actual patch compliance percentage and remediation timeline for a real period, not a patch management policy document
- For backup and recovery: a completed restore test with a timestamp and outcome, not a backup schedule configuration screenshot
- For incident response: evidence of a tabletop exercise or an actual incident walked through the documented process, not the process document alone
Why the three-state model beats binary yes/no
A control is rarely simply on or off. A backup control might be fully implemented for production databases but not yet extended to a newly acquired subsidiary's file shares — calling that either 'yes we do backups' or 'no we don't' loses the information an auditor, an insurer, or a board actually needs to assess real risk. A model that allows implemented, partial, and planned as honest states, each with its own attached evidence, produces a posture picture that's actually usable for decision-making instead of one optimized to look complete on a form.
An auditor who accepts 'yes' without asking for evidence isn't conducting an audit. They're transcribing what they were told.
This is the exact model Nexus's compliance module is built around — implemented, partial, or planned per control, with evidence attached directly to the control rather than living in a separate binder nobody opens during the actual audit. It's worth restating plainly what that model is and isn't: it's posture tracking that makes an organization's real state visible and evidence-backed. It is not, and doesn't claim to be, the audit itself or a certification — that determination still belongs to the auditor or assessor reviewing the evidence, not the tool that organized it.