← Back to Stories

Story · Case study

Controls testing that stopped being a spreadsheet

Sample selection, testing evidence and the exceptions list lived in one workbook that one person understood.

The company

Company
Sanderson Group
Industry
Financial services

The starting point

Sanderson Group's controls testing lived in a forty-tab workbook: the sample selection, the testing evidence, the exceptions, and a set of formulas that decided which of a population of transactions got tested. It worked. It had worked for six years.

The finding that started this was not about the workbook's accuracy. It was that one person could open it, and that the head of internal audit could not describe, in a meeting, how a sample had been selected — she could only show that it had been.

What changed

What they described

The description was written by two people: the audit lead and a control owner. It set out what a control population is, how a sample is drawn from it and with what seed, what evidence a tested control has to carry, and what makes an exception an exception rather than a note.

The seed clause is the one worth repeating. A sample that cannot be redrawn identically is a sample that has to be defended by trust; the description says how the draw is reproduced, and the application implements that rather than a random selection nobody can repeat.

The results

What the audit lead says

That the point was never speed. Five weeks instead of nine is welcome and it is not why the change was approved. It was approved because the method is now written down somewhere other than in one person's head, and can be described in a meeting by anybody who runs it.

Example

Controls tested per cycle

146

Exceptions raised

9

each one owned before the cycle closes

Weeks per testing cycle

5 wks

from nine

People who can open the work

7

previously one

“The workbook was not the risk. The one person who could open it was the risk.”

— Amara Osei, Head of internal audit, Sanderson Group (an example business)

The apps

Connected to this story

Tell me when it's ready

We keep your email only to tell you once, when the app is ready, and delete it then.

What happens next

Thank you. We will write once, when it's ready.