Journal

/

Guides

Setting confidence thresholds your auditors will accept

How to choose when an agent acts on its own and when it asks a person, and how to document the choice.

Wei Zhang

Head of Machine Learning

Published

Reading time

6 min read

Category

Guides

In short

How to choose when an agent acts on its own and when it asks a person, and how to document the choice.

Every Kestrel agent decides with a confidence score. The threshold you set decides what it does alone and what it hands to a person.

Start high

Begin at 98% for postings and 95% for matches. In shadow mode, look at what falls just under the line and lower it only when those cases are consistently right.

Set different limits by risk

A threshold can depend on the amount, the vendor’s history or the account. Large or unusual entries can always require a reviewer, whatever the score.

Write it down

Auditors don’t need to understand the model. They need a written policy, evidence that it was followed and a log of every exception. Kestrel exports all three.

Written by

Wei Zhang

Head of Machine Learning

All articles →

Kestrel for finance teams

See Kestrel run on your own invoices

A 30-minute walkthrough on a copy of your data. No setup, no commitment.

Get started

Give your team its month back

See Kestrel run on a copy of your own invoices in a 30-minute walkthrough.

Get started

Give your team its month back

See Kestrel run on a copy of your own invoices in a 30-minute walkthrough.

Get started

Give your team its month back

See Kestrel run on a copy of your own invoices in a 30-minute walkthrough.

AI agents for the finance back office.

© 2026 Kestrel Finance, Inc.

Made for teams who’d rather be forecasting.

AI agents for the finance back office.

© 2026 Kestrel Finance, Inc.

Made for teams who’d rather be forecasting.

AI agents for the finance back office.

© 2026 Kestrel Finance, Inc.

Made for teams who’d rather be forecasting.

Create a free website with Framer, the website builder loved by startups, designers and agencies.