Lesson 3 of 9 · about 18 minutes
How AI Handles Budgets, Audits, Transcripts and Bills
You'll be able to
- Understand why an AI-found document should be checked against the agency's own copy
- Check an AI-extracted budget table by adding it up
- Spot the wrong-column trap in budget comparisons
- Explain why a motion log is easier to verify than an AI meeting summary
- Understand why a mechanical diff catches bill changes that AI summaries miss
AI is good at one research job above all others: finding the right page in a long document. It is mediocre at reading tables and poor at knowing which of two similar columns you meant. Once you know that split, a 248-page budget stops being a weekend and becomes an evening.
Finding primary sources
AI search engines are good at telling you what exists and who publishes it. They are bad at handing you the right copy. A prompt like this one asks for the map and nothing else:
What official documents would show how the invented Halden County
spends its road budget? For each, name the office that publishes
it and where on a county website it usually lives. Do not
summarize the contents.
A good answer is a list: the adopted budget (clerk or auditor), the annual financial audit (independent auditor, filed with the county), road department capital plans, commission minutes. The documents themselves live on the county's own website. A copy the AI links on a third-party file site may be a draft, an old year or somebody's edited version.
Worked example: the Halden County budget
Halden County is invented. Its proposed fiscal 2027 budget is a 248-page PDF posted on the clerk's page. Theo Branck, a retired bookkeeper who sits on a citizen budget committee, has one night before the budget hearing.
Step 1: Use AI as an index
The PDF is public, so uploading it to a cloud tool is fine. (Under 100 pages, Claude reads text and visuals; this one is longer, so the tool may read text only. Charts and scanned pages can be missed. Each tool's help page lists its limits.) Theo's first prompt asks for pages, not conclusions.
[budget PDF attached]
Give me the page numbers in this budget for: (1) the general fund
summary table by department, (2) any list of new positions,
(3) debt service, (4) transfers between funds. One line each with
page numbers. If you can't find one, say NOT FOUND.
It came back with pages 12, 37, 88 and 91. Page 88 was right. Page 91 was a glossary that mentioned transfers. The real transfer schedule was on page 203, which Theo found by searching the PDF for "transfer out." The index saved him time. It was not perfect.
Step 2: Pull the table, then foot it
Theo asked for the general fund summary from page 12 as CSV, with all three columns: 2025 actual, 2026 adopted, 2027 proposed. Then he pasted it into a spreadsheet and added the columns himself.
| Department | 2025 actual | 2026 adopted | 2027 proposed |
|---|---|---|---|
| Sheriff | $6,512,000 | $6,840,000 | $7,412,000 |
| Jail | $2,980,000 | $3,250,000 | $3,905,000 |
| Road and bridge | $4,290,000 | $4,120,000 | $4,035,000 |
| Parks | $575,000 | $610,000 | $702,000 |
| Commissioners and admin | $1,141,000 | $1,180,000 | $1,214,000 |
| Total (printed) | $15,498,000 | $16,000,000 | $17,268,000 |
Footing the 2027 column: 7,412,000 + 3,905,000 + 4,035,000 + 702,000 + 1,214,000 = 17,268,000. It matches. The 2026 column: 6,840,000 + 3,250,000 + 4,120,000 + 610,000 + 1,180,000 = 16,000,000. Matches. The 2025 column: 6,512,000 + 2,980,000 + 4,290,000 + 575,000 + 1,141,000 = 15,498,000. Matches.
On his first try the AI had given the parks 2027 figure as $720,000. The column added to $17,286,000, which didn't match the printed total, and that one mismatch sent Theo back to page 12, where it said $702,000. Two digits swapped. Footing caught it in under a minute.
Step 3: The wrong-column trap
Theo then asked the AI which department grew fastest. It said the jail, up 31 percent. That number felt high, so he did the math.
The arithmetic
Right comparison (2026 adopted to 2027 proposed): 3,905,000 minus 3,250,000 = 655,000. Then 655,000 divided by 3,250,000 = 0.2015, or 20.2 percent.
What the AI did (2025 actual to 2027 proposed): 3,905,000 minus 2,980,000 = 925,000. Then 925,000 divided by 2,980,000 = 0.3104, or 31.0 percent.
Both are real numbers. Only one answers "how much more than last year's budget." Comparing a proposal to an old actual mixes a plan with a result two years apart.
Here is the full year-over-year picture Theo built in his own spreadsheet.
| Department | Change, 2026 adopted to 2027 proposed | Percent |
|---|---|---|
| Jail | +$655,000 | +20.2% |
| Parks | +$92,000 | +15.1% |
| Sheriff | +$572,000 | +8.4% |
| Commissioners and admin | +$34,000 | +2.9% |
| Road and bridge | minus $85,000 | minus 2.1% |
| Total | +$1,268,000 | +7.9% |
Parks grew faster in percentage terms than the sheriff, but the sheriff's raise is six times bigger in dollars. Dollars tell the size of big items and percent gives context. The jail line is the big one either way: $655,000 is more than half of the county's total increase of $1,268,000 (655 divided by 1,268 is 0.517).
One more context check: a general fund grows from more than property tax, and Idaho Code 63-802 limits how fast most taxing districts can grow their property tax budgets (generally 3 percent a year, plus amounts for new construction and annexation, with other exceptions). A 7.9 percent spending increase does not mean a 7.9 percent tax increase. The revenue page and the clerk can say where the money comes from.
Step 4: Questions, not conclusions
Theo's last AI prompt: "Based only on pages 12, 37 and 88, what questions should a resident ask the sheriff about the jail increase?" He got eight. Three were good (Is the increase from staffing, medical contracts or housing inmates for other counties? How many new positions? Is any of it one-time?). He took those to the hearing.
Meeting transcripts
Auto-transcripts are full of errors in names and numbers, and AI summaries of them drift toward whatever got discussed most. A long debate about a rate hike can turn into "the council approved the rate hike" even when the motion failed. A log of motions holds up better than a summary because every line points to a timestamp.
[transcript pasted]
Make a table of every motion: timestamp, mover, seconder, exact
wording if stated, result and vote by name. Then list every dollar
figure spoken, with speaker and timestamp. Mark anything unclear
as UNCLEAR. Do not summarize the discussion.
Each line can then be confirmed at its timestamp in the recording. Ten motions take about ten minutes. Official minutes, once approved, are the record of the action; the recording is the record of who said what.
Comparing versions of a bill
Bills change between printings. A one-word edit ("shall" to "may") can gut a requirement, and AI summaries are exactly the kind of reader that skims past one word. A two-pass check catches it.
- Mechanical diff. Both versions come from the legislature's own site. Word's Review, then Compare, then Compare Documents marks every insertion and deletion. Free text-diff tools do the same.
- AI explanation. The marked-up changes (not the two whole bills) go to the AI with a request like: "For each change, explain in one plain sentence what it does. Quote the old and new wording. Flag any change to who must act, deadlines, penalties or money."
The diff is the ground truth. If the AI explains six changes and the diff shows seven, you know which one it missed.
Reporting angle
- Request the department budget requests, which often differ from what the budget officer proposes. The gap is a story.
- Ask for the prior three years of actuals for any line that jumps more than 15 percent.
- Get the audit's management letter, which sometimes holds findings that never make the main report.
- Check that a meeting where the budget changed was properly noticed; the Idaho Open-Meetings Compliance Tracker checks a meeting's details against Idaho Code Title 74, Chapter 2.
Research angle
- Idaho Code 63-802: the limit on budget requests, text from the Legislature.
- Idaho Code 74-103: response deadlines for public records requests.
- Microsoft Support: Compare two versions of a document: a way to compare bill or document versions.
- Claude Help: Uploading files: file types and size limits.
- Idaho FOIA / Public Records Letter Generator: drafts a request under Idaho Code Title 74, Chapter 1.
Check yourself
1. An AI search engine links to a PDF of the county audit hosted on a document-sharing site. Which copy can you rely on?
The AI's link is a clue to what exists. The copy to rely on comes from the agency that issued it, so you know it is the real, current version.
2. In the Halden County example, the jail line rose from $3,250,000 (2026 adopted) to $3,905,000 (2027 proposed). What is the percent change?
$3,905,000 minus $3,250,000 is $655,000. Divide by the starting $3,250,000 and you get 0.2015, about 20.2 percent. 31.0 percent is what you get by wrongly using the 2025 actual column.
3. What is 'footing' a table you extracted with AI?
If the extracted lines don't add up to the printed total, a number was misread, skipped or duplicated. It is the fastest check there is.
4. Why run a deterministic comparison (such as Word's Compare Documents) before asking AI what changed between two bill versions?
A diff tool is mechanical and complete. AI is good at explaining what a change means but can skip a one-word edit such as 'shall' to 'may'. The diff is the ground truth and AI is the explainer.
5. An AI meeting summary says the council 'approved the rate hike.' The transcript shows the motion failed 2 to 3. What caused this kind of error most likely?
Summaries drift toward what was talked about most. A motion log with vote counts and timestamps can be checked against the recording; a summary of the mood cannot.
6. What is the best use of AI with a 248-page budget?
AI is a fast index. It finds the pages; you read them. Judgment and the final numbers stay with you.
Terms in this lesson
- Primary source
- The original record: the budget itself, the audit, the bill text, the recording. Not an article or post about it.
- Adopted vs. proposed vs. actual
- Budget columns: proposed is the draft request, adopted is what the board approved, actual is what was really spent once the year closed.
- Footing
- Adding up a column yourself to check it matches the printed total.
- Diff
- A mechanical comparison of two texts that marks every insertion and deletion.
- Engrossed bill
- A bill reprinted with adopted amendments folded into the text.
Sources
- Microsoft Support: Compare and merge two versions of a document checked 2026-10
- Idaho Code 63-802: Limitation on budget requests checked 2026-10
- Anthropic: Prompting best practices (long context tips) checked 2026-10
- Claude Help Center: Uploading files to Claude checked 2026-10