🏛️ Issues and Advocacy Training
Courses › Using AI for Research and Writing

Lesson 3 of 9 · about 18 minutes

How AI Handles Budgets, Audits, Transcripts and Bills

You'll be able to

  • Understand why an AI-found document should be checked against the agency's own copy
  • Check an AI-extracted budget table by adding it up
  • Spot the wrong-column trap in budget comparisons
  • Explain why a motion log is easier to verify than an AI meeting summary
  • Understand why a mechanical diff catches bill changes that AI summaries miss

AI is good at one research job above all others: finding the right page in a long document. It is mediocre at reading tables and poor at knowing which of two similar columns you meant. Once you know that split, a 248-page budget stops being a weekend and becomes an evening.

Finding primary sources

AI search engines are good at telling you what exists and who publishes it. They are bad at handing you the right copy. A prompt like this one asks for the map and nothing else:

What official documents would show how the invented Halden County
spends its road budget? For each, name the office that publishes
it and where on a county website it usually lives. Do not
summarize the contents.

A good answer is a list: the adopted budget (clerk or auditor), the annual financial audit (independent auditor, filed with the county), road department capital plans, commission minutes. The documents themselves live on the county's own website. A copy the AI links on a third-party file site may be a draft, an old year or somebody's edited version.

The agency's copy is the record, never the AI's link to it. Note the date you downloaded it and keep the file. Agency websites change and documents vanish.

Worked example: the Halden County budget

Halden County is invented. Its proposed fiscal 2027 budget is a 248-page PDF posted on the clerk's page. Theo Branck, a retired bookkeeper who sits on a citizen budget committee, has one night before the budget hearing.

Step 1: Use AI as an index

The PDF is public, so uploading it to a cloud tool is fine. (Under 100 pages, Claude reads text and visuals; this one is longer, so the tool may read text only. Charts and scanned pages can be missed. Each tool's help page lists its limits.) Theo's first prompt asks for pages, not conclusions.

[budget PDF attached]

Give me the page numbers in this budget for: (1) the general fund
summary table by department, (2) any list of new positions,
(3) debt service, (4) transfers between funds. One line each with
page numbers. If you can't find one, say NOT FOUND.

It came back with pages 12, 37, 88 and 91. Page 88 was right. Page 91 was a glossary that mentioned transfers. The real transfer schedule was on page 203, which Theo found by searching the PDF for "transfer out." The index saved him time. It was not perfect.

Step 2: Pull the table, then foot it

Theo asked for the general fund summary from page 12 as CSV, with all three columns: 2025 actual, 2026 adopted, 2027 proposed. Then he pasted it into a spreadsheet and added the columns himself.

Department2025 actual2026 adopted2027 proposed
Sheriff$6,512,000$6,840,000$7,412,000
Jail$2,980,000$3,250,000$3,905,000
Road and bridge$4,290,000$4,120,000$4,035,000
Parks$575,000$610,000$702,000
Commissioners and admin$1,141,000$1,180,000$1,214,000
Total (printed)$15,498,000$16,000,000$17,268,000

Footing the 2027 column: 7,412,000 + 3,905,000 + 4,035,000 + 702,000 + 1,214,000 = 17,268,000. It matches. The 2026 column: 6,840,000 + 3,250,000 + 4,120,000 + 610,000 + 1,180,000 = 16,000,000. Matches. The 2025 column: 6,512,000 + 2,980,000 + 4,290,000 + 575,000 + 1,141,000 = 15,498,000. Matches.

On his first try the AI had given the parks 2027 figure as $720,000. The column added to $17,286,000, which didn't match the printed total, and that one mismatch sent Theo back to page 12, where it said $702,000. Two digits swapped. Footing caught it in under a minute.

Step 3: The wrong-column trap

Theo then asked the AI which department grew fastest. It said the jail, up 31 percent. That number felt high, so he did the math.

The arithmetic

Right comparison (2026 adopted to 2027 proposed): 3,905,000 minus 3,250,000 = 655,000. Then 655,000 divided by 3,250,000 = 0.2015, or 20.2 percent.

What the AI did (2025 actual to 2027 proposed): 3,905,000 minus 2,980,000 = 925,000. Then 925,000 divided by 2,980,000 = 0.3104, or 31.0 percent.

Both are real numbers. Only one answers "how much more than last year's budget." Comparing a proposal to an old actual mixes a plan with a result two years apart.

Here is the full year-over-year picture Theo built in his own spreadsheet.

DepartmentChange, 2026 adopted to 2027 proposedPercent
Jail+$655,000+20.2%
Parks+$92,000+15.1%
Sheriff+$572,000+8.4%
Commissioners and admin+$34,000+2.9%
Road and bridgeminus $85,000minus 2.1%
Total+$1,268,000+7.9%

Parks grew faster in percentage terms than the sheriff, but the sheriff's raise is six times bigger in dollars. Dollars tell the size of big items and percent gives context. The jail line is the big one either way: $655,000 is more than half of the county's total increase of $1,268,000 (655 divided by 1,268 is 0.517).

One more context check: a general fund grows from more than property tax, and Idaho Code 63-802 limits how fast most taxing districts can grow their property tax budgets (generally 3 percent a year, plus amounts for new construction and annexation, with other exceptions). A 7.9 percent spending increase does not mean a 7.9 percent tax increase. The revenue page and the clerk can say where the money comes from.

Step 4: Questions, not conclusions

Theo's last AI prompt: "Based only on pages 12, 37 and 88, what questions should a resident ask the sheriff about the jail increase?" He got eight. Three were good (Is the increase from staffing, medical contracts or housing inmates for other counties? How many new positions? Is any of it one-time?). He took those to the hearing.

Meeting transcripts

Auto-transcripts are full of errors in names and numbers, and AI summaries of them drift toward whatever got discussed most. A long debate about a rate hike can turn into "the council approved the rate hike" even when the motion failed. A log of motions holds up better than a summary because every line points to a timestamp.

[transcript pasted]

Make a table of every motion: timestamp, mover, seconder, exact
wording if stated, result and vote by name. Then list every dollar
figure spoken, with speaker and timestamp. Mark anything unclear
as UNCLEAR. Do not summarize the discussion.

Each line can then be confirmed at its timestamp in the recording. Ten motions take about ten minutes. Official minutes, once approved, are the record of the action; the recording is the record of who said what.

Comparing versions of a bill

Bills change between printings. A one-word edit ("shall" to "may") can gut a requirement, and AI summaries are exactly the kind of reader that skims past one word. A two-pass check catches it.

  1. Mechanical diff. Both versions come from the legislature's own site. Word's Review, then Compare, then Compare Documents marks every insertion and deletion. Free text-diff tools do the same.
  2. AI explanation. The marked-up changes (not the two whole bills) go to the AI with a request like: "For each change, explain in one plain sentence what it does. Quote the old and new wording. Flag any change to who must act, deadlines, penalties or money."

The diff is the ground truth. If the AI explains six changes and the diff shows seven, you know which one it missed.

Reporting angle

  • Request the department budget requests, which often differ from what the budget officer proposes. The gap is a story.
  • Ask for the prior three years of actuals for any line that jumps more than 15 percent.
  • Get the audit's management letter, which sometimes holds findings that never make the main report.
  • Check that a meeting where the budget changed was properly noticed; the Idaho Open-Meetings Compliance Tracker checks a meeting's details against Idaho Code Title 74, Chapter 2.

Research angle

Check yourself

1. An AI search engine links to a PDF of the county audit hosted on a document-sharing site. Which copy can you rely on?

2. In the Halden County example, the jail line rose from $3,250,000 (2026 adopted) to $3,905,000 (2027 proposed). What is the percent change?

3. What is 'footing' a table you extracted with AI?

4. Why run a deterministic comparison (such as Word's Compare Documents) before asking AI what changed between two bill versions?

5. An AI meeting summary says the council 'approved the rate hike.' The transcript shows the motion failed 2 to 3. What caused this kind of error most likely?

6. What is the best use of AI with a 248-page budget?

Terms in this lesson

Primary source
The original record: the budget itself, the audit, the bill text, the recording. Not an article or post about it.
Adopted vs. proposed vs. actual
Budget columns: proposed is the draft request, adopted is what the board approved, actual is what was really spent once the year closed.
Footing
Adding up a column yourself to check it matches the printed total.
Diff
A mechanical comparison of two texts that marks every insertion and deletion.
Engrossed bill
A bill reprinted with adopted amendments folded into the text.

Full glossary

Sources