🏛️ Issues and Advocacy Training
Courses › Surveillance Technology and Privacy

Lesson 4 of 9 · about 16 minutes

Facial Recognition: Accuracy, Arrests and Rules

You'll be able to

  • Explain the difference between one-to-one verification and one-to-many searches
  • Read a false match rate and estimate false matches against a large photo gallery
  • Describe what NIST's 2019 demographic study found and why the algorithm matters
  • Summarize state limits on police face recognition and the Detroit settlement rules

Face recognition software does one thing: it turns a face into a list of numbers and compares that list with other lists. Everything else, from opening a phone to naming a robbery suspect, depends on what it is compared against and what people do with the answer.

How a match happens

The software finds a face in an image, lines it up, and runs it through a trained model that outputs a template, a long string of numbers describing the face's features. Two templates get a similarity score. If the score passes a threshold, the system calls it a match.

The uses split sharply.

One-to-one verification asks "is this the same person?" Your phone compares your face to the one template you enrolled. Passport gates do the same with your passport photo. The odds of a mistake are low because there is only one comparison and the photos are usually good.

One-to-many identification asks "who is this?" A detective uploads a probe image, maybe a grainy still from a gas station camera, and the system compares it with every face in a gallery: a state's mugshots, sometimes driver's license photos. It returns a candidate list, ranked by score. A human analyst picks from that list. This is the kind of use behind every wrongful arrest on record.

One-to-oneOne-to-many
QuestionIs this the person they claim to be?Who in this gallery looks most like this face?
Comparisons1Thousands to millions
Typical image qualityGood, cooperative subjectOften poor: angle, blur, low light
OutputYes or noRanked candidate list
Main riskRejecting the right personPointing at the wrong person

What NIST found

The National Institute of Standards and Technology runs the main independent tests of face recognition, now called the Face Recognition Technology Evaluation (FRTE). In December 2019 it published NISTIR 8280, a study of demographic effects. NIST tested 189 algorithms from 99 developers on about 18.27 million images of 8.49 million people, all drawn from State Department, Homeland Security and FBI databases.

The findings, in short:

  • In one-to-one tests, many algorithms produced more false positives for Asian and African American faces than for white faces, sometimes 10 to 100 times more, depending on the algorithm.
  • Among U.S.-developed algorithms, false positive rates were high for Asian, African American and Native American faces, with American Indian faces highest.
  • Some algorithms developed in Asia did not show the large gap between Asian and white faces.
  • In one-to-many tests against 1.6 million FBI mugshots, some algorithms produced more false positives for African American women.
  • The most equitable algorithms were also among the most accurate.

That last point gets dropped a lot, by both sides. A police department can truthfully say "our vendor's algorithm ranks near the top in NIST testing." An advocate can truthfully say "NIST found large demographic gaps." Both claims can stand at once because algorithms differ enormously. So the question to ask is which algorithm, which version, and how it ranked. NIST keeps updating its demographic tables; the most recent update on its page is from March 2025.

The arithmetic of a big gallery

Worked example: why a match is only a lead

NIST's demographic tables measure false positives at a threshold set to produce a false match rate (FMR) of 0.00003 overall, or 3 in 100,000 comparisons. That sounds tiny. Now apply it, crudely, to a one-to-many search.

  • Gallery size: 2,000,000 mugshots in an invented state database.
  • Expected false matches if the real person is not in the gallery: 2,000,000 x 0.00003 = 60.
  • If a group's false match rate is 10 times higher, as NIST found for some groups with some algorithms: 2,000,000 x 0.0003 = 600.

Real one-to-many systems use different metrics and return a short ranked list instead of every face above a threshold, so treat these numbers as a teaching model, not a measurement. The lesson holds: when the gallery is huge and the probe photo is poor, someone innocent will look similar. A candidate is a person to investigate, never a person to arrest.

Wrongful arrests on record

The first publicly known case was Robert Williams. In January 2020, Detroit police arrested him at his home in front of his wife and two young children, accused of stealing watches from a store. A face recognition search had matched a blurry surveillance image to an older photo of him. He was not the man in the video. With the ACLU, he sued. The settlement, announced June 28, 2024, set rules the ACLU called the strongest in the country:

  • Police may not arrest someone based solely on a face recognition result, or on a photo lineup that directly follows a face recognition search.
  • A lineup based on a face recognition lead needs independent, reliable evidence linking the person to the crime.
  • Officers get training on the technology's risks, including higher misidentification rates for people of color.
  • An audit reviews every case since 2017 in which face recognition was used to get an arrest warrant.

The ACLU said Detroit police had relied on face recognition in at least three wrongful arrests, all of Black people. Nationally, Stateline counted at least seven people falsely arrested after face recognition matches as of early 2025. The count is a floor; defendants often are not told face recognition was used.

In each known case, the software was not the only failure. Detectives treated a candidate as a suspect and skipped the ordinary work: checking alibis, comparing height, looking at phone records. That is why the better rules focus on what must happen after the match.

Bans and rules

Several cities, beginning with San Francisco in 2019, voted to bar city departments from using face recognition at all. States have mostly chosen limits instead of bans. By the end of 2024, 15 states had some law on police face recognition, according to Stateline and the Center for Democracy and Technology: Washington, Oregon, Montana, Utah, Colorado, Minnesota, Illinois, Alabama, Virginia, Maryland, New Jersey, Massachusetts, New Hampshire, Vermont and Maine.

Type of ruleExample statesWhat it does
Warrant requirementMontana (2023), Utah (2024)A judge must approve the search, with exceptions such as emergencies
Serious crime limitMaryland (2024), VermontUse allowed only for listed serious offenses
Notice to defendantsMaryland, New Jersey, MontanaProsecutors must tell defendants face recognition was used
Not sole basis for arrestWashingtonA match alone cannot justify an arrest
Body camera banNew Hampshire, OregonNo face recognition on body camera footage

Idaho was not on the 15-state list. As of October 2026, this course found no Idaho statute specific to police face recognition; check the legislature's site for later bills.

Supporters of police use make a real case. Face recognition has helped identify suspects in violent crimes, child exploitation victims, and people who cannot identify themselves. The Policing Project, a group that pushes for rules on police technology, has said some of these tools can provide benefits for solving crime and protecting victims. The fight in most legislatures is over safeguards, not over whether the tool works at all.

Common mix-ups

  • Claim: Face recognition is 99 percent accurate, so errors are not a concern. What the evidence shows: Top algorithms are very accurate on good photos. Accuracy falls with poor probe images, and small error rates multiply across large galleries.
  • Claim: Face recognition is biased, period. What the evidence shows: NIST found demographic gaps in most algorithms, and that the best algorithms had the smallest gaps. Which product matters.
  • Claim: Plate cameras secretly run face recognition. What the evidence shows: Most ALPR products do not, and Flock says its system cannot identify individuals. Ask the vendor and read the contract's feature list.

Reporting angle

Ask whether your agency uses face recognition directly or through a state fusion center or another agency. Request the policy, the vendor and algorithm name, the number of searches last year, how many produced a lead, and how many led to arrests. Ask whether prosecutors disclose face recognition use to defendants. If an agency says it does not use the technology, ask whether its officers can request searches from another agency that does.

Check yourself

1. Opening your phone with your face is an example of which kind of matching?

2. NIST's December 2019 study (NISTIR 8280) tested how many algorithms?

3. What did NIST find about demographic differences?

4. A system has a false match rate of 0.00003 per comparison. A probe photo of someone not in the database is compared to 2 million mugshots. About how many false matches above the threshold would you expect, using simple arithmetic?

5. Under the June 2024 Williams v. City of Detroit settlement, what can Detroit police no longer do?

6. Which pair of states require a warrant for police face recognition searches, per Stateline's 2025 review?

Terms in this lesson

One-to-one verification
Comparing a face to a single stored image to confirm identity, as when a phone opens for its owner's face.
One-to-many identification
Comparing a probe face against a gallery of many images to find possible matches.
Probe image
The photo being searched, often a still from surveillance video.
False match rate (FMR)
How often the system says two different people are the same person at a given threshold.
Candidate list
The ranked set of possible matches a one-to-many search returns for human review.
Threshold
The similarity score a comparison must exceed to count as a match. Lower thresholds catch more true matches and more false ones.

Full glossary

Sources