Court Tells Cops That The 4th Amendment Doesn’t Cover AI-Generated ‘Probable Cause’

Legal Issues
from the remember-that-time-robocop-shot-the-Constitution-in-the-dick dept
I don’t know where this decision will take us, but its implications reach much further than the single case it covers. AI is pretty much everywhere, and if a court says an algorithm can’t make probable cause determinations, it affects/infects everything from facial recognition tech to predictive policing software to Axon adding AI shovelware to its omnipresent body cameras under the (correct) assumption cops don’t like writing reports.
In this case, Alain Osorio was arrested for allegedly passing a bad check at local bank. The only pictures of the suspect came from the bank’s CCTV footage. This was handed over to Detective Ryan Kilmer of the Florence (KY) Police Department.
The detective decided to run a screenshot of the suspect’s face (derived from the CCTV footage) through the PD’s facial recognition program. The decision [PDF] doesn’t specify which facial recognition program was used, but given that the match was made using photos found on Facebook, it suggests Clearview AI might have been involved, given its scraping of hundreds of billions of images from the open web since its inception.
Not that it did anything useful in terms of actual detective work. Nor did it do anything remotely constitutional, not when the operative word in “probable cause” is “probable.”
Relying solely on the AI identification, Detective Kilmer concluded that the match was accurate. [Id. at 4–5]. The Facebook profile belonged to an individual known as “Yony Smith Npoles Charon,” and for an unknown reason, Detective Kilmer concluded that “Yony” was actually Alain Vizcay Osorio—the man in the booking photo.
The court says “for an unknown reason.” I can make an educated guess, however. Passing a bad check is the sort of crime most cops won’t really dig into. Detective Kilmer was handed the case and did the bare minimum: he ran an AI-assisted search. He didn’t actually do anything that resembled actual detective work. But he still felt his 30 seconds of non-existent effort were enough to support a criminal complaint and the issuance of an arrest warrant.
Osorio — who lived in Nebraska — was arrested and extradited to Kentucky to face criminal charges. He was released on bond the day after his arrest (January 24, 2025). He was then indicted by a grand jury in March 2025 and arraigned roughly two months later. Again, Osorio pleaded not guilty. At that point, the state’s attorney’s office dismissed the charges after Osorio provided proof he had been working in Nebraska at the time the bad check was being passed by (the presumably still at-large) suspect captured by the bank’s security camera.
The only thing the AI used by the detective seemed to be capable of doing was reinforcing the investigator’s “all Black people look the same” prejudices. (To be clear, I don’t specifically know if this detective has these prejudices, but the chain of events in this case certainly support an assumption of this person’s assumptions, if you catch my drift.)
The individuals in the security footage and the Facebook profile image do not resemble the booking photo of Osorio. [Id. at 6–7]. Based on the booking photo, the only thing Osorio has in common with the suspect is that he is a black male with facial hair. [Dkt. 3-1 at 2–3]. Based on the photographs, it appears that Osorio has a different head shape, different haircut, different facial features, and different complexion.
Detective Kilmer told the court (via his affidavit) that he had used “investigative tools” to “match” Osario to the suspect. In reality, the court says, Kilmer only used a single tool and rolled with its obviously faulty conclusions despite Florence PD policy specifically stating facial recognition AI alone is not enough to “establish probable cause.”
Kilmer runs directly into this policy and the Fourth Amendment itself, which poses multiple problems for his desire to walk away fiscally intact from this lawsuit. The policy is undeniable, which means Kilmer deliberately ignored his “training” and any “expertise” it was supposed to impart.
But beyond that, there’s the Fourth Amendment itself, which can’t as easily be ignored as cop shop software clickwrap. That much is made perfectly clear in the court’s introductory paragraph:
The Fourth Amendment to the United States Constitution does not allow a detective to delegate to AI the task of assessing probable cause. In other words, the Fourth Amendment does not permit an individual to be arrested based on nothing more than an uncorroborated conclusion by AI that the individual in question has committed a crime. And no reasonable detective in the Defendant’s position could conclude otherwise.
The first part of that suggests implications far beyond this case, given how often “detectives” are letting their fingers do the walking (so to speak) and pretending whatever the computer coughs up is arrest-worthy. That’s not just the facial recognition tech used in this case. This is also the AI that steers patrols and public interactions via so-called “predictive policing.” That’s also the AI that writes reports for police officers, allowing the computer to create the permanent, official record of stops, arrests, and uses of force.
But what’s also important is the last sentence of that paragraph. That’s the thing that’s going to make this stick. The detective isn’t shielded by qualified immunity, which means this is sure to be appealed. But if this officer does this (rather than “allow” the people who he’s supposed to be serving to buy him out of a lawsuit via a settlement), he’s going to make this an appellate case. And there’s definitely no reason to assume the higher court is just going to blow off the obvious concerns raised by this lawsuit and allow QI to cover up this compendium of wrongs.
For now, the decision stands as it is: AI isn’t probable cause. Never has been. Never should be. And if this court has anything to say about it, it never will be. Detectives who prefer to let computers do their thinking for them might want to dial back their reliance on algorithms. Justice should never be subject to available processing power. And if you lack the desire (or intelligence!) to do detective work properly, well…

Filed Under: 4th amendment, ai, facial recognition, facial recognition tech, false positives, florence pd, kentucky, mass surveillance, probable cause