Your Junk Food Is a Weapon Now

An AI camera mistook a Doritos bag for a handgun, and police put a teenager on his knees. This isn't a glitch in the system. This is the system.
On an October evening in Baltimore County, a 17-year-old was sitting outside his school after football practice. An AI surveillance camera decided the Doritos bag in his pocket was a Glock. Moments later, police cars swarmed, guns were drawn, and Taki Allen was on his knees in handcuffs. They found the chips. They did not find a weapon. This is not a story about a one-off technical glitch. It is a story about what happens when law enforcement treats a statistical probability generated by a cheap sensor as ground truth, and the human in the loop defaults to believing the machine.
These systems are not thinking. They are pattern-matching at scale. The object detection model that targeted Allen was likely a convolutional neural network trained on millions of images of actual firearms. To that algorithm, the crumpled foil of a chip bag under evening light presented enough overlapping pixel patterns with its training data for 'handgun' to cross a confidence threshold. The system sends an alert, not a nuanced report with error bars. For predictive policing platforms like Geolitica, the process is similar but with demographic data. The software ingests years of historical arrest records—data sets already saturated with human bias—and spits out heat maps showing where crime is 'likely' to occur. An officer doesn't see the skewed inputs; they see a red square on a map telling them where to patrol, creating a feedback loop that all but guarantees the cycle of over-policing repeats itself.
The market for policing AI is opaque but booming. Municipalities funnel taxpayer dollars to a growing roster of vendors like SoundThinking and Clearview AI, who sell the promise of objective, data-driven security. The unit economics work because the costs of failure are externalized. A wrongful arrest doesn't show up on the vendor's balance sheet; it shows up as a traumatic event for Taki Allen or five months in jail for Angela Lipps, a grandmother misidentified by facial recognition in a state she'd never visited. Police departments buy these tools to signal they're modernizing, and city councils sign the checks to appear tough on crime. The people who live in algorithmically-flagged 'hot spots' are not the customers. They are the data points.
The trend for the next five years is more integration, not less. As the cost of compute and sensors continues to fall, automated surveillance will become a default feature of municipal infrastructure, not a specialized deployment. Vendors will claim improved accuracy, but the fundamental problem will persist: a machine's guess is being deputized to initiate police force. The legal system moves too slowly to litigate the nuances of a neural network's confidence score, and departments have little incentive to question a tool that provides justification for action. The real test is not whether the tech gets better at spotting threats. It is whether we decide a system with a 1% error rate is acceptable when that one percent means an innocent person is staring down the barrel of a gun.
Premium tech-audience inventory.
More in Legal

California Wants to Stop Publishers From Killing the Games You Buy
You bought the game. The publisher turned off the servers. A proposed California law says they now either have to patch it to work forever, or give you your money back.

France's Zombie Copyright Law Cost €82 Million and Caught Nobody
France spent €82 million on a copyright system that collected €87,000 in fines. The automated system failed, but the mass surveillance powers it created are very much alive.