High School Student Detained by Police After AI Mistakens Bag of Chips for Gun, Video Shows.
A 16-year-old student was taken into custody by law enforcement in Maryland after an artificial intelligence (AI) gun detection system mistakenly identified a bag of chips as a firearm, prompting a swarm of police cars to surround him.
According to footage from the Baltimore Police Department, responding officers quickly realized that the AI's alert had been triggered by the snack, which was later confirmed not to be a real threat. However, before this correction, they had already handcuffed and detained Taki Allen, who was simply waiting for his ride home after school.
The incident has raised questions about the reliability of AI-powered security systems, particularly in environments where human judgment may be clouded by fatigue or distractions.
When asked to explain the malfunction, a police spokesperson noted that "AI's not the best" at distinguishing between legitimate threats and everyday objects. They attributed the error to a combination of factors, including an overly broad trigger threshold and inadequate human oversight.
For his part, Allen expressed deep concerns about his safety and well-being in the wake of this incident. He now avoids going outside after school until he knows his ride has arrived, citing fear for his personal security.
The Omnilert system, which powers the AI-powered alert that triggered the police response, acknowledged that its functions operated as designed โ identifying a potential threat, escalating it for human review, and relying on authorized personnel for final determination. However, they also noted that from that point forward, their system had no further involvement in any subsequent actions or decisions related to this event.
As the incident continues to draw attention and criticism, many are left wondering what measures can be put in place to prevent such mistakes from occurring in the future.
A 16-year-old student was taken into custody by law enforcement in Maryland after an artificial intelligence (AI) gun detection system mistakenly identified a bag of chips as a firearm, prompting a swarm of police cars to surround him.
According to footage from the Baltimore Police Department, responding officers quickly realized that the AI's alert had been triggered by the snack, which was later confirmed not to be a real threat. However, before this correction, they had already handcuffed and detained Taki Allen, who was simply waiting for his ride home after school.
The incident has raised questions about the reliability of AI-powered security systems, particularly in environments where human judgment may be clouded by fatigue or distractions.
When asked to explain the malfunction, a police spokesperson noted that "AI's not the best" at distinguishing between legitimate threats and everyday objects. They attributed the error to a combination of factors, including an overly broad trigger threshold and inadequate human oversight.
For his part, Allen expressed deep concerns about his safety and well-being in the wake of this incident. He now avoids going outside after school until he knows his ride has arrived, citing fear for his personal security.
The Omnilert system, which powers the AI-powered alert that triggered the police response, acknowledged that its functions operated as designed โ identifying a potential threat, escalating it for human review, and relying on authorized personnel for final determination. However, they also noted that from that point forward, their system had no further involvement in any subsequent actions or decisions related to this event.
As the incident continues to draw attention and criticism, many are left wondering what measures can be put in place to prevent such mistakes from occurring in the future.