A 13-year-old Florida teenager logged into OpenAI’s ChatGPT chatbot on a school computer and asked «how to kill my friend in the middle of class.» He said it was just a joke when he was arrested by police.
A 13-year-old Florida teenager logged into OpenAI’s ChatGPT chatbot on a school computer and asked «how to kill my friend in the middle of class.» He said it was just a joke when he was arrested by police.
The teenager’s actions were reported by the school’s artificial intelligence-based monitoring system called Gaggle, Futurism reports.
According to the student, he was «just trolling» his friend, but the police and school administration didn’t like the joke, especially given the frequent incidents of mass shootings in American schools. Therefore, local police from the Volusia County Sheriff’s Office arrested the teenager and placed him in the county jail.
A video circulating on social media shows him being handcuffed and exiting a police car. Officers have warned parents that their children should be very careful about what they ask ChatGPT for.
Police were able to respond quickly because the school devices are equipped with Gaggle, an app that can detect if a student is displaying distressing behavior toward themselves or others and block inappropriate content. Gaggle has been criticized for its high rate of false alarms and for creating a total surveillance atmosphere in schools.
Previously, OpenAI, together with Harvard economist David Deming, conducted a large-scale study and analyzed 1.5 million dialogues of ChatGPT users. The results showed that the chatbot is increasingly used for work, and mainly for advice, information search, and text editing.
