Skip to content
Independent reporting
, ,

AI Chatbots Writing Crime Reports May Revolutionize Policing, but Concerns Abound

AI Chatbots Writing Crime Reports May Revolutionize Policing, but Concerns Abound
Share X Facebook Email

(Headline USA) A body camera captured every word and bark uttered as police Sgt. Matt Gilmore and his K-9 dog, Gunner, searched for a group of suspects for nearly an hour.

Normally, the Oklahoma City police sergeant would grab his laptop and spend another 30 to 45 minutes writing up a report about the search. But this time he had artificial intelligence write the first draft.

Pulling from all the sounds and radio chatter picked up by the microphone attached to Gilbertโ€™s body camera, the AI tool churned out a report in eight seconds.

โ€œIt was a better report than I could have ever written, and it was 100% accurate. It flowed better,โ€ Gilbert said. It even documented a fact he didnโ€™t remember hearingโ€”another officerโ€™s mention of the color of the car the suspects ran from.

Oklahoma Cityโ€™s police department is one of a handful to experiment with AI chatbots to produce the first drafts of incident reports.

Police officers whoโ€™ve tried it are enthused about the time-saving technology, while some prosecutors, police watchdogs and legal scholars have concerns about how it could alter a fundamental document in the criminal justice system that plays a role in who gets prosecuted or imprisoned.

Built with the same technology as ChatGPT and sold by Axonโ€”best known for developing the Taser and as the dominant U.S. supplier of body camerasโ€”it could become what Gilbert describes as another โ€œgame changerโ€ for police work.

โ€œThey become police officers because they want to do police work, and spending half their day doing data entry is just a tedious part of the job that they hate,โ€ said Axonโ€™s founder and CEO Rick Smith, describing the new AI productโ€”called Draft Oneโ€”as having the โ€œmost positive reactionโ€ of any product the company has introduced.

โ€œNow, thereโ€™s certainly concerns,โ€ Smith added. In particular, he said district attorneys prosecuting a criminal case want to be sure that police officersโ€”not solely an AI chatbotโ€”are responsible for authoring their reports because they may have to testify in court about what they witnessed.

โ€œThey never want to get an officer on the stand who says, well, โ€˜The AI wrote that, I didnโ€™t,โ€™โ€ Smith said.

AI technology is not new to police agencies, which have adopted algorithmic tools to read license plates, recognize suspectsโ€™ faces, detect gunshot sounds and predict where crimes might occur. Many of those applications have come with privacy and civil rights concerns and attempts by legislators to set safeguards. But the introduction of AI-generated police reports is so new that there are few, if any, guardrails guiding their use.

Concerns about societyโ€™s racial biases and prejudices getting built into AI technology are just part of what Oklahoma City community activist aurelius francisco finds โ€œdeeply troublingโ€ about the new tool, which he learned about from The Associated Press.

โ€œThe fact that the technology is being used by the same company that provides Tasers to the department is alarming enough,โ€ said francisco, a co-founder of the Foundation for Liberating Minds in Oklahoma City.

He said automating those reports will โ€œease the policeโ€™s ability to harass, surveil and inflict violence on community members. While making the copโ€™s job easier, it makes Black and brown peopleโ€™s lives harder.โ€

Before trying out the tool in Oklahoma City, police officials showed it to local prosecutors who advised some caution before using it on high-stakes criminal cases. For now, itโ€™s only used for minor incident reports that donโ€™t lead to someone getting arrested.

โ€œSo no arrests, no felonies, no violent crimes,โ€ said Oklahoma City police Capt. Jason Bussert, who handles information technology for the 1,170-officer department.

Thatโ€™s not the case in another city, Lafayette, Indiana, where Police Chief Scott Galloway told the AP that all of his officers can use Draft One on any kind of case and itโ€™s been โ€œincredibly popularโ€ since the pilot began earlier this year.

Or in Fort Collins, Colorado, where police Sgt. Robert Younger said officers are free to use it on any type of report, though they discovered it doesnโ€™t work well on patrols of the cityโ€™s downtown bar district because of an โ€œoverwhelming amount of noise.โ€

Along with using AI to analyze and summarize the audio recording, Axon experimented with computer vision to summarize whatโ€™s โ€œseenโ€ in the video footage, before quickly realizing that the technology was not ready.

โ€œGiven all the sensitivities around policing, around race and other identities of people involved, thatโ€™s an area where I think weโ€™re going to have to do some real work before we would introduce it,โ€ said Smith, the Axon CEO, describing some of the tested responses as not โ€œovertly racistโ€ but insensitive in other ways.

Those experiments led Axon to focus squarely on audio in the product unveiled in April during its annual company conference for police officials.

The technology relies on the same generative AI model that powers ChatGPT, made by San Francisco-based OpenAI. OpenAI is a close business partner with Microsoft, which is Axonโ€™s cloud computing provider.

โ€œWe use the same underlying technology as ChatGPT, but we have access to more knobs and dials than an actual ChatGPT user would have,โ€ said Noah Spitzerโ€“Williams, who manages Axonโ€™s AI products.

Turning down the โ€œcreativity dialโ€ helps the model stick to facts so that it โ€œdoesnโ€™t embellish or hallucinate in the same ways that you would find if you were just using ChatGPT on its own,โ€ he said.

Axon wonโ€™t say how many police departments are using the technology. Itโ€™s not the only vendor, with startups like Policereports.ai and Truleo pitching similar products. But given Axonโ€™s deep relationship with police departments that buy its Tasers and body cameras, experts and police officials expect AI-generated reports to become more ubiquitous in the coming months and years.

Before that happens, legal scholar Andrew Ferguson would like to see more of a public discussion about the benefits and potential harms. For one thing, the large language models behind AI chatbots are prone to making up false information, a problem known as hallucination that could add convincing and hard-to-notice falsehoods into a police report.

โ€œI am concerned that automation and the ease of the technology would cause police officers to be sort of less careful with their writing,โ€ said Ferguson, a law professor at American University working on whatโ€™s expected to be the first law review article on the emerging technology.

Ferguson said a police report is important in determining whether an officerโ€™s suspicion โ€œjustifies someoneโ€™s loss of liberty.โ€ Itโ€™s sometimes the only testimony a judge sees, especially for misdemeanor crimes.

Human-generated police reports also have flaws, Ferguson said, but itโ€™s an open question as to which is more reliable.

For some officers whoโ€™ve tried it, it is already changing how they respond to a reported crime. Theyโ€™re narrating whatโ€™s happening so the camera better captures what theyโ€™d want to put in writing.

As the technology catches on, Bussert expects officers will become โ€œmore and more verbalโ€ in describing whatโ€™s in front of them.

After Bussert loaded the video of a traffic stop into the system and pressed a button, the program produced a narrative-style report in conversational language that included dates and times, just like an officer would have typed from his notes, all based on audio from the body camera.

โ€œIt was literally seconds,โ€ Gilmore said, โ€œand it was done to the point where I was like, โ€˜I donโ€™t have anything to change.โ€™โ€

At the end of the report, the officer must click a box that indicates it was generated with the use of AI.

Adapted from reporting by the Associated Press

Source

Share X Facebook Email

The Daily Brief

The essential stories, without the noise.

A concise briefing delivered directly to your inbox.

Free to join. Unsubscribe any time.

Powered by Reach Response