AI Detection Software in Schools Raises Concerns Over Accuracy and Student Impact

Student Accusations and District Response

Ailsa Ostovitz, a 17-year-old student, faced accusations of using AI on three assignments across two classes. An AI detection program indicated a 30.76% probability of AI use on one of her writing assignments. Ostovitz denied using AI, and her grade was subsequently adjusted. Her mother, Stephanie Rizk, met with the teacher, who later stated a change in belief regarding Ostovitz's AI use.

Prince George's County Public Schools confirmed that Ostovitz's teacher utilized the AI detection tool independently. The district does not fund or endorse such software, advising educators against relying on these tools due to documented inaccuracies and inconsistencies.

Prevalence and Reliability of AI Detection Tools

A survey by the Center for Democracy and Technology reported that over 40% of 6th- to 12th-grade teachers employed AI detection tools during the last academic year. Research, including studies by Mike Perkins on academic integrity and AI, indicates that commonly used AI detectors such as Turnitin, GPTZero, and Copyleaks have demonstrated inaccuracies. These tools have been observed to incorrectly flag human-generated text as AI-generated and vice versa. Accuracy rates reportedly decrease when AI-generated text undergoes manipulation to appear more human.

District Implementation and Vendor Statements

Broward County Public Schools in Florida secured a three-year contract totaling over $550,000 with Turnitin. The company introduced an AI detection feature in 2023. The district states that the Turnitin tool is intended to facilitate conversation and provide feedback, not for grading. It also acknowledges the tool's known inaccuracies. Turnitin's own guidance advises that scores of 20% or lower are less reliable and that its AI writing detection should not be the sole basis for adverse actions against students.

While Broward County Public Schools utilizes Turnitin to assist in meeting authentication requirements for programs like International Baccalaureate, these programs do not mandate the use of AI detection software.

Teacher Perspectives on Tool Utilization

John Grady, a language and literature teacher in the Shaker Heights City School District, uses GPTZero as a starting point for discussions with students concerning potential AI use. The district allocates approximately $5,600 annually for 27 teacher licenses for GPTZero. Grady investigates further, including examining student revision histories, if the tool indicates a likelihood greater than 50% that AI was involved in an assignment. He reports that approximately 75% of students admit to AI use when confronted in these situations.

Edward Tian, co-founder and CEO of GPTZero, characterizes his company's tool as a