Can AI Detectors Be Trusted?
AI detectors trained on human prose can flag straightforward syntax and a measured tone as machine-generated. “An AI detector should not be used as the sole mechanism for determining whether someone has violated a policy and then sanctioning them,” said Chris Callison-Burch. He also calls for full disclosure that an AI detection tool will be used. “If you adopt a no-AI policy and a detector flags text, the next step is to have a conversation with the person. Otherwise, you will accuse innocent people of cheating.”