Revolutionary Method Identifies AI-Generated Text
This post is also available in: 
עברית (Hebrew)
Discerning accuracy and detecting misinformation is crucial in today’s online environment, where brief texts (like social media posts or internet comments) have a major role in information dissemination and can have a profound impact on public opinion and discourse.
This new transformative method detects AI-generated text, promising to revolutionize how we authenticate digital content. This work by computer scientists at Columbia Engineering addresses the mounting concerns surrounding large language models, digital integrity, misinformation, and trust.
The development of Raidar (Generative AI Detection via Rewriting) was led by Computer Science Professors Junfeng Yang and Carl Vondrick. Raidar provides an innovative approach for identifying whether text has been written by a human or generated by AI without accessing a model’s internal workings.
According to Techxplore, the researchers leveraged a unique characteristic of LLMs they call its “stubbornness”—they report that large language models tend to alter human-written text more than AI-generated text, possible because LLMs often regard AI-generated text as already optimal and therefore make minimal changes.
Raidar uses a language model to rephrase or alter a given text and then measures how many edits the system makes to the given text. The system receives a text (could be a social media post, product review, blog post, etc.) and then prompts an LLM to rewrite it. The LLM then replies with the rewritten text for Raidar to compare the original with the rewritten text to measure modifications – many edits indicate the text is likely written by a human, while few modifications mean the text is likely machine-generated.
This method is remarkably accurate even on short texts or snippets, a significant advancement from prior techniques that required long texts for good accuracy. This is achieved using advanced LLMs to rewrite the input without the need to access the AI’s architecture, algorithms, or training data – a first in the field of AI-generated text detection.
The paper’s lead author Chengzhi Mao, a former Ph.D. student at Columbia Engineering, says: “Our method’s ability to accurately detect AI-generated content fills a crucial gap in current technology. It’s not just exciting; it’s essential for anyone who values the integrity of digital content and the societal implications of AI’s expanding capabilities.”
Looking to the future, Raidar promises to be a powerful tool in combating the spread of misinformation and ensuring the credibility of digital information. The team is also reportedly working to develop ways to detect machine-generated images, videos, and audio, aiming to develop comprehensive tools for identifying AI-generated content across multiple media types.
