As large language models become ubiquitous across social media and publishing, readers increasingly try to identify whether content was written by artificial intelligence. In this video, linguist Dr. Taylor Jones explores why conventional methods for spotting generated text frequently fail and introduces a more rigorous linguistic test. Creators and readers commonly rely on surface markers, such as an upbeat conversational tone, excessive validation, and specific pet words like "delve" or "gap" explored in the classic tells of AI writing4:08. However, as Jones demonstrates by citing Gerald Graff and Cathy Birkenstein's classic composition text They Say / I Say7:36, many of these supposed markers—such as the antithetical framing "it's not X, it's Y," parenthetical thoughts, and triads of descriptors—are simply time-honored strategies of classical rhetoric taught in standard academic writing.
To understand why AI text falters, one must understand how it operates under the hood. Jones points out that LLMs are autocomplete on steroids8:45, functioning as massive next-token predictors driven by n-grams, term frequency-inverse document frequency (TF-IDF), and deep neural architectures. Because LLMs process numerical tokens rather than real-world semantic concepts, they possess no internal model of physics, spatial relationships, or abstract logic. They do not think; they merely optimize statistical sequences of digits converted back into text to deliver plausible-looking responses.
This fundamental architectural limitation leads directly to what Jones argues is the single most reliable marker of LLM generation: semantic incoherence and mixed metaphors11:40. While human writers intentionally blend idioms or occasionally make grammatical slips, LLMs routinely assemble words that share high statistical co-occurrence but collide conceptually. Examples include describing military action as being nestled amid a year of war11:40, Google Gemini producing overarching pillars that undergird11:50 a topic, or Anthropic Claude proposing to see what toolkits buy you when pointed12:40 at a problem. In each case, individual phrases match standard corpora, but their synthesis is conceptually absurd.
While this semantic test is robust, Jones acknowledges the complication posed by incoherent human writing13:40, where untrained human authors produce similarly muddled prose. Rather than discarding all AI assistance, he reflects on reasonable boundaries—echoing Hank Green's perspective on AI drafting5:35—and outlines practical, valid uses for LLMs15:15. These include generating boilerplate drafts, spotting glaring structural omissions, and practicing language acquisition, provided every output undergoes rigorous human editing and fact-checking. Ultimately, spotting machine prose requires looking past superficial vocabulary lists and focusing on the underlying conceptual coherence of the thoughts expressed.
