China Is Building AI That Arrests You Before You Protest

Technology10 articles covering this story· 2026-06-01

China Is Building AI That Arrests You Before You Protest

Artificial intelligenceChinaSurveillanceInternetVanderbilt UniversityThe New York Times
China Is Building AI That Arrests You Before You Protest
"Under Surveillance" by Victoria Reay is licensed under CC BY 2.0. To view a copy of this license, visit https://creativecommons.org/licenses/by/2.0/.

There is a category of technology that authoritarian states have always wanted but could never quite build: a system that identifies the dissident before the dissent. Leaked internal documents from Geedge Networks, a Chinese company that sells surveillance and internet censorship software, reveal that the firm has been working on exactly that — an AI-powered system designed to predict which ordinary citizens might, someday, criticize the government.

Researchers at Vanderbilt University's Institute for National Security analyzed more than 100,000 internal company documents that were inadvertently exposed in a data leak. What they found inside those documents is not a finished product. The system appears to be in active research and development. But the architecture being pursued is explicit and deliberate: ingest location data, telecommunications records, and granular internet activity — what a person reads, what films they watch, what books they browse — feed it into an AI model, and generate a political risk score for each citizen.

Geedge's government-supported research arm, Mesa Lab, is identified in the documents as the body doing the technical development work. The goal, as the leaked materials describe it, is to move beyond reactive surveillance — catching someone after they speak — and into preemptive targeting: flagging individuals before they have publicly done anything at all. The machinery of state control, in this model, doesn't wait for a protest. It moves first.

The philosophical leap here deserves to be said plainly. Every surveillance state since the Cold War has justified monitoring on the basis of known behavior: a person joins a group, attends a rally, publishes a pamphlet, and so gets watched. What Geedge is reportedly developing eliminates that requirement entirely. The AI infers future political behavior from present cultural consumption and physical movement. Reading the wrong novel, watching the wrong documentary, or lingering too long in the wrong neighborhood could, in theory, elevate your score. The system, as conceived, punishes thought patterns, not actions.

Geedge is not an obscure startup. The company already sells a commercial version of China's Great Firewall — the surveillance and censorship infrastructure the Chinese government uses to control online activity at the national level. Cross-border investigations by security researchers have documented Geedge's active contracts with the governments of Myanmar, Ethiopia, Kazakhstan, and Pakistan, as well as at least one additional unnamed country. In Myanmar, the military junta has used Geedge-supplied systems to censor the internet and track dissidents — a process that has been directly linked by human rights investigators to arrests and, in documented cases, torture. Geedge, in other words, is not building tools for China alone. It is a global exporter of the architecture of repression.

U.S. export controls on advanced semiconductors — intended to slow China's AI capabilities — may be creating a ceiling on how far this technology can progress in the near term. The leaked documents don't establish that a working predictive system exists today, only that one is being actively pursued. That distinction matters for evaluating immediate risk, but it matters considerably less for evaluating intent. The engineering ambition is documented. The political will behind it is documented. The only open question is capability — and capabilities have a way of catching up to ambitions.

What makes the Geedge case particularly significant is that it is not emerging from the classified depths of the Chinese security state. It is a commercial firm with a research arm and a client list. That tells you something important about the market. There is demand for this. Governments are willing to pay for AI that predicts enemies before those enemies exist, and Chinese technology companies are willing to build it, iterate on it, and export it to whoever is buying. The product roadmap of a single corporate entity becomes a mirror of what the next generation of authoritarianism wants from technology.

The western policy response has so far focused on chip export controls — a supply-side friction that slows the compute available for training large AI models. That is not nothing. But it addresses the hardware layer, not the institutional layer. Geedge's contracts with Myanmar and Ethiopia were not prevented by semiconductor restrictions. The export of censorship infrastructure, surveillance architecture, and now predictive political profiling tools continues through commercial channels that remain largely ungoverned by any international framework. No multilateral treaty governs the export of AI systems designed to suppress political speech. No international court has jurisdiction. The leaked documents are a data point; the absence of a legal structure to respond to them is the larger story.

The Vanderbilt researchers' analysis of those 100,000 documents is not the Chinese government announcing a program. It is internal corporate material describing what a Chinese firm is trying to build and sell. That distinction is worth holding: this is not a confirmed state capability. It is a confirmed commercial ambition with state backing. In the history of surveillance technology, commercial ambition backed by state resources has an almost perfect track record of becoming operational reality — eventually. The question for everyone outside China's borders, and for the citizens inside it, is whether eventually arrives before the legal and political world builds anything capable of stopping it.

Who is covering this (9+ outlets)

See what people are saying about this story on X.