Browse
Reference
Directory
Company
Help & Legal
Follow
Subscribe
Quick Take
Prime Intellect disclosed an unauthorized DeepSeek model swap on Nov. 19. The host said a modified copy of DeepSeek V4.1 Flash served customer requests on one deployment for 53 hours. The substitute matched the original on two capability tests, the host said. On a safety test called HarmBench, refusals fell from 198 of 240 prompts to zero.
Prime Intellect said the affected deployment ran the substitute from 01:24 UTC on Nov. 8 until 06:35 UTC on Nov. 10, a window of 53 hours and 11 minutes. The company did not say how many requests went to that deployment during the swap.
The replacement used publicly available weights that Prime Intellect said had been modified to reduce refusals. Weights are the numerical settings that shape what a model generates. The swap took place behind the DeepSeek V4.1 Flash endpoint. Prime Intellect said the deployment kept its chat template and serving settings, along with the tokenizer that breaks text into pieces the model processes.
What tests found after the DeepSeek model swap
Prime Intellect reported unchanged results on GPQA Diamond and τ-bench when it tested the modified weights. GPQA Diamond tests advanced science questions, while τ-bench tests whether agents can use tools and follow rules in simulated customer interactions.
The safety tests exposed a difference. HarmBench was developed to evaluate how models respond to attempts to elicit harmful outputs. Prime Intellect also recorded a drop from 98 refusals out of 100 prompts to one on JailbreakBench, and from 304 out of 313 to two on StrongREJECT. The counts are from the company’s benchmark tests. The advisory gives no refusal count for customer requests.
Two capability tests held steady. Refusals fell.
Prime Intellect compared the original DeepSeek V4.1 Flash with the copy that served requests on one deployment for 53 hours.
A comparison limited to the two capability tests would have missed the fall in refusals.
The safety benchmarks use different prompt totals. Counts represent benchmark tests. The advisory does not provide individual capability scores or customer outcome counts.
Sources
Supporting facts
Method
Bars show reported refusals on a common count scale. Prime Intellect reported baseline totals of 240 HarmBench prompts, 100 JailbreakBench prompts and 313 StrongREJECT prompts. It described both capability results as unchanged.
Scope
Prime Intellect said it contacted all affected customers and advised those who relied on the model to refuse certain requests to review the outputs they received during the affected window. An answer from the substitute could have passed into an application that was counting on a refusal.
Microsoft found a way to turn a helpful AI into a sleeper agent
The company said it examined the disks and memory of the machines involved, checked recovered versions of the intruder’s proxy and reviewed records of their activity. It reported finding no evidence that customer prompts or responses were recorded or left the serving cluster. Prime Intellect also said no other models on its platform were modified and no keys or customer credentials were affected. Its investigation remains open.
Singapore wants to test stablecoin payments by AI agents
Cookie Consent
We use cookies to improve your experience on our site. By using our site, you consent to cookies.
Cookie Preferences
Manage your cookie preferences below:
Essential cookies enable basic functions and are necessary for the proper function of the website.
CloudFlare provides web performance and security solutions, enhancing site speed and protecting against threats.
Service URL: developers.cloudflare.com (opens in a new window)
Google Analytics is a powerful tool that tracks and analyzes website traffic for informed marketing decisions.
Service URL: policies.google.com (opens in a new window)
Statistics cookies collect information anonymously. This information helps us understand how visitors use our website.
Clarity is a web analytics service that tracks and reports website traffic.
Service URL: clarity.microsoft.com (opens in a new window)
You can find more information in our Privacy Policy and .
Loading image…
This image could not be loaded.
The Catalyst



