Northflank Breach: Assume Every Secret Is Stolen, Rotate Now
Northflank tells customers to assume all environment variables were decrypted after a breach Wiz flagged on Oct. 30; users report their stored AI API keys being abused.
Cloud hosting platform Northflank is telling every customer to assume the secrets in their environment variables were decrypted and stolen, after a breach that customers say was followed by strangers running up charges on their AI API keys. According to BleepingComputer, Northflank learned of the intrusion from a Wiz threat alert on Oct. 30 and pushed several network policy patches the same day. How the attackers got in hasn’t been disclosed.
For defenders
Timeline (UTC, Oct. 30): Wiz alert at 11:43, Northflank engineers on it a minute later, a network policy patch, then more patches at 12:50 and 13:05, with Wiz’s incident response team brought in. Northflank’s own updates are on its status page.
What’s at risk: everything users put in environment variables, workload secrets, secret groups and global secrets: database passwords, cloud credentials, auth tokens and API keys. Northflank’s advice, quoted by BleepingComputer, is blunt: “Assume all environment variables have been decrypted.” Users have since reported unauthorized use of AI API keys stored on the platform; the providers weren’t named.
Not disclosed: initial access, customer count, whether other credentials were abused, and attribution.
Bigger picture: Wiz’s report “Black October for AI Developer Platforms” counts at least nine incidents at AI development platforms in October, including Northflank, Railway, OpenCode, Warp and Lightning AI. Wiz hasn’t confirmed one group is behind them all. Stolen AI keys feed LLMjacking, where attackers resell or run model access on someone else’s bill; Wiz says two unrelated enterprise cases it handled ran up about $100,000 in Amazon Bedrock charges.
Northflank’s fixes: credential rotation enabled for PostgreSQL, MongoDB, MySQL and Redis add-ons, and audit logs switched on for all customers, free tier included.
What it means for you
If you or your developers host anything on Northflank, act as if every password and key you stored there is in someone else’s hands, because the company says to. The quickest damage is financial: a stolen AI key lets someone run chatbot and image jobs on your account until you notice the bill. Rotating keys takes an afternoon; a surprise invoice can take months to argue about.
Do this now
- Rotate every secret you stored in Northflank: workload variables, secret groups, global secrets and add-on database credentials. Revoke the old keys at the provider, don’t just add new ones.
- Check OpenAI, Anthropic, AWS Bedrock and other AI provider usage and billing for spikes since early October, set spend limits, and report abuse to the provider and Northflank.
- Turn off public access on any Northflank add-on that doesn’t need it, and review the new audit logs for actions you didn’t make.