OpenAI buys AI security startup Promptfoo to harden enterprise agent platform
What's the deal? OpenAI has agreed to acquire Promptfoo, a two-year-old San Francisco startup that helps companies test and find security vulnerabilities in AI systems. Financial terms were not disclosed.
Promptfoo's technology will be folded into OpenAI Frontier, a recently launched platform for building and managing AI agents, adding automated security testing and red-teaming capabilities.
Promptfoo's open-source tools will continue to be developed alongside their integration into Frontier.
Why now? OpenAI is pushing hard to win over enterprise customers for its AI agent products, which it markets as "AI coworkers." For larger organisations, safety and compliance are non-negotiable — and Promptfoo already has roughly a quarter of Fortune 500 firms as customers, giving OpenAI an immediate foothold in that market.
The deal also comes as the AI security space heats up. In early March 2026, OpenAI introduced a separate security agent aimed at helping teams patch database vulnerabilities, mirroring a similar move by AnthropicDealroom has a profile for this one. Try Dealroom →.
What could go wrong? Integrating a security-focused, open-source-first startup into a large commercial platform is rarely seamless. Promptfoo's value partly rests on its independence and community trust; folding it into OpenAI's commercial stack risks alienating the developer community it has built around its open-source tools.
There is also the broader question of whether bolting security capabilities onto an agent platform is sufficient. Enterprise risk teams may demand independent, third-party auditing rather than tools built and controlled by the same company whose AI they are testing.
The signal: AI security is no longer an afterthought — it is becoming a core product layer. As AI agents gain access to sensitive data and execute consequential tasks with limited human oversight, the ability to test, red-team, and monitor those agents is increasingly valuable.
OpenAI's move to own that capability in-house, rather than rely on third parties, reflects how seriously it is treating enterprise trust as a competitive differentiator.
Sources:
OpenAI
Promptfoo
Bloomberg
Investing.com
Image credit:
Promptfoo
J.V.
