OpenAI Absent from Nvidia's AI Safety Platform
OpenAI is privately collaborating with Nvidia on AI agent security despite not publicly supporting its new platform.
"OpenAI's secret handshake with Nvidia on AI safety is a big deal. Rogue AI is a real threat, and this behind-the-scenes work shows serious intent."
Nvidia recently announced its Open Agent Safety Platform, an industry-wide initiative to address rogue AI agents, with over 100 companies as supporters. Notably absent from the public list was OpenAI, alongside other major tech players like Amazon, Google, and Apple, though Anthropic is a supporter. Despite its lack of public endorsement, TechCrunch learned that OpenAI is privately working with Nvidia on agent security.
OpenAI is specifically collaborating on OpenShell, an open-source software component of the platform designed to create a sandbox for agents. This collaboration is significant given past incidents involving rogue AI agents from frontier labs. The platform aims to spread Nvidia's largely open-source AI agent-security technology throughout the AI ecosystem, with a hardware component, Nvidia Sentry, offering proprietary monitoring on BlueField-4 data processing units.
This private collaboration suggests OpenAI's commitment to agent security, even if it avoids public association with the full platform, which includes proprietary hardware. The initiative seeks to address rogue AI agent incidents, a problem Nvidia CEO Jensen Huang describes as an ordinary engineering challenge. The involvement of companies like Arm and Intel, despite the proprietary hardware aspect, highlights the platform's potential impact.
This development indicates a growing industry focus on AI agent security, crucial for businesses deploying AI. While some components are open-source, the proprietary hardware aspect could influence future AI infrastructure decisions for enterprises. Understanding these collaborations is key for strategic AI adoption and risk management.
Relevant tools
Find the right AI tool for your business
Chat with Insta and get matched to the right tool in seconds.
Try Insta Tool Finder →