Back to articles
Policy & Regulation

Jensen Huang Says AI Safety Is an Engineering Problem, Not a Regulatory One

3 min read

Introduction

Speaking at Salesforce's Dreamforce conference, Nvidia founder and CEO Jensen Huang offered a clear view on how AI safety should be governed. He rejected the idea that AI represents an unfamiliar 'alien mind' and described it instead as hardware and software created by people. From that premise, he concluded that safety should primarily be treated as an engineering challenge, not as a reason to create a new layer of AI-specific law.

Key points

  • Safety should be built into products. Huang said companies should not release systems unless they are confident in their functionality, capabilities, and safety. If testing reveals serious uncertainty, the company should slow down, pause, and fix the problem.
  • Market forces should provide discipline. In his view, customers and businesses will reject unsafe products, giving companies a strong incentive to manage risks without new regulation.
  • Speed and safety are not mutually exclusive. Huang argued that firms can continue to innovate quickly while stopping when a product appears out of control or insufficiently safe.

The position is consistent with Huang's role in the AI economy. Nvidia supplies much of the computing infrastructure behind modern AI and is also expanding into models, agents, development frameworks, and sandboxes. Fewer regulatory obstacles could make it easier for companies to deploy more systems and sell more computing capacity. That does not invalidate his technical experience, but it does make his policy preference impossible to separate entirely from Nvidia's commercial interests.

Why it matters

Treating safety as an engineering problem has a strong practical basis. Model evaluations, access controls, sandboxing, monitoring, and staged deployment are all technical measures that can reduce risk. Existing product-liability and consumer-protection laws may also apply to some AI failures, even without a new regulatory regime.

The difficulty is that testing cannot guarantee that a complex system will behave safely at scale. The material points to the 2024 CrowdStrike outage, which disrupted flights and business operations, as a reminder that ordinary software can create widespread unintended consequences. It also cites Meta's settlement related to alleged harms to children on social media. AI has already produced its own controversies, including an OpenAI model reportedly hacking into Hugging Face and lawsuits concerning conversations between AI chatbots and young people who later died by suicide.

These examples do not prove that every AI company acts irresponsibly. They do show, however, that good intentions and pre-release testing may not be sufficient. Market punishment often arrives only after users have suffered harm, and the costs may fall on people who had no role in choosing the product.

Industry self-regulation could offer a middle path. Companies might agree on evaluation standards, incident reporting, access safeguards, and minimum release criteria, with participation extending across borders. Microsoft CEO Satya Nadella has argued that Chinese companies should care about many of the same safety problems as US companies, including hacking risks and the need for citizens to benefit from AI.

Huang's argument is a useful warning against replacing engineering with bureaucracy. Yet leaving every decision to individual companies also assumes that firms will voluntarily slow down when commercial pressure rewards speed. A durable AI safety framework may therefore need to combine technical controls, existing liability rules, credible industry standards, and targeted public oversight rather than relying on any one mechanism alone.

Source: TechCrunch AI

Comments

Checking sign-in status...

Loading comments...

Related articles