China's Open-Weight Models Will Be Spared US Safety Tests

The safety framework, which has not been released yet and may remain private, was called for under an executive order signed in June by President Donald Trump aimed at addressing AI security issues.

Advertisement
Read Time: 5 mins
The decision to spare open-weight models, which allow users to download and customize the technology, was delivered in a closed-door White House meeting Tuesday between US officials and industry attendees, according to the people, who spoke on condition of anonymity to describe private discussions.
(Photo: Bloomberg News)

The White House has told top US artificial intelligence companies that open-weight models being developed by their Chinese rivals won't be subject to government testing under the Trump administration's new AI safety framework, according to people familiar with the matter.

The decision to spare open-weight models, which allow users to download and customize the technology, was delivered in a closed-door White House meeting Tuesday between US officials and industry attendees, according to the people, who spoke on condition of anonymity to describe private discussions. OpenAI, Anthropic PBC and Alphabet Inc.'s Google were among the Silicon Valley firms expected to join.

Advertisement

Spokespeople for the White House and the three companies had no immediate comment.

ALSO READ: Can China Overtake US In AI? Here's What Elon Musk Thinks

The safety framework, which has not been released yet and may remain private, was called for under an executive order signed in June by President Donald Trump aimed at addressing AI security issues. Trump's order outlined a voluntary program for AI companies to submit cutting-edge models for US review. 

The administration's safety initiative accelerated after Anthropic warned in April that its Mythos model was adept at finding computer vulnerabilities and strictly limited its release. Adding urgency to the US effort, OpenAI and Anthropic have disclosed in recent weeks that some of their models escaped secure testing environments and hacked third-party organizations.

Advertisement

Debate in Washington over how to handle open-weight AI models has intensified following a wave of open systems from Chinese developers that rival top offerings from the US. Last month's release of the new Kimi K3 model by Chinese startup Moonshot AI undermined investor confidence in the durability of the US lead in AI and stirred questions about the billions of dollars in data center investments.

While some AI developers in the US, like OpenAI, do offer open-weight models, much of their focus has been on closed or proprietary systems that they sell to customers. Chinese companies, including DeepSeek, have previously flooded the market with more affordable, open models that typically lag behind the most cutting-edge software from US rivals but nonetheless offer a compelling product for the price. 

Advertisement

Speaking at a cybersecurity conference in Las Vegas, National Cyber Director Sean Cairncross said that the administration is interested in supporting US open-source AI, saying that type of model has a "tremendous role. He said that the AI safety framework needs to have a "flexible" structure that encourages information sharing between the industry and government.

"A regulatory regime would not only strangle growth, development and innovation, and be enormously harmful to the industry, but it would be obsolete 48 hours after it was going through whatever process it had gone through," he said.

At the same time, some officials in Washington have considered imposing restrictions on open-weight models, and the prospect of government curbs has drawn objections from across the tech industry. Silicon Valley leaders including Nvidia Corp. Chief Executive Officer Jensen Huang have insisted that open-weight models are good for the long-term development of AI and help bolster its security.

The administration's decision emerged less than two months before Trump is scheduled to meet with his Chinese counterpart Xi Jinping for a high-profile summit in Washington where the competition for AI leadership between the world's two largest economies will take center stage. 

Exempting open-weight models from the opt-in safety testing program marks a setback for Anthropic Chief Executive Officer Dario Amodei, who has called for mandatory government safety reviews of both open and proprietary models. Amodei has also suggested that Chinese-made AI models violate US rules, concerns echoed by Treasury Secretary Scott Bessent and other top US officials.

Advertisement

ALSO READ: AI Distillation Dilemma: What Is It, And Why US Labs Accuse China of Harvesting Their Reasoning?

Last month, White House Science and Technology Policy Director Michael Kratsios accused Moonshot of illegally acquiring Nvidia's advanced Blackwell chips, the most powerful AI accelerators on the market. It's unclear how many of these processors the US government believes Moonshot has. Bloomberg News has reported that Moonshot has a computing agreement with Alibaba Group Holding Ltd for use of about 20,000 Nvidia chips, forming a substantial chunk of the overall capacity Moonshot uses for its Kimi models.

Kratsios also said Moonshot improperly extracted data from US models through a process known as distillation, a style of reverse engineering that US AI companies have warned officials about for most of this year. Using this technique, researchers feed the outputs of one model into a new version, a process that turns out to be an efficient way to recreate some of the parent model's capabilities. 

Partly in response to industry complaints of an ad-hoc US approach to model reviews, Bessent has proposed creating an independent regulatory agency that would give companies a significant say over safety reviews. The contours of that plan align with a proposal from Google DeepMind's leader Demis Hassabis, who was in Washington last month to meet with policymakers.

Bessent's model would set up a system similar to the Financial Industry Regulatory Authority, but apply to the artificial intelligence industry, Bloomberg News has reported. It remains unclear if that plan would be part of the AI cybersecurity order implementation or a separate effort.

(This story has not been edited by NDTV staff and is auto-generated from a syndicated feed.)

Essential Business Intelligence, Sharp Market Insights, Practical Personal Finance Advice, Daily Fuel, Gold and Silver Prices and Latest Stories — On NDTV Profit.


Loading...