Key Takeaways:
- OpenAI accuses Moonshot AI of copying output from its reasoning models in a large campaign.
- The company says thousands of accounts were used to collect model responses, with activity linked to Chinese AI startup Moonshot.
- OpenAI says its engineers stopped the activity before any secure company databases were breached.
OpenAI reported that OpenAI accuses Moonshot AI of launching a large campaign to copy information from its reasoning models. The company said the attackers collected model outputs to help improve competing AI systems.
OpenAI Detects Large Model Copying Campaign
OpenAI said it recently found a coordinated effort to copy information from its technology without permission. This process, known as distillation, involves using the answers or reasoning of a larger AI model to train a smaller one.
OpenAI said a major part of the activity was linked to Moonshot, the company behind the Kimi AI models.
According to OpenAI’s findings, the campaign began around July 1. Investigators said thousands of accounts were involved in collecting model responses over several weeks. The activity was designed to study how advanced AI systems respond to questions and produce answers.
OpenAI said the findings point to the use of its models to help develop future software from Moonshot. OpenAI accuses Moonshot AI of being linked to this activity. Moonshot released its Kimi K3 model on July 16. Moonshot has not publicly responded to the specific accusations in the report.
Investigators Track Unusual User Request Patterns
OpenAI’s technical teams tracked the activity as the number of requests increased during July. On July 24 and July 25, the company recorded 16,000 requests from more than 4,000 active users. Further checks found that more than 15,000 unique users had used similar prompt patterns on the platform.
The operators also tried to move hidden reasoning information from one conversation to another. They attempted to get another model to decode and write out that hidden information. OpenAI said no encryption keys or databases were breached.
The company shared details of its investigation through the Frontier Model Forum and government information-sharing channels. OpenAI also worked with other AI companies, including Anthropic and Google, to address similar attempts to extract model information.
OpenAI Blocks Accounts Behind The Activity
OpenAI took action against the accounts involved in the activity. The company said it banned or restricted thousands of accounts connected to the suspicious behavior. By July 28, its security teams had disrupted the unauthorized data collection effort.
China rejected the accusations after OpenAI accuses Moonshot AI of the alleged activity. Its Ministry of Foreign Affairs called on the United States to avoid making what it described as unfounded or defamatory claims. OpenAI said it has also made changes to gradually hide parts of its reasoning to reduce the risk of similar data collection efforts.
The case shows how AI companies are dealing with attempts to collect large amounts of model output to build competing systems. OpenAI and other companies are expected to strengthen controls as the use and development of AI systems continue to grow.
Visit CyberPro Magazine For The Most Recent Information.
