OpenAI, the company behind the internet-scraping ChatGPT large language model (LLM), has complained that the new Chinese AI assistant DeepSeek has been copying its models. The emergence of DeepSeek, an AI LLM that was apparently developed at a fraction of the cost of other models but boasts comparable performance, has sent shares in AI-focused tech firms like Nvidia tumbling.
A new Bloomberg report says Microsoft, which is a major investor in OpenAI, is investigating whether OpenAI's data has been exfiltrated on a large scale by DeepSeek. An OpenAI license allows developers access to the OpenAI API so it can be plugged into other software. The implication is that DeepSeek has been trained on OpenAI responses during its development.
«There's substantial evidence that what DeepSeek did here is they distilled the knowledge out of OpenAI's models and I don’t think OpenAI is very happy about this,” said the US administration's new 'AI and crypto czar' David Sacks. „I think one of the things you're going to see over the next few months is our leading AI companies taking steps to try and prevent distillation… That would definitely slow down some of these copycat models.“
Distillation is an AI buzzword meaning that an AI model uses the outputs of another AI model to train itself. OpenAI also used this phrasing in a statement, saying „[People's Republic of China] based companies—and others—are constantly trying to distill the models of leading US AI companies. As the leading builder of AI, we engage in countermeasures to protect our IP… and believe as we go forward that it is critically important that we are working closely with the US government to best protect the most capable models from efforts by adversaries and competitors to take US technology.”
Before we get to the delicious schadenfreude, the main reason this matters is because of the apparent low cost of DeepSeek: If it really has just been built on the back of OpenAI's model, then the claims about its
Read more on pcgamer.com