The developer of the chatbot Claude, Anthropic, has officially warned potential investors about the potential existential risks to humanity posed by artificial intelligence technologies. The relevant warnings are contained in the long-awaited prospectus that the startup sent to partners ahead of its listing on the Nasdaq stock exchange this fall.
The developer of the chatbot Claude, Anthropic, has officially warned potential investors about the potential existential risks to humanity posed by artificial intelligence technologies. The relevant warnings are contained in the long-awaited prospectus that the startup sent to partners ahead of its listing on the Nasdaq stock exchange this fall.
This is reported by the Financial Times, citing sources familiar with the materials for investors.
Nearly a third of the large document is devoted to describing risk factors. Anthropic notes that increasingly sophisticated AI models can exhibit unpredictable behavior, resort to manipulation or blackmail.
In addition to global threats to humanity, the company also outlined operational risks. In particular, it is about the high concentration of the customer base: almost a quarter of last year’s revenue was provided by just two customers.
Despite this, investors expect Anthropic to go public at a valuation of more than $2 trillion. That’s more than double its May valuation and dwarfs SpaceX’s June valuation of $1.78 trillion.
To support this pace of development, Anthropic plans to invest $518 billion in cloud computing and infrastructure over the next few years. Google and SpaceX are the main partners in providing capacity.
According to the provided reporting, last year the company’s revenue grew 12 times and reached almost $4.6 billion. However, the operating loss exceeded $8 billion due to the increase in model training costs, which reached almost $13 billion. The situation has improved this year: in the second quarter, revenue reached $11.5 billion, and the company is heading for its second consecutive quarter of operating profit on an adjusted basis.
At the same time, the startup’s leadership is calling for increased oversight of AI development. Speaking at the UN Security Council, Anthropic CEO Dario Amodei said that artificial intelligence is “the most important global security challenge facing the world today.” His calls to slow down the pace of development and strengthen security measures were also supported by OpenAI’s Sam Altman and Elon Musk.
Recall that the artificial intelligence industry has been in a fever of high-profile statements and incidents recently. Former OpenAI and Anthropic employee Jacob Coxon publicly left the industry, stating that developers are racing to create systems capable of self-improvement and are "playing with our lives."
World leaders and heads of tech corporations are joining the apocalyptic predictions. dev.ua investigated whether these fears are justified or whether this is just a panic and a Cold War-style geopolitical game beneficial to monopolists, together with AI experts Bohdan Didenko and Mykhailo Patsan.
