Monday, December 11, 2023
HomeTelecomAnthropic to make use of Google chips for its giant language mannequin

Anthropic to make use of Google chips for its giant language mannequin

Google just lately invested $2 billion in Anthropic

San Francisco-based generative AI startup Anthropic has revealed that it will likely be one of many first firms to deploy new AI chips from Google. The announcement comes just some weeks after Google confirmed a $2 billion funding within the startup.

Anthropic, thought-about a severe rival to ChatGPT creator OpenAI, will use Google Cloud’s latest TPU v5e chips in its Claude giant language mannequin (LLM). Claude 2, in keeping with Anthropic, is a chatbot with the power to summarize as much as about 75,000 phrases — in comparison with Chat GPT’s 3,000 phrases.

Google acknowledged in a press launch that its Cloud TPU v5e is designed to ship the “cost-efficiency and efficiency required for medium- and large-scale coaching and inference,” and delivers 2.3x greater coaching efficiency per greenback relative to the prior technology. On latency, Cloud TPU v5e reportedly achieves as much as 1.7x speedup in comparison with TPU v4, as proven within the graph beneath.

Google Inside Information. August 2023. Precision: Llama 2 7B, 13B and 70B: int8; GPT-3 175B: bf16.

The brand new chips, continued the corporate, will allow Anthropic to scale its LLMs past the bodily boundaries of a single TPU pod — “as much as tens of hundreds of interconnected chips.” The AI firm can be now utilizing Google Cloud’s safety companies as a part of the collaboration.

“Anthropic and Google Cloud share the identical values in relation to growing AI–it must be carried out in each a daring and accountable manner,” stated Thomas Kurian, CEO of Google Cloud. “This expanded partnership with Anthropic, constructed on years of working collectively, will carry AI to extra folks safely and securely, and gives one other instance of how essentially the most modern and quickest rising AI startups are constructing on Google Cloud.”

Along with the Google Cloud funding, Anthropic additionally secured a $4 billion from Amazon in September the pair introduced strategic partnership, a partnership that can see Anthropic use AWS Trainium and Inferentia chips to construct, prepare and deploy its future basis fashions, whereas AWS will change into Anthropic’s main cloud supplier for mission essential workloads, together with security analysis and future basis mannequin improvement. 

Extra particulars about Google’s funding in Anthropic stay scarce; nevertheless, it has been reported that Google’s funding contains $500 million upfront, and that in April the tech big invested a whole lot of tens of millions into the Anthropic for what was then a ten% stake.

For extra about Google’s cloud and AI efforts, obtain the Google Cloud Subsequent ’23 in Evaluate report.



Please enter your comment!
Please enter your name here

Most Popular

Recent Comments