April 16, 2024

November 7 (Portal) – (This story has been refiled to spell AGI in paragraph 5)

Amazon (AMZN.O) is investing thousands and thousands to coach an bold giant language mannequin (LLMs), hoping it may compete with the highest fashions from OpenAI and Alphabet (GOOGL.O), two folks aware of the matter advised Portal.

The mannequin, codenamed “Olympus,” has 2 trillion parameters, the folks mentioned, which might make it one of many largest skilled fashions. OpenAI’s GPT-4 mannequin, among the best fashions out there, is alleged to have a trillion parameters.

The folks spoke on situation of anonymity as a result of particulars of the mission weren’t but public.

Amazon declined to remark. This reported details about the mission title on Tuesday.

The workforce is headed by Rohit Prasad, former head of Alexa, who now experiences on to CEO Andy Jassy. As Amazon’s lead synthetic normal intelligence (AGI) scientist, Prasad introduced in researchers who had labored on Alexa AI and Amazon’s science workforce to work on coaching fashions, unifying AI efforts throughout the corporate with devoted assets.

Amazon has already skilled smaller fashions like Titan. It has additionally labored with AI mannequin startups comparable to Anthropic and AI21 Labs and supplied them to Amazon Net Companies (AWS) customers.

Amazon believes homegrown fashions might make its choices extra engaging on AWS, the place enterprise prospects need entry to the best efficiency fashions, folks aware of the matter mentioned, including that there was no particular timeline for releasing the brand new mannequin.

LLMs are the underlying know-how for AI instruments that be taught from huge knowledge units to generate human-like solutions.

Coaching bigger AI fashions is dearer given the computing energy required. In an earnings name in April, Amazon executives mentioned the corporate would improve investments in LLMs and generative AI whereas limiting order success and transportation in its retail enterprise.

Reporting by Krystal Hu in San Francisco. Edited by Gerry Doyle

Our requirements: The Belief Rules.

Purchase license rights, opens new tab

Krystal covers enterprise capital and startups for Portal. She covers Silicon Valley and past by the lens of cash and characters, with a give attention to growth-stage startups, know-how investing and AI. She beforehand coated mergers and acquisitions for Portal and printed tales on Trump’s SPAC and Elon Musk’s Twitter funding. She beforehand coated Amazon for Yahoo Finance, and her investigation into the corporate’s retail practices was cited by lawmakers in Congress. Krystal started her journalism profession writing about know-how and politics in China. She has a grasp’s diploma from New York College and enjoys a scoop of matcha ice cream as a lot as a scoop at work.