Researchers claim new approach to LLMs could slash AI power consumption

Work was conducted as concerns about power demands of AI have risen

clock • 2 min read
Researchers claim new approach to LLMs could slash AI power consumption

ChatGPT uses 10 times the electricity of a Google search – but cutting out ‘matrix multiplication’ could cut this number without affecting performance

New research suggests that eliminating the ‘matrix multiplication' stage of large-language models (LLMs) used in AI could slash power consumption without affecting performance. The research was ...

To continue reading this article...

Join Computing

  • Unlimited access to real-time news, analysis and opinion from the technology industry
  • Receive important and breaking news in our daily newsletter
  • Be the first to hear about our events and awards programmes
  • Join live member only interviews with IT leaders at the ‘IT Lounge’; your chance to ask your burning tech questions and have them answered
  • Access to the Computing Delta hub providing market intelligence and research
  • Receive our members-only newsletter with exclusive opinion pieces from senior IT Leaders

Join now

 

Already a Computing member?

Login

You may also like
Asian Tech Roundup: To the moon and back

Legislation and Regulation

Plus: AI comes to Asia in a big way

clock 28 June 2024 • 5 min read
YouTube in talks with record companies to license music for AI-powered song generator

Artificial Intelligence

Despite the sums on offer, artists unconvinced

clock 27 June 2024 • 2 min read
UK needs system to record AI misuse and mistakes, says thinktank

Artificial Intelligence

Current system is piecemeal and lacks an effective reporting framework

clock 26 June 2024 • 2 min read

Sign up to our newsletter

The best news, stories, features and photos from the day in one perfectly formed email.

More on Artificial Intelligence

YouTube in talks with record companies to license music for AI-powered song generator

YouTube in talks with record companies to license music for AI-powered song generator

Despite the sums on offer, artists unconvinced

Graeme Burton
clock 27 June 2024 • 2 min read
UK needs system to record AI misuse and mistakes, says thinktank

UK needs system to record AI misuse and mistakes, says thinktank

Current system is piecemeal and lacks an effective reporting framework

Penny Horwood
clock 26 June 2024 • 2 min read
Citi: AI threatens 54% of current banking jobs, but will create new ones

Citi: AI threatens 54% of current banking jobs, but will create new ones

AI could add $170 billion to global banking profits

John Leonard
clock 25 June 2024 • 2 min read