Monday, November 4, 2024
HomeTechnologyScientists Unveil Energy Breakthrough for AI with 95% Savings!

Scientists Unveil Energy Breakthrough for AI with 95% Savings!

Scientists Unveil Energy Breakthrough for AI with 95% Savings!

By changing the way large language models are calculated, researchers have been able to reduce the energy consumption of artificial intelligence by 95%. And this, without loss of performance.

Artificial intelligence is very energetic. Very much indeed. Some predict an energy crisis due to mass adoption of AI within a year or two. However, BitEnergy AI researchers have found a solution. According to his article published on Arxiothe energy cost of running large language models can be reduced by 95%.

This solution is called the linear complexity multiplier (L-Mul). This makes it possible to significantly improve the mathematical operations necessary for the operation of AI. It replaces floating-point multiplications with approximations obtained by more simple integer addition.

A solution without performance loss

According to the researchers, without additional training, this approximation leads to a loss of accuracy of only 0.07% for natural language reasoning tasks and 0.12% for visual tasks. A performance difference that completely disappears with a few adjustments. However, if the technique can now be used to reduce the consumption of large language models, it must be integrated at the hardware level for optimal operation. Once completed, researchers report a 95 percent reduction in energy costs and even an 80 percent reduction for floating-point tensor products. Energy consumptionEnergy consumption For scalar products.

BitEnergy AI says it is working on a hardware solution and will develop a programming API for high-level model design. They hope to reduce the energy costs of data centers, RobotRobot And many other devices.

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments