Abstract
How can we measure and understand the energy use of Large Language Models during the inference process?
Measuring and understanding energy use in Large Language Model inference
Category
Lecture
Language
English
Author(s)
Affiliation
- SINTEF Digital / Sustainable Communication Technologies
Presented at
Sensor Fagdrypp
Place
Digital
Date
21.03.2024 - 21.03.2024
Organizer
SINTEF Digital
Date
21.03.2024
Year
2024View this publication at Norwegian Research Information Repository