{"id":3539,"date":"2025-04-23T00:51:01","date_gmt":"2025-04-23T00:51:01","guid":{"rendered":"https:\/\/jrdingwall.ca\/blogwall\/?p=3539"},"modified":"2025-04-23T04:11:56","modified_gmt":"2025-04-23T04:11:56","slug":"ever-wonder-how-much-energy-your-chats-with-llms-use","status":"publish","type":"post","link":"https:\/\/jrdingwall.ca\/blogwall\/ever-wonder-how-much-energy-your-chats-with-llms-use\/","title":{"rendered":"Ever wonder how much energy your chats with LLMs use?"},"content":{"rendered":"<p>I came across <a href=\"https:\/\/huggingface.co\/spaces\/jdelavande\/chat-ui-energy\">this tool<\/a> via Sasha Luccioni on LinkedIn. I started following Dr. Luccioni&#8217;s work after listening to <a href=\"https:\/\/peertube.dair-institute.org\/w\/qpKuiNLTuHHMnvWGjnA2D8\">Mystery AI Hype Theater 3000, Episode 19 &#8211; The Murky Climate and Environmental Impact of Large Language Models<\/a>. That quote about &#8220;how much water getting ChatGPT to write your email&#8221; you&#8217;ve probably seen all over social media comes from one of their papers. It&#8217;s an interesting discussion and is worth a listen.<\/p>\n<p>Anyway, this tool is really interesting. As the response to your prompt appears it tallies total energy use, an estimate compared to different appliances you might be more familiar with (e.g. charging a phone &#8211; click on it to see another comparison), and the duration the response ran for. Note that this tool is currently running for Mistral and Qwen large language models, and that every model will use different amounts of energy. To really know how much energy your ChatGPT, Gemini, or Claude conversations use, we would need transparency from the companies managing those models. HuggingFace is really leading the way here.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-3541\" src=\"https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/hugging-face-tool.jpg\" alt=\"A screenshot of a Hugging Face web interface showing an AI-generated cover letter for an eLearning Developer application, with a highlighted section at the bottom displaying energy usage metrics\u2014Total Energy: 0.6523 Wh, approx. 3.43% of a phone charge, and Total Duration: 32.762 seconds.\" width=\"2230\" height=\"1274\" srcset=\"https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/hugging-face-tool.jpg 2230w, https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/hugging-face-tool-300x171.jpg 300w, https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/hugging-face-tool-1024x585.jpg 1024w, https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/hugging-face-tool-768x439.jpg 768w, https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/hugging-face-tool-1536x878.jpg 1536w, https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/hugging-face-tool-2048x1170.jpg 2048w\" sizes=\"auto, (max-width: 2230px) 100vw, 2230px\" \/><\/p>\n<hr \/>\n<p>Photo by <a href=\"https:\/\/unsplash.com\/@pino_rumbero?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash\">Michael Pointner<\/a> on <a href=\"https:\/\/unsplash.com\/photos\/a-bunch-of-wires-that-are-connected-to-a-building-fP5LU1iD5p4?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash\">Unsplash<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I came across this tool via Sasha Luccioni on LinkedIn. I started following Dr. Luccioni&#8217;s work after listening to Mystery AI Hype Theater 3000, Episode 19 &#8211; The Murky Climate and Environmental Impact of Large Language Models. That quote about &#8220;how much water getting ChatGPT to write your email&#8221; you&#8217;ve probably seen all over social [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3540,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"webmentions_disabled":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[16,52],"tags":[],"class_list":["post-3539","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-educational-technology-and-design","category-quick-reflections-and-webmentions"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/jrdingwall.ca\/blogwall\/files\/2025\/04\/michael-pointner-fP5LU1iD5p4-unsplash.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/posts\/3539","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/comments?post=3539"}],"version-history":[{"count":4,"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/posts\/3539\/revisions"}],"predecessor-version":[{"id":3545,"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/posts\/3539\/revisions\/3545"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/media\/3540"}],"wp:attachment":[{"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/media?parent=3539"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/categories?post=3539"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jrdingwall.ca\/blogwall\/wp-json\/wp\/v2\/tags?post=3539"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}