In the late 2000s there was a push by a lot of businesses to not print emails and people use to add a ‘Please consider this environment before printing this email.’
Considering how bad LLMs/‘ai’ are with power consumption and water usage a new useless tag email footer should be made.
i had no car my entire life and have flown 4 times (i like trains lol).
Ok, something nearly everyone does - washing clothes.
A 500W washing machine uses this amount of energy in 10.8 seconds during the spin cycle.
Using a dryer? 4.3 seconds@3000W.
If we look at the equivalent mechanical energy, lets look at your bike (you gotta eat to offset the energy loss, causing emissions through agriculture and cooking!)
You can generate a Chatbot response by pedaling ~2 minutes@100W power!
The chips are already pretty optimized, since they are in principle not different to high-end gaming GPU’s. I have a 3070 TI, and i can generate a complex response locally in under a minute @ 290W TDP, 30-40 seconds if i use something like qwen 2.5, which aligns pretty well with what i’ve said before. Playing a video game uses a lot more power.
2 minutes for every query and im 100% not using it and I think these numbers like 2 min of biking aren’t really based on anything. It will help again if the industry makes it a point to track and publish energy usage.