I honestly find this obsession with LLM energy usage weird. The paper listed gives typical energy usage per query at around 1Wh for most models at a reasonable output length (1000 tokens). A typical home in the UK directly uses around 7,400 Wh of electricity and 31,000 Wh of gas per day.
I just don’t see why some people are obsessing over something which uses 0.01% of someone’s daily electricity usage as opposed to far more impactful things like decarbonising electricity generation, transport and heating.
I honestly find this obsession with LLM energy usage weird. The paper listed gives typical energy usage per query at around 1Wh for most models at a reasonable output length (1000 tokens). A typical home in the UK directly uses around 7,400 Wh of electricity and 31,000 Wh of gas per day.
I just don’t see why some people are obsessing over something which uses 0.01% of someone’s daily electricity usage as opposed to far more impactful things like decarbonising electricity generation, transport and heating.
If we were charged the real electric cost of the AI queries, maybe we would stop using it so speculatively.
184w for ~10 sec on my build. If I had an EV, charging that would be magnitudes higher than me poking my local ai models for stuff.
Not any worse than playing a VR game in the same span of time.
Also, the air conditioner is the biggest eater of my electric bill, not the computer.