Researchers found some LLMs create four times the amount of CO2 emissions than other models with comparable accuracy. Their findings allow users to make informe
FWIW, a short query to a typical sized LLM takes about 1Wh of energy, there lots of variance on how big the model you are using and how long the input and outputs are but thats the correct order of magnitude. 1Wh is the amount of energy consumed by a 1kW electric kettle in 3.6 seconds or a 2kW hairdryer in 1.8 seconds.
if you assume that energy was produced in a coal power plant (the worst for co2 emissions) then it makes around 0.3g of co2 emissions, which is the equivalent of burning about one droplet of gasoline.
FWIW, a short query to a typical sized LLM takes about 1Wh of energy, there lots of variance on how big the model you are using and how long the input and outputs are but thats the correct order of magnitude. 1Wh is the amount of energy consumed by a 1kW electric kettle in 3.6 seconds or a 2kW hairdryer in 1.8 seconds.
if you assume that energy was produced in a coal power plant (the worst for co2 emissions) then it makes around 0.3g of co2 emissions, which is the equivalent of burning about one droplet of gasoline.