Researchers found some LLMs create four times the amount of CO2 emissions than other models with comparable accuracy. Their findings allow users to make informe
You can run a model locally on your phone and it will answer most prompts without breaking a sweet, it’s actually way less energy than googling and loading the content from a website that’s hosted 24/7 just waiting for you to access the content.
You can run a model locally on your phone and it will answer most prompts without breaking a sweet, it’s actually way less energy than googling and loading the content from a website that’s hosted 24/7 just waiting for you to access the content.
Training a model is expensive, using it isn’t.
Nice claim you have there. Do you have anything to back that up?
If it’s so easy, it shouldn’t be hard for you to link a model like that.
Can you link me to what model you are talking about? I experimented with running some models on my server, but had a rather tough time without a GPU.
I would like to learn about this a bit more, I keep hearing it in conversations here and there. Do you have links around studies/data on this?