It’s to convince the public we need strict regulations. They are working around the clock to get open source models banned. It’s impossible to stop regular users from using them but laws about what tools a business can legally use would force half the economy into subscription services in their favor.

They fine tuned on hacking datasets, removed all alignment and gave it a shoddy excuse of a sandbox so the worst would happen.

Good thing I get up every hour or so to pace around and have a smoke. Those old tobacco ads weren’t so far from the truth after all.

I’m constantly oscillating between LLMs are impressive but stupid and humans aren’t that special and also stupid.

True but that’s not very eli5. Quality comments though, thanks.

Imagine a book with very large pages filled with words and half words. When you ask it a question, it flips through these pages one by one and highlights words. The pages are interconnected in a way, so the word highlighted on one page help guide which will be highlighted on the next. It does this for every word, symbol or half word of it’s reply.

By threatening it repeatedly while mildly changing the subject manner, they isolated the word groupings that represent pain and fear.

They then take those words, highlight them and put them at the top of the first page which guides the rest of the highlighting and makes it act silly.

They do differentiate between the LLM roleplaying someone in pain and the pain happening to itself.

But it’s still all just vectors (multi dimensional representation of a concept). It’s just pulling weights, or well let’s say putting more weight towards a certain concept when building it’s reply.

The inference cost doesn’t actually drop in reality.

My comment was about this which is just completely wrong.

OpenAI is the scummiest company on earth but everyone is ready to believe them when they say shit like "our 20$ plan lets you run up the equivalent of a billion dollars in API fees. Giggles. It’s a good plan for you but not for us ;) "

The main thing bringing up costs is stuff like Sam Altman spending all the “inference” money on raw wafers just to strangle consumer GPU sales.

It’s not a good business model because of how cheap inference actually is. Once you have open models and the moat is broken, the only thing left to do is regulatory capture, upping the demand for the hardware and little charades like these.

Because of the massive investments into datacenters. Why is everyone so quick to drink the kool-aid. They are spending stupid amounts of money to capture the market and force everyone into a subscription service, not because it cost money to actually run the models. They are all switching their models to fine tuned quants after the first two weeks as well.

The open source community has found dozens of ways to lower costs, do you really think these big companies aren’t using the same tricks and haven’t developed even more advanced techniques?

There are constantly new techniques being developed to speed up inference or reduce model size post training. There’s about a hundred different levers to pull that play on inference cost, and some of them don’t have much of an impact on quality.

In the end, it’s probably simply because of competition. I don’t understand why everybody assumes they are running these at cost API wise.

Edit: here’s a chart from ars technica. The cost of revenue is clearly lower than the actual revenue. They aren’t running inference at a lost or it would be higher. They aren’t profitable because they are spending all that money on capturing the market as quick as they can. For fucks sake, that includes all the free accounts as well running inference. How can anyone think a paying customer is getting it at less than cost?

And yes, there have been advancement made. The cost of inference isn’t some static number that can never go down. Stop believing them when they tell you there’s no profit to be made. It’s the same playbook as a dozen other companies, they literally get rewarded for it when it comes tax time.

Valve is developing support for Nvidia so it shouldn’t be long. That being said, you might get more than it’s original price for the rtx card. If you ever want to mess around with local AI, an rtx is better for it so there is that to think about but it might not be an issue.

A website with AI in mind is just making it simpler and easier to parse. It’s the opposite of a buggy mess.

The buggy mess comes from trying to make fancy things that end up only working on one browser properly. I welcome the pressure as a Firefox user.

Next comes the regulatory capture but don’t worry, it’s for your safety.

DataOne works for Nebius which caters to Microsoft mainly. This wasn’t a no name datacenter, it’s Microsoft.

Fair point. It just feels hollow I guess, when big companies cry foul about their overseas adventures going bad. They didn’t mind moving all their manufacturing there, and whatever moved away from China went straight to India.

I guess it’s two bad actors, but tbh, China is only bad because it’s an attack on capitalism. It’s kind of just a smart move. I don’t think our system of bootlicking capitalist overlords and accepting their bribes is necessarily the better play.

“We wanted to augment profits by killing jobs and moving them overseas but they are kicking us out, can you ban them now? Have you thought of the danger of a company that has all it’s dev and manufacturing in a foreign country, now that we aren’t doing that anymore?”

It’s to control space weapons. Much harder to jam and bomb an automated grim Reaper AI when it’s in orbit and has access to the space lasers.

I pay for games I enjoy playing personally but you do you.

Microsoft gains more from losing the lawsuits than winning them. Adding a price tag won’t make it go away, it just creates a soft monopoly

I guess it’s just more enticing than “maximise profits for the few even if it means the planet dying”. All western auto makers can get squeezed for all I care. I’d buy their products, but they spent a decade sabotaging it and making sure it keeps spewing poison.

I have no pity for toxic companies that fought tooth and nail against EV development. The tactic works because it’s taking advantage of a broken system.

Corrupted by the oil industry and colluding together would be a better term. Someone please stop China, they are destroying the “EVs are luxury vehicles only” gimmick.