i don’t think people in this forum would disagree with this move in 2018, as much as sentiments have changed. if you remove the political context and market moves from the equation, it is truly fascinating how these models work. GPT 2 was a crazy leap forward for language modeling, and the idea that a language model would be threatening middle class jobs wasn’t even on the table at that point. the idea that a pile of floating point numbers could write a React app is incredible, if politically fraught.

also, it wasn’t clear back then what OpenAI would become. they were a non-profit, and as clear as our hindsight is today this was before ChatGPT or any customer facing products were coming out of OpenAI.

i can’t be the only nerd in the room that has been fascinated by AI since i was a child only to face a reality where it’s not what i imagined it would be.

as much as i hate this garbage site, it was referenced in the article: https://x.com/kdaigle/status/2047803291988590609

come back to

is the real joke here. why would anyone come back? the reason this is such a joke is that GitHub has started to fail not just in Actions or Copilot but literally losing commits, ie the core git technology that has been rock solid since before there even was a GitHub. after migrating away for stuff like this they’d literally have to pay me.

ROS is an embedded systems OS, right?

thanks for clarifying. it was hard for me to dignify such a comment with a response.

you’re also going to run into hardware acceleration issues trying to run Metal acceleration with a Linux kernel. i don’t really see a need to containerize these workloads these days anyway with tools like uv.

it’s a big pain in my ass at times trying to do web dev work with an aarch64-darwin dev env vs the target x86_64-linux. adding in hardware acceleration issues just sounds painful.

i also just personally don’t like containers. feels like bludgeon of a solution.

oh i see. embedded systems makes sense. i wouldn’t even try to go beyond the factory recommendation for systems like that. maybe for fun. likely there are kernel modifications or modules that are required for those systems.

Linux libraries sometimes can’t even install on a newer kernel.

i’m curious where you run into this. i’ve never had this issue in 10 years of using Linux, most of which being on Arch with the latest kernel

in a container

well there’s your issue. i get not liking the OS, but actively crippling your project will cripple your project.

containers on macOS do kinda suck

just a silly turn of phrase meaning: you should know that this is what you signed up for

so, it’s the same.

saying “Linux does dynamic linking and Window does static linking” is both false and a mischaracterization. Windows absolutely does dynamic linking with its Dynamically Linked Libraries (.dll). how dependencies are linked is up to the developer and whatever hardware constraints. one reason i like Rust is that it prefers static linking, and a lot of tool chains are moving in that direction. the reason Linux distros push people toward their internal package management tools (eg apt) is to have tighter control over dynamic linking.

and we’re also glossing over scoop and chocolatey and winget and Docker.

but that’s where you get to stuff like flatpack and snap and Nix that try to contain the dynamic dependencies.

i don’t think downloading exes hoping that Windows has stuffed enough DLLs into the OS and just running them is a better solution.

super fair. i am a Linux guy normally. i’m just being honest. i wish there was a better more open alternative.

if you want to go with the Linux alternative it’s going to cost. get at least 32GB of RAM and at least a 4090 to run the kind of models you’re asking for. it’s the way she goes

it’s Ubuntu dawg. you get what you pay for.

honestly it’s hard to beat Macs these days in this space for two reasons:

• unified memory means that you don’t have to load up on RAM just to load the model and then also shell out for a video card with barely enough VRAM to fit a basic language model
• their supply chain is solid and has mostly avoided the constraints that other OEMs and parts manufacturers are struggling with

pricing is tough. sure, crypto is on its way out, but GPUs are still the platform of choice for most neural net workloads (outside of SoCs like Apple M-series). i built a PC in late 2024, and it’s easily worth twice what i paid for it.

i guess it would be nice, but packages being a few months out of date is pretty normal for Ubuntu, in my experience. i’m not sure what their testing process is like, but part of using something like Ubuntu is stability guarantees. if they felt like the couldn’t do that for newer versions for whatever reason (resource constraints, lack of downstream interest from stakeholders, etc) they’re not necessarily obligated to.

there’s a world of options. this is an LTS distro. use Arch or Nix or whatever if you want the latest packages. i actually switched to NixOS because the CUDA drivers were too new on Arch, and i wanted a better way to pin versions.

or i dunno keep publicly complaining about it until someone does the work for you

guaranteed any company worth more than a handful of salt does not want this. my company would throw a library of books at them for using data in any way that isn’t 100% explicit. for the longest time they blocked me from running Ollama on my laptop cuz the lawyers didn’t understand how neural networks work and thought i was exfiltrating data.

this is only going to hurt companies that probably shouldn’t be using Atlassian products anyway (ie any company with more agility than a boomer era corporate dinosaur)

art isn’t something you can generate as such. having a model that can copy the Mona Lisa pixel perfectly hasn’t stolen the Mona Lisa. it’s the shitty kids’ movies and TV ads and company logos that are at stake.

art is about effort and ingenuity and is centered around people and places and times and can’t be simply replicated by an industrial process, as much as Disney wants that

i mean, still. using any CLI tool for the vast majority of people is a nonstarter

anyone who says installing Arch is easy is hiding an extensive computer background. i struggled to install it the first time for sure. then it ran like a champ for like 8 years. solid distro with few compromises imo.

it’s one of those cases where if you have to ask, you should probably just use systemd. anything else is outdated or a passion project based on some idealism, which i’m all for, but if you’re worried about gaming performance as a primary concern i’d put it out of your mind. for example, i’m an obsessive tinkerer that uses NixOS and Arch before that and i use nushell and Neovim and Hyprland, but i use systemd cuz i don’t see a reason not to. it’s well supported and stable.