• 4 Posts
  • 154 Comments
Joined 2 years ago
cake
Cake day: December 31st, 2023

help-circle

  • I’m surprised that you’re talking about models being CUDA-specific or AMD-specific. I’ve had a bunch of models running on my amd-only pc, using ollama, lemonade, and lm-studio, through either rocm or vulkan. None of these models were billed as AMD-specific. I had to do some config tweaking for ollama to use my graphics card but that’s more because I have a weird in-between-generations card that also predates the LLM hype (6700XT).

    However, I did generally need to look for the GGUF format versions of things - usually accounts like unsloth have them uploaded on huggingface barely a day or two after the original version gets posted.


  • There will be no demand for software for a while, as we did not need much in the first place.

    I don’t think software is like some raw resource that can be accumulated and then consumed at a later date. In my own career as a dev, people are constantly coming up with new demands that have to be implemented to meet their needs.

    I do agree that a lot of software made in the past 20 years was primarily made because someone (often not the devs making it) thought it would make them rich(er) in some way instead of actually “benefitting” humanity. My own hope is that however the economics of LLM-based AI work out, we’ll see a decline in this specific sort of software development taking up so much of the pool of available developer effort.

    If companies are spending more on tokens than on developers to churn out software that is decidedly meh (which is all I’ve seen so far of the trend), I would expect the actually induces demand for human developers - either as a complement to “AI” or as competition to it.


  • I agree with most of what you’re saying, but:

    • forgejo is working on federation. They’ve been working on it for a certain amount of time by now, but I do think we can expect some concrete version of what you describe in terms of community to materialize in the next decade as long a people want it and are motivated enough

    • when talking about code that is stored in a version control software that supports decentralized state (git, mercurial are the 2 I have working knowledge of) the “easy” fix for low bus factors is to just fork/mirror the software you want to see continue to exist. Source code is not that voluminous, I would be surprised if [the collective we] can’t manage to store multiple copies of the sources for software we deem useful. It’s a question of changing habits, not finding some miracle tech

    Of course, habits aren’t necessarily easy to change.





  • You have all my sympathies. Someone in another post/thread brought up the idea of a support group for burned out devs/tech workers in general. I definitely think there’s something between that and unionization that is both needed and starting to be possible. Heck, even in the hackernews comments for this article there was at least one person telling another “welcome to luddism!” as both resonated with the spirit of the article itself.


  • That’s wild. Your managers’ reaction to “the project made by AI has created 2-4 years of work by experienced engineers, perhaps up to 6 of them, before it’s ready” was “why don’t you use more AI??”?

    I’m starting to think Mao had a point when he sent the business owners to do farm work. Barring a revolution, I can only hope the effective cost of inference rises du much as to make these dipshits back off from wanting it to do all the labor ever.


  • I don’t know about heavier vehicles like vans or trucks, but in my parent’s Renault Zoé the Regen braking is strong enough to slow the car down from like 50km/h to 30km/h when going downhill. It might be enough to bring the car to a standstill, I’ve never actually tried letting it be - usually there’s a car behind me or I need to get somewhere in time so I can’t afford to experiment.

    Brakes are still important for emergency/manual speed adjustments, of course. Just wanted to share my experience with “how well does regen braking work downhill?”



  • Vic Lagina, who was a lead producer and director for the porn production company Brazzers for 16 years and is the author of Filthy!: The Rise and (Pending) Death of Vic Lagina, welcomes it. “As a former business owner in porn, the prospect of completely eliminating humans from the equation in porn production would be extremely enticing,” he wrote in an email to Playboy, celebrating an end to “self-serving attitudes of performers, … questions about revoked consent despite whatever rigid protocols are in place, … bad hygiene, … and waiting for wood from a shaky male performer” before concluding: “It sounds like a dream.”

    huh.







  • I haven’t tried any Anthropic models personally.

    So far, between the free online chats by OpenAI and DeepSeek, and the smaller models I’ve run on my own machine, the most useful things I have gotten from it were to treat it as an overeager student that lacks the first-hand experience needed to see the big picture, asking it questions that I’m pretty sure I already know the answer to and seeing if 1) it “understands” what I’m getting at and 2) it can surprise me with a viewpoint I hadn’t thought of before.

    Using them to double-check my own ideas seems to be marginally useful, especially when there’s no qualified human being whose attention I can borrow. Using them as a sort of semantic web search can sometimes get me what I’m looking for faster than Google. If anything, they’re an opportunity to exercise critical thinking; if I can tell where it’s getting things wrong I can be fairly confident that my own understanding of the problem/subject is pretty solid.

    Vibe coding, though? I have yet to see it work out. Maybe as some starting slop so that I can get to work refactoring code (and get the ideas flowing) instead of staring at a blank file.


  • Learned helplessness is an insidious foe, and one that market forces have tended to side with over the past 20 years (probably for far longer than that, but as I was a mere child back then I wouldn’t claim it with as much certainty).

    It’s an “easy way” for those like you and me who have more or less already built up the know-how over countless small steps, but if you’ve never known “life” outside of these corporate surveillance playgrounds I imagine it seems very scary and deserted.


  • A small gui to automate generating some pdfs from some CSV files.

    There’s a small non-profit in my area helping people operate localized energy distribution (as producers and consumers). Each month, they receive a zip file containing the raw kiloWatt-hours produced and consumed by each participant over the past month as CSV files. So far the non-profit has been manually importing these CSVs into LibreOffice to generate graphs and tables and export the whole thing as an individualized PDF file for each participant. Now that they’re starting to help more than 2-3 operations, it’s become useful to try to automate that process.

    I’ve been writing it in rust for a few reasons. First of all I wanted cross-compilation to be sure to work and at this point I’m more familiar with rust than go, secondly I read a blog post recently that evaluated rust gui solutions in terms of accessibility and IME-compatibility on windows. I started off looking for a “direct” pdf-writing library but eventually switched to using typst to generate the pdfs from templates I write. typst being written in rust has enabled me to bundle its engine into the program in a pretty-straightforward way.

    I’m currently working on allowing the import of multiple sets of data so that the generated PDFs can show line plots of the electricity production and consumption over several months.