• 0 Posts
  • 10 Comments
Joined 1 year ago
cake
Cake day: July 3rd, 2023

help-circle
  • Read through the Readme and it’s definitely a good tool to know about. It doesn’t fit the needs of my current problem, but I’m certain I’ll use it in the future for context sensitive searching, since grep/awk/sed/tr have definitely fallen flat for me in the past. I might also be able to study how they utilized tree-sitter CLI when I explore my own implementation.

    For my purposes, I want to take a group of similar-yet-different YAML file sets (though file type should be arbitrary), and feed them through a tool that will spit out a YAML template containing everything that is shared between multiple sets.

    Then, I want it to create a file for each YAML which defines which parts to pull from the template file and a list of variables to be inserted into holes in the templates. Basically creating a madlib that can recreate any file in the original group given the right list of variables to insert.

    For example, if I have a hundred YAML files that are mostly similar but contain different project names, have different server types provisioned, and are pulling different product versions, I would want this script to parse all hundred files and spit out a template that could be used as the basis to build any of the hundred files. The template would be combined with a hundred variable trees that would insert each unique part of each file into the right place.

    In effect, I could have a small variables file that gives only the unique portions of the equivalent YAML - in this case, it would contain only the project name, the server type, the product version. Then, these small files could be combined with the universal template to recreate the original hundred YAML files. But unlike using a simple override mechanism, I would be able to change elements of the template YAML including broad structural changes, and after some processing, the change would affect all one hundred output YAMLs.

    One could track things like environment variables that are specific to a certain project version and require that whenever a project version has a particular value to insert a particular environment variable into the output YAML. Or a centralized file could be made specifying which product versions correspond to which projects, allowing the engineer to change all product versions for a given set of projects in one go. Or one could create a universal template of IaC code that’s applicable to a broad swath of use cases and quickly build out a full set of YAML manifests and Terraform files using a small file that specifies what components will be needed and where to authenticate to the server.

    I’m not aware of any tool that does this, but I think tree-sitter gets me much of the way there. If I can use it to parse any given file into a context aware tree, I would then need to make a script that combines the shared features of many context trees and splits the unique features out into small variable files. Then a script to merge them back together as needed. And something to manage file system structure, such as whether to parse every file individually or to strategically merge some sets so you have one variable file that produces multiple output YAML.

    Sorry I’m brainstorming at you, just trying to figure out if the tool I’m envisioning is even feasible. Seems like it is, but I’ll have to figure out how to use tree-sitter CLI before I begin.



  • Just built my first fully dedicated Linux machine. Still keeping my old Windows desktop around purely because I play League of Legends and they use a kernel level anticheat, so it won’t run on VM.

    Fun fact, ever since Riot made it mandatory to install their rootkit if you want to play their games, every time I try to eject a flash drive, it says it can’t eject because it’s in use - even if I just plugged it in. And that’s super comforting.


  • This is super cool. Watched the talks from Max Brunsfeld, surprised this has been around since 2018 and I haven’t heard of it.

    I actually tried some complex parsing myself lately. I had a bunch of YAML I needed to maintain for various deployments in a CI/CD system. I really wanted to have one YAML template to generate the files, plus a file for each project with unique elements to be injected into that project’s generated YAML.

    Probably was more of an indication that we needed to clean up the overrides we were putting on top of our Helm charts, but I wanted a way to generate our lengthy override files without having to manually keep track of where the differences were between projects. And maybe even stage changes to deployment files for when new product versions are released.

    This is exciting. I’m going to look into Tree Sitter more and maybe try to contact the dev. It seems like it does everything I’m looking for, just for an entirely different use case.


  • I used to work for a company that did various kinds of biometric recognition. I unfortunately was paraded past these cameras many times for testing purposes, so my face was compromised many moons ago.

    We had two kinds of products we installed in airports. When looking at large crowds most airports wanted cameras that would monitor the flow of traffic, determining if there were any bottlenecks causing people to arrive at their gate (or baggage claim) after their luggage.

    The other product was facial recognition for identification purposes. These are the machines you have to stand right next to. There are various legal reasons airports did not want to use any crowd-level cameras for identification. They hadn’t obtained consent, but also, the low resolution per face would lead to many more false positives. It was also too costly.

    But we did have high def cameras installed in strategic locations at large music halls. These private companies were less concerned with privacy and more concerned with keeping banned individuals out of their property. In those cases, we registered faces of people who were kicked out for various reasons and ignored all other faces.

    My point I guess is twofold: first, you might not be facially tracked in as many places as you think you are. Second, eventually you will be and there’s not a whole lot we can do to stop it. For many years, Target has identified people with their payment card, used facial recognition to detect when they return to the store, and used crowd tracking to see where in the store you go (and sometimes they have even changed ad displays based on the demographics of people standing nearby).

    Mostly, you will be identified and tracked when there is financial incentive to do so.



  • I finally got fed up with my Windows machine and upon seeing symptoms of motherboard failure, I’ve ordered all the parts for a new rig and intend on installing Linux as my primary OS.

    Haven’t decided on a distro yet. I’m a DevOps engineer with a few passion projects, so I plan on setting up a couple of kubernetes clusters where I can play. I do all the usual things (word processing, gaming, web browsing, multimedia, etc), plus some AI stuff (stable diffusion, local LLMs, OpenCV). Ideally don’t want to have to fuss with drivers too much, but I don’t mind getting my hands dirty every now and then.

    Is Chimera the kind of distro I should be looking at, or should I pick something else for my first go at full-time Linux?




  • I work in devops as well and while Windows is easier and more convenient for many things, some processing-heavy tasks are better left to Linux. Doing generative AI stuff, for example, I don’t want to be loading a bulky OS on top of the task at hand.

    I thought about dual booting, but it would make multitasking nearly impossible. So, instead, I’m using Linux whenever possible and I have a Windows VM I can enter at a moment’s notice or hibernate if I need the resources. And then there’s the MacBook, but we don’t talk about the MacBook.