Posts

Why build a WhatsApp RAG? I have a very active group chat with my friends on WhatsApp. At the time of writing, it is a bit over half a million messages. Since LLMs became a thing, I always wondered how I could use this data for something useful—or at the very least, prank my friends. Last year I tried a few different approaches to fine tune a model using the chat data, but it didn’t work all that well. Fine‑tuning a model on commodity hardware is a challenge in itself and the results were underwhelming. So I dropped that idea for a while. While going through the material for the HuggingFace Agents Course though, it became very clear that RAG (Retrieval Augmented Generation) would be a perfect fit for what I was trying to do. ...

RHEL-based LXD VMs (Rocky, Fedora) can hang at boot after kernel updates. This post explains the root cause and shows how to fix the boot entry, and get the VM booting again.

I’ve been working through the Hugging Face agents course, and I’m enjoying it quite a bit. Highly recommended! First, it’s rounding out my knowledge of LLMs, transformers, and AI in general. Second, it paints a very clear picture of what agentic AI is all about—while staying away from the hype. I’ll try to summarize here, but I really recommend checking out the full course. This is not a formal definition, but I think the crucial feature of agents is the ability to use tools to interact with the environment. Instead of relying solely on the knowledge of the model itself, agents can search the web, access web pages, and use Unix commands like find, ls, and grep to help answer your questions. Another key characteristic is that this all happens in a loop, giving the agent the ability to course correct in case things don’t go as planned in order to achieve its goal. ...

This post describes the technique I use to organize my configuration files (i.e., dotfiles). What are dotfiles Dotfiles are hidden configuration files of a Unix system that live usually in your home folder and are prefixed by a dot. Things like your .vimrc, .bashrc, or even folders like .config and so on are examples of these configuration files. Storing files in git Since these are usually text files, using a source version control system makes a lot of sense to store these files. I used to have a github repository that I would store all these files and then symlink them whenever I was setting up a new system. That process became tedious and error prone very quickly, so I decided to create an install script to automate the whole process. ...