zaakir.io | blog

My thoughts

Tag: local-ai

Abliteration: Uncensoring an LLM (and Why You Might Want To)

Commercial models refuse a lot of legitimate requests. Here's why "uncensoring" an open-weight model is useful and how I achieved it. ⚠️ A note before we start. An uncensored model will answer almost...

LLMs, AI, abliteration, local ai

1 Month into Local LLM - What I've learned.

One Month Into Local LLMs: What I've Learned It's been about a month since I went down the local-LLM rabbit hole. In that time I've: Built llama.cpp from source Written my own benchmarking software to...

AI, LLMs, LLM, local ai